title: Scalable and RISC-V Programmable Near-Memory Computing Architectures for Edge Nodes

abstract: The widespread adoption of data-centric algorithms, particularly Artificial Intelligence (AI) and Machine Learning (ML), has exposed the limitations of centralized processing infrastructures, driving a shift towards edge computing. This necessitates stringent constraints on energy efficiency, which traditional von Neumann architectures struggle to meet. The Compute-In-Memory (CIM) paradigm has emerged as a superior candidate due to its efficient exploitation of available memory bandwidth. However, existing CIM solutions require high implementation effort and lack flexibility from a software integration standpoint. This work proposes a novel, software-friendly, general-purpose, and low-integration-effort Near-Memory Computing (NMC) approach, paving the way for the adoption of CIM-based systems in the next generation of edge computing nodes. Two architectural variants, NM-Caesar and NM-Carus, are proposed and characterized to target different trade-offs in area efficiency, performance, and flexibility, covering a wide range of embedded microcontrollers. Post-layout simulations show up to $25.8\times$ and $50.0\times$ lower execution time and $23.2\times$ and $33.1\times$ higher energy efficiency at the system level, respectively, compared to executing the same tasks on a state-of-the-art RISC-V CPU (RV32IMC). NM-Carus achieves a peak energy efficiency of $306.7$ GOPS/W in 8-bit matrix multiplications, surpassing recent state-of-the-art in- and near-memory circuits.


title: Zero-Shot Image Denoising for High-Resolution Electron Microscopy

abstract: High-resolution electron microscopy (HREM) imaging technique is a powerful tool for directly visualizing a broad range of materials in real-space. However, it faces challenges in denoising due to ultra-low signal-to-noise ratio (SNR) and scarce data availability. In this work, we propose Noise2SR, a zero-shot self-supervised learning (ZS-SSL) denoising framework for HREM. Within our framework, we propose a super-resolution (SR) based self-supervised training strategy, incorporating the Random Sub-sampler module. The Random Sub-sampler is designed to generate approximate infinite noisy pairs from a single noisy image, serving as an effective data augmentation in zero-shot denoising. Noise2SR trains the network with paired noisy images of different resolutions, which is conducted via SR strategy. The SR-based training facilitates the network adopting more pixels for supervision, and the random sub-sampling helps compel the network to learn continuous signals enhancing the robustness. Meanwhile, we mitigate the uncertainty caused by random-sampling by adopting minimum mean squared error (MMSE) estimation for the denoised results. With the distinctive integration of training strategy and proposed designs, Noise2SR can achieve superior denoising performance using a single noisy HREM image. We evaluate the performance of Noise2SR in both simulated and real HREM denoising tasks. It outperforms state-of-the-art ZS-SSL methods and achieves comparable denoising performance with supervised methods. The success of Noise2SR suggests its potential for improving the SNR of images in material imaging domains.


title: VeriFlow: Modeling Distributions for Neural Network Verification

abstract: Formal verification has emerged as a promising method to ensure the safety and reliability of neural networks. Naively verifying a safety property amounts to ensuring the safety of a neural network for the whole input space irrespective of any training or test set. However, this also implies that the safety of the neural network is checked even for inputs that do not occur in the real-world and have no meaning at all, often resulting in spurious errors. To tackle this shortcoming, we propose the VeriFlow architecture as a flow based density model tailored to allow any verification approach to restrict its search to the some data distribution of interest. We argue that our architecture is particularly well suited for this purpose because of two major properties. First, we show that the transformation and log-density function that are defined by our model are piece-wise affine. Therefore, the model allows the usage of verifiers based on SMT with linear arithmetic. Second, upper density level sets (UDL) of the data distribution take the shape of an $L^p$-ball in the latent space. As a consequence, representations of UDLs specified by a given probability are effectively computable in latent space. This allows for SMT and abstract interpretation approaches with fine-grained, probabilistically interpretable, control regarding on how (a)typical the inputs subject to verification are.


title: Intelligent Interface: Enhancing Lecture Engagement with Didactic Activity Summaries

abstract: Recently, multiple applications of machine learning have been introduced. They include various possibilities arising when image analysis methods are applied to, broadly understood, video streams. In this context, a novel tool, developed for academic educators to enhance the teaching process by automating, summarizing, and offering prompt feedback on conducting lectures, has been developed. The implemented prototype utilizes machine learning-based techniques to recognise selected didactic and behavioural teachers' features within lecture video recordings. Specifically, users (teachers) can upload their lecture videos, which are preprocessed and analysed using machine learning models. Next, users can view summaries of recognized didactic features through interactive charts and tables. Additionally, stored ML-based prediction results support comparisons between lectures based on their didactic content. In the developed application text-based models trained on lecture transcriptions, with enhancements to the transcription quality, by adopting an automatic speech recognition solution are applied. Furthermore, the system offers flexibility for (future) integration of new/additional machine-learning models and software modules for image and video analysis.


title: On the Evaluation Practices in Multilingual NLP: Can Machine Translation Offer an Alternative to Human Translations?

abstract: While multilingual language models (MLMs) have been trained on 100+ languages, they are typically only evaluated across a handful of them due to a lack of available test data in most languages. This is particularly problematic when assessing MLM's potential for low-resource and unseen languages. In this paper, we present an analysis of existing evaluation frameworks in multilingual NLP, discuss their limitations, and propose several directions for more robust and reliable evaluation practices. Furthermore, we empirically study to what extent machine translation offers a {reliable alternative to human translation} for large-scale evaluation of MLMs across a wide set of languages. We use a SOTA translation model to translate test data from 4 tasks to 198 languages and use them to evaluate three MLMs. We show that while the selected subsets of high-resource test languages are generally sufficiently representative of a wider range of high-resource languages, we tend to overestimate MLMs' ability on low-resource languages. Finally, we show that simpler baselines can achieve relatively strong performance without having benefited from large-scale multilingual pretraining.


title: A hierarchical Bayesian approach to point source analysis in high-energy neutrino telescopes

abstract: We propose a novel approach to the detection of point-like sources of high-energy neutrinos. Motivated by evidence for emerging sources in existing data, we focus on the characterisation and interpretation of these sources. The hierarchical Bayesian model is implemented in the Stan platform, enabling computation of the posterior distribution with Hamiltonian Monte Carlo. We simulate a population of weak neutrino sources detected by the IceCube experiment and use the resulting data set to demonstrate and validate our framework. We show that even for the challenging case of sources at the threshold of detection and using limited prior information, it is possible to correctly infer the source properties. Additionally, we demonstrate how modelling flexible connections between similar sources can be used to recover the contribution of sources that would not be detectable individually, going beyond what is possible with existing stacking methods.


title: Concentration of a sparse Bayesian model with Horseshoe prior in estimating high-dimensional precision matrix

abstract: Precision matrices are crucial in many fields such as social networks, neuroscience, and economics, representing the edge structure of Gaussian graphical models (GGMs), where a zero in an off-diagonal position of the precision matrix indicates conditional independence between nodes. In high-dimensional settings where the dimension of the precision matrix $p$ exceeds the sample size $n$ and the matrix is sparse, methods like graphical Lasso, graphical SCAD, and CLIME are popular for estimating GGMs. While frequentist methods are well-studied, Bayesian approaches for (unstructured) sparse precision matrices are less explored. The graphical horseshoe estimate by \citet{li2019graphical}, applying the global-local horseshoe prior, shows superior empirical performance, but theoretical work for sparse precision matrix estimations using shrinkage priors is limited. This paper addresses these gaps by providing concentration results for the tempered posterior with the fully specified horseshoe prior in high-dimensional settings. Moreover, we also provide novel theoretical results for model misspecification, offering a general oracle inequality for the posterior.


title: Inverse optimal control problem in the non autonomous linear-quadratic case

abstract: Inverse optimal control problem emerges in different practical applications, where the goal is to design a cost function in order to approximate given optimal strategies of an expert. Typical application is in robotics for generation of human motions. In this paper we analyze a general class of non autonomous inverse linear quadratic problems. This class of problems is of particular interest because it arises as a linearization of a nonlinear problem around an optimal trajectory. The addressed questions are the injectivity of the inverse problem and the reconstruction. We show that the nonlinear problem admits the same characterization of the injectivity as the autonomous one. In the autonomous case we show moreover that the injectivity property is generic in the considered class. We also provide a numerical test of the reconstruction algorithm in the autonomous setting.


title: Pointwise convergence for the heat equation on tori $\mathbb T^n$ and waveguide manifold $\mathbb T^n \times \mathbb R^m$

abstract: We completely characterize the weighted Lebesgue spaces on the torus $\mathbb T^n$ and waveguide manifold $\mathbb T^n \times \mathbb R^m$ for which the solutions of the heat equation converge pointwise (as time tends to zero) to the initial data. In the process, we also characterize the weighted Lebesgue spaces for the boundedness of maximal operators on the torus and waveguide manifold, which may be of independent interest.


title: MultiTalk: Enhancing 3D Talking Head Generation Across Languages with Multilingual Video Dataset

abstract: Recent studies in speech-driven 3D talking head generation have achieved convincing results in verbal articulations. However, generating accurate lip-syncs degrades when applied to input speech in other languages, possibly due to the lack of datasets covering a broad spectrum of facial movements across languages. In this work, we introduce a novel task to generate 3D talking heads from speeches of diverse languages. We collect a new multilingual 2D video dataset comprising over 420 hours of talking videos in 20 languages. With our proposed dataset, we present a multilingually enhanced model that incorporates language-specific style embeddings, enabling it to capture the unique mouth movements associated with each language. Additionally, we present a metric for assessing lip-sync accuracy in multilingual settings. We demonstrate that training a 3D talking head model with our proposed dataset significantly enhances its multilingual performance. Codes and datasets are available at https://multi-talk.github.io/.


title: The Impact of AI on Perceived Job Decency and Meaningfulness: A Case Study

abstract: The proliferation of Artificial Intelligence (AI) in workplaces stands to change the way humans work, with job satisfaction intrinsically linked to work life. Existing research on human-AI collaboration tends to prioritize performance over the experiential aspects of work. In contrast, this paper explores the impact of AI on job decency and meaningfulness in workplaces. Through interviews in the Information Technology (IT) domain, we not only examined the current work environment, but also explored the perceived evolution of the workplace ecosystem with the introduction of an AI. Findings from the preliminary exploratory study reveal that respondents tend to visualize a workplace where humans continue to play a dominant role, even with the introduction of advanced AIs. In this prospective scenario, AI is seen as serving as a complement rather than replacing the human workforce. Furthermore, respondents believe that the introduction of AI will maintain or potentially increase overall job satisfaction.


title: Learning to Discover Knowledge: A Weakly-Supervised Partial Domain Adaptation Approach

abstract: Domain adaptation has shown appealing performance by leveraging knowledge from a source domain with rich annotations. However, for a specific target task, it is cumbersome to collect related and high-quality source domains. In real-world scenarios, large-scale datasets corrupted with noisy labels are easy to collect, stimulating a great demand for automatic recognition in a generalized setting, i.e., weakly-supervised partial domain adaptation (WS-PDA), which transfers a classifier from a large source domain with noises in labels to a small unlabeled target domain. As such, the key issues of WS-PDA are: 1) how to sufficiently discover the knowledge from the noisy labeled source domain and the unlabeled target domain, and 2) how to successfully adapt the knowledge across domains. In this paper, we propose a simple yet effective domain adaptation approach, termed as self-paced transfer classifier learning (SP-TCL), to address the above issues, which could be regarded as a well-performing baseline for several generalized domain adaptation tasks. The proposed model is established upon the self-paced learning scheme, seeking a preferable classifier for the target domain. Specifically, SP-TCL learns to discover faithful knowledge via a carefully designed prudent loss function and simultaneously adapts the learned knowledge to the target domain by iteratively excluding source examples from training under the self-paced fashion. Extensive evaluations on several benchmark datasets demonstrate that SP-TCL significantly outperforms state-of-the-art approaches on several generalized domain adaptation tasks.


title: Step-Back Profiling: Distilling User History for Personalized Scientific Writing

abstract: Large language models (LLMs) excel at a variety of natural language processing tasks, yet they struggle to generate personalized content for individuals, particularly in real-world scenarios like scientific writing. Addressing this challenge, we introduce Step-Back Profiling to personalize LLMs by distilling user history into concise profiles, including essential traits and preferences of users. Regarding our experiments, we construct a Personalized Scientific Writing (PSW) dataset to study multiuser personalization. PSW requires the models to write scientific papers given specialized author groups with diverse academic backgrounds. As for the results, we demonstrate the effectiveness of capturing user characteristics via Step-Back Profiling for collaborative writing. Moreover, our approach outperforms the baselines by up to 3.6 points on the general personalization benchmark (LaMP), including 7 personalization LLM tasks. Our extensive ablation studies validate the contributions of different components in our method and provide insights into our task definition. Our dataset and code are available at \url{https://github.com/gersteinlab/step-back-profiling}.


title: (u,v)-absorbing (prime) hyperideals in commutative multiplicative hyperrings

abstract: In this paper, we will introduce the notion of (u,v)-absorbing hyperideals in multiplicative hyperrings and we will show some properties of them. Then we extend this concept to the notion of (u,v)-absorbing prime hyperideals and thhen we will give some results about them.


title: Augmenting Query and Passage for Retrieval-Augmented Generation using LLMs for Open-Domain Question Answering

abstract: Retrieval-augmented generation (RAG) has received much attention for Open-domain question-answering (ODQA) tasks as a means to compensate for the parametric knowledge of large language models (LLMs). While previous approaches focused on processing retrieved passages to remove irrelevant context, they still rely heavily on the quality of retrieved passages which can degrade if the question is ambiguous or complex. In this paper, we propose a simple yet efficient method called question and passage augmentation via LLMs for open-domain QA. Our method first decomposes the original questions into multiple-step sub-questions. By augmenting the original question with detailed sub-questions and planning, we are able to make the query more specific on what needs to be retrieved, improving the retrieval performance. In addition, to compensate for the case where the retrieved passages contain distracting information or divided opinions, we augment the retrieved passages with self-generated passages by LLMs to guide the answer extraction. Experimental results show that the proposed scheme outperforms the previous state-of-the-art and achieves significant performance gain over existing RAG methods.


title: Efficient Deterministic Algorithms for Maximizing Symmetric Submodular Functions

abstract: Symmetric submodular maximization is an important class of combinatorial optimization problems, including MAX-CUT on graphs and hyper-graphs. The state-of-the-art algorithm for the problem over general constraints has an approximation ratio of $0.432$. The algorithm applies the canonical continuous greedy technique that involves a sampling process. It, therefore, suffers from high query complexity and is inherently randomized. In this paper, we present several efficient deterministic algorithms for maximizing a symmetric submodular function under various constraints. Specifically, for the cardinality constraint, we design a deterministic algorithm that attains a $0.432$ ratio and uses $O(kn)$ queries. Previously, the best deterministic algorithm attains a $0.385-\epsilon$ ratio and uses $O\left(kn (\frac{10}{9\epsilon})^{\frac{20}{9\epsilon}-1}\right)$ queries. For the matroid constraint, we design a deterministic algorithm that attains a $1/3-\epsilon$ ratio and uses $O(kn\log \epsilon^{-1})$ queries. Previously, the best deterministic algorithm can also attain $1/3-\epsilon$ ratio but it uses much larger $O(\epsilon^{-1}n^4)$ queries. For the packing constraints with a large width, we design a deterministic algorithm that attains a $0.432-\epsilon$ ratio and uses $O(n^2)$ queries. To the best of our knowledge, there is no deterministic algorithm for the constraint previously. The last algorithm can be adapted to attain a $0.432$ ratio for single knapsack constraint using $O(n^4)$ queries. Previously, the best deterministic algorithm attains a $0.316-\epsilon$ ratio and uses $\widetilde{O}(n^3)$ queries.


title: Uniqueness and modified Newton method for cracks from the far field patterns with a fixed incident direction

abstract: We consider the inverse cracks scattering problems from the far field patterns with a fixed incident direction. We firstly show that the sound-soft cracks can be uniquely determined by the multi-frequency far field patterns with a fixed incident direction. The proof is based on a low frequency asymptotic analysis of the scattered field. One important feature of the uniqueness result is that the background can even be an unknown inhomogeneous medium. A modified Newton method is then proposed for the numerical reconstruction of the shapes and locations of the cracks. Compared to the classical Newton method, the modified Newton method relaxes the dependence of a good initial guess and can be applied for multiple cracks. Numerical examples in two dimensions are presented to demonstrate the feasibility and effectiveness of the modified Newton method. In particular, the quality of the reconstructions can be greatly improved if we use the measurements properly with two frequencies or two incident directions.


title: Eichler-Selberg relations for singular moduli

abstract: The Eichler-Selberg trace formula expresses the trace of Hecke operators on spaces of cusp forms as weighted sums of Hurwitz-Kronecker class numbers. We extend this formula to a natural class of relations for traces of singular moduli, where one views class numbers as traces of the constant function $j_0(\tau)=1$. More generally, we consider the singular moduli for the Hecke system of modular functions \[ j_m(\tau) := mT_m \left(j(\tau)-744\right). \] For each $\nu\geq 0$ and $m\geq 1$, we obtain an Eichler-Selberg relation. For $\nu=0$ and $m\in \{1, 2\},$ these relations are Kaneko's celebrated singular moduli formulas for the coefficients of $j(\tau).$ For each $\nu\geq 1$ and $m\geq 1,$ we obtain a new Eichler-Selberg trace formula for the Hecke action on the space of weight $2\nu+2$ cusp forms, where the traces of $j_m(\tau)$ singular moduli replace Hurwitz-Kronecker class numbers. These formulas involve a new term that is assembled from values of symmetrized shifted convolution $L$-functions.


title: FairX: A comprehensive benchmarking tool for model analysis using fairness, utility, and explainability

abstract: We present FairX, an open-source Python-based benchmarking tool designed for the comprehensive analysis of models under the umbrella of fairness, utility, and eXplainability (XAI). FairX enables users to train benchmarking bias-removal models and evaluate their fairness using a wide array of fairness metrics, data utility metrics, and generate explanations for model predictions, all within a unified framework. Existing benchmarking tools do not have the way to evaluate synthetic data generated from fair generative models, also they do not have the support for training fair generative models either. In FairX, we add fair generative models in the collection of our fair-model library (pre-processing, in-processing, post-processing) and evaluation metrics for evaluating the quality of synthetic fair data. This version of FairX supports both tabular and image datasets. It also allows users to provide their own custom datasets. The open-source FairX benchmarking package is publicly available at https://github.com/fahim-sikder/FairX.


title: Learning to Plan for Retrieval-Augmented Large Language Models from Knowledge Graphs

abstract: Improving the performance of large language models (LLMs) in complex question-answering (QA) scenarios has always been a research focal point. Recent studies have attempted to enhance LLMs' performance by combining step-wise planning with external retrieval. While effective for advanced models like GPT-3.5, smaller LLMs face challenges in decomposing complex questions, necessitating supervised fine-tuning. Previous work has relied on manual annotation and knowledge distillation from teacher LLMs, which are time-consuming and not accurate enough. In this paper, we introduce a novel framework for enhancing LLMs' planning capabilities by using planning data derived from knowledge graphs (KGs). LLMs fine-tuned with this data have improved planning capabilities, better equipping them to handle complex QA tasks that involve retrieval. Evaluations on multiple datasets, including our newly proposed benchmark, highlight the effectiveness of our framework and the benefits of KG-derived planning data.


title: Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planning

abstract: Large Language Models (LLMs) have demonstrated impressive capability in many natural language tasks. However, the auto-regressive generation process makes LLMs prone to produce errors, hallucinations and inconsistent statements when performing multi-step reasoning. In this paper, by casting multi-step reasoning of LLMs as a heuristic search problem, we aim to alleviate the pathology by introducing Q*, a general, versatile and agile framework for guiding LLMs decoding process with deliberative planning. By learning a plug-and-play Q-value model as heuristic function for estimating expected future rewards, our Q* can effectively guide LLMs to select the most promising next reasoning step without fine-tuning LLMs for the current task, which avoids the significant computational overhead and potential risk of performance degeneration on other tasks. Extensive experiments on GSM8K, MATH and MBPP demonstrate the superiority of our method, contributing to improving the reasoning performance of existing open-source LLMs.


title: VAIYAKARANA : A Benchmark for Automatic Grammar Correction in Bangla

abstract: Bangla (Bengali) is the fifth most spoken language globally and, yet, the problem of automatic grammar correction in Bangla is still in its nascent stage. This is mostly due to the need for a large corpus of grammatically incorrect sentences, with their corresponding correct counterparts. The present state-of-the-art techniques to curate a corpus for grammatically wrong sentences involve random swapping, insertion and deletion of words. However,these steps may not always generate grammatically wrong sentences in Bangla. In this work, we propose a pragmatic approach to generate grammatically wrong sentences in Bangla. We first categorize the different kinds of errors in Bangla into 5 broad classes and 12 finer classes. We then use these to generate grammatically wrong sentences systematically from a correct sentence. This approach can generate a large number of wrong sentences and can, thus, mitigate the challenge of lacking a large corpus for neural networks. We provide a dataset, Vaiyakarana, consisting of 92,830 grammatically incorrect sentences as well as 18,426 correct sentences. We also collected 619 human-generated sentences from essays written by Bangla native speakers. This helped us to understand errors that are more frequent. We evaluated our corpus against neural models and LLMs and also benchmark it against human evaluators who are native speakers of Bangla. Our analysis shows that native speakers are far more accurate than state-of-the-art models to detect whether the sentence is grammatically correct. Our methodology of generating erroneous sentences can be applied for most other Indian languages as well.


title: A Survey of Methods for Mitigating Barren Plateaus for Parameterized Quantum Circuits

abstract: Barren Plateaus are a formidable challenge for hybrid quantum-classical algorithms that lead to flat plateaus in the loss function landscape making it difficult to take advantage of the expressive power of parameterized quantum circuits with gradient-based methods. Like in classical neural network models, parameterized quantum circuits suffer the same vanishing gradient issue due to large parameter spaces with non-convex landscapes. In this review, we present an overview of the different genesis for barren plateaus, mathematical formalisms of common themes around barren plateaus, and dives into gradients. The central objective is to provide a conceptual perspective between classical and quantum interpretations of vanishing gradients as well as dive into techniques involving cost functions, entanglement, and initialization strategies to mitigate barren plateaus. Addressing barren plateaus paves the way towards feasibility of many classically intractable applications for quantum simulation, optimization, chemistry, and quantum machine learning.


title: Trim turnpikes for optimal control problems with symmetries

abstract: Motivated by mechanical systems with symmetries, we focus on optimal control problems possessing symmetries. Following recent works, which generalized the classical concept of static turnpike to manifold turnpike, we extend the exponential turnpike property to the exponential trim turnpike for control systems with symmetries induced by abelian or non-abelian groups. Our analysis is mainly based on the geometric reduction of control systems with symmetries. More concretely, we first reduce the control system on the quotient space and state the turnpike theorem for the reduced problem. Then we use the group properties to obtain the trim turnpike theorem for the full problem. Finally, we illustrate our results on the Kepler problem and the Rigid body problem.


title: Segmentation of Non-Small Cell Lung Carcinomas: Introducing DRU-Net and Multi-Lens Distortion

abstract: Considering the increased workload in pathology laboratories today, automated tools such as artificial intelligence models can help pathologists with their tasks and ease the workload. In this paper, we are proposing a segmentation model (DRU-Net) that can provide a delineation of human non-small cell lung carcinomas and an augmentation method that can improve classification results. The proposed model is a fused combination of truncated pre-trained DenseNet201 and ResNet101V2 as a patch-wise classifier followed by a lightweight U-Net as a refinement model. We have used two datasets (Norwegian Lung Cancer Biobank and Haukeland University Hospital lung cancer cohort) to create our proposed model. The DRU-Net model achieves an average of 0.91 Dice similarity coefficient. The proposed spatial augmentation method (multi-lens distortion) improved the network performance by 3%. Our findings show that choosing image patches that specifically include regions of interest leads to better results for the patch-wise classifier compared to other sampling methods. The qualitative analysis showed that the DRU-Net model is generally successful in detecting the tumor. On the test set, some of the cases showed areas of false positive and false negative segmentation in the periphery, particularly in tumors with inflammatory and reactive changes.


title: Revisiting Modularity Maximization for Graph Clustering: A Contrastive Learning Perspective

abstract: Graph clustering, a fundamental and challenging task in graph mining, aims to classify nodes in a graph into several disjoint clusters. In recent years, graph contrastive learning (GCL) has emerged as a dominant line of research in graph clustering and advances the new state-of-the-art. However, GCL-based methods heavily rely on graph augmentations and contrastive schemes, which may potentially introduce challenges such as semantic drift and scalability issues. Another promising line of research involves the adoption of modularity maximization, a popular and effective measure for community detection, as the guiding principle for clustering tasks. Despite the recent progress, the underlying mechanism of modularity maximization is still not well understood. In this work, we dig into the hidden success of modularity maximization for graph clustering. Our analysis reveals the strong connections between modularity maximization and graph contrastive learning, where positive and negative examples are naturally defined by modularity. In light of our results, we propose a community-aware graph clustering framework, coined MAGI, which leverages modularity maximization as a contrastive pretext task to effectively uncover the underlying information of communities in graphs, while avoiding the problem of semantic drift. Extensive experiments on multiple graph datasets verify the effectiveness of MAGI in terms of scalability and clustering performance compared to state-of-the-art graph clustering methods. Notably, MAGI easily scales a sufficiently large graph with 100M nodes while outperforming strong baselines.


title: Electrical switching of chirality in rhombohedral graphene Chern insulators

abstract: A Chern insulator hosts topologically protected chiral edge currents with quantized conductance characterized by its Chern number. Switching the chirality of the Chern insulator, namely, the direction of the edge current, is highly challenging due to topologically forbidden backscattering but is of considerable importance for the design of topological devices. Nevertheless, this can be achieved by reversing the sign of the Chern number through a topological phase transition. Here, we report electrically switchable chirality in rhombohedral heptalayer graphene-based Chern insulators. The surface flat band and giant Berry curvature in rhombohedral multilayer graphene provide a highly tunable platform for engineering the topological states. By introducing moire superlattices in rhombohedral heptalayer graphene, we observed a cascade of topological phase transitions at quarter electron filling of a moire band. The Chern number can be continuously tuned from 0, -1, 1 to 2 by electric fields, manifesting as a large anomalous Hall effect and following Streda's formula. Sign reversal and the anomalous Hall effect also occurred at non-integer fillings, suggesting the possibility of electrically tunable topological phase transitions within the regime of fractional Chern insulators. Our work establishes rhombohedral heptalayer graphene moire superlattices as a versatile platform for topological engineering. The realization of switchable chirality enhances the potential application of chiral edge currents in topological circuit interconnects.


title: Examining the Implications of Deepfakes for Election Integrity

abstract: It is becoming cheaper to launch disinformation operations at scale using AI-generated content, in particular 'deepfake' technology. We have observed instances of deepfakes in political campaigns, where generated content is employed to both bolster the credibility of certain narratives (reinforcing outcomes) and manipulate public perception to the detriment of targeted candidates or causes (adversarial outcomes). We discuss the threats from deepfakes in politics, highlight model specifications underlying different types of deepfake generation methods, and contribute an accessible evaluation of the efficacy of existing detection methods. We provide this as a summary for lawmakers and civil society actors to understand how the technology may be applied in light of existing policies regulating its use. We highlight the limitations of existing detection mechanisms and discuss the areas where policies and regulations are required to address the challenges of deepfakes.


title: Post-Newtonian expansions of extreme mass ratio inspirals of spinning bodies into Schwarzschild black holes

abstract: Space-based gravitational-wave detectors such as LISA are expected to detect inspirals of stellar-mass compact objects into massive black holes. Modeling such inspirals requires fully relativistic computations to achieve sufficient accuracy at leading order. However, subleading corrections such as the effects of the spin of the inspiraling compact object may potentially be treated in weak-field expansions such as the post-Newtonian (PN) approach. In this work, we calculate the PN expansion of eccentric orbits of spinning bodies around Schwarzschild black holes. Then we use the Teukolsky equation to compute the energy and angular momentum fluxes from these orbits up to the 5PN order. Some of these PN orders are exact in eccentricity, while others are expanded up to the tenth power in eccentricity. Then we use the fluxes to construct a hybrid inspiral model, where the leading part of the fluxes is calculated numerically in the fully relativistic regime, while the part linear in the small spin is analytically approximated using the PN series. We calculate LISA-relevant inspirals and respective waveforms with this model and a fully relativistic model. Through the calculation of mismatch between the waveforms from both models we conclude that the PN approximation of the linear-in-spin part of the fluxes is sufficient for lower eccentricities.


abstract: We introduce a class of algorithms, termed Proximal Interacting Particle Langevin Algorithms (PIPLA), for inference and learning in latent variable models whose joint probability density is non-differentiable. Leveraging proximal Markov chain Monte Carlo (MCMC) techniques and the recently introduced interacting particle Langevin algorithm (IPLA), we propose several variants within the novel proximal IPLA family, tailored to the problem of estimating parameters in a non-differentiable statistical model. We prove nonasymptotic bounds for the parameter estimates produced by multiple algorithms in the strongly log-concave setting and provide comprehensive numerical experiments on various models to demonstrate the effectiveness of the proposed methods. In particular, we demonstrate the utility of the proposed family of algorithms on a toy hierarchical example where our assumptions can be checked, as well as on the problems of sparse Bayesian logistic regression, sparse Bayesian neural network, and sparse matrix completion. Our theory and experiments together show that PIPLA family can be the de facto choice for parameter estimation problems in latent variable models for non-differentiable models.


title: Abundant hydrocarbons in the disk around a very-low-mass star

abstract: Very low-mass stars (those <0.3 solar masses) host orbiting terrestrial planets more frequently than other types of stars, but the compositions of those planets are largely unknown. We use mid-infrared spectroscopy with the James Webb Space Telescope to investigate the chemical composition of the planet-forming disk around ISO-ChaI 147, a 0.11 solar-mass star. The inner disk has a carbon-rich chemistry: we identify emission from 13 carbon-bearing molecules including ethane and benzene. We derive large column densities of hydrocarbons indicating that we probe deep into the disk. The high carbon to oxygen ratio we infer indicates radial transport of material within the disk, which we predict would affect the bulk composition of any planets forming in the disk.


title: DASB - Discrete Audio and Speech Benchmark

abstract: Discrete audio tokens have recently gained considerable attention for their potential to connect audio and language processing, enabling the creation of modern multimodal large language models. Ideal audio tokens must effectively preserve phonetic and semantic content along with paralinguistic information, speaker identity, and other details. While several types of audio tokens have been recently proposed, identifying the optimal tokenizer for various tasks is challenging due to the inconsistent evaluation settings in existing studies. To address this gap, we release the Discrete Audio and Speech Benchmark (DASB), a comprehensive leaderboard for benchmarking discrete audio tokens across a wide range of discriminative tasks, including speech recognition, speaker identification and verification, emotion recognition, keyword spotting, and intent classification, as well as generative tasks such as speech enhancement, separation, and text-to-speech. Our results show that, on average, semantic tokens outperform compression tokens across most discriminative and generative tasks. However, the performance gap between semantic tokens and standard continuous representations remains substantial, highlighting the need for further research in this field.


title: Crowdfunding for Equitable EV Charging Infrastructure

abstract: The transportation sector significantly contributes to greenhouse gas emissions, highlighting the need to transition to Electric Vehicles (EVs) to reduce fossil fuel dependence and combat climate change. The US government has set ambitious targets for 2030, aiming for half of all new vehicles sold to be zero-emissions. Expanding EV charging stations is crucial for this transition, but social equity presents a significant challenge. The Justice40 program mandates that at least 40% of benefits be allocated to disadvantaged communities, ensuring they benefit from federal investments. Given the current concentration of EV ownership in affluent areas, merely installing charging stations in disadvantaged neighborhoods may not suffice. This article explores crowdfunding as a novel method to finance EV charging infrastructure, engaging, and empowering underserved communities. The paper concludes with a hypothetical case showing financing benefits for disadvantaged communities, exploring crowdfunding variations, and scaling to develop equitable EV charging networks.


title: Foundry compatible, efficient wafer-scale manufacturing of ultra-low loss, high-density Si$_3$N$_4$ photonic integrated circuits

abstract: Silicon nitride (Si$_3$N$_4$) photonic integrated circuits (PICs) have shown low linear loss, negligible nonlinear loss, and high power handling over traditional silicon photonics. To achieve high-density photonic integration and high effective nonlinearity through tight optical confinement, thick stoichiometric Si$_3$N$_4$ films are indispensable. However, when using low-pressure chemical vapor deposition (LPCVD) to achieve high optical material transparency, Si$_3$N$_4$ films exhibit large tensile stress on the order of GPa. Methods for crack prevention are therefore essential. The photonic Damascene process has addressed this issue, attaining record low loss Si$_3$N$_4$ PICs, but it lacks control of the waveguide height. Conversely, precise waveguide dimension and ultra-low loss have been achieved with subtractive processing, but this method is not compatible with mass production due to the use of electron beam lithography. To date, an outstanding challenge is to attain both lithographic precision and ultra-low loss in high confinement Si$_3$N$_4$ PICs that are compatible with large-scale foundry manufacturing. Here, we present a single-step deposited, DUV-based subtractive method for producing wafer-scale ultra-low loss Si$_3$N$_4$ PICs that harmonize these necessities. By employing deep etching of densely distributed, interconnected trenches into the substrate, we effectively mitigate the tensile stress in the Si$_3$N$_4$ layer, enabling direct deposition of thick films without cracking and substantially prolonged storage duration. Lastly, we identify ultraviolet (UV) radiation-induced damage that can be remedied through rapid thermal annealing. Collectively, we develop ultra-low loss Si$_3$N$_4$ microresonators and 0.5 m-long spiral waveguides with losses down to 1.4 dB/m at 1550 nm with high production yield.


title: AI in Space for Scientific Missions: Strategies for Minimizing Neural-Network Model Upload

abstract: Artificial Intelligence (AI) has the potential to revolutionize space exploration by delegating several spacecraft decisions to an onboard AI instead of relying on ground control and predefined procedures. It is likely that there will be an AI/ML Processing Unit onboard the spacecraft running an inference engine. The neural-network will have pre-installed parameters that can be updated onboard by uploading, by telecommands, parameters obtained by training on the ground. However, satellite uplinks have limited bandwidth and transmissions can be costly. Furthermore, a mission operating with a suboptimal neural network will miss out on valuable scientific data. Smaller networks can thereby decrease the uplink cost, while increasing the value of the scientific data that is downloaded. In this work, we evaluate and discuss the use of reduced-precision and bare-minimum neural networks to reduce the time for upload. As an example of an AI use case, we focus on the NASA's Magnetosperic MultiScale (MMS) mission. We show how an AI onboard could be used in the Earth's magnetosphere to classify data to selectively downlink higher value data or to recognize a region-of-interest to trigger a burst-mode, collecting data at a high-rate. Using a simple filtering scheme and algorithm, we show how the start and end of a region-of-interest can be detected in on a stream of classifications. To provide the classifications, we use an established Convolutional Neural Network (CNN) trained to an accuracy >94%. We also show how the network can be reduced to a single linear layer and trained to the same accuracy as the established CNN. Thereby, reducing the overall size of the model by up to 98.9%. We further show how each network can be reduced by up to 75% of its original size, by using lower-precision formats to represent the network parameters, with a change in accuracy of less than 0.6 percentage points.


title: High-resolution observations of two pores with the integral field unit (IFU) of the GREGOR Infrared Spectrograph (GRIS)

abstract: The goal is to compare the intricate details of the magnetic and flow fields around two solar pores, where one is part of an active region and the other is an isolated pore, with a secondary goal of demonstrating the scientific capabilities of the GRIS IFU. Two pores were observed with the HiFI and the GRIS IFU at the GREGOR solar telescope on 29 May and 6 June 2019. The GRIS IFU mosaics provide spectropolarimetric data for inversions of the Ca I 1083.9 nm and Si I 1082.7 nm spectral lines, covering the deep and upper photosphere. The t-SNE machine learning algorithm is employed to identify different classes of Si I Stokes-V profiles. The LCT technique derives horizontal proper motions around the pores. Both pores contain a thin light bridge, are stable during the observations, and never develop a penumbra. The isolated pore is three times smaller and significantly darker than the active-region pore, which is not predicted by simulations. The LCT maps show inflows around both pores, with lower velocities for the isolated pore. Both pores are embedded in the photospheric LOS velocity pattern of the granulation but filamentary structures are only visible in the chromospheric LOS maps of the active-region pore. The t-SNE identifies five clusters of Si I Stokes-V profiles, revealing an `onion-peel' magnetic field structure, despite the small size of the pores. The core with strong vertical magnetic fields is surrounded by concentric layers with lower and more inclined magnetic fields. The active-region pore shows some signatures of increased interaction between plasma motions and magnetic fields, which can be considered as early signs of penumbra formation. However, similar physical properties prevail for smaller pores. A statistically meaningful sample of different pore sizes and morphologies is required to distinguish between active-region and isolated pore formation mechanisms.


title: Symplectic Stiefel manifold: tractable metrics, second-order geometry and Newton's methods

abstract: Optimization under the symplecticity constraint is an approach for solving various problems in quantum physics and scientific computing. Building on the results that this optimization problem can be transformed into an unconstrained problem on the symplectic Stiefel manifold, we construct geometric ingredients for Riemannian optimization with a new family of Riemannian metrics called tractable metrics and develop Riemannian Newton schemes. The newly obtained ingredients do not only generalize several existing results but also provide us with freedom to choose a suitable metric for each problem. To the best of our knowledge, this is the first try to develop the explicit second-order geometry and Newton's methods on the symplectic Stiefel manifold. For the Riemannian Newton method, we first consider novel operator-valued formulas for computing the Riemannian Hessian of a~cost function, which further allows the manifold to be endowed with a weighted Euclidean metric that can provide a preconditioning effect. We then solve the resulting Newton equation, as the central step of Newton's methods, directly via transforming it into a~saddle point problem followed by vectorization, or iteratively via applying any matrix-free iterative method either to the operator Newton equation or its saddle point formulation. Finally, we propose a hybrid Riemannian Newton optimization algorithm that enjoys both global convergence and quadratic/superlinear local convergence at the final stage. Various numerical experiments are presented to validate the proposed methods.


title: The Connes-Chamseddine Hochschild cocycle and the noncommutative integral

abstract: In [5], Connes and Chamseddine defined a Hochschild cocycle in the general framework of noncommutative geometry. They computed this Hochschild cocycle for the Dirac operator on 4-dimensioanl manifolds. We propose a way to study the Connes-Chamseddine Hochschild cocycle from the viewpoint of the noncommutative integral on 6-dimensional manifolds in this paper. We compute several interesting noncommutative integral defined in [8] by the normal coodinated way on n-dimensional manifolds. As a corollary, the Connes-Chamseddine Hochschild cocycle on 6-dimensional manifolds is obtained.


title: Resource Optimization for Tail-Based Control in Wireless Networked Control Systems

abstract: Achieving control stability is one of the key design challenges of scalable Wireless Networked Control Systems (WNCS) under limited communication and computing resources. This paper explores the use of an alternative control concept defined as tail-based control, which extends the classical Linear Quadratic Regulator (LQR) cost function for multiple dynamic control systems over a shared wireless network. We cast the control of multiple control systems as a network-wide optimization problem and decouple it in terms of sensor scheduling, plant state prediction, and control policies. Toward this, we propose a solution consisting of a scheduling algorithm based on Lyapunov optimization for sensing, a mechanism based on Gaussian Process Regression (GPR) for state prediction and uncertainty estimation, and a control policy based on Reinforcement Learning (RL) to ensure tail-based control stability. A set of discrete time-invariant mountain car control systems is used to evaluate the proposed solution and is compared against four variants that use state-of-the-art scheduling, prediction, and control methods. The experimental results indicate that the proposed method yields 22% reduction in overall cost in terms of communication and control resource utilization compared to state-of-the-art methods.


title: Identifiable Exchangeable Mechanisms for Causal Structure and Representation Learning

abstract: Identifying latent representations or causal structures is important for good generalization and downstream task performance. However, both fields have been developed rather independently. We observe that several methods in both representation and causal structure learning rely on the same data-generating process (DGP), namely, exchangeable but not i.i.d. (independent and identically distributed) data. We provide a unified framework, termed Identifiable Exchangeable Mechanisms (IEM), for representation and structure learning under the lens of exchangeability. IEM provides new insights that let us relax the necessary conditions for causal structure identification in exchangeable non--i.i.d. data. We also demonstrate the existence of a duality condition in identifiable representation learning, leading to new identifiability results. We hope this work will pave the way for further research in causal representation learning.


title: Non-Hermitian topology of transport in Chern insulators

abstract: It has recently been shown that signatures of non-Hermitian topology can be realized in a conventional quantum Hall device connected to multiple current sources. These signatures manifest as robust current-voltage characteristics, dictated by the presence of a nontrivial, non-Hermitian topological invariant of the conductance matrix. Chiral edge states are believed to be responsible for this non-Hermitian response, similar to how they lead to a quantized Hall conductivity in the presence of a single current source. Here, we go beyond this paradigm, showing that multi-terminal conductance matrices can exhibit non-Hermitian topological phase transitions that cannot be traced back to the presence and directionality of a boundary-localized chiral mode. By performing quantum transport simulations in the quantum Hall regime of monolayer graphene, we find that when the chemical potential is swept across the zeroth Landau level, unavoidable device imperfections cause the appearance of an additional non-Hermitian phase of the conductance matrix. This highlights graphene as an ideal platform for the study of non-Hermitian topological phase transitions, and is a first step towards exploring how the geometry of quantum devices can be harnessed to produce robust, topologically-protected transport characteristics.


title: A Variational Characterization of $H$-Mutual Information and its Application to Computing $H$-Capacity

abstract: $H$-mutual information ($H$-MI) is a wide class of information leakage measures, where $H=(\eta, F)$ is a pair of monotonically increasing function $\eta$ and a concave function $F$, which is a generalization of Shannon entropy. $H$-MI is defined as the difference between the generalized entropy $H$ and its conditional version, including Shannon mutual information (MI), Arimoto MI of order $\alpha$, $g$-leakage, and expected value of sample information. This study presents a variational characterization of $H$-MI via statistical decision theory. Based on the characterization, we propose an alternating optimization algorithm for computing $H$-capacity.


title: Disproving Termination of Non-Erasing Sole Combinatory Calculus with Tree Automata (Full Version)

abstract: We study the termination of sole combinatory calculus, which consists of only one combinator. Specifically, the termination for non-erasing combinators is disproven by finding a desirable tree automaton with a SAT solver as done for term rewriting systems by Endrullis and Zantema. We improved their technique to apply to non-erasing sole combinatory calculus, in which it suffices to search for tree automata with a final sink state. Our method succeeds in disproving the termination of 8 combinators, whose termination has been an open problem.


title: Efficient parameterization of transferable Atomic Cluster Expansion for water

abstract: We present a highly accurate and transferable parameterization of water using the atomic cluster expansion (ACE). To efficiently sample liquid water, we propose a novel approach that involves sampling static calculations of various ice phases and utilizing the active learning (AL) feature of ACE-based D-optimality algorithm to select relevant liquid water configurations, bypassing computationally intensive ab-initio molecular dynamics (AIMD) simulations. Our results demonstrate that the ACE descriptors enable a potential initially-fitted solely on ice structures which is later upfitted with few configurations of liquid, identified with active learning to provide an excellent description of liquid water. The developed potential exhibits remarkable agreement with first-principles reference, accurately capturing various properties of liquid water, including structural characteristics such as pair correlation functions, covalent bonding profiles, and hydrogen bonding profiles, as well as dynamic properties like the vibrational density of states, diffusion coefficient and thermodynamic properties such as the melting point of the ice Ih. Our research introduces a new and efficient sampling technique for machine learning potentials in water simulations, while also presenting a transferable interatomic potential for water that reveals the accuracy of first principles reference. This advancement not only enhances our understanding the relationship between ice and liquid water at the atomic level, but also opens up new avenues for studying complex aqueous systems.


title: QuST-LLM: Integrating Large Language Models for Comprehensive Spatial Transcriptomics Analysis

abstract: In this paper, we introduce QuST-LLM, an innovative extension of QuPath that utilizes the capabilities of large language models (LLMs) to analyze and interpret spatial transcriptomics (ST) data. This tool effectively simplifies the intricate and high-dimensional nature of ST data by offering a comprehensive workflow that includes data loading, region selection, gene expression analysis, and functional annotation. QuST-LLM employs LLMs to transform complex ST data into understandable and detailed biological narratives based on gene ontology annotations, thereby significantly improving the interpretability of ST data. Consequently, users can interact with their own ST data using natural language. Hence, QuST-LLM provides researchers with a potent functionality to unravel the spatial and functional complexities of tissues, fostering novel insights and advancements in biomedical research.


title: FIESTA: Fourier-Based Semantic Augmentation with Uncertainty Guidance for Enhanced Domain Generalizability in Medical Image Segmentation

abstract: Single-source domain generalization (SDG) in medical image segmentation (MIS) aims to generalize a model using data from only one source domain to segment data from an unseen target domain. Despite substantial advances in SDG with data augmentation, existing methods often fail to fully consider the details and uncertain areas prevalent in MIS, leading to mis-segmentation. This paper proposes a Fourier-based semantic augmentation method called FIESTA using uncertainty guidance to enhance the fundamental goals of MIS in an SDG context by manipulating the amplitude and phase components in the frequency domain. The proposed Fourier augmentative transformer addresses semantic amplitude modulation based on meaningful angular points to induce pertinent variations and harnesses the phase spectrum to ensure structural coherence. Moreover, FIESTA employs epistemic uncertainty to fine-tune the augmentation process, improving the ability of the model to adapt to diverse augmented data and concentrate on areas with higher ambiguity. Extensive experiments across three cross-domain scenarios demonstrate that FIESTA surpasses recent state-of-the-art SDG approaches in segmentation performance and significantly contributes to boosting the applicability of the model in medical imaging modalities.


title: Emerging-properties Mapping Using Spatial Embedding Statistics: EMUSES

abstract: Understanding complex phenomena often requires analyzing high-dimensional data to uncover emergent properties that arise from multifactorial interactions. Here, we present EMUSES (Emerging-properties Mapping Using Spatial Embedding Statistics), an innovative approach employing Uniform Manifold Approximation and Projection (UMAP) to create high-dimensional embeddings that reveal latent structures within data. EMUSES facilitates the exploration and prediction of emergent properties by statistically analyzing these latent spaces. Using three distinct datasets--a handwritten digits dataset from the National Institute of Standards and Technology (NIST, E. Alpaydin, 1998), the Chicago Face Database (Ma et al., 2015), and brain disconnection data post-stroke (Talozzi et al., 2023)--we demonstrate EMUSES' effectiveness in detecting and interpreting emergent properties. Our method not only predicts outcomes with high accuracy but also provides clear visualizations and statistical insights into the underlying interactions within the data. By bridging the gap between predictive accuracy and interpretability, EMUSES offers researchers a powerful tool to understand the multifactorial origins of complex phenomena.


title: Cross-level Requirement Traceability: A Novel Approach Integrating Bag-of-Words and Word Embedding for Enhanced Similarity Functionality

abstract: Requirement traceability is the process of identifying the inter-dependencies between requirements. It poses a significant challenge when conducted manually, especially when dealing with requirements at various levels of abstraction. In this work, we propose a novel approach to automate the task of linking high-level business requirements with more technical system requirements. The proposed approach begins by representing each requirement using a Bag of-Words (BOW) model combined with the Term Frequency-Inverse Document Frequency (TF-IDF) scoring function. Then, we suggested an enhanced cosine similarity that uses recent advances in word embedding representation to correct traditional cosine similarity function limitations. To evaluate the effectiveness of our approach, we conducted experiments on three well-known datasets: COEST, WARC(NFR), and WARC(FRS). The results demonstrate that our approach significantly improves efficiency compared to existing methods. We achieved better results with an increase of approximately 18.4% in one of the datasets, as measured by the F2 score.


title: A Heegaard-Floer TQFT for link cobordisms

abstract: We introduce a Heegaard-Floer homology functor from the category of oriented links in closed $3$-manifolds and oriented surface cobordisms in $4$-manifolds connecting them to the category of $\mathbb{F}[v]$-modules and $\mathbb{F}[v]$-homomorphisms between them, where $\mathbb{F}$ is the field with two elements. In comparison with previously defined TQFTs for decorated links and link cobordisms, the construction of this paper has the advantage of being independent from the decoration. Some of the basic properties of this functor are also explored.


title: Infusing clinical knowledge into tokenisers for language models

abstract: This study introduces a novel knowledge enhanced tokenisation mechanism, K-Tokeniser, for clinical text processing. Technically, at initialisation stage, K-Tokeniser populates global representations of tokens based on semantic types of domain concepts (such as drugs or diseases) from either a domain ontology like Unified Medical Language System or the training data of the task related corpus. At training or inference stage, sentence level localised context will be utilised for choosing the optimal global token representation to realise the semantic-based tokenisation. To avoid pretraining using the new tokeniser, an embedding initialisation approach is proposed to generate representations for new tokens. Using three transformer-based language models, a comprehensive set of experiments are conducted on four real-world datasets for evaluating K-Tokeniser in a wide range of clinical text analytics tasks including clinical concept and relation extraction, automated clinical coding, clinical phenotype identification, and clinical research article classification. Overall, our models demonstrate consistent improvements over their counterparts in all tasks. In particular, substantial improvements are observed in the automated clinical coding task with 13\% increase on Micro $F_1$ score. Furthermore, K-Tokeniser also shows significant capacities in facilitating quicker converge of language models. Specifically, using K-Tokeniser, the language models would only require 50\% of the training data to achieve the best performance of the baseline tokeniser using all training data in the concept extraction task and less than 20\% of the data for the automated coding task. It is worth mentioning that all these improvements require no pre-training process, making the approach generalisable.


title: Robust Few-shot Transfer Learning for Knowledge Base Question Answering with Unanswerable Questions

abstract: Real-world KBQA applications require models that are (1) robust -- e.g., can differentiate between answerable and unanswerable questions, and (2) low-resource -- do not require large training data. Towards this goal, we propose the novel task of few-shot transfer for KBQA with unanswerable questions. We present FUn-FuSIC that extends the state-of-the-art (SoTA) few-shot transfer model for answerable-only KBQA to handle unanswerability. It iteratively prompts an LLM to generate logical forms for the question by providing feedback using a diverse suite of syntactic, semantic and execution guided checks, and adapts self-consistency to assess confidence of the LLM to decide answerability. Experiments over newly constructed datasets show that FUn-FuSIC outperforms suitable adaptations of the SoTA model for KBQA with unanswerability, and the SoTA model for answerable-only few-shot-transfer KBQA.


title: Identifying User Goals from UI Trajectories

abstract: Autonomous agents that interact with graphical user interfaces (GUIs) hold significant potential for enhancing user experiences. To further improve these experiences, agents need to be personalized and proactive. By effectively comprehending user intentions through their actions and interactions with GUIs, agents will be better positioned to achieve these goals. This paper introduces the task of goal identification from observed UI trajectories, aiming to infer the user's intended task based on their GUI interactions. We propose a novel evaluation metric to assess whether two task descriptions are paraphrases within a specific UI environment. By Leveraging the inverse relation with the UI automation task, we utilized the Android-In-The-Wild and Mind2Web datasets for our experiments. Using our metric and these datasets, we conducted several experiments comparing the performance of humans and state-of-the-art models, specifically GPT-4 and Gemini-1.5 Pro. Our results show that Gemini performs better than GPT but still underperforms compared to humans, indicating significant room for improvement.


title: AI-coupled HPC Workflow Applications, Middleware and Performance

abstract: AI integration is revolutionizing the landscape of HPC simulations, enhancing the importance, use, and performance of AI-driven HPC workflows. This paper surveys the diverse and rapidly evolving field of AI-driven HPC and provides a common conceptual basis for understanding AI-driven HPC workflows. Specifically, we use insights from different modes of coupling AI into HPC workflows to propose six execution motifs most commonly found in scientific applications. The proposed set of execution motifs is by definition incomplete and evolving. However, they allow us to analyze the primary performance challenges underpinning AI-driven HPC workflows. We close with a listing of open challenges, research issues, and suggested areas of investigation including the the need for specific benchmarks that will help evaluate and improve the execution of AI-driven HPC workflows.


title: Cluster Formation induced by local dielectric saturation in Restricted Primitive Model Electrolytes

abstract: Experiments using the Surface Force Apparatus (SFA) have found anomalously long ranged charge-charge underscreening in concentrated salt solutions. Meanwhile, theory and simulations have suggested ion clustering to be the possible origin of this behaviour. The popular Restricted Primitive Model of electrolyte solutions, in which the solvent is represented by a uniform relative dielectric constant, $\varepsilon_r$, is unable to resolve the anomalous underscreening seen in experiments. In this work, we modify the Restricted Primitive Model to account for local dielectric saturation within the ion hydration shell. The dielectric constant in our model locally decreases from the bulk value to a lower saturated value at the ionic surface. The parameters for the model are deduced so that typical salt solubilities are obtained. Our simulations for both bulk and slit geometries show that our model displays strong cluster formation and these give rise to long-ranged interactions between charged surfaces at distances similar to what has been observed in SFA measurements. An electrolyte model wherein the dielectric constant remains uniform does not display similar clusters, even with $\varepsilon_r$ equal to the saturated value at ion contact. Hence, the observed behaviours are not simply due to an enhanced Coulomb interaction.


title: Maximum principle preserving time implicit DGSEM for nonlinear scalar conservation laws

abstract: This work concerns the analysis of the discontinuous Galerkin spectral element method (DGSEM) with implicit time stepping for the numerical approximation of nonlinear scalar conservation laws in multiple space dimensions. We consider either the DGSEM with a backward Euler time stepping, or a space-time DGSEM discretization to remove the restriction on the time step. We design graph viscosities in space, and in time for the space-time DGSEM, to make the schemes maximum principle preserving and entropy stable for every admissible convex entropy. We also establish well-posedness of the discrete problems by showing existence and uniqueness of the solutions to the nonlinear implicit algebraic relations that need to be solved at each time step. Numerical experiments in one space dimension are presented to illustrate the properties of these schemes.


title: The Fire Thief Is Also the Keeper: Balancing Usability and Privacy in Prompts

abstract: The rapid adoption of online chatbots represents a significant advancement in artificial intelligence. However, this convenience brings considerable privacy concerns, as prompts can inadvertently contain sensitive information exposed to large language models (LLMs). Limited by high computational costs, reduced task usability, and excessive system modifications, previous works based on local deployment, embedding perturbation, and homomorphic encryption are inapplicable to online prompt-based LLM applications. To address these issues, this paper introduces Prompt Privacy Sanitizer (i.e., ProSan), an end-to-end prompt privacy protection framework that can produce anonymized prompts with contextual privacy removed while maintaining task usability and human readability. It can also be seamlessly integrated into the online LLM service pipeline. To achieve high usability and dynamic anonymity, ProSan flexibly adjusts its protection targets and strength based on the importance of the words and the privacy leakage risk of the prompts. Additionally, ProSan is capable of adapting to diverse computational resource conditions, ensuring privacy protection even for mobile devices with limited computing power. Our experiments demonstrate that ProSan effectively removes private information across various tasks, including question answering, text summarization, and code generation, with minimal reduction in task performance.


title: LiveMind: Low-latency Large Language Models with Simultaneous Inference

abstract: In this paper, we introduce a novel low-latency inference framework for large language models (LLMs) inference which enables LLMs to perform inferences with incomplete prompts. By reallocating computational processes to prompt input phase, we achieve a substantial reduction in latency, thereby significantly enhancing the interactive experience for users of LLMs. The framework adeptly manages the visibility of the streaming prompt to the model, allowing it to infer from incomplete prompts or await additional prompts. Compared with traditional inference methods that utilize complete prompts, our approach demonstrates an average reduction of 59% in response latency on the MMLU-Pro dataset, while maintaining comparable accuracy. Additionally, our framework facilitates collaborative inference and output across different models. By employing an LLM for inference and a small language model (SLM) for output, we achieve an average 68% reduction in response latency, alongside a 5.5% improvement in accuracy on the MMLU-Pro dataset compared with the SLM baseline. For long prompts exceeding 20 sentences, the response latency can be reduced by up to 93%.


title: Anyon condensation in mixed-state topological order

abstract: We discuss anyon condensation in mixed-state topological order. The phases were recently conjectured to be classified by pre-modular fusion categories. Just like anyon condensation in pure-state topological order, a bootstrap analysis shows condensable anyons are given by connected \'etale algebras. We explain how to perform generic anyon condensation including non-invertible anyons and successive condensations. Interestingly, some condensations lead to pure-state topological orders. We clarify when this happens. We also compute topological invariants of equivalence classes.

categories: hep-th cond-mat.str-el math-ph math.CT math.MP quant-ph


title: The motive of the Hilbert scheme of points in all dimensions

abstract: We prove a closed formula for the generating function $\mathsf Z_d(t)$ of the motives $[\mathrm{Hilb}^d(\mathbb A^n)_0] \in K_0(\mathrm{Var}_{\mathbb C})$ of punctual Hilbert schemes, summing over $n$, for fixed $d>0$. The result is an expression for $\mathsf Z_d(t)$ as the product of the zeta function of $\mathbb P^{d-1}$ and a polynomial $\mathsf P_d(t)$, which in particular implies that $\mathsf Z_d(t)$ is a rational function. Moreover, we reduce the complexity of $\mathsf P_d(t)$ to the computation of $d-8$ initial data, and therefore give explicit formulas for $\mathsf Z_d(t)$ in the cases $d \leq 8$, which in turn yields a formula for $[\mathrm{Hilb}^{\leq 8}(X)]$ for any smooth variety $X$. We perform a similar analysis for the Quot scheme of points, obtaining explicit formulas for the full generating function (summing over all ranks and dimensions) for $d \leq 4$. In the limit $n \to \infty$, we prove that the motives $[\mathrm{Hilb}^d(\mathbb A^n)_0]$ stabilise to the class of the infinite Grassmannian $\mathrm{Gr}(d-1,\infty)$. Finally, exploiting our geometric methods, we conjecture (and partially confirm) a structural result on the 'error' measuring the discrepancy between the count of higher dimensional partitions and MacMahon's famous guess.


title: Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning

abstract: Large language models (LLMs) have emerged as powerful tools for tackling complex tasks across diverse domains, but they also raise privacy concerns when fine-tuned on sensitive data due to potential memorization. While differential privacy (DP) offers a promising solution by ensuring models are `almost indistinguishable' with or without any particular privacy unit, current evaluations on LLMs mostly treat each example (text record) as the privacy unit. This leads to uneven user privacy guarantees when contributions per user vary. We therefore study user-level DP motivated by applications where it necessary to ensure uniform privacy protection across users. We present a systematic evaluation of user-level DP for LLM fine-tuning on natural language generation tasks. Focusing on two mechanisms for achieving user-level DP guarantees, Group Privacy and User-wise DP-SGD, we investigate design choices like data selection strategies and parameter tuning for the best privacy-utility tradeoff.


title: Anisotropy of Yu-Shiba-Rusinov states in NbSe$_2$

abstract: The spatial structure of in-gap Yu-Shiba-Rusinov (YSR) bound states induced by a magnetic impurity in a superconductor is the essential ingredient for the possibility of engineering collective impurity states. Recently, a saddle-point approximation [Phys. Rev. B 105, 144503] revealed how the spatial form of a YSR state is controlled by an anisotropic exponential decay length, and an anisotropic prefactor, which depends on the Fermi velocity and Fermi-surface curvature. Here we analyze STM data on YSR states in NbSe$_2$, focusing on a key issue that the exponential decay length predicted theoretically from the small superconducting gap is much larger than the observed extent of YSR states. We confirm that the exponential decay can be neglected in the analysis of the anisotropy. Instead, we extract the anisotropic prefactor directly from the data, matching it to the theoretical prediction, and we establish that the theoretical expression for the prefactor alone captures the characteristic flower-like shape of the YSR state. Surprisingly, we find that up to linear order in the superconducting gap the anisotropic prefactor that determines the shape of YSR states is the same as the anisotropic response to the impurity in the underlying normal metal. Our work points out the correct way to analyze STM data on impurities in small-gap superconductors, and reveals the importance of the normal band structure's curvature and Fermi velocity in designing multi-impurity in-gap states in superconductors.


title: Revealing the learning process in reinforcement learning agents through attention-oriented metrics

abstract: The learning process of a reinforcement learning (RL) agent remains poorly understood beyond the mathematical formulation of its learning algorithm. To address this gap, we introduce attention-oriented metrics (ATOMs) to investigate the development of an RL agent's attention during training. We tested ATOMs on three variations of a Pong game, each designed to teach the agent distinct behaviours, complemented by a behavioural assessment. Our findings reveal that ATOMs successfully delineate the attention patterns of an agent trained on each game variation, and that these differences in attention patterns translate into differences in the agent's behaviour. Through continuous monitoring of ATOMs during training, we observed that the agent's attention developed in phases, and that these phases were consistent across games. Finally, we noted that the agent's attention to its paddle emerged relatively late in the training and coincided with a marked increase in its performance score. Overall, we believe that ATOMs could significantly enhance our understanding of RL agents' learning processes, which is essential for improving their reliability and efficiency.


title: Reproducibility in Machine Learning-based Research: Overview, Barriers and Drivers

abstract: Research in various fields is currently experiencing challenges regarding the reproducibility of results. This problem is also prevalent in machine learning (ML) research. The issue arises primarily due to unpublished data and/or source code and the sensitivity of ML training conditions. Although different solutions have been proposed to address this issue, such as using ML platforms, the level of reproducibility in ML-driven research remains unsatisfactory. Therefore, in this article, we discuss the reproducibility of ML-driven research with three main aims: (i) identify the barriers to reproducibility when applying ML in research as well as categorize the barriers to different types of reproducibility (description, code, data, and experiment reproducibility), (ii) identify potential drivers such as tools, practices, and interventions that support ML reproducibility as well as distinguish between technology-driven drivers, procedural drivers, and drivers related to awareness and education, and (iii) map the drivers to the barriers. With this work, we hope to provide insights and contribute to the decision-making process regarding the adoption of different solutions to support ML reproducibility.


title: medIKAL: Integrating Knowledge Graphs as Assistants of LLMs for Enhanced Clinical Diagnosis on EMRs

abstract: Electronic Medical Records (EMRs), while integral to modern healthcare, present challenges for clinical reasoning and diagnosis due to their complexity and information redundancy. To address this, we proposed medIKAL (Integrating Knowledge Graphs as Assistants of LLMs), a framework that combines Large Language Models (LLMs) with knowledge graphs (KGs) to enhance diagnostic capabilities. medIKAL assigns weighted importance to entities in medical records based on their type, enabling precise localization of candidate diseases within KGs. It innovatively employs a residual network-like approach, allowing initial diagnosis by the LLM to be merged into KG search results. Through a path-based reranking algorithm and a fill-in-the-blank style prompt template, it further refined the diagnostic process. We validated medIKAL's effectiveness through extensive experiments on a newly introduced open-sourced Chinese EMR dataset, demonstrating its potential to improve clinical diagnosis in real-world settings.


title: Application of Haldane's statistical correlation theory in classical systems

abstract: This letter investigates the application of Haldane's statistical correlation theory in classical systems. A modified statistical correlation theory has been proposed by including non-linearity in the form of an exponent into the original theory of Haldane. The dependence of the statistical correlation on indistinguishability is highlighted. Using this modified theory, a quasi-classical derivation of intermediate statistics is shown where indistinguishability can be introduced into distinguishable systems in the form of a statistical correlation. The final result is equivalent to the classical fractional exclusion statistics (CFES), which was derived earlier using a purely classical route. An extended non-linear correlation model based on power series expansion is also proposed, which can produce various intermediate statistical models.

categories: cond-mat.stat-mech math-ph math.MP physics.data-an quant-ph


title: Computing Within Limits: An Empirical Study of Energy Consumption in ML Training and Inference

abstract: Machine learning (ML) has seen tremendous advancements, but its environmental footprint remains a concern. Acknowledging the growing environmental impact of ML this paper investigates Green ML, examining various model architectures and hyperparameters in both training and inference phases to identify energy-efficient practices. Our study leverages software-based power measurements for ease of replication across diverse configurations, models and datasets. In this paper, we examine multiple models and hardware configurations to identify correlations across the various measurements and metrics and key contributors to energy reduction. Our analysis offers practical guidelines for constructing sustainable ML operations, emphasising energy consumption and carbon footprint reductions while maintaining performance. As identified, short-lived profiling can quantify the long-term expected energy consumption. Moreover, model parameters can also be used to accurately estimate the expected total energy without the need for extensive experimentation.


title: Adaptive Adversarial Cross-Entropy Loss for Sharpness-Aware Minimization

abstract: Recent advancements in learning algorithms have demonstrated that the sharpness of the loss surface is an effective measure for improving the generalization gap. Building upon this concept, Sharpness-Aware Minimization (SAM) was proposed to enhance model generalization and achieved state-of-the-art performance. SAM consists of two main steps, the weight perturbation step and the weight updating step. However, the perturbation in SAM is determined by only the gradient of the training loss, or cross-entropy loss. As the model approaches a stationary point, this gradient becomes small and oscillates, leading to inconsistent perturbation directions and also has a chance of diminishing the gradient. Our research introduces an innovative approach to further enhancing model generalization. We propose the Adaptive Adversarial Cross-Entropy (AACE) loss function to replace standard cross-entropy loss for SAM's perturbation. AACE loss and its gradient uniquely increase as the model nears convergence, ensuring consistent perturbation direction and addressing the gradient diminishing issue. Additionally, a novel perturbation-generating function utilizing AACE loss without normalization is proposed, enhancing the model's exploratory capabilities in near-optimum stages. Empirical testing confirms the effectiveness of AACE, with experiments demonstrating improved performance in image classification tasks using Wide ResNet and PyramidNet across various datasets. The reproduction code is available online


title: Promise of Graph Sparsification and Decomposition for Noise Reduction in QAOA: Analysis for Trapped-Ion Compilations

abstract: We develop new approximate compilation schemes that significantly reduce the expense of compiling the Quantum Approximate Optimization Algorithm (QAOA) for solving the Max-Cut problem. Our main focus is on compilation with trapped-ion simulators using Pauli-$X$ operations and all-to-all Ising Hamiltonian $H_\text{Ising}$ evolution generated by Molmer-Sorensen or optical dipole force interactions, though some of our results also apply to standard gate-based compilations. Our results are based on principles of graph sparsification and decomposition; the former reduces the number of edges in a graph while maintaining its cut structure, while the latter breaks a weighted graph into a small number of unweighted graphs. Though these techniques have been used as heuristics in various hybrid quantum algorithms, there have been no guarantees on their performance, to the best of our knowledge. This work provides the first provable guarantees using sparsification and decomposition to improve quantum noise resilience and reduce quantum circuit complexity. For quantum hardware that uses edge-by-edge QAOA compilations, sparsification leads to a direct reduction in circuit complexity. For trapped-ion quantum simulators implementing all-to-all $H_\text{Ising}$ pulses, we show that for a $(1-\epsilon)$ factor loss in the Max-Cut approximation ($\epsilon>0)$, our compilations improve the (worst-case) number of $H_\text{Ising}$ pulses from $O(n^2)$ to $O(n\log(n/\epsilon))$ and the (worst-case) number of Pauli-$X$ bit flips from $O(n^2)$ to $O\left(\frac{n\log(n/\epsilon)}{\epsilon^2}\right)$ for $n$-node graphs. We demonstrate significant reductions in noise are obtained in our new compilation approaches using theory and numerical calculations for trapped-ion hardware. We anticipate these approximate compilation techniques will be useful tools in a variety of future quantum computing experiments.


title: Photonic and phononic modes in acoustoplasmonic toroidal nanopropellers

abstract: Non-conventional resonances, both acoustic and photonic, are found in metallic particles with a toroidal nanopropeller geometry that is generated by sweeping a three-lobed 2D-shape along a spiral with twisting angle, ${\alpha}$. For both optical and acoustic cases, spectral location of resonances experiences a red-shift as a function of ${\alpha}$. We demonstrate that the optical case can be understood as a natural evolution of resonances as the spiral length of the toroidal nanopropeller increases with ${\alpha}$, implying a huge helicity dependent absorption cross section. In the case of acoustic response, two red-shifting breathing modes are identified. Additionally, even small ${\alpha}$ allows the appearance of new low-frequency resonances, whose spectral dispersion depends on a competition between length of the generative spiral and the pitch of the toroidal nanopropeller.


title: Sufficient conditions for closed-trailable in digraphs

abstract: A digraph $D$ with a subset $S$ of $V(D)$ is called $\boldsymbol{S}${\bf -strong} if for every pair of distinct vertices $u$ and $v$ of $S$, there is a $(u, v)$-dipath and a $(v, u)$-dipath in $D$. We define a digraph $D$ with a subset $S$ of $V(D)$ to be $\boldsymbol{S}${\bf -strictly strong} if there exist two nonadjacent vertices $u,v\in S$ such that $D$ contains a closed ditrail through the vertices $u$ and $v$; and define a subset $S\subseteq V(D)$ to be {\bf closed-trailable} if $D$ contains a closed ditrail through all the vertices of $S$. In this paper, we prove that for a digraph $D$ with $n$ vertices and a subset $S$ of $V(D)$, if $D$ is $S$-strong and if $d(u) + d(v)\geq 2n -3$ for any two nonadjacent vertices $u,v$ of $S$, then $S$ is closed-trailable. This result generalizes the theorem of Bang-Jensen et al. \cite{BaMa14} on supereulerianity. Moveover, we show that for a digraph $D$ and a subset $S$ of $V(D)$, if $D$ is $S$-strictly strong and if $\delta^0(D\langle S\rangle)\geq\alpha'(D\langle S\rangle)>0$, where $\delta^0(D\langle S\rangle)$ is the minimum semi-degree of $D\langle S\rangle$ and $\alpha'(D\langle S\rangle)$ is the matching number of $D\langle S\rangle$, then $S$ is closed-trailable. This result generalizes the theorem of Algefari et al. \cite{AlLa15} on supereulerianity.


title: LARP: Language Audio Relational Pre-training for Cold-Start Playlist Continuation

abstract: As online music consumption increasingly shifts towards playlist-based listening, the task of playlist continuation, in which an algorithm suggests songs to extend a playlist in a personalized and musically cohesive manner, has become vital to the success of music streaming. Currently, many existing playlist continuation approaches rely on collaborative filtering methods to perform recommendation. However, such methods will struggle to recommend songs that lack interaction data, an issue known as the cold-start problem. Current approaches to this challenge design complex mechanisms for extracting relational signals from sparse collaborative data and integrating them into content representations. However, these approaches leave content representation learning out of scope and utilize frozen, pre-trained content models that may not be aligned with the distribution or format of a specific musical setting. Furthermore, even the musical state-of-the-art content modules are either (1) incompatible with the cold-start setting or (2) unable to effectively integrate cross-modal and relational signals. In this paper, we introduce LARP, a multi-modal cold-start playlist continuation model, to effectively overcome these limitations. LARP is a three-stage contrastive learning framework that integrates both multi-modal and relational signals into its learned representations. Our framework uses increasing stages of task-specific abstraction: within-track (language-audio) contrastive loss, track-track contrastive loss, and track-playlist contrastive loss. Experimental results on two publicly available datasets demonstrate the efficacy of LARP over uni-modal and multi-modal models for playlist continuation in a cold-start setting. Code and dataset are released at: https://github.com/Rsalganik1123/LARP.


title: The Bose-Marletto-Vedral proposal in different frames of reference and the quantum nature of gravity

abstract: Observing spatial entanglement in the Bose-Marletto-Vedral (BMV) experiment would demonstrate the existence of non-classical properties of the gravitational field. We show that the special relativistic invariance of the linear regime of general relativity implies that all the components of the gravitational potential must be non-classical. This is simply necessary in order to describe the BMV entanglement consistently across different inertial frames of reference. On the other hand, we show that the entanglement in accelerated frames could differ from that in stationary frames.


title: Self-supervised Interpretable Concept-based Models for Text Classification

abstract: Despite their success, Large-Language Models (LLMs) still face criticism as their lack of interpretability limits their controllability and reliability. Traditional post-hoc interpretation methods, based on attention and gradient-based analysis, offer limited insight into the model's decision-making processes. In the image field, Concept-based models have emerged as explainable-by-design architectures, employing human-interpretable features as intermediate representations. However, these methods have not been yet adapted to textual data, mainly because they require expensive concept annotations, which are impractical for real-world text data. This paper addresses this challenge by proposing a self-supervised Interpretable Concept Embedding Models (ICEMs). We leverage the generalization abilities of LLMs to predict the concepts labels in a self-supervised way, while we deliver the final predictions with an interpretable function. The results of our experiments show that ICEMs can be trained in a self-supervised way achieving similar performance to fully supervised concept-based models and end-to-end black-box ones. Additionally, we show that our models are (i) interpretable, offering meaningful logical explanations for their predictions; (ii) interactable, allowing humans to modify intermediate predictions through concept interventions; and (iii) controllable, guiding the LLMs' decoding process to follow a required decision-making path.


title: Exploring Spatial Representations in the Historical Lake District Texts with LLM-based Relation Extraction

abstract: Navigating historical narratives poses a challenge in unveiling the spatial intricacies of past landscapes. The proposed work addresses this challenge within the context of the English Lake District, employing the Corpus of the Lake District Writing. The method utilizes a generative pre-trained transformer model to extract spatial relations from the textual descriptions in the corpus. The study applies this large language model to understand the spatial dimensions inherent in historical narratives comprehensively. The outcomes are presented as semantic triples, capturing the nuanced connections between entities and locations, and visualized as a network, offering a graphical representation of the spatial narrative. The study contributes to a deeper comprehension of the English Lake District's spatial tapestry and provides an approach to uncovering spatial relations within diverse historical contexts.


title: Fast Convergence to Second-Order Stationary Point through Random Subspace Optimization

abstract: We propose the Random Subspace Homogenized Trust Region (RSHTR) method, which efficiently solves high-dimensional non-convex optimization problems by identifying descent directions within randomly selected subspaces. RSHTR provides the strongest theoretical guarantees among random subspace algorithms for non-convex optimization, achieving an $\varepsilon$-approximate first-order stationary point in $O(\varepsilon^{-3/2})$ iterations and converging locally at a linear rate. Furthermore, under rank-deficient conditions, RSHTR satisfies $\varepsilon$-approximate second-order necessary condition in $O(\varepsilon^{-3/2})$ iterations and exhibits a local quadratic convergence.


title: Adaptive Robust Controller for handling Unknown Uncertainty of Robotic Manipulators

abstract: The ability to achieve precise and smooth trajectory tracking is crucial for ensuring the successful execution of various tasks involving robotic manipulators. State-of-the-art techniques require accurate mathematical models of the robot dynamics, and robustness to model uncertainties is achieved by relying on precise bounds on the model mismatch. In this paper, we propose a novel adaptive robust feedback linearization scheme able to compensate for model uncertainties without any a-priori knowledge on them, and we provide a theoretical proof of convergence under mild assumptions. We evaluate the method on a simulated RR robot. First, we consider a nominal model with known model mismatch, which allows us to compare our strategy with state-of-the-art uncertainty-aware methods. Second, we implement the proposed control law in combination with a learned model, for which uncertainty bounds are not available. Results show that our method leads to performance comparable to uncertainty-aware methods while requiring less prior knowledge.


title: Mixed multiquadratic splitting fields

abstract: We study mixed multiquadratic field extensions as splitting fields for central simple algebras of exponent $2$ in characteristic $2$. As an application, we provide examples of nonexcellent mixed biquadratic field extensions.


title: Learning rate adaptive stochastic gradient descent optimization methods: numerical simulations for deep learning methods for partial differential equations and convergence analyses

abstract: It is known that the standard stochastic gradient descent (SGD) optimization method, as well as accelerated and adaptive SGD optimization methods such as the Adam optimizer fail to converge if the learning rates do not converge to zero (as, for example, in the situation of constant learning rates). Numerical simulations often use human-tuned deterministic learning rate schedules or small constant learning rates. The default learning rate schedules for SGD optimization methods in machine learning implementation frameworks such as TensorFlow and Pytorch are constant learning rates. In this work we propose and study a learning-rate-adaptive approach for SGD optimization methods in which the learning rate is adjusted based on empirical estimates for the values of the objective function of the considered optimization problem (the function that one intends to minimize). In particular, we propose a learning-rate-adaptive variant of the Adam optimizer and implement it in case of several neural network learning problems, particularly, in the context of deep learning approximation methods for partial differential equations such as deep Kolmogorov methods, physics-informed neural networks, and deep Ritz methods. In each of the presented learning problems the proposed learning-rate-adaptive variant of the Adam optimizer faster reduces the value of the objective function than the Adam optimizer with the default learning rate. For a simple class of quadratic minimization problems we also rigorously prove that a learning-rate-adaptive variant of the SGD optimization method converges to the minimizer of the considered minimization problem. Our convergence proof is based on an analysis of the laws of invariant measures of the SGD method as well as on a more general convergence analysis for SGD with random but predictable learning rates which we develop in this work.