title: Babysit A Language Model From Scratch: Interactive Language Learning by Trials and Demonstrations

abstract: Humans are efficient language learners and inherently social creatures. Our language development is largely shaped by our social interactions, for example, the demonstration and feedback from caregivers. Contrary to human language learning, recent advancements in large language models have primarily adopted a non-interactive training paradigm, and refined pre-trained models through feedback afterward. In this work, we aim to examine how corrective feedback from interactions influences neural language acquisition from the ground up through systematically controlled experiments, assessing whether it contributes to learning efficiency in language models. We introduce a trial-and-demonstration (TnD) learning framework that incorporates three components: student trials, teacher demonstrations, and a reward conditioned on language competence at various developmental stages. Our experiments reveal that the TnD approach accelerates word acquisition for student models of equal and smaller numbers of parameters, and we highlight the significance of both trials and demonstrations. We further show that the teacher's choices of words influence students' word-specific learning efficiency, and a practice-makes-perfect effect is evident by a strong correlation between the frequency of words in trials and their respective learning curves. Our findings suggest that interactive language learning, with teacher demonstrations and student trials, can facilitate efficient word learning in language models.


title: Iarrobino's decomposition for self-dual modules

abstract: We investigate self-dual modules and their Hilbert functions. We generalize Iarrobino's decomposition to this setup and deduce consequences for their local Hilbert functions. We classify the local Hilbert functions for small degree modules. We prove a generalization of Kunte's criterion for self-duality in terms of Macaulay's inverse systems.


title: One loop effective actions in Kerr-(A)dS Black Holes

abstract: We compute new exact analytic expressions for one-loop scalar effective actions in Kerr (A)dS black hole (BH) backgrounds in four and five dimensions. These are computed by the connection coefficients of the Heun equation via a generalization of the Gelfand-Yaglom formalism to second-order linear ODEs with regular singularities. The expressions we find are in terms of Nekrasov-Shatashvili special functions, making explicit the analytic properties of the one-loop effective actions with respect to the gravitational parameters and the precise contributions of the quasi-normal modes. The latter arise via an associated integrable system. In particular, we prove asymptotic formulae for large angular momenta in terms of hypergeometric functions and give a precise mathematical meaning to Rindler-like region contributions. Moreover we identify the leading terms in the large distance expansion as the point particle approximation of the BH and their finite size corrections as encoding the BH tidal response. We also discuss exact properties of the thermal version of the BH effective actions. Although we focus on the real scalar field in dS-Kerr and (A)dS-Schwarzschild in four and five dimensions, similar formulae can be given for higher spin matter and radiation fields in more general gravitational backgrounds.


title: Enhancing Smart Grids with Internet of Energy: Deep Reinforcement Learning and Convolutional Neural Network

abstract: The increasing demand for electricity, coupled with the rise in greenhouse gas emissions, necessitates the integration of Renewable Energy Sources (RESs) into power grids. However, the fluctuating nature of RESs introduces new challenges in energy management. The Internet of Energy (IoE) framework provides a solution by enabling real-time monitoring, dynamic scheduling, and enhanced energy routing. This paper proposes a comprehensive approach to optimizing energy management in smart grids using Deep Reinforcement Learning (DRL) and Convolutional Neural Networks (CNN). The research focuses on three main objectives: optimizing operation scheduling, improving energy routing, and enhancing cyber-physical security. A DRL-based scheduling algorithm is developed to manage energy components effectively, while an optimized energy routing algorithm ensures efficient electricity flow. Additionally, a security framework utilizing Long Short-Term Memory (LSTM) and CNN is proposed to detect False Data Injection (FDI) attacks and electricity theft. The proposed methods aim to improve energy efficiency, reduce costs, and ensure the security of IoE-enabled power systems. This research bridges existing gaps by addressing the dynamic and complex nature of modern energy networks. The integration of these advanced technologies promises significant advancements in the reliability and efficiency of smart grids. Ultimately, this work contributes to the development of a sustainable and secure energy future.


title: Federated Learning in Healthcare: Model Misconducts, Security, Challenges, Applications, and Future Research Directions -- A Systematic Review

abstract: Data privacy has become a major concern in healthcare due to the increasing digitization of medical records and data-driven medical research. Protecting sensitive patient information from breaches and unauthorized access is critical, as such incidents can have severe legal and ethical complications. Federated Learning (FL) addresses this concern by enabling multiple healthcare institutions to collaboratively learn from decentralized data without sharing it. FL's scope in healthcare covers areas such as disease prediction, treatment customization, and clinical trial research. However, implementing FL poses challenges, including model convergence in non-IID (independent and identically distributed) data environments, communication overhead, and managing multi-institutional collaborations. A systematic review of FL in healthcare is necessary to evaluate how effectively FL can provide privacy while maintaining the integrity and usability of medical data analysis. In this study, we analyze existing literature on FL applications in healthcare. We explore the current state of model security practices, identify prevalent challenges, and discuss practical applications and their implications. Additionally, the review highlights promising future research directions to refine FL implementations, enhance data security protocols, and expand FL's use to broader healthcare applications, which will benefit future researchers and practitioners.


title: Flavor dependence of unpolarized quark Transverse Momentum Distributions from a global fit

abstract: We present an extraction of the unpolarized transverse-momentum-dependent parton distribution and fragmentation functions that takes into account possible differences between quark flavors and final-state hadrons. The extraction is based on experimental measurements from Drell-Yan processes and semi-inclusive deep-inelastic scattering, whose combination is essential to distinguish flavor differences. The analysis is carried out at N$^3$LL accuracy. The extracted flavor-dependent distributions give a very good description of the data ($\chi^2/N_{\rm dat} = 1.08$). The resulting uncertainties take fully into account also the uncertainties in the determination of the corresponding collinear distributions.


title: Constraining photon trajectories in black hole shadows

abstract: We examine the shadow cast by a Kerr black hole, focusing on constraints on photons corresponding to different shadow boundaries. The photons are related to different orbital ranges and impact parameter values, creating a map of the shadow boundaries. Our analysis fixes also the conditions under which it is possible to observe an "imprint" of the black hole (outer) ergosurface and (outer) ergoregion on the Kerr black hole shadow boundary. The counter-rotating case resulted strongly constrained with respect to the co-rotating case, constituting a remarkable and significant difference where the counter-rotating component associated with the shadow boundary is strongly distinct from the co-rotating one. However, in this framework, even the co-rotating photons imply restrictions on conditions on the spins and planes, which are bounded by limiting values. We believe the results found here, being a tracer for the central black hole, can constitute new templates for the ongoing observations.


title: Unbounded order demi Dunford-Pettis operators

abstract: In this paper, we introduce and study a new concept of unbounded order demi Dunford-Pettis operators. Namely, we investigate some properties for this new class of operators and we study its connection with other known operators, we also establish important results about power unbounded order demi Dunford-Pettis operators, and domination property.


title: Generalized topological complexity and its monoidal version

abstract: In the context of the Lusternik-Schnirelmann category, researcher T. Srinivasan demonstrated that when the space under consideration is an absolute neighborhood retract, its category can be realized through arbitrary subsets, not necessarily open ones. The primary aim of this survey is to illustrate how this result has been extended to the case of topological complexity and its monoidal version, along with some of its most significant implications.


title: Direct observation of linear dispersion close to the Fermi level in the topological semimetal WTe$_2$ through Landau quantization at atomic scale

abstract: We study the topological Weyl type-II semimetal WTe$_2$ via Scanning Tunneling Microscopy (STM) and Density Functional Theory calculations (DFT). We succesfully determine the band structure at zero field close to the Fermi level by comparing quasiparticle interference (QPI) experiments with DFT. Under magnetic fields, we observe Landau level quantization on atomic scale measurements and find a level sequence evidencing a linearly dispersing portion of the band structure. Our results establish the long sought connection between Weyl cones and Landau quantization in WTe$_2$. Atomic scale Landau quantization emerges as a powerful probe of topological surface states for semimetals, superconductors and topological insulators.


title: Equidistribution of graphs of holomorphic correspondences

abstract: Let $X$ be a compact Riemann surface. Let $f$ be a holomorphic self-correspondence of $X$ with dynamical degrees $d_1$ and $d_2$. Assume that $d_1\neq d_2$ or $f$ is non-weakly modular. We show that the graphs of the iterates $f^n$ of $f$ are equidistributed exponentially fast with respect to a positive closed current in $X\times X$.


title: Diffusing Winding Gradients (DWG): A Parallel and Scalable Method for 3D Reconstruction from Unoriented Point Clouds

abstract: This paper presents a method for reconstructing watertight 3D surfaces from unoriented point clouds. Starting with randomly initialized normals, the method iteratively refines each normal by diffusing the gradient of the generalized winding number (GWN) field. Upon convergence, the target surface is extracted using the standard Marching Cubes algorithm. Our method is conceptually simple, easy to implement, and does not require numerical solvers, which distinguishes it from existing approaches. Designed for parallelization and scalability, it efficiently handles large-scale models on both CPUs and GPUs. Experimental results demonstrate that our method outperforms all existing methods in reconstructing from unoriented point clouds, particularly in terms of runtime performance. On large-scale models with 10 to 20 million points, our CUDA implementation on an NVIDIA GTX 4090 GPU is typically 30-100x faster than iPSR, the leading sequential method tested on a high-end PC with an Intel i9 CPU. Furthermore, our approach exhibits superior robustness against noise and effectively handles models with thin structures, surpassing existing methods. We will make the source code publicly available to encourage further research and applications.


title: Asymptotic behaviour of the confidence region in orbit determination for hyperbolic maps with a parameter

abstract: When dealing with an orbit determination problem, uncertainties naturally arise from intrinsic errors related to observation devices and approximation models. Following the least squares method and applying approximation schemes such as the differential correction, uncertainties can be geometrically summarized in confidence regions and estimated by confidence ellipsoids. We investigate the asymptotic behaviour of the confidence ellipsoids while the number of observations and the time span over which they are performed simultaneously increase. Numerical evidences suggest that, in the chaotic scenario, the uncertainties decay at different rates whether the orbit determination is set up to recover the initial conditions alone or along with a dynamical or kinematical parameter, while in the regular case there is no distinction. We show how to improve some of the results in \cite{maro.bonanno}, providing conditions that imply a non-faster-than-polynomial rate of decay in the chaotic case with the parameter, in accordance with the numerical experiments. We also apply these findings to well known examples of chaotic maps, such as piecewise expanding maps of the unit interval or affine hyperbolic toral transformations. We also discuss the applicability to intermittent maps.


title: Robot Explanation Identity

abstract: To bring robots into human everyday life, their capacity for social interaction must increase. One way for robots to acquire social skills is by assigning them the concept of identity. This research focuses on the concept of \textit{Explanation Identity} within the broader context of robots' roles in society, particularly their ability to interact socially and explain decisions. Explanation Identity refers to the combination of characteristics and approaches robots use to justify their actions to humans. Drawing from different technical and social disciplines, we introduce Explanation Identity as a multidisciplinary concept and discuss its importance in Human-Robot Interaction. Our theoretical framework highlights the necessity for robots to adapt their explanations to the user's context, demonstrating empathy and ethical integrity. This research emphasizes the dynamic nature of robot identity and guides the integration of explanation capabilities in social robots, aiming to improve user engagement and acceptance.


title: On Nash-Williams' Theorem regarding sequences with finite range

abstract: The famous theorem of Higman states that for any well-quasi-order (wqo) $Q$ the embeddability order on finite sequences over $Q$ is also wqo. In his celebrated 1965 paper, Nash-Williams established that the same conclusion holds even for all the transfinite sequences with finite range, thus proving a far reaching generalization of Higman's theorem. In the present paper we show that Nash-Williams' Theorem is provable in the system $\mathsf{ATR}_0$ of second-order arithmetic, thus solving an open problem by Antonio Montalb\'an and proving the reverse-mathematical equivalence of Nash-Williams' Theorem and $\mathsf{ATR}_0$. In order to accomplish this, we establish equivalent characterization of transfinite Higman's order and an order on the cumulative hierarchy with urelements from the starting wqo $Q$, and find some new connection that can be of purely order-theoretic interest. Moreover, in this paper we present a new setup that allows us to develop the theory of $\alpha$-wqo's in a way that is formalizable within primitive-recursive set theory with urelements, in a smooth and code-free fashion.


title: Hyperspectral Image Reconstruction for Predicting Chick Embryo Mortality Towards Advancing Egg and Hatchery Industry

abstract: As the demand for food surges and the agricultural sector undergoes a transformative shift towards sustainability and efficiency, the need for precise and proactive measures to ensure the health and welfare of livestock becomes paramount. In the context of the broader agricultural landscape outlined, the application of Hyperspectral Imaging (HSI) takes on profound significance. HSI has emerged as a cutting-edge, non-destructive technique for fast and accurate egg quality analysis, including the detection of chick embryo mortality. However, the high cost and operational complexity compared to conventional RGB imaging are significant bottlenecks in the widespread adoption of HSI technology. To overcome these hurdles and unlock the full potential of HSI, a promising solution is hyperspectral image reconstruction from standard RGB images. This study aims to reconstruct hyperspectral images from RGB images for non-destructive early prediction of chick embryo mortality. Firstly, the performance of different image reconstruction algorithms, such as HRNET, MST++, Restormer, and EDSR were compared to reconstruct the hyperspectral images of the eggs in the early incubation period. Later, the reconstructed spectra were used to differentiate live from dead chick-producing eggs using the XGBoost and Random Forest classification methods. Among the reconstruction methods, HRNET showed impressive reconstruction performance with MRAE of 0.0955, RMSE of 0.0159, and PSNR of 36.79 dB. This study motivated that harnessing imaging technology integrated with smart sensors and data analytics has the potential to improve automation, enhance biosecurity, and optimize resource management towards sustainable agriculture 4.0.


title: Causal Inference with Cocycles

abstract: Many interventions in causal inference can be represented as transformations. We identify a local symmetry property satisfied by a large class of causal models under such interventions. Where present, this symmetry can be characterized by a type of map called a cocycle, an object that is central to dynamical systems theory. We show that such cocycles exist under general conditions and are sufficient to identify interventional and counterfactual distributions. We use these results to derive cocycle-based estimators for causal estimands and show they achieve semiparametric efficiency under typical conditions. Since (infinitely) many distributions can share the same cocycle, these estimators make causal inference robust to mis-specification by sidestepping superfluous modelling assumptions. We demonstrate both robustness and state-of-the-art performance in several simulations, and apply our method to estimate the effects of 401(k) pension plan eligibility on asset accumulation using a real dataset.


title: Semantic Density: Uncertainty Quantification in Semantic Space for Large Language Models

abstract: With the widespread application of Large Language Models (LLMs) to various domains, concerns regarding the trustworthiness of LLMs in safety-critical scenarios have been raised, due to their unpredictable tendency to hallucinate and generate misinformation. Existing LLMs do not have an inherent functionality to provide the users with an uncertainty metric for each response it generates, making it difficult to evaluate trustworthiness. Although a number of works aim to develop uncertainty quantification methods for LLMs, they have fundamental limitations, such as being restricted to classification tasks, requiring additional training and data, considering only lexical instead of semantic information, and being prompt-wise but not response-wise. A new framework is proposed in this paper to address these issues. Semantic density extracts uncertainty information for each response from a probability distribution perspective in semantic space. It has no restriction on task types and is "off-the-shelf" for new models and tasks. Experiments on seven state-of-the-art LLMs, including the latest Llama 3 and Mixtral-8x22B models, on four free-form question-answering benchmarks demonstrate the superior performance and robustness of semantic density compared to prior approaches.


title: Regression Trees Know Calculus

abstract: Regression trees have emerged as a preeminent tool for solving real-world regression problems due to their ability to deal with nonlinearities, interaction effects and sharp discontinuities. In this article, we rather study regression trees applied to well-behaved, differentiable functions, and determine the relationship between node parameters and the local gradient of the function being approximated. We find a simple estimate of the gradient which can be efficiently computed using quantities exposed by popular tree learning libraries. This allows the tools developed in the context of differentiable algorithms, like neural nets and Gaussian processes, to be deployed to tree-based models. To demonstrate this, we study measures of model sensitivity defined in terms of integrals of gradients and demonstrate how to compute them for regression trees using the proposed gradient estimates. Quantitative and qualitative numerical experiments reveal the capability of gradients estimated by regression trees to improve predictive analysis, solve tasks in uncertainty quantification, and provide interpretation of model behavior.


title: AI-Protected Blockchain-based IoT environments: Harnessing the Future of Network Security and Privacy

abstract: Integrating blockchain technology with the Internet of Things offers transformative possibilities for enhancing network security and privacy in the contemporary digital landscape, where interconnected devices and expansive networks are ubiquitous. This paper explores the pivotal role of artificial intelligence in bolstering blockchain-enabled IoT systems, potentially marking a significant leap forward in safeguarding data integrity and confidentiality across networks. Blockchain technology provides a decentralized and immutable ledger, ideal for the secure management of device identities and transactions in IoT networks. When coupled with AI, these systems gain the ability to not only automate and optimize security protocols but also adaptively respond to new and evolving cyber threats. This dual capability enhances the resilience of networks against cyber-attacks, a critical consideration as IoT devices increasingly permeate critical infrastructures. The synergy between AI and blockchain in IoT is profound. AI algorithms can analyze vast amounts of data from IoT devices to detect patterns and anomalies that may signify security breaches. Concurrently, blockchain can ensure that data records are tamper-proof, enhancing the reliability of AI-driven security measures. Moreover, this research evaluates the implications of AI-enhanced blockchain systems on privacy protection within IoT networks. IoT devices often collect sensitive personal data, making privacy a paramount concern. AI can facilitate the development of new protocols that ensure data privacy and user anonymity without compromising the functionality of IoT systems. Through comprehensive analysis and case studies, this paper aims to provide an in-depth understanding of how AI-enhanced blockchain technology can revolutionize network security and privacy in IoT environments.


title: Maximum Manifold Capacity Representations in State Representation Learning

abstract: The expanding research on manifold-based self-supervised learning (SSL) builds on the manifold hypothesis, which suggests that the inherent complexity of high-dimensional data can be unraveled through lower-dimensional manifold embeddings. Capitalizing on this, DeepInfomax with an unbalanced atlas (DIM-UA) has emerged as a powerful tool and yielded impressive results for state representations in reinforcement learning. Meanwhile, Maximum Manifold Capacity Representation (MMCR) presents a new frontier for SSL by optimizing class separability via manifold compression. However, MMCR demands extensive input views, resulting in significant computational costs and protracted pre-training durations. Bridging this gap, we present an innovative integration of MMCR into existing SSL methods, incorporating a discerning regularization strategy that enhances the lower bound of mutual information. We also propose a novel state representation learning method extending DIM-UA, embedding a nuclear norm loss to enforce manifold consistency robustly. On experimentation with the Atari Annotated RAM Interface, our method improves DIM-UA significantly with the same number of target encoding dimensions. The mean F1 score averaged over categories is 78% compared to 75% of DIM-UA. There are also compelling gains when implementing SimCLR and Barlow Twins. This supports our SSL innovation as a paradigm shift, enabling more nuanced high-dimensional data representations.


title: Degenerate parabolic $p$-Laplacian equations: existence, uniqueness and asymptotic behavior of solutions

abstract: In this paper we study the degenerate parabolic $p$-Laplacian, $ \partial_t u - v^{-1}{\rm div}(|\sqrt{Q} \nabla u|^{p-2} Q \nabla u)=0$, where the degeneracy is controlled by a matrix $Q$ and a weight $v$. With mild integrability assumptions on $Q$ and $v$, we prove the existence and uniqueness of solutions on any interval $[0,T]$. If we further assume the existence of a degenerate Sobolev inequality with gain, the degeneracy again controlled by $v$ and $Q$, then we can prove both finite time extinction and ultracontractive bounds. Moreover, we show that there is equivalence between the existence of ultracontractive bounds and the weighted Sobolev inequality.


title: Enhancing lattice kinetic schemes for fluid dynamics with Lattice-Equivariant Neural Networks

abstract: We present a new class of equivariant neural networks, hereby dubbed Lattice-Equivariant Neural Networks (LENNs), designed to satisfy local symmetries of a lattice structure. Our approach develops within a recently introduced framework aimed at learning neural network-based surrogate models Lattice Boltzmann collision operators. Whenever neural networks are employed to model physical systems, respecting symmetries and equivariance properties has been shown to be key for accuracy, numerical stability, and performance. Here, hinging on ideas from group representation theory, we define trainable layers whose algebraic structure is equivariant with respect to the symmetries of the lattice cell. Our method naturally allows for efficient implementations, both in terms of memory usage and computational costs, supporting scalable training/testing for lattices in two spatial dimensions and higher, as the size of symmetry group grows. We validate and test our approach considering 2D and 3D flowing dynamics, both in laminar and turbulent regimes. We compare with group averaged-based symmetric networks and with plain, non-symmetric, networks, showing how our approach unlocks the (a-posteriori) accuracy and training stability of the former models, and the train/inference speed of the latter networks (LENNs are about one order of magnitude faster than group-averaged networks in 3D). Our work opens towards practical utilization of machine learning-augmented Lattice Boltzmann CFD in real-world simulations.


title: Analysis of ion chain sympathetic cooling and gate dynamics

abstract: Sympathetic cooling is a technique often employed to mitigate motional heating in trapped-ion quantum computers. However, choosing system parameters such as number of coolants and cooling duty cycle for optimal gate performance requires evaluating trade-offs between motional errors and other slower errors such as qubit dephasing. The optimal parameters depend on cooling power, heating rate, and ion spacing in a particular system. In this study, we aim to analyze best practices for sympathetic cooling of long chains of trapped ions using analytical and computational methods. We use a case study to show that optimal cooling performance is achieved when coolants are placed at the center of the chain and provide a perturbative upper-bound on the cooling limit of a mode given a particular set of cooling parameters. In addition, using computational tools, we analyze the trade-off between the number of coolant ions in a chain and the center-of-mass mode heating rate. We also show that cooling as often as possible when running a circuit is optimal when the qubit coherence time is otherwise long. These results provide a roadmap for how to choose sympathetic cooling parameters to maximize circuit performance in trapped ion quantum computers using long chains of ions.


title: Predicting long time contributors with knowledge units of programming languages: an empirical study

abstract: Predicting potential long-time contributors (LTCs) early allows project maintainers to effectively allocate resources and mentoring to enhance their development and retention. Mapping programming language expertise to developers and characterizing projects in terms of how they use programming languages can help identify developers who are more likely to become LTCs. However, prior studies on predicting LTCs do not consider programming language skills. This paper reports an empirical study on the usage of knowledge units (KUs) of the Java programming language to predict LTCs. A KU is a cohesive set of key capabilities that are offered by one or more building blocks of a given programming language. We build a prediction model called KULTC, which leverages KU-based features along five different dimensions. We detect and analyze KUs from the studied 75 Java projects (353K commits and 168K pull requests) as well as 4,219 other Java projects in which the studied developers previously worked (1.7M commits). We compare the performance of KULTC with the state-of-the-art model, which we call BAOLTC. Even though KULTC focuses exclusively on the programming language perspective, KULTC achieves a median AUC of at least 0.75 and significantly outperforms BAOLTC. Combining the features of KULTC with the features of BAOLTC results in an enhanced model (KULTC+BAOLTC) that significantly outperforms BAOLTC with a normalized AUC improvement of 16.5%. Our feature importance analysis with SHAP reveals that developer expertise in the studied project is the most influential feature dimension for predicting LTCs. Finally, we develop a cost-effective model (KULTC_DEV_EXP+BAOLTC) that significantly outperforms BAOLTC. These encouraging results can be helpful to researchers who wish to further study the developers' engagement/retention to FLOSS projects or build models for predicting LTCs.


title: Symmetries of weight 6 multiple polylogarithms and Goncharov's Depth Conjecture

abstract: We prove that the weight 6, depth 3, multiple polylogarithm $ \mathrm{Li}_{4,1,1}((xyz)^{-1}, x, y) $, or rather its more natural `divergent' incarnation $ \mathrm{Li}_{3;1,1,1}(x,y,z) $, satisfies the 6-fold anharmonic symmetries of the dilogarithm $ \mathrm{Li}_2 $, $ \lambda \mapsto 1-\lambda $ and $ \lambda \mapsto \lambda^{-1} $, in each of $x$, $y$ and $z$ independently, modulo terms of depth $ \leq2 $. This establishes the `higher Zagier' part of the weight 6, depth 3, reduction conjectured by Matveiakin and Rudenko. Together with their proof of the `higher Gangl' part of the weight 6, depth 3, reduction (which is formulated modulo the `higher Zagier' part), we establish Goncharov's Depth Conjecture in the case of weight 6, depth 3.


title: On the dynamics of convolutional recurrent neural networks near their critical point

abstract: We examine the dynamical properties of a single-layer convolutional recurrent network with a smooth sigmoidal activation function, for small values of the inputs and when the convolution kernel is unitary, so all eigenvalues lie exactly at the unit circle. Such networks have a variety of hallmark properties: the outputs depend on the inputs via compressive nonlinearities such as cubic roots, and both the timescales of relaxation and the length-scales of signal propagation depend sensitively on the inputs as power laws, both diverging as the input to 0. The basic dynamical mechanism is that inputs to the network generate ongoing activity, which in turn controls how additional inputs or signals propagate spatially or attenuate in time. We present analytical solutions for the steady states when the network is forced with a single oscillation and when a background value creates a steady state of ongoing activity, and derive the relationships shaping the value of the temporal decay and spatial propagation length as a function of this background value.


title: Consistent expansion of the Langevin propagator with application to entropy production

abstract: Stochastic thermodynamics is a developing theory for systems out of thermal equilibrium. It allows to formulate a wealth of nontrivial relations among thermodynamic quantities such as heat dissipation, excess work, and entropy production in generic nonequilibrium stochastic processes. A key quantity for the derivation of these relations is the propagator - the probability to observe a transition from one point in phase space to another after a given time. Here, applying stochastic Taylor expansions, we devise a formal expansion procedure for the propagator of overdamped Langevin dynamics. The three leading orders are obtained explicitly. The technique resolves the shortcomings of the current mathematical machinery for the calculation of the propagator. For the evaluation of the first two displacement cumulants, the leading order Gaussian propagator is sufficient. However, some functionals of the propagator - such as the entropy production - which we refer to as "first derivatives of the trajectory", need to be evaluated to a previously-unrecognized higher order. The method presented here can be extended to arbitrarily higher orders in order to accurately compute any other functional of the propagator.


title: In-beam $\gamma-$spectroscopy of the transitional nucleus $^{217}$Ac

abstract: High-spin states in the transitional $^{217}$Ac nucleus are established up to 3.8 MeV excitation energy and $I^{\pi} =$ 41/2$^+$ with the addition of around 20 new transitions. The structure of the yrast and near-yrast states below the 29/2$^+$ isomer is revisited. The inconsistencies in the level schemes reported earlier are resolved. The level structure above the 29/2$^+$ isomer is established for the first time. Large-basis shell-model calculations with the KHPE interaction are performed to compare the experimentally observed level energies with the theoretical predictions. A comparison with the systematics of the N = 128 isotones suggests that the yrast structures result from a weak coupling of the odd proton to the even-even 216Ra core, which is consistent with the shell-model configurations. Furthermore, alpha decay of the 29/2$^+$ isomer is revisited and the decay scheme established from this work is discussed in the framework of the shell model.


title: What Do Privacy Advertisements Communicate to Consumers?

abstract: When companies release marketing materials aimed at promoting their privacy practices or highlighting specific privacy features, what do they actually communicate to consumers? In this paper, we explore the impact of privacy marketing on: (1) consumers' attitudes toward the organizations providing the campaigns, (2) overall privacy awareness, and (3) the actionability of suggested privacy advice. To this end, we investigated the impact of four privacy advertising videos and one privacy game published by five different technology companies. We conducted 24 semi-structured interviews with participants randomly assigned to view one or two of the videos or play the game. Our findings suggest that awareness of privacy features can contribute to positive perceptions of a company or its products. The ads we tested were more successful in communicating the advertised privacy features than the game we tested. We observed that advertising a single privacy feature using a single metaphor in a short ad increased awareness of the advertised feature. The game failed to communicate privacy features or motivate study participants to use the features. Our results also suggest that privacy campaigns can be useful for raising awareness about privacy features and improving brand image, but may not be the most effective way to teach viewers how to use privacy features.


title: Carbon Connect: An Ecosystem for Sustainable Computing

abstract: Computing is at a moment of profound opportunity. Emerging applications -- such as capable artificial intelligence, immersive virtual realities, and pervasive sensor systems -- drive unprecedented demand for computer. Despite recent advances toward net zero carbon emissions, the computing industry's gross energy usage continues to rise at an alarming rate, outpacing the growth of new energy installations and renewable energy deployments. A shift towards sustainability is needed to spark a transformation in how computer systems are manufactured, allocated, and consumed. Carbon Connect envisions coordinated research thrusts that produce design and management strategies for sustainable, next-generation computer systems. These strategies must flatten and then reverse growth trajectories for computing power and carbon for society's most rapidly growing applications such as artificial intelligence and virtual spaces. We will require accurate models for carbon accounting in computing technology. For embodied carbon, we must re-think conventional design strategies -- over-provisioned monolithic servers, frequent hardware refresh cycles, custom silicon -- and adopt life-cycle design strategies that more effectively reduce, reuse and recycle hardware at scale. For operational carbon, we must not only embrace renewable energy but also design systems to use that energy more efficiently. Finally, new hardware design and management strategies must be cognizant of economic policy and regulatory landscape, aligning private initiatives with societal goals. Many of these broader goals will require computer scientists to develop deep, enduring collaborations with researchers in economics, law, and industrial ecology to spark change in broader practice.


title: QGait: Toward Accurate Quantization for Gait Recognition with Binarized Input

abstract: Existing deep learning methods have made significant progress in gait recognition. Typically, appearance-based models binarize inputs into silhouette sequences. However, mainstream quantization methods prioritize minimizing task loss over quantization error, which is detrimental to gait recognition with binarized inputs. Minor variations in silhouette sequences can be diminished in the network's intermediate layers due to the accumulation of quantization errors. To address this, we propose a differentiable soft quantizer, which better simulates the gradient of the round function during backpropagation. This enables the network to learn from subtle input perturbations. However, our theoretical analysis and empirical studies reveal that directly applying the soft quantizer can hinder network convergence. We further refine the training strategy to ensure convergence while simulating quantization errors. Additionally, we visualize the distribution of outputs from different samples in the feature space and observe significant changes compared to the full precision network, which harms performance. Based on this, we propose an Inter-class Distance-guided Distillation (IDD) strategy to preserve the relative distance between the embeddings of samples with different labels. Extensive experiments validate the effectiveness of our approach, demonstrating state-of-the-art accuracy across various settings and datasets. The code will be made publicly available.


title: MAGIC: Map-Guided Few-Shot Audio-Visual Acoustics Modeling

abstract: Few-shot audio-visual acoustics modeling seeks to synthesize the room impulse response in arbitrary locations with few-shot observations. To sufficiently exploit the provided few-shot data for accurate acoustic modeling, we present a *map-guided* framework by constructing acoustic-related visual semantic feature maps of the scenes. Visual features preserve semantic details related to sound and maps provide explicit structural regularities of sound propagation, which are valuable for modeling environment acoustics. We thus extract pixel-wise semantic features derived from observations and project them into a top-down map, namely the **observation semantic map**. This map contains the relative positional information among points and the semantic feature information associated with each point. Yet, limited information extracted by few-shot observations on the map is not sufficient for understanding and modeling the whole scene. We address the challenge by generating a **scene semantic map** via diffusing features and anticipating the observation semantic map. The scene semantic map then interacts with echo encoding by a transformer-based encoder-decoder to predict RIR for arbitrary speaker-listener query pairs. Extensive experiments on Matterport3D and Replica dataset verify the efficacy of our framework.


title: Transformers Learn Temporal Difference Methods for In-Context Reinforcement Learning

abstract: In-context learning refers to the learning ability of a model during inference time without adapting its parameters. The input (i.e., prompt) to the model (e.g., transformers) consists of both a context (i.e., instance-label pairs) and a query instance. The model is then able to output a label for the query instance according to the context during inference. A possible explanation for in-context learning is that the forward pass of (linear) transformers implements iterations of gradient descent on the instance-label pairs in the context. In this paper, we prove by construction that transformers can also implement temporal difference (TD) learning in the forward pass, a phenomenon we refer to as in-context TD. We demonstrate the emergence of in-context TD after training the transformer with a multi-task TD algorithm, accompanied by theoretical analysis. Furthermore, we prove that transformers are expressive enough to implement many other policy evaluation algorithms in the forward pass, including residual gradient, TD with eligibility trace, and average-reward TD.


title: On the properties of qudits

abstract: Motivated by the growing interest in the applications of quantum information science in astrophysical settings, especially for the neutrino transport in compact objects where three-flavors of neutrinos need to be mapped on qutrits, we review properties of one- and two-qudit systems. We contrast two-qubit and two-qudits systems by pointing out how some of the properties of two-qubit systems generalize to higher dimensions and explore emerging new properties for dimensions three or higher. One example is provided by the Werner states: when the density operator is written in the fundamental representation, we show that only two-qubit Werner states can be pure states, but not two-qudit Werner states when the qudit dimension is larger than two.


title: Dynamic Model Predictive Shielding for Provably Safe Reinforcement Learning

abstract: Among approaches for provably safe reinforcement learning, Model Predictive Shielding (MPS) has proven effective at complex tasks in continuous, high-dimensional state spaces, by leveraging a backup policy to ensure safety when the learned policy attempts to take risky actions. However, while MPS can ensure safety both during and after training, it often hinders task progress due to the conservative and task-oblivious nature of backup policies. This paper introduces Dynamic Model Predictive Shielding (DMPS), which optimizes reinforcement learning objectives while maintaining provable safety. DMPS employs a local planner to dynamically select safe recovery actions that maximize both short-term progress as well as long-term rewards. Crucially, the planner and the neural policy play a synergistic role in DMPS. When planning recovery actions for ensuring safety, the planner utilizes the neural policy to estimate long-term rewards, allowing it to observe beyond its short-term planning horizon. Conversely, the neural policy under training learns from the recovery plans proposed by the planner, converging to policies that are both high-performing and safe in practice. This approach guarantees safety during and after training, with bounded recovery regret that decreases exponentially with planning horizon depth. Experimental results demonstrate that DMPS converges to policies that rarely require shield interventions after training and achieve higher rewards compared to several state-of-the-art baselines.


title: Just rotate it! Uncertainty estimation in closed-source models via multiple queries

abstract: We propose a simple and effective method to estimate the uncertainty of closed-source deep neural network image classification models. Given a base image, our method creates multiple transformed versions and uses them to query the top-1 prediction of the closed-source model. We demonstrate significant improvements in the calibration of uncertainty estimates compared to the naive baseline of assigning 100\% confidence to all predictions. While we initially explore Gaussian perturbations, our empirical findings indicate that natural transformations, such as rotations and elastic deformations, yield even better-calibrated predictions. Furthermore, through empirical results and a straightforward theoretical analysis, we elucidate the reasons behind the superior performance of natural transformations over Gaussian noise. Leveraging these insights, we propose a transfer learning approach that further improves our calibration results.


title: ReVideo: Remake a Video with Motion and Content Control

abstract: Despite significant advancements in video generation and editing using diffusion models, achieving accurate and localized video editing remains a substantial challenge. Additionally, most existing video editing methods primarily focus on altering visual content, with limited research dedicated to motion editing. In this paper, we present a novel attempt to Remake a Video (ReVideo) which stands out from existing methods by allowing precise video editing in specific areas through the specification of both content and motion. Content editing is facilitated by modifying the first frame, while the trajectory-based motion control offers an intuitive user interaction experience. ReVideo addresses a new task involving the coupling and training imbalance between content and motion control. To tackle this, we develop a three-stage training strategy that progressively decouples these two aspects from coarse to fine. Furthermore, we propose a spatiotemporal adaptive fusion module to integrate content and motion control across various sampling steps and spatial locations. Extensive experiments demonstrate that our ReVideo has promising performance on several accurate video editing applications, i.e., (1) locally changing video content while keeping the motion constant, (2) keeping content unchanged and customizing new motion trajectories, (3) modifying both content and motion trajectories. Our method can also seamlessly extend these applications to multi-area editing without specific training, demonstrating its flexibility and robustness.


title: Koopcon: A new approach towards smarter and less complex learning

abstract: In the era of big data, the sheer volume and complexity of datasets pose significant challenges in machine learning, particularly in image processing tasks. This paper introduces an innovative Autoencoder-based Dataset Condensation Model backed by Koopman operator theory that effectively packs large datasets into compact, information-rich representations. Inspired by the predictive coding mechanisms of the human brain, our model leverages a novel approach to encode and reconstruct data, maintaining essential features and label distributions. The condensation process utilizes an autoencoder neural network architecture, coupled with Optimal Transport theory and Wasserstein distance, to minimize the distributional discrepancies between the original and synthesized datasets. We present a two-stage implementation strategy: first, condensing the large dataset into a smaller synthesized subset; second, evaluating the synthesized data by training a classifier and comparing its performance with a classifier trained on an equivalent subset of the original data. Our experimental results demonstrate that the classifiers trained on condensed data exhibit comparable performance to those trained on the original datasets, thus affirming the efficacy of our condensation model. This work not only contributes to the reduction of computational resources but also paves the way for efficient data handling in constrained environments, marking a significant step forward in data-efficient machine learning.


title: Scaling-laws for Large Time-series Models

abstract: Scaling laws for large language models (LLMs) have provided useful guidance on how to train ever larger models for predictable performance gains. Time series forecasting shares a similar sequential structure to language, and is amenable to large-scale transformer architectures. Here we show that foundational decoder-only time series transformer models exhibit analogous scaling-behavior to LLMs, while architectural details (aspect ratio and number of heads) have a minimal effect over broad ranges. We assemble a large corpus of heterogenous time series data on which to train, and establish, for the first time, power-law scaling relations with respect to parameter count, dataset size, and training compute, spanning five orders of magnitude.


title: Automatically Identifying Local and Global Circuits with Linear Computation Graphs

abstract: Circuit analysis of any certain model behavior is a central task in mechanistic interpretability. We introduce our circuit discovery pipeline with sparse autoencoders (SAEs) and a variant called skip SAEs. With these two modules inserted into the model, the model's computation graph with respect to OV and MLP circuits becomes strictly linear. Our methods do not require linear approximation to compute the causal effect of each node. This fine-grained graph enables identifying both end-to-end and local circuits accounting for either logits or intermediate features. We can scalably apply this pipeline with a technique called Hierarchical Attribution. We analyze three kind of circuits in GPT2-Small, namely bracket, induction and Indirect Object Identification circuits. Our results reveal new findings underlying existing discoveries.


title: Pentacene-Doped Naphthalene for Levitated Optomechanics

abstract: We introduce pentacene-doped naphthalene as a material for diamagnetic levitation, offering compelling applications in matter-wave interferometry and nuclear magnetic resonance. Pentacene-doped naphthalene offers remarkable polarizability of its nuclear spin ensemble, achieving polarization rates exceeding 80 % at cryogenic temperatures with polarization lifetimes extending weeks. We design a multi-spin Stern-Gerlach-type interferometry protocol which, thanks to the homogeneous spin distribution and the absence of a preferential nuclear-spin quantization axis, avoids many of the limitations associated with materials hosting electronic spin defects, such as nanodiamonds containing NV centers. We assess the potential of our interferometer to enhance existing bounds on the free parameters of objective collapse models. Beyond matter-wave interferometry, we analyze the prospects for implementing magic angle spinning at frequencies surpassing the current standard in NMR, capitalizing on the exceptional rotational capabilities offered by levitation. Additionally, we outline a novel protocol for measuring spin ensemble polarization via the position of the nanoparticle and conduct an analysis of dominant noise sources, benchmarking the required isolation levels for various applications.


title: FreeCustom: Tuning-Free Customized Image Generation for Multi-Concept Composition

abstract: Benefiting from large-scale pre-trained text-to-image (T2I) generative models, impressive progress has been achieved in customized image generation, which aims to generate user-specified concepts. Existing approaches have extensively focused on single-concept customization and still encounter challenges when it comes to complex scenarios that involve combining multiple concepts. These approaches often require retraining/fine-tuning using a few images, leading to time-consuming training processes and impeding their swift implementation. Furthermore, the reliance on multiple images to represent a singular concept increases the difficulty of customization. To this end, we propose FreeCustom, a novel tuning-free method to generate customized images of multi-concept composition based on reference concepts, using only one image per concept as input. Specifically, we introduce a new multi-reference self-attention (MRSA) mechanism and a weighted mask strategy that enables the generated image to access and focus more on the reference concepts. In addition, MRSA leverages our key finding that input concepts are better preserved when providing images with context interactions. Experiments show that our method's produced images are consistent with the given concepts and better aligned with the input text. Our method outperforms or performs on par with other training-based methods in terms of multi-concept composition and single-concept customization, but is simpler. Codes can be found at https://github.com/aim-uofa/FreeCustom.


title: Gravitational wave background from primordial black holes in globular clusters

abstract: Primordial black holes still represent a viable candidate for a significant fraction, if not for the totality, of dark matter. If these compact objects have masses of order tens of solar masses, their coalescence can be observed by current and future ground-based gravitational wave detectors. Therefore, finding new gravitational wave signatures associated with this dark matter candidate can either lead to their detection or help constraining their abundance. In this work we consider the phenomenology of primordial black holes in dense environments, in particular globular clusters. We model the internal structure of globular clusters in a semi-analytical fashion, and we derive the expected merger rate. We show that, if primordial black holes are present in globular clusters, their contribution to the GW background can be comparable to other well-known channels, such as early- and late-time binaries, thus enhancing the detectability prospects of primordial black holes and demonstrating that this contribution needs to be taken into account.


title: Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models

abstract: Recent advancements in Chain-of-Thought (CoT) and related rationale-based works have significantly improved the performance of Large Language Models (LLMs) in complex reasoning tasks. With the evolution of Multimodal Large Language Models (MLLMs), enhancing their capability to tackle complex multimodal reasoning problems is a crucial frontier. However, incorporating multimodal rationales in CoT has yet to be thoroughly investigated. We propose the Image-of-Thought (IoT) prompting method, which helps MLLMs to extract visual rationales step-by-step. Specifically, IoT prompting can automatically design critical visual information extraction operations based on the input images and questions. Each step of visual information refinement identifies specific visual rationales that support answers to complex visual reasoning questions. Beyond the textual CoT, IoT simultaneously utilizes visual and textual rationales to help MLLMs understand complex multimodal information. IoT prompting has improved zero-shot visual reasoning performance across various visual understanding tasks in different MLLMs. Moreover, the step-by-step visual feature explanations generated by IoT prompting elucidate the visual reasoning process, aiding in analyzing the cognitive processes of large multimodal models


title: FiDeLiS: Faithful Reasoning in Large Language Model for Knowledge Graph Question Answering

abstract: While large language models (LLMs) have achieved significant success in various applications, they often struggle with hallucinations, especially in scenarios that require deep and responsible reasoning. These issues could be partially mitigate by integrating external knowledge graphs (KG) in LLM reasoning. However, the method of their incorporation is still largely unexplored. In this paper, we propose a retrieval-exploration interactive method, FiDelis to handle intermediate steps of reasoning grounded by KGs. Specifically, we propose Path-RAG module for recalling useful intermediate knowledge from KG for LLM reasoning. We incorporate the logic and common-sense reasoning of LLMs and topological connectivity of KGs into the knowledge retrieval process, which provides more accurate recalling performance. Furthermore, we propose to leverage deductive reasoning capabilities of LLMs as a better criterion to automatically guide the reasoning process in a stepwise and generalizable manner. Deductive verification serve as precise indicators for when to cease further reasoning, thus avoiding misleading the chains of reasoning and unnecessary computation. Extensive experiments show that our method, as a training-free method with lower computational cost and better generality outperforms the existing strong baselines in three benchmarks.


title: Affine-based Deformable Attention and Selective Fusion for Semi-dense Matching

abstract: Identifying robust and accurate correspondences across images is a fundamental problem in computer vision that enables various downstream tasks. Recent semi-dense matching methods emphasize the effectiveness of fusing relevant cross-view information through Transformer. In this paper, we propose several improvements upon this paradigm. Firstly, we introduce affine-based local attention to model cross-view deformations. Secondly, we present selective fusion to merge local and global messages from cross attention. Apart from network structure, we also identify the importance of enforcing spatial smoothness in loss design, which has been omitted by previous works. Based on these augmentations, our network demonstrate strong matching capacity under different settings. The full version of our network achieves state-of-the-art performance among semi-dense matching methods at a similar cost to LoFTR, while the slim version reaches LoFTR baseline's performance with only 15% computation cost and 18% parameters.


title: On the Inapproximability of Finding Minimum Monitoring Edge-Geodetic Sets

abstract: Given an undirected connected graph $G = (V(G), E(G))$ on $n$ vertices, the minimum Monitoring Edge-Geodetic Set (MEG-set) problem asks to find a subset $M \subseteq V(G)$ of minimum cardinality such that, for every edge $e \in E(G)$, there exist $x,y \in M$ for which all shortest paths between $x$ and $y$ in $G$ traverse $e$. We show that, for any constant $c < \frac{1}{2}$, no polynomial-time $(c \log n)$-approximation algorithm for the minimum MEG-set problem exists, unless $\mathsf{P} = \mathsf{NP}$.


title: Disorder Enhanced Thermalization in Interacting Many-Particle System

abstract: We introduce an extension of the non-equilibrium dynamical mean field theory to incorporate the effects of static random disorder in the dynamics of a many-particle system by integrating out different disorder configurations resulting in an effective time-dependent density-density interaction. We use this method to study the non-equilibrium transient dynamics of a system described by the Fermi Anderson-Hubbard model following an interaction and disorder quench. The method recovers the solution of the disorder-free case for which the system exhibits qualitatively distinct dynamical behaviors in the weak-coupling (prethermalization) and strong-coupling regimes (collapse-and-revival oscillations). However, we find that weak random disorder promotes thermalization. In the weak coupling regime, the jump in the quasiparticle weight in the prethermal regime is suppressed by random disorder while in the strong-coupling regime, random disorder reduces the amplitude of the quasiparticle weight oscillations. These results highlight the importance of disorder in the dynamics of realistic many-particle systems.


title: On connections between k-coloring and Euclidean k-means

abstract: In the Euclidean $k$-means problems we are given as input a set of $n$ points in $\mathbb{R}^d$ and the goal is to find a set of $k$ points $C\subseteq \mathbb{R}^d$, so as to minimize the sum of the squared Euclidean distances from each point in $P$ to its closest center in $C$. In this paper, we formally explore connections between the $k$-coloring problem on graphs and the Euclidean $k$-means problem. Our results are as follows: $\bullet$ For all $k\ge 3$, we provide a simple reduction from the $k$-coloring problem on regular graphs to the Euclidean $k$-means problem. Moreover, our technique extends to enable a reduction from a structured max-cut problem (which may be considered as a partial 2-coloring problem) to the Euclidean $2$-means problem. Thus, we have a simple and alternate proof of the NP-hardness of Euclidean 2-means problem. $\bullet$ In the other direction, we mimic the $O(1.7297^n)$ time algorithm of Williams [TCS'05] for the max-cut of problem on $n$ vertices to obtain an algorithm for the Euclidean 2-means problem with the same runtime, improving on the naive exhaustive search running in $2^n\cdot \text{poly}(n,d)$ time. $\bullet$ We prove similar results and connections as above for the Euclidean $k$-min-sum problem.


title: Implicit gaze research for XR systems

abstract: Although eye-tracking technology is being integrated into more VR and MR headsets, the true potential of eye tracking in enhancing user interactions within XR settings remains relatively untapped. Presently, one of the most prevalent gaze applications in XR is input control; for example, using gaze to control a cursor for pointing. However, our eyes evolved primarily for sensory input and understanding of the world around us, and yet few XR applications have leveraged natural gaze behavior to infer and support users' intent and cognitive states. Systems that can represent a user's context and interaction intent can better support the user by generating contextually relevant content, by making the user interface easier to use, by highlighting potential errors, and more. This mode of application is not fully taken advantage of in current commercially available XR systems and yet it is likely where we'll find paradigm-shifting use cases for eye tracking. In this paper, we elucidate the state-of-the-art applications for eye tracking and propose new research directions to harness its potential fully.


title: FACT or Fiction: Can Truthful Mechanisms Eliminate Federated Free Riding?

abstract: Standard federated learning (FL) approaches are vulnerable to the free-rider dilemma: participating agents can contribute little to nothing yet receive a well-trained aggregated model. While prior mechanisms attempt to solve the free-rider dilemma, none have addressed the issue of truthfulness. In practice, adversarial agents can provide false information to the server in order to cheat its way out of contributing to federated training. In an effort to make free-riding-averse federated mechanisms truthful, and consequently less prone to breaking down in practice, we propose FACT. FACT is the first federated mechanism that: (1) eliminates federated free riding by using a penalty system, (2) ensures agents provide truthful information by creating a competitive environment, and (3) encourages agent participation by offering better performance than training alone. Empirically, FACT avoids free-riding when agents are untruthful, and reduces agent loss by over 4x.


title: Heavy Fermions as an Efficient Representation of Atomistic Strain and Relaxation in Twisted Bilayer Graphene

abstract: Although the strongly interacting flat bands in twisted bilayer graphene (TBG) have been approached using the minimal Bistritzer-MacDonald (BM) Hamiltonian, there is mounting evidence that strain and lattice relaxation are essential in correctly determining the order of the correlated insulator groundstates. These effects can be incorporated in an enhanced continuum model by introducing additional terms computed from the relaxation profile. To develop an analytical and physical understanding of these effects, we include strain and relaxation in the topological heavy fermion (HF) model of TBG. We find that strain and relaxation are very well captured in first order perturbation theory by projection onto the fully symmetric HF Hilbert space, and remarkably do not alter the interacting terms in the periodic Anderson model. Their effects are fully incorporated in the single-particle HF Hamiltonian, and can be reproduced in a minimal model with only 4 symmetry-breaking terms. Our results demonstrate that the heavy fermion framework of TBG is an efficient and robust representation of the perturbations encountered in experiment.


title: Natural Inflation with Exponentially Small Tensor-To-Scalar Ratio

abstract: We demonstrate that "natural inflation", also known as "axion inflation", can be compatible with Planck 2018 measurements of the cosmic microwave background, while predicting an exponentially small tensor-to-scalar ratio, e.g., $r\sim 10^{-15}$. The strong suppression of $r$ arises from dynamics of the radial component of the complex scalar field, whose phase is the axion. Such tiny values of $r$ remain well below the threshold for detection by CMB-S4 or Simons Observatory B-mode searches. The model is testable with the running $\alpha_s$ of the spectral index, which is within reach of next-generation CMB and large-scale structure experiments, motivating the running as a primary science goal for future experiments.


title: Resonant Conversion of Wave Dark Matter in the Ionosphere

abstract: We consider resonant wave-like dark matter conversion into low-frequency radio waves in the Earth's ionosphere. Resonant conversion occurs when the dark matter mass and the plasma frequency coincide, defining a range $m_{ \text{DM} } \sim 10^{-9} - 10^{-8}$ eV where this approach is best suited. Owing to the non-relativistic nature of dark matter and the typical variational scale of the Earth's ionosphere, the standard linearized approach to computing dark matter conversion is not suitable. We therefore solve a second-order boundary-value problem, effectively framing the ionosphere as a driven cavity filled with a positionally-varying plasma. An electrically-small dipole antenna targeting the generated radio waves can be orders of magnitude more sensitive to dark photon and axion-like particle dark matter in the relevant mass range. The present study opens up a promising way of testing hitherto unexplored parameter space which could be further improved with a dedicated instrument.


title: Gravitational Production of Heavy Particles during and after Inflation

abstract: We investigate the gravitational production of a scalar field $\chi$ with a mass exceeding the Hubble scale during inflation $m_\chi \gtrsim H_I$, employing both analytical and numerical approaches. We demonstrate that the steepest descent method effectively captures the epochs and yields of gravitational production in a compact and simple analytical framework. These analytical results align with the numerical solutions of the field equation. Our study covers three spacetime backgrounds: de Sitter, power-law inflation, and the Starobinsky inflation model. Within these models, we identify two distinct phases of particle production: during and after inflation. During inflation, we derive an accurate analytic expression for the particle production rate, accounting for a varying Hubble rate. After inflation, the additional burst of particle production depends on the inflaton mass around its minimum. When this mass is smaller than the Hubble scale during inflation, $H_I$, there is no significant extra production. However, if the inflaton mass is larger, post-inflation production becomes the dominant contribution. Furthermore, we explore the implications of gravitationally produced heavy fields for dark matter abundance, assuming their cosmological stability.


title: Quantum Reference Frames from Top-Down Crossed Products

abstract: All physical observations are made relative to a reference frame, which is a system in its own right. If the system of interest admits a group symmetry, the reference frame observing it must transform commensurately under the group to ensure the covariance of the combined system. We point out that the crossed product is a way to realize quantum reference frames from the bottom-up; adjoining a quantum reference frame and imposing constraints generates a crossed product algebra. We provide a top-down specification of crossed product algebras and show that one cannot obtain inequivalent quantum reference frames using this approach. As a remedy, we define an abstract algebra associated to the system and symmetry group built out of relational crossed product algebras associated with different choices of quantum reference frames. We term this object the G-framed algebra, and show how potentially inequivalent frames are realized within this object. We comment on this algebra's analog of the classical Gribov problem in gauge theory, its importance in gravity where we show that it is relevant for semiclassical de Sitter and potentially beyond the semiclassical limit, and its utility for understanding the frame-dependence of physical notions like observables, density states, and entropies.


title: Nonlinear Spectroscopy via Generalized Quantum Phase Estimation

abstract: Response theory has a successful history of connecting experimental observations with theoretical predictions. Of particular interest is the optical response of matter, from which spectroscopy experiments can be modelled. However, the calculation of response properties for quantum systems is often prohibitively expensive, especially for nonlinear spectroscopy, as it requires access to either the time evolution of the system or to excited states. In this work, we introduce a generalized quantum phase estimation framework designed for multi-variate phase estimation. This allows the treatment of general correlation functions enabling the recovery of response properties of arbitrary orders. The generalized quantum phase estimation circuit has an intuitive construction that is linked with a physical process of interest, and can directly sample frequencies from the distribution that would be obtained experimentally. In addition, we provide a single-ancilla modification of the new framework for early fault-tolerant quantum computers. Overall, our framework enables the efficient simulation of spectroscopy experiments beyond the linear regime, such as Raman spectroscopy. This opens up an exciting new field of applications for quantum computers with potential technological impact.


title: Quantum Energy Teleportation versus Information Teleportation

abstract: Quantum energy teleportation (QET) is the phenomenon in which locally inaccessible energy is activated as extractable work through collaborative local operations and classical communication (LOCC) with an entangled partner. It closely resembles the more well-known quantum information teleportation (QIT) where quantum information can be sent through an entangled pair with LOCC. It is tempting to ask how QET is related to QIT. Here we report a first study of this connection. Despite the apparent similarity, we show that these two phenomena are not only distinct but moreover are mutually exclusive to each other. We show a perturbative trade-off relation between their performance in a thermal entangled chaotic many-body system, in which both QET and QIT are simultaneously implemented through a traversable wormhole in an emergent spacetime. To better understand their competition, we study the finite-dimensional counterpart of two entangled qudits and prove a universal non-perturbative trade-off bound. It shows that for any teleportation scheme, the overall performance of QET and QIT together is constrained by the amount of the entanglement resource. We discuss some explanations of our results.


title: Multi-Zone Modeling of Black Hole Accretion and Feedback in 3D GRMHD: Bridging Vast Spatial and Temporal Scales

abstract: Simulating accretion and feedback from the horizon scale of supermassive black holes (SMBHs) out to galactic scales is challenging because of the vast range of scales involved. We describe and test a "multi-zone" technique which is designed to tackle this difficult problem in 3D general relativistic magnetohydrodynamic (GRMHD) simulations. We simulate accretion on a non-spinning SMBH ($a_*=0$) using initial conditions from a large scale galaxy simulation, and achieve steady state over 8 decades in radius. The density scales with radius as $\rho \propto r^{-1}$ inside the Bondi radius $R_B$, which is located at $R_B=2\times 10^5 \,r_g$ ($\approx 60\,{\rm pc}$ for M87) where $r_g$ is the gravitational radius of the SMBH; the plasma-$\beta\sim$ unity, indicating an extended magnetically arrested state; the mass accretion rate $\dot{M}$ is $\approx 1\%$ of the analytical Bondi accretion rate $\dot{M}_B$; and there is continuous energy feedback out to $\approx 100R_B$ (or beyond $>\,{\rm kpc}$) at a rate $\approx 0.02 \dot{M}c^2$. Surprisingly, any ordered rotation in the external medium does not survive as the magnetized gas flows to smaller radii, and the final steady solution is very similar to when the exterior has no rotation. Using the multi-zone method, we simulate GRMHD accretion for a wide range of Bondi radii, $R_{\rm B} \sim 10^2 - 10^7\,r_{\rm g}$, and find that $\dot{M}/\dot{M}_B\approx (R_B/6\, r_g)^{-0.5}$.


title: Marrying Causal Representation Learning with Dynamical Systems for Science

abstract: Causal representation learning promises to extend causal models to hidden causal variables from raw entangled measurements. However, most progress has focused on proving identifiability results in different settings, and we are not aware of any successful real-world application. At the same time, the field of dynamical systems benefited from deep learning and scaled to countless applications but does not allow parameter identification. In this paper, we draw a clear connection between the two and their key assumptions, allowing us to apply identifiable methods developed in causal representation learning to dynamical systems. At the same time, we can leverage scalable differentiable solvers developed for differential equations to build models that are both identifiable and practical. Overall, we learn explicitly controllable models that isolate the trajectory-specific parameters for further downstream tasks such as out-of-distribution classification or treatment effect estimation. We experiment with a wind simulator with partially known factors of variation. We also apply the resulting model to real-world climate data and successfully answer downstream causal questions in line with existing literature on climate change.


title: A Joint X-ray and Optical Study of the Massive Redback Pulsar J2215+5135

abstract: PSR J2215+5135 (J2215) is a `redback' spider pulsar, where the intrabinary shock (IBS) wraps around the pulsar rather than the stellar-mass companion. Spider orbital light curves are modulated, dominated by their binary companion thermal emission in the optical band and by IBS synchrotron emission in the X-rays. We report on new XMM-Newton X-ray and U-band observations of J2215. We produce orbital light curves and use them to model the system properties. From our optical light curve modeling, we find a neutron star mass $M_{NS}=2.15\pm0.10 M_\odot$, somewhat lower than previously reported. From the X-ray analysis, we find that the IBS still wraps around the pulsar, but with a wind/companion wind momenta ratio unusually close to unity, implying a flatter IBS geometry {than seen in other spiders. Estimating the companion wind momentum and speed from the X-ray light curve, we find a companion mass-loss rate of ${\dot M}_c\gtrsim10^{-10}$ M$_\odot$ yr$^{-1}$, so that J2215 may become an isolated millisecond pulsar in $\sim 1$ Gyr. Our X-ray analyses support models of magnetic reconnection and particle acceleration in the highly magnetized relativistic IBS.


title: An empirical study to understand how students use ChatGPT for writing essays and how it affects their ownership

abstract: As large language models (LLMs) become more powerful and ubiquitous, systems like ChatGPT are increasingly used by students to help them with writing tasks. To better understand how these tools are used, we investigate how students might use an LLM for essay writing, for example, to study the queries asked to ChatGPT and the responses that ChatGPT gives. To that end, we plan to conduct a user study that will record the user writing process and present them with the opportunity to use ChatGPT as an AI assistant. This study's findings will help us understand how these tools are used and how practitioners -- such as educators and essay readers -- should consider writing education and evaluation based on essay writing.


title: DeepNcode: Encoding-Based Protection against Bit-Flip Attacks on Neural Networks

abstract: Fault injection attacks are a potent threat against embedded implementations of neural network models. Several attack vectors have been proposed, such as misclassification, model extraction, and trojan/backdoor planting. Most of these attacks work by flipping bits in the memory where quantized model parameters are stored. In this paper, we introduce an encoding-based protection method against bit-flip attacks on neural networks, titled DeepNcode. We experimentally evaluate our proposal with several publicly available models and datasets, by using state-of-the-art bit-flip attacks: BFA, T-BFA, and TA-LBF. Our results show an increase in protection margin of up to $7.6\times$ for $4-$bit and $12.4\times$ for $8-$bit quantized networks. Memory overheads start at $50\%$ of the original network size, while the time overheads are negligible. Moreover, DeepNcode does not require retraining and does not change the original accuracy of the model.


title: Emergence of Navier-Stokes hydrodynamics in chaotic quantum circuits

abstract: We construct an ensemble of two-dimensional nonintegrable quantum circuits that are chaotic but have a conserved particle current, and thus a finite Drude weight. The long-wavelength hydrodynamics of such systems is given by the incompressible Navier-Stokes equations. By analyzing circuit-to-circuit fluctuations in the ensemble we argue that these are negligible, so the circuit-averaged value of transport coefficients like the viscosity is also (in the long-time limit) the value in a typical circuit. The circuit-averaged transport coefficients can be mapped onto a classical irreversible Markov process. Therefore, remarkably, our construction allows us to efficiently compute the viscosity of a family of strongly interacting chaotic two-dimensional quantum systems.


title: On a new problem about the local irregularity of graphs

abstract: We say that a graph or a multigraph is locally irregular if adjacent vertices have different degrees. The locally irregular edge coloring is an edge coloring of a (multi)graph $G$ such that every color induces a locally irregular sub(multi)graph of $G$. We denote by ${\rm lir}(G)$ the locally irregular chromatic index of $G$, which is the smallest number of colors required in a locally irregular edge coloring of $G$ if such a coloring exists. We state the following new problem. Let $G$ be a connected graph that is not isomorphic to $K_2$ or $K_3$. What is the minimum number of edges of $G$ whose doubling yields a multigraph which is locally irregular edge colorable using at most two colors with no multiedges colored with two colors? This problem is closely related to the Local Irregularity Conjecture for graphs, (2, 2)-Conjecture, Local Irregularity Conjecture for 2-multigraphs and other similar concepts concerning edge colorings. We solve this problem for graph classes like paths, cycles, trees, complete graphs, complete $k$-partite graphs, split graphs and powers of cycles. Our solution of this problem for complete $k$-partite graphs ($k>1$) and powers of cycles which are not complete graphs shows that the locally irregular chromatic index is equal to two for these graph classes. We also consider this problem for some special families of cacti and prove that the minimum number of edges in a graph whose doubling yields a multigraph which has such coloring does not have a constant upper bound not only for locally irregular uncolorable cacti.


title: Charge and Spin Sharpening Transitions on Dynamical Quantum Trees

abstract: The dynamics of monitored systems can exhibit a measurement-induced phase transition (MIPT) between entangling and disentangling phases, tuned by the measurement rate. When the dynamics obeys a continuous symmetry, the entangling phase further splits into a fuzzy phase and a sharp phase based on the scaling of fluctuations of the symmetry charge. While the sharpening transition for Abelian symmetries is well understood analytically, no such understanding exists for the non- Abelian case. In this work, building on a recent analytical solution of the MIPT on tree-like circuit architectures (where qubits are repatedly added or removed from the system in a recursive pattern), we study entanglement and sharpening transitions in monitored dynamical quantum trees obeying U (1) and SU (2) symmetries. The recursive structure of tree tensor networks enables powerful analytical and numerical methods to determine the phase diagrams in both cases. In the U (1) case, we analytically derive a Fisher-KPP-like differential equation that allows us to locate the critical point and identify its properties. We find that the entanglement/purification and sharpening transitions generically occur at distinct measurement rates. In the SU (2) case, we find that the fuzzy phase is generic, and a sharp phase is possible only in the limit of maximal measurement rate. In this limit, we analytically solve the boundaries separating the fuzzy and sharp phases, and find them to be in agreement with exact numerical simulations.


title: The variation in the response of solar full-disc magnetographs

abstract: We compared magnetograms from the KPVT/SPM, SoHO/MDI, SOLIS/VSM, and SDO/HMI with the aim of probing the effect on measured solar magnetism of the variation in instrument response with time, magnetogram signal level, and position on the solar disc. Taking near-simultaneous observations from the various instruments, we examined the surface coverage by magnetic activity and the effect of cross-calibrating the various instruments under different assumptions. By comparing the surface coverage by magnetic activity in the observations from the various instruments, we traced the effect of the time variation in instrument response on the longitudinal magnetogram signal and disc-integrated unsigned magnetic flux. This yielded evidence of acute changes in the response of MDI and VSM with certain events such as the SoHO vacation in 1998 and the upgrade of the VSM CCD camera in 2009. Excluding these changes, the effect of instrument instability on the magnetogram signal and disc-integrated magnetic flux appears to be rather benign, with an associated uncertainty of less than 2%. We determined the magnetogram signal ratio between each instrument pairing as a function of magnetogram signal level and distance from disc centre and with it cross-calibrated the various instruments. We compared the result with that from repeating the cross-calibration with the overall magnetogram signal ratio. This allowed us to estimate the uncertainty in the magnetogram signal associated with the variation in instrument response with magnetogram signal level and distance from disc centre to be about 8% to 14%. The corresponding uncertainty in the disc-integrated magnetic flux is about 7% to 23 %. The results here will be useful to the interpretation of SPM, MDI, VSM, and HMI magnetograms. As examples, we applied our findings to selected results from earlier studies based on such data.


title: A General Framework for Jersey Number Recognition in Sports Video

abstract: Jersey number recognition is an important task in sports video analysis, partly due to its importance for long-term player tracking. It can be viewed as a variant of scene text recognition. However, there is a lack of published attempts to apply scene text recognition models on jersey number data. Here we introduce a novel public jersey number recognition dataset for hockey and study how scene text recognition methods can be adapted to this problem. We address issues of occlusions and assess the degree to which training on one sport (hockey) can be generalized to another (soccer). For the latter, we also consider how jersey number recognition at the single-image level can be aggregated across frames to yield tracklet-level jersey number labels. We demonstrate high performance on image- and tracklet-level tasks, achieving 91.4% accuracy for hockey images and 87.4% for soccer tracklets. Code, models, and data are available at https://github.com/mkoshkina/jersey-number-pipeline.


title: Geometry of rational quasi-independence models as toric fiber products

abstract: We investigate the geometry of a family of log-linear statistical models called quasi-independence models. The toric fiber product is useful for understanding the geometry of parameter inference in these models because the maximum likelihood degree is multiplicative under the TFP. We define the coordinate toric fiber product, or cTFP, and give necessary and sufficient conditions under which a quasi-independence model is a cTFP of lower-order models. We show that the vanishing ideal of every 2-way quasi-independence model with ML-degree 1 can be realized as an iterated toric fiber product of linear ideals. We also classify which Lawrence lifts of 2-way quasi-independence models are cTFPs and give a necessary condition under which a $k$-way model has ML-degree 1 using its facial submodels.


title: Bias-field digitized counterdiabatic quantum optimization

abstract: We introduce a method for solving combinatorial optimization problems on digital quantum computers, where we incorporate auxiliary counterdiabatic (CD) terms into the adiabatic Hamiltonian, while integrating bias terms derived from an iterative digitized counterdiabatic quantum algorithm. We call this protocol bias-field digitized counterdiabatic quantum optimization (BF-DCQO). Designed to effectively tackle large-scale combinatorial optimization problems, BF-DCQO demonstrates resilience against the limitations posed by the restricted coherence times of current quantum processors and shows clear enhancement even in the presence of noise. Additionally, our purely quantum approach eliminates the dependency on classical optimization required in hybrid classical-quantum schemes, thereby circumventing the trainability issues often associated with variational quantum algorithms. Through the analysis of an all-to-all connected general Ising spin-glass problem, we exhibit a polynomial scaling enhancement in ground state success probability compared to traditional DCQO and finite-time adiabatic quantum optimization methods. Furthermore, it achieves scaling improvements in ground state success probabilities, increasing by up to two orders of magnitude, and offers an average 1.3x better approximation ratio than the quantum approximate optimization algorithm for the problem sizes studied. We validate these findings through experimental implementations on both trapped-ion quantum computers and superconducting processors, tackling a maximum weighted independent set problem with 36 qubits and a spin-glass on a heavy-hex lattice with 100 qubits, respectively. These results mark a significant advancement in gate-based quantum computing, employing a fully quantum algorithmic approach.


title: Symmetric Linear Bandits with Hidden Symmetry

abstract: High-dimensional linear bandits with low-dimensional structure have received considerable attention in recent studies due to their practical significance. The most common structure in the literature is sparsity. However, it may not be available in practice. Symmetry, where the reward is invariant under certain groups of transformations on the set of arms, is another important inductive bias in the high-dimensional case that covers many standard structures, including sparsity. In this work, we study high-dimensional symmetric linear bandits where the symmetry is hidden from the learner, and the correct symmetry needs to be learned in an online setting. We examine the structure of a collection of hidden symmetry and provide a method based on model selection within the collection of low-dimensional subspaces. Our algorithm achieves a regret bound of $ O(d_0^{1/3} T^{2/3} \log(d))$, where $d$ is the ambient dimension which is potentially very large, and $d_0$ is the dimension of the true low-dimensional subspace such that $d_0 \ll d$. With an extra assumption on well-separated models, we can further improve the regret to $ O(d_0\sqrt{T\log(d)} )$.


title: Rehearsal-free Federated Domain-incremental Learning

abstract: We introduce a rehearsal-free federated domain incremental learning framework, RefFiL, based on a global prompt-sharing paradigm to alleviate catastrophic forgetting challenges in federated domain-incremental learning, where unseen domains are continually learned. Typical methods for mitigating forgetting, such as the use of additional datasets and the retention of private data from earlier tasks, are not viable in federated learning (FL) due to devices' limited resources. Our method, RefFiL, addresses this by learning domain-invariant knowledge and incorporating various domain-specific prompts from the domains represented by different FL participants. A key feature of RefFiL is the generation of local fine-grained prompts by our domain adaptive prompt generator, which effectively learns from local domain knowledge while maintaining distinctive boundaries on a global scale. We also introduce a domain-specific prompt contrastive learning loss that differentiates between locally generated prompts and those from other domains, enhancing RefFiL's precision and effectiveness. Compared to existing methods, RefFiL significantly alleviates catastrophic forgetting without requiring extra memory space, making it ideal for privacy-sensitive and resource-constrained devices.


title: DCT-Based Decorrelated Attention for Vision Transformers

abstract: Central to the Transformer architectures' effectiveness is the self-attention mechanism, a function that maps queries, keys, and values into a high-dimensional vector space. However, training the attention weights of queries, keys, and values is non-trivial from a state of random initialization. In this paper, we propose two methods. (i) We first address the initialization problem of Vision Transformers by introducing a simple, yet highly innovative, initialization approach utilizing Discrete Cosine Transform (DCT) coefficients. Our proposed DCT-based attention initialization marks a significant gain compared to traditional initialization strategies; offering a robust foundation for the attention mechanism. Our experiments reveal that the DCT-based initialization enhances the accuracy of Vision Transformers in classification tasks. (ii) We also recognize that since DCT effectively decorrelates image information in the frequency domain, this decorrelation is useful for compression because it allows the quantization step to discard many of the higher-frequency components. Based on this observation, we propose a novel DCT-based compression technique for the attention function of Vision Transformers. Since high-frequency DCT coefficients usually correspond to noise, we truncate the high-frequency DCT components of the input patches. Our DCT-based compression reduces the size of weight matrices for queries, keys, and values. While maintaining the same level of accuracy, our DCT compressed Swin Transformers obtain a considerable decrease in the computational overhead.


title: LOGIN: A Large Language Model Consulted Graph Neural Network Training Framework

abstract: Recent prevailing works on graph machine learning typically follow a similar methodology that involves designing advanced variants of graph neural networks (GNNs) to maintain the superior performance of GNNs on different graphs. In this paper, we aim to streamline the GNN design process and leverage the advantages of Large Language Models (LLMs) to improve the performance of GNNs on downstream tasks. We formulate a new paradigm, coined "LLMs-as-Consultants," which integrates LLMs with GNNs in an interactive manner. A framework named LOGIN (LLM Consulted GNN training) is instantiated, empowering the interactive utilization of LLMs within the GNN training process. First, we attentively craft concise prompts for spotted nodes, carrying comprehensive semantic and topological information, and serving as input to LLMs. Second, we refine GNNs by devising a complementary coping mechanism that utilizes the responses from LLMs, depending on their correctness. We empirically evaluate the effectiveness of LOGIN on node classification tasks across both homophilic and heterophilic graphs. The results illustrate that even basic GNN architectures, when employed within the proposed LLMs-as-Consultants paradigm, can achieve comparable performance to advanced GNNs with intricate designs. Our codes are available at https://github.com/QiaoYRan/LOGIN.


title: ST-Gait++: Leveraging spatio-temporal convolutions for gait-based emotion recognition on videos

abstract: Emotion recognition is relevant for human behaviour understanding, where facial expression and speech recognition have been widely explored by the computer vision community. Literature in the field of behavioural psychology indicates that gait, described as the way a person walks, is an additional indicator of emotions. In this work, we propose a deep framework for emotion recognition through the analysis of gait. More specifically, our model is composed of a sequence of spatial-temporal Graph Convolutional Networks that produce a robust skeleton-based representation for the task of emotion classification. We evaluate our proposed framework on the E-Gait dataset, composed of a total of 2177 samples. The results obtained represent an improvement of approximately 5% in accuracy compared to the state of the art. In addition, during training we observed a faster convergence of our model compared to the state-of-the-art methodologies.


title: ECG-TEM: Time-based sub-Nyquist sampling for ECG signal reconstruction and Hardware Prototype

abstract: Portable heart rate monitoring (HRM) systems based on electrocardiograms (ECGs) have become increasingly crucial for preventing lifestyle diseases. For such portable systems, minimizing power consumption and sampling rate is critical due to the substantial data generated during long-term ECG monitoring. The variable pulse-width finite rate of innovation (VPW-FRI) framework provides an effective solution for low-rate sampling and compression of ECG signals. We develop a time-based sub-Nyquist sampling and reconstruction method for ECG signals specifically designed for HRM applications. Our approach harnesses the integrate-and-fire time-encoding machine (IF-TEM) as a power-efficient, time-based, asynchronous sampler, generating a sequence of time instants without the need for a global clock. The ECG signal is represented as a linear combination of VPW-FRI pulses, which is then subjected to pre-filtering before being sampled by the IF-TEM sampler. A compactly supported robust filter with a frequency-domain alias cancellation condition is used to combat the effects of noise. Our reconstruction process involves consecutive partial summations of discrete representations of the input signal derived from the series of time encodings, further enhancing the accuracy of the reconstructed ECG signals. Additionally, we introduce an IF-TEM sampling hardware system for ECG signals, implemented using an analog filter device. The firing rate is 42-80Hz, equivalent to approximately 0.025-0.05 of the Nyquist rate. Our hardware validation bridges the gap between theory and practice and demonstrates the robust performance and practical applicability of our approach in accurately monitoring heart rates and reconstructing ECG signals.


title: Calibration of stochastic, agent-based neuron growth models with Approximate Bayesian Computation

abstract: Understanding how genetically encoded rules drive and guide complex neuronal growth processes is essential to comprehending the brain's architecture, and agent-based models (ABMs) offer a powerful simulation approach to further develop this understanding. However, accurately calibrating these models remains a challenge. Here, we present a novel application of Approximate Bayesian Computation (ABC) to address this issue. ABMs are based on parametrized stochastic rules that describe the time evolution of small components -- the so-called agents -- discretizing the system, leading to stochastic simulations that require appropriate treatment. Mathematically, the calibration defines a stochastic inverse problem. We propose to address it in a Bayesian setting using ABC. We facilitate the repeated comparison between data and simulations by quantifying the morphological information of single neurons with so-called morphometrics and resort to statistical distances to measure discrepancies between populations thereof. We conduct experiments on synthetic as well as experimental data. We find that ABC utilizing Sequential Monte Carlo sampling and the Wasserstein distance finds accurate posterior parameter distributions for representative ABMs. We further demonstrate that these ABMs capture specific features of pyramidal cells of the hippocampus (CA1). Overall, this work establishes a robust framework for calibrating agent-based neuronal growth models and opens the door for future investigations using Bayesian techniques for model building, verification, and adequacy assessment.