title: Relaxed Quantile Regression: Prediction Intervals for Asymmetric Noise

abstract: Constructing valid prediction intervals rather than point estimates is a well-established approach for uncertainty quantification in the regression setting. Models equipped with this capacity output an interval of values in which the ground truth target will fall with some prespecified probability. This is an essential requirement in many real-world applications where simple point predictions' inability to convey the magnitude and frequency of errors renders them insufficient for high-stakes decisions. Quantile regression is a leading approach for obtaining such intervals via the empirical estimation of quantiles in the (non-parametric) distribution of outputs. This method is simple, computationally inexpensive, interpretable, assumption-free, and effective. However, it does require that the specific quantiles being learned are chosen a priori. This results in (a) intervals that are arbitrarily symmetric around the median which is sub-optimal for realistic skewed distributions, or (b) learning an excessive number of intervals. In this work, we propose Relaxed Quantile Regression (RQR), a direct alternative to quantile regression based interval construction that removes this arbitrary constraint whilst maintaining its strengths. We demonstrate that this added flexibility results in intervals with an improvement in desirable qualities (e.g. mean width) whilst retaining the essential coverage guarantees of quantile regression.


title: Empirical calibration for helium abundance determinations in Active Galactic Nuclei

abstract: For the first time, a calibration between the HeI $\lambda5876$/H$\beta$ emission line ratio and the helium abundance $y$=12+log(He/H) for Narrow line regions (NLRs) of Seyfert~2 Active Galactic Nuclei (AGN) is proposed. In this context, observational data (taken from the SDSS-DR15 and from the literature) and direct abundance estimates (via the $T_{\rm e}$-method) for a sample of 65 local ($z \: < \: 0.2$) Seyfert~2 nuclei are considered. The resulting calibration estimates the $y$ abundance with an average uncertainty of 0.02 dex. Applying our calibration to spectroscopic data containing only strong emission lines, it yields a helium abundance distribution similar to that obtained via the $T_{\rm e}$-method. Some cautions must be considered to apply our calibration for Seyfert~2 nuclei with high values of electron temperature ($\gtrsim\: 20\,000$ K) or ionization parameter ($\log U > -2.0$).


title: Feature learning in finite-width Bayesian deep linear networks with multiple outputs and convolutional layers

abstract: Deep linear networks have been extensively studied, as they provide simplified models of deep learning. However, little is known in the case of finite-width architectures with multiple outputs and convolutional layers. In this manuscript, we provide rigorous results for the statistics of functions implemented by the aforementioned class of networks, thus moving closer to a complete characterization of feature learning in the Bayesian setting. Our results include: (i) an exact and elementary non-asymptotic integral representation for the joint prior distribution over the outputs, given in terms of a mixture of Gaussians; (ii) an analytical formula for the posterior distribution in the case of squared error loss function (Gaussian likelihood); (iii) a quantitative description of the feature learning infinite-width regime, using large deviation theory. From a physical perspective, deep architectures with multiple outputs or convolutional layers represent different manifestations of kernel shape renormalization, and our work provides a dictionary that translates this physics intuition and terminology into rigorous Bayesian statistics.

categories: stat.ML cond-mat.dis-nn cs.LG math.ST stat.TH


title: Baryogenesis via QCD preheating with nonadiabatic baryon chemical potential

abstract: The chiral phase transition in QCD can be supercooled in the thermal history of the universe to be instantaneously out-of equilibrium, if QCD is coupled to a dark QCD sector exhibiting the dark chiral phase transition of the first order. In that case the QCD sigma meson field (as the chiral order parameter, or the light quark condensate) starts to roll in a nonadiabatic way down to the true QCD vacuum. Meanwhile a dynamic baryonic chemical potential can be generated solely within QCD, which is governed by the dynamic motion of the QCD sigma meson field, analogously to the spontaneous baryogenesis or the leptogenesis via the Higgs or axionlike relaxation scenario. When QCD is further allowed to communicate with a dark fermion with mass of order of 1 GeV and the baryon number violating coupling to neutron, the nonadiabatic QCD sigma motion along with the nonadiabatic baryon chemical potential can trigger the preheating and produce the baryon number asymmetry. We discuss this scenario in details to find that the QCD-induced dynamic baryon chemical potential plays a significant role for the QCD preheating and the baryogenesis, which yields the desired amount of the asymmetry today consistently with current astrophysical, cosmological, and terrestrial experimental constraints. Cosmological and phenomenological consequences characteristic to the present scenario are also addressed.


title: ADer: A Comprehensive Benchmark for Multi-class Visual Anomaly Detection

abstract: Visual anomaly detection aims to identify anomalous regions in images through unsupervised learning paradigms, with increasing application demand and value in fields such as industrial inspection and medical lesion detection. Despite significant progress in recent years, there is a lack of comprehensive benchmarks to adequately evaluate the performance of various mainstream methods across different datasets under the practical multi-class setting. The absence of standardized experimental setups can lead to potential biases in training epochs, resolution, and metric results, resulting in erroneous conclusions. This paper addresses this issue by proposing a comprehensive visual anomaly detection benchmark, \textbf{\textit{ADer}}, which is a modular framework that is highly extensible for new methods. The benchmark includes multiple datasets from industrial and medical domains, implementing fifteen state-of-the-art methods and nine comprehensive metrics. Additionally, we have open-sourced the GPU-assisted \href{https://pypi.org/project/ADEval}{ADEval} package to address the slow evaluation problem of metrics like time-consuming mAU-PRO on large-scale data, significantly reducing evaluation time by more than \textit{1000-fold}. Through extensive experimental results, we objectively reveal the strengths and weaknesses of different methods and provide insights into the challenges and future directions of multi-class visual anomaly detection. We hope that \textbf{\textit{ADer}} will become a valuable resource for researchers and practitioners in the field, promoting the development of more robust and generalizable anomaly detection systems. Full codes have been attached in Appendix and open-sourced at \url{https://github.com/zhangzjn/ader}.


title: Deep Generative Models for Proton Zero Degree Calorimeter Simulations in ALICE, CERN

abstract: Simulating detector responses is a crucial part of understanding the inner-workings of particle collisions in the Large Hadron Collider at CERN. The current reliance on statistical Monte-Carlo simulations strains CERN's computational grid, underscoring the urgency for more efficient alternatives. Addressing these challenges, recent proposals advocate for generative machine learning methods. In this study, we present an innovative deep learning simulation approach tailored for the proton Zero Degree Calorimeter in the ALICE experiment. Leveraging a Generative Adversarial Network model with Selective Diversity Increase loss, we directly simulate calorimeter responses. To enhance its capabilities in modeling a broad range of calorimeter response intensities, we expand the SDI-GAN architecture with additional regularization. Moreover, to improve the spatial fidelity of the generated data, we introduce an auxiliary regressor network. Our method offers a significant speedup when comparing to the traditional Monte-Carlo based approaches.


title: No-Regret Algorithms for Safe Bayesian Optimization with Monotonicity Constraints

abstract: We consider the problem of sequentially maximizing an unknown function $f$ over a set of actions of the form $(s,\mathbf{x})$, where the selected actions must satisfy a safety constraint with respect to an unknown safety function $g$. We model $f$ and $g$ as lying in a reproducing kernel Hilbert space (RKHS), which facilitates the use of Gaussian process methods. While existing works for this setting have provided algorithms that are guaranteed to identify a near-optimal safe action, the problem of attaining low cumulative regret has remained largely unexplored, with a key challenge being that expanding the safe region can incur high regret. To address this challenge, we show that if $g$ is monotone with respect to just the single variable $s$ (with no such constraint on $f$), sublinear regret becomes achievable with our proposed algorithm. In addition, we show that a modified version of our algorithm is able to attain sublinear regret (for suitably defined notions of regret) for the task of finding a near-optimal $s$ corresponding to every $\mathbf{x}$, as opposed to only finding the global safe optimum. Our findings are supported with empirical evaluations on various objective and safety functions.


title: Unification with Simple Variable Restrictions and Admissibility of $\Pi_{2}$-rules

abstract: We develop a method to recognize admissibility of $\Pi_{2}$-rules, relating this problem to a specific instance of the unification problem with linear constants restriction, called here "unification with simple variable restriction". It is shown that for logical systems enjoying an appropriate algebraic semantics and a finite approximation of left uniform interpolation, this unification with simple variable restriction can be reduced to standard unification. As a corollary, we obtain the decidability of admissibility of $\Pi_{2}$-rules for many logical systems.


title: Technological Perspective on Digital Sovereignty

abstract: This report for the attention of the Federal Department of Foreign Affairs (FDFA) makes a scientific contribution in the context of postulate 22.4411 "Digital Sovereignty Strategy for Switzerland" by Councillor of States Heidi Z'graggen. The report shows what digital sovereignty means from a technological perspective and what activities are currently being carried out in this regard in Switzerland and abroad. It also provides strategic directions and specific recommendations for a future "Swiss Digital Sovereignty Strategy".


title: Nonlinear Ion-Acoustic Waves with Landau Damping in Non-Maxwellian Space Plasmas

abstract: The dynamics of nonlinear ion-acoustic solitary waves in the presence of kinetic (Landau type) damping have been investigated in a collisionless, non-magnetized electron-ion plasma. A cold ion fluid model, coupled to a Vlasov-type kinetic equation for the electron dynamics, has been adopted as a starting point. The electron population was assumed to be in a kappa-distributed state, in account of the non-Maxwellian behavior of energetic (suprathermal) electrons often observed in Space. A multiscale perturbation technique has led to an evolution equation for the electrostatic potential, in the form of a modified Korteweg-de Vries (KdV) equation, incorporating a non-local term accounting for Landau damping (associated with the electron statistics). Exact analytical solutions have been obtained, representing solitary waves undergoing amplitude decay over time. The combined effect of Landau damping and non-Maxwellian electron statistics (via the kappa parameter) on the characteristics of IASWs has been examined. Numerical integration of the evolution equation has been undertaken, to elucidate the importance of kinetic Landau damping on a shock-shaped initial condition. The results of this investigation aim to improve our understanding of the dynamics of nonlinear electrostatic waves under the influence of Landau damping in various space plasma environments.


title: Relative Entropy for the Numerical Diffusive Limit of the Linear Jin-Xin System

abstract: This paper deals with the diffusive limit of the Jin and Xin model and its approximation by an asymptotic preserving finite volume scheme. At the continuous level, we determine a convergence rate to the diffusive limit by means of a relative entropy method. Considering a semi-discrete approximation (discrete in space and continuous in time), we adapt the method to this semi-discrete framework and establish that the approximated solutions converge towards the discrete convection-diffusion limit with the same convergence rate.


title: Advancing Mathematical Epidemic Modeling via synergies with Chemical Reaction Network Theory and Lagrange-Hamilton Geometry

abstract: This essay reviews some key concepts in mathematical epidemiology and examines the intersection of this field with related scientific disciplines, such as chemical reaction network theory and Lagrange-Hamilton geometry. Through a synthesis of theoretical insights and practical perspectives, we underscore the significance of essentially non-negative kinetic systems in the development and implementation of robust epidemiological models. Our purpose is to make the case that currently mathematical modeling of epidemiology is focusing too much on simple particular cases, and maybe not enough on more complex models, whose challenges would require cooperation with scientific computing experts and with researchers in the "sister disciplines" involving essentially nonnegative kinetic systems (like virology, ecology, chemical reaction networks, population dynamics, etc).


title: A Successive Gap Constraint Linearization Method for Optimal Control Problems with Equilibrium Constraints

abstract: In this study, we propose a novel gap-constraint-based reformulation for optimal control problems with equilibrium constraints (OCPECs). We show that the proposed reformulation generates a new constraint system equivalent to the original one but more concise and with favorable differentiability. Moreover, constraint regularity can be recovered by a relaxation strategy. We show that the gap constraint and its gradient can be evaluated efficiently. We then propose a successive gap constraint linearization method to solve the discretized OCPEC. We also provide an intuitive geometric interpretation of the gap constraint. Numerical experiments validate the effectiveness of the proposed reformulation and solution method.


title: Image Copy-Move Forgery Detection and Localization Scheme: How to Avoid Missed Detection and False Alarm

abstract: Image copy-move is an operation that replaces one part of the image with another part of the same image, which can be used for illegal purposes due to the potential semantic changes. Recent studies have shown that keypoint-based algorithms achieved excellent and robust localization performance even when small or smooth tampered areas were involved. However, when the input image is low-resolution, most existing keypoint-based algorithms are difficult to generate sufficient keypoints, resulting in more missed detections. In addition, existing algorithms are usually unable to distinguish between Similar but Genuine Objects (SGO) images and tampered images, resulting in more false alarms. This is mainly due to the lack of further verification of local homography matrix in forgery localization stage. To tackle these problems, this paper firstly proposes an excessive keypoint extraction strategy to overcome missed detection. Subsequently, a group matching algorithm is used to speed up the matching of excessive keypoints. Finally, a new iterative forgery localization algorithm is introduced to quickly form pixel-level localization results while ensuring a lower false alarm. Extensive experimental results show that our scheme has superior performance than state-of-the-art algorithms in overcoming missed detection and false alarm. Our code is available at https://github.com/LUZW1998/CMFDL.


title: Multi-Microphone Speech Emotion Recognition using the Hierarchical Token-semantic Audio Transformer Architecture

abstract: Most emotion recognition systems fail in real-life situations (in the wild scenarios) where the audio is contaminated by reverberation. Our study explores new methods to alleviate the performance degradation of Speech Emotion Recognition (SER) algorithms and develop a more robust system for adverse conditions. We propose processing multi-microphone signals to address these challenges and improve emotion classification accuracy. We adopt a state-of-the-art transformer model, the Hierarchical Token-semantic Audio Transformer (HTS-AT), to handle multi-channel audio inputs. We evaluate two strategies: averaging mel-spectrograms across channels and summing patch-embedded representations. Our multimicrophone model achieves superior performance compared to single-channel baselines when tested on real-world reverberant environments.


title: VWise: A novel benchmark for evaluating scene classification for vehicular applications

abstract: Current datasets for vehicular applications are mostly collected in North America or Europe. Models trained or evaluated on these datasets might suffer from geographical bias when deployed in other regions. Specifically, for scene classification, a highway in a Latin American country differs drastically from an Autobahn, for example, both in design and maintenance levels. We propose VWise, a novel benchmark for road-type classification and scene classification tasks, in addition to tasks focused on external contexts related to vehicular applications in LatAm. We collected over 520 video clips covering diverse urban and rural environments across Latin American countries, annotated with six classes of road types. We also evaluated several state-of-the-art classification models in baseline experiments, obtaining over 84% accuracy. With this dataset, we aim to enhance research on vehicular tasks in Latin America.


title: Enhancing CTC-based speech recognition with diverse modeling units

abstract: In recent years, the evolution of end-to-end (E2E) automatic speech recognition (ASR) models has been remarkable, largely due to advances in deep learning architectures like transformer. On top of E2E systems, researchers have achieved substantial accuracy improvement by rescoring E2E model's N-best hypotheses with a phoneme-based model. This raises an interesting question about where the improvements come from other than the system combination effect. We examine the underlying mechanisms driving these gains and propose an efficient joint training approach, where E2E models are trained jointly with diverse modeling units. This methodology does not only align the strengths of both phoneme and grapheme-based models but also reveals that using these diverse modeling units in a synergistic way can significantly enhance model accuracy. Our findings offer new insights into the optimal integration of heterogeneous modeling units in the development of more robust and accurate ASR systems.


title: Improved stability for the size and structure of sumsets

abstract: Let $A \subset \mathbb{Z}^d$ be a finite set. It is known that the sumset $NA$ has predictable size ($\vert NA\vert = P_A(N)$ for some $P_A(X) \in \mathbb{Q}[X]$) and structure (all of the lattice points in some finite cone other than all of the lattice points in a finite collection of exceptional subcones), once $N$ is larger than some threshold. In previous work, joint with Shakan, the first and third named authors established the first effective bounds for both of these thresholds for an arbitrary set $A$. In this article we substantially improve each of these bounds, coming much closer to the corresponding lower bounds known.


title: Revisiting Scalable Hessian Diagonal Approximations for Applications in Reinforcement Learning

abstract: Second-order information is valuable for many applications but challenging to compute. Several works focus on computing or approximating Hessian diagonals, but even this simplification introduces significant additional costs compared to computing a gradient. In the absence of efficient exact computation schemes for Hessian diagonals, we revisit an early approximation scheme proposed by Becker and LeCun (1989, BL89), which has a cost similar to gradients and appears to have been overlooked by the community. We introduce HesScale, an improvement over BL89, which adds negligible extra computation. On small networks, we find that this improvement is of higher quality than all alternatives, even those with theoretical guarantees, such as unbiasedness, while being much cheaper to compute. We use this insight in reinforcement learning problems where small networks are used and demonstrate HesScale in second-order optimization and scaling the step-size parameter. In our experiments, HesScale optimizes faster than existing methods and improves stability through step-size scaling. These findings are promising for scaling second-order methods in larger models in the future.


title: Turbulent relaxation patterns in SOL plasma

abstract: Relaxations of localized over-density in a plane transverse to the magnetic field are numericallyinvestigated under the effect of drift-wave and interchange drives in SOL conditions. Such a controlleddeparture from thermodynamic equilibrium allows the investigation of fundamental processesat play in cross-field transport. Interchange instabilities generate ballistic outward radial flux withlow amplitude zonal flow patterns, whereas drift-wave instabilities result in symmetric radial fluxwith large amplitude zonal flow patterns. When both instabilities are considered, the combinedeffects tend to favor drift-waves, leading to a weaker outward flux with larger zonal flow patterns.


title: Using GNN property predictors as molecule generators

abstract: Graph neural networks (GNNs) have emerged as powerful tools to accurately predict materials and molecular properties in computational discovery pipelines. In this article, we exploit the invertible nature of these neural networks to directly generate molecular structures with desired electronic properties. Starting from a random graph or an existing molecule, we perform a gradient ascent while holding the GNN weights fixed in order to optimize its input, the molecular graph, towards the target property. Valence rules are enforced strictly through a judicious graph construction. The method relies entirely on the property predictor; no additional training is required on molecular structures. We demonstrate the application of this method by generating molecules with specific DFT-verified energy gaps and octanol-water partition coefficients (logP). Our approach hits target properties with rates comparable to or better than state-of-the-art generative models while consistently generating more diverse molecules.


title: Effective Quantum Gravitational Collapse in a Polymer Framework

abstract: We study how the presence of an area gap, different than zero, affects the gravitational collapse of a dust ball. The implementation of such discreteness is achieved through the framework of polymer quantization, a scheme inspired by loop quantum gravity (LQG). We study the collapse using variables which represent the area, in order to impose the non-zero area gap condition. The collapse is analyzed for both the flat and spherical Oppenheimer-Snyder models. In both scenarios the formation of the singularity is avoided, due to the inversion of the velocity at finite values of the sphere surface. This happens due to the presence of a negative pressure, with origins at a quantum level. When the inversion happens inside the black hole event horizon, we achieve a geometry transition to a white hole. When the inversion happens outside the event horizon, we find a new possible astrophysical object. A characterization of such hypothetical object is done. Some constraints on the value for the area gap are also imposed in order to maintain the link with our already established physical theories.


title: FusionBench: A Comprehensive Benchmark of Deep Model Fusion

abstract: Deep model fusion is an emerging technique that unifies the predictions or parameters of several deep neural networks into a single model in a cost-effective and data-efficient manner. This enables the unified model to take advantage of the original models' strengths, potentially exceeding their performance. Although a variety of deep model fusion techniques have been introduced, their evaluations tend to be inconsistent and often inadequate to validate their effectiveness and robustness against distribution shifts. To address this issue, we introduce FusionBench, which is the first comprehensive benchmark dedicated to deep model fusion. FusionBench covers a wide range of tasks, including open-vocabulary image classification, text classification, and text-to-text generation. Each category includes up to eight tasks with corresponding task-specific models, featuring both full fine-tuning and LoRA fine-tuning, as well as models of different sizes, to ensure fair and balanced comparisons of various multi-task model fusion techniques across different tasks, model scales, and fine-tuning strategies. We implement and evaluate a broad spectrum of deep model fusion techniques. These techniques range from model ensemble methods, which combine the predictions to improve the overall performance, to model merging, which integrates different models into a single one, and model mixing methods, which upscale or recombine the components of the original models. FusionBench now contains 26 distinct tasks, 74 fine-tuned models, and 16 fusion techniques, and we are committed to consistently expanding the benchmark with more tasks, models, and fusion techniques. In addition, we offer a well-documented set of resources and guidelines to aid researchers in understanding and replicating the benchmark results. Homepage https://github.com/tanganke/fusion_bench


title: Constructing efficient spatial discretizations of spans of multivariate Chebyshev polynomials

abstract: For an arbitrary given span of high-dimensional multivariate Chebyshev polynomials, an approach to construct spatial discretizations is presented, i.e., the construction of a sampling set that allows for the unique reconstruction of each polynomial of this span. The approach presented here combines three different types of efficiency. First, the construction of the spatial discretization should be efficient with respect to the dimension of the span of the Chebyshev polynomials. Second, the number of sampling nodes within the constructed discretizations should be efficient, i.e., the oversampling factors should be reasonable. Third, there should be an efficient method for the unique reconstruction of a polynomial from given sampling values at the sampling nodes of the discretization. The first two mentioned types of efficiency are also present in constructions based on random sampling nodes, but the lack of structure here causes the inefficiency of the reconstruction method. Our approach uses a combination of cosine transformed rank-1 lattices whose structure allows for applications of univariate fast Fourier transforms for the reconstruction algorithm and is thus a priori efficiently realizable. Besides the theoretical estimates of numbers of sampling nodes and failure probabilities due to a random draw of the used lattices, we present several improvements of the basic design approach that significantly increases its practical applicability. Numerical tests, which discretize spans of multivariate Chebyshev polynomials depending on up to more than 50 spatial variables, corroborate the theoretical results and the significance of the improvements.


title: Globally and Locally Optimized Pannini Projection for High FoV Rendering of 360-degree Images

abstract: To render a spherical (360 degree or omnidirectional) image on planar displays, a 2D image -- called as viewport -- must be obtained by projecting a sphere region on a plane, according to the users viewing direction and a predefined field of view (FoV). However, any sphere to plan projection introduces geometric distortions, such as object stretching and/or bending of straight lines, which intensity increases with the considered FoV. In this paper, a fully automatic content-aware projection is proposed, aiming to reduce the geometric distortions when high FoVs are used. This new projection is based on the Pannini projection, whose parameters are firstly globally optimized according to the image content, followed by a local conformality improvement of relevant viewport objects. A crowdsourcing subjective test showed that the proposed projection is the most preferred solution among the considered state-of-the-art sphere to plan projections, producing viewports with a more pleasant visual quality.


title: Enhancing Repository-Level Code Generation with Integrated Contextual Information

abstract: Large language models (LLMs) have demonstrated remarkable capabilities in code generation tasks. However, repository-level code generation presents unique challenges, particularly due to the need to utilize information spread across multiple files within a repository. Existing retrieval-based approaches sometimes fall short as they are limited in obtaining a broader and deeper repository context. In this paper, we present CatCoder, a novel code generation framework designed for statically typed programming languages. CatCoder enhances repository-level code generation by integrating relevant code and type context. Specifically, it leverages static analyzers to extract type dependencies and merges this information with retrieved code to create comprehensive prompts for LLMs. To evaluate the effectiveness of CatCoder, we adapt and construct benchmarks that include 199 Java tasks and 90 Rust tasks. The results show that CatCoder outperforms the RepoCoder baseline by up to 17.35%, in terms of pass@k score. Furthermore, the generalizability of CatCoder is assessed using various LLMs, including both code-specialized models and general-purpose models. Our findings indicate consistent performance improvements across all models, which underlines the practicality of CatCoder.


title: Geometric inequalities for quasi-Einstein manifolds

abstract: In this article, we investigate some geometric inequalities for quasi-Einstein manifolds. We use the generalized Reilly's formulas by Qiu-Xia and Li-Xia to establish new boundary estimates and an isoperimetric type inequality for compact quasi-Einstein manifolds with boundary. Boundary estimates in terms of the first eigenvalue of the Jacobi operator and the Hawking mass are also established. In particular, we present a Heintze-Karcher type inequality for a compact domain on a quasi-Einstein manifold.


title: Efficient Data-Parallel Continual Learning with Asynchronous Distributed Rehearsal Buffers

abstract: Deep learning has emerged as a powerful method for extracting valuable information from large volumes of data. However, when new training data arrives continuously (i.e., is not fully available from the beginning), incremental training suffers from catastrophic forgetting (i.e., new patterns are reinforced at the expense of previously acquired knowledge). Training from scratch each time new training data becomes available would result in extremely long training times and massive data accumulation. Rehearsal-based continual learning has shown promise for addressing the catastrophic forgetting challenge, but research to date has not addressed performance and scalability. To fill this gap, we propose an approach based on a distributed rehearsal buffer that efficiently complements data-parallel training on multiple GPUs, allowing us to achieve short runtime and scalability while retaining high accuracy. It leverages a set of buffers (local to each GPU) and uses several asynchronous techniques for updating these local buffers in an embarrassingly parallel fashion, all while handling the communication overheads necessary to augment input mini-batches (groups of training samples fed to the model) using unbiased, global sampling. In this paper we explore the benefits of this approach for classification models. We run extensive experiments on up to 128 GPUs of the ThetaGPU supercomputer to compare our approach with baselines representative of training-from-scratch (the upper bound in terms of accuracy) and incremental training (the lower bound). Results show that rehearsal-based continual learning achieves a top-5 classification accuracy close to the upper bound, while simultaneously exhibiting a runtime close to the lower bound.


title: Exponential Consensus Formation in Time-Varying Multiagent Systems via Compactification Methods

abstract: In this article, we establish exponential contraction results for the diameter and variance of general first-order multiagent systems. Our approach is based on compactification techniques, and works under rather mild assumptions. Namely, we posit that either the scrambling coefficient, or the algebraic connectivity of the averaged interaction graphs of the system over all time windows of a given length are uniformly positive.


title: SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms

abstract: Towards energy-efficient artificial intelligence similar to the human brain, the bio-inspired spiking neural networks (SNNs) have advantages of biological plausibility, event-driven sparsity, and binary activation. Recently, large-scale language models exhibit promising generalization capability, making it a valuable issue to explore more general spike-driven models. However, the binary spikes in existing SNNs fail to encode adequate semantic information, placing technological challenges for generalization. This work proposes the first fully spiking mechanism for general language tasks, including both discriminative and generative ones. Different from previous spikes with {0,1} levels, we propose a more general spike formulation with bi-directional, elastic amplitude, and elastic frequency encoding, while still maintaining the addition nature of SNNs. In a single time step, the spike is enhanced by direction and amplitude information; in spike frequency, a strategy to control spike firing rate is well designed. We plug this elastic bi-spiking mechanism in language modeling, named SpikeLM. It is the first time to handle general language tasks with fully spike-driven models, which achieve much higher accuracy than previously possible. SpikeLM also greatly bridges the performance gap between SNNs and ANNs in language modeling. Our code is available at https://github.com/Xingrun-Xing/SpikeLM.


title: Embarrassingly Parallel GFlowNets

abstract: GFlowNets are a promising alternative to MCMC sampling for discrete compositional random variables. Training GFlowNets requires repeated evaluations of the unnormalized target distribution or reward function. However, for large-scale posterior sampling, this may be prohibitive since it incurs traversing the data several times. Moreover, if the data are distributed across clients, employing standard GFlowNets leads to intensive client-server communication. To alleviate both these issues, we propose embarrassingly parallel GFlowNet (EP-GFlowNet). EP-GFlowNet is a provably correct divide-and-conquer method to sample from product distributions of the form $R(\cdot) \propto R_1(\cdot) ... R_N(\cdot)$ -- e.g., in parallel or federated Bayes, where each $R_n$ is a local posterior defined on a data partition. First, in parallel, we train a local GFlowNet targeting each $R_n$ and send the resulting models to the server. Then, the server learns a global GFlowNet by enforcing our newly proposed \emph{aggregating balance} condition, requiring a single communication step. Importantly, EP-GFlowNets can also be applied to multi-objective optimization and model reuse. Our experiments illustrate the EP-GFlowNets's effectiveness on many tasks, including parallel Bayesian phylogenetics, multi-objective multiset, sequence generation, and federated Bayesian structure learning.


title: Production of $ B \bar{B}$ bound state via $\Upsilon (4S)$ radiative decays

abstract: Motivated by recent theoretical predictions about the existence of a $ B \bar{B}$ bound state (also denoted as $ X(10550) $), in this work we estimate the production of the $S$-wave $ B^+ B^-$ molecule via $\Upsilon (4S)$ radiative decays. In particular, we make use of effective Lagrangian approach and the compositeness condition to calculate the $ X(10550) $ production rate via $\Upsilon(4S)\rightarrow \gamma X(10550)$ decays employing triangle diagrams. Our results show that the partial decay width of this reaction is of the order of $0.5 - 192 \ \keV $ for a respective binding energy of $1 - 100 $ MeV, corresponding to a branching fraction of $ 10^{-5} - 10^{-3}$. These findings suggest that the existence of the $ X(10550) $ might be checked via the analysis of the mentioned decay in present and future experiments.


title: Sparse Sets in Triangle-free Graphs

abstract: A set of vertices is $k$-sparse if it induces a graph with a maximum degree of at most $k$. In this missive, we consider the order of the largest $k$-sparse set in a triangle-free graph of fixed order. We show, for example, that every triangle-free graph of order 11 contains a 1-sparse 5-set; every triangle-free graph of order 13 contains a 2-sparse 7-set; and every triangle-free graph of order 8 contains a 3-sparse 6-set. Further, these are all best possible. For fixed $k$, we consider the growth rate of the largest $k$-sparse set of a triangle-free graph of order $n$. Also, we consider Ramsey numbers of the following type. Given $i$, what is the smallest $n$ having the property that all triangle-free graphs of order $n$ contain a 4-cycle or a $k$-sparse set of order $i$. We use both direct proof techniques and an efficient graph enumeration algorithm to obtain several values for defective Ramsey numbers and a parameter related to largest sparse sets in triangle-free graphs, along with their extremal graphs.


title: Partial regularity and $L^3$-norm concentration effects around possible blow-up points for the micropolar fluid equations

abstract: The micropolar fluid system is a model based on the Navier-Stokes equations which considers two coupled variables: the velocity field $\vec u$ and the microrotation field $\vec\omega$. Assuming an additional condition over the variable $\vec u$ we will first prove that weak solutions $(\vec u, \vec\omega)$ of this system are smooth. Then, we will present a concentration effect of the $L^3_x$ norm of the velocity field $\vec u$ near a possible singular time.


title: Evaluating AI fairness in credit scoring with the BRIO tool

abstract: We present a method for quantitative, in-depth analyses of fairness issues in AI systems with an application to credit scoring. To this aim we use BRIO, a tool for the evaluation of AI systems with respect to social unfairness and, more in general, ethically undesirable behaviours. It features a model-agnostic bias detection module, presented in \cite{DBLP:conf/beware/CoragliaDGGPPQ23}, to which a full-fledged unfairness risk evaluation module is added. As a case study, we focus on the context of credit scoring, analysing the UCI German Credit Dataset \cite{misc_statlog_(german_credit_data)_144}. We apply the BRIO fairness metrics to several, socially sensitive attributes featured in the German Credit Dataset, quantifying fairness across various demographic segments, with the aim of identifying potential sources of bias and discrimination in a credit scoring model. We conclude by combining our results with a revenue analysis.


title: Text-to-Image Rectified Flow as Plug-and-Play Priors

abstract: Large-scale diffusion models have achieved remarkable performance in generative tasks. Beyond their initial training applications, these models have proven their ability to function as versatile plug-and-play priors. For instance, 2D diffusion models can serve as loss functions to optimize 3D implicit models. Rectified flow, a novel class of generative models, enforces a linear progression from the source to the target distribution and has demonstrated superior performance across various domains. Compared to diffusion-based methods, rectified flow approaches surpass in terms of generation quality and efficiency, requiring fewer inference steps. In this work, we present theoretical and experimental evidence demonstrating that rectified flow based methods offer similar functionalities to diffusion models - they can also serve as effective priors. Besides the generative capabilities of diffusion priors, motivated by the unique time-symmetry properties of rectified flow models, a variant of our method can additionally perform image inversion. Experimentally, our rectified flow-based priors outperform their diffusion counterparts - the SDS and VSD losses - in text-to-3D generation. Our method also displays competitive performance in image inversion and editing.


title: Feedback loop dependent charge density wave imaging by scanning tunneling spectroscopy

abstract: Scanning Tunneling Spectroscopy (STS) is a unique technique to probe the local density of states (LDOS) at the atomic scale by measuring the tunneling conductance between a sharp tip and a sample surface. However, the technique suffers of well-known limitations, the so-called set-point effect, which can potentially introduce artifacts in the measurements. We compare several STS imaging schemes applied to the LDOS modulations of the charge density wave state on atomically flat surfaces, and demonstrate that only constant-height STS is capable of mapping the intrinsic LDOS. In the constant-current STS, commonly used and easier-to-implement, the tip-sample distance variations imposed by the feedback loop result in set-point-dependent STS images and possibly mislead the identification of the CDW gap edges.


title: Comparative Analysis of Nanomechanical Resonators: Sensitivity, Response Time, and Practical Considerations in Photothermal Sensing

abstract: Nanomechanical photothermal sensing has significantly advanced single-molecule/particle microscopy and spectroscopy, and infrared detection through the use of nanomechanical resonators that detect shifts in resonant frequency due to photothermal heating. However, the relationship between resonator design, photothermal sensitivity, and response time remains unclear. This paper compares three resonator types - strings, drumheads, and trampolines - to explore this relationship. Through theoretical modeling, experimental validation, and finite element method simulations, we find that strings offer the highest sensitivity (with a noise equivalent power of 280 fW/Hz$^{1/2}$ for strings made of silicon nitride), while drumheads exhibit the fastest thermal response. The study reveals that photothermal sensitivity correlates with the average temperature rise and not the peak temperature. Finally, the impact of photothermal back-action is discussed, which can be a major source of frequency instability. This work clarifies the performance differences and limits among resonator designs and guides the development of advanced nanomechanical photothermal sensors, benefiting a wide range of applications.


title: Multi-relational Network Autoregression Model with Latent Group Structures

abstract: Multi-relational networks among entities are frequently observed in the era of big data. Quantifying the effects of multiple networks have attracted significant research interest recently. In this work, we model multiple network effects through an autoregressive framework for tensor-valued time series. To characterize the potential heterogeneity of the networks and handle the high dimensionality of the time series data simultaneously, we assume a separate group structure for entities in each network and estimate all group memberships in a data-driven fashion. Specifically, we propose a group tensor network autoregression (GTNAR) model, which assumes that within each network, entities in the same group share the same set of model parameters, and the parameters differ across networks. An iterative algorithm is developed to estimate the model parameters and the latent group memberships simultaneously. Theoretically, we show that the group-wise parameters and group memberships can be consistently estimated when the group numbers are correctly- or possibly over-specified. An information criterion for group number estimation of each network is also provided to consistently select the group numbers. Lastly, we implement the method on a Yelp dataset to illustrate the usefulness of the method.


title: Functional calculus on weighted Sobolev spaces for the Laplacian on the half-space

abstract: In this paper, we consider the Laplace operator on the half-space with Dirichlet and Neumann boundary conditions. We prove that this operator admits a bounded $H^\infty$-calculus on Sobolev spaces with power weights measuring the distance to the boundary. These weights do not necessarily belong to the class of Muckenhoupt $A_p$ weights. We additionally study the corresponding Dirichlet and Neumann heat semigroup. It is shown that these semigroups, in contrast to the $L^p$-case, have polynomial growth. Moreover, maximal regularity results for the heat equation are derived on inhomogeneous and homogeneous weighted Sobolev spaces.


title: L-PR: Exploiting LiDAR Fiducial Marker for Unordered Low Overlap Multiview Point Cloud Registration

abstract: Point cloud registration is a prerequisite for many applications in computer vision and robotics. Most existing methods focus on pairwise registration of two point clouds with high overlap. Although there have been some methods for low overlap cases, they struggle in degraded scenarios. This paper introduces a novel framework named L-PR, designed to register unordered low overlap multiview point clouds leveraging LiDAR fiducial markers. We refer to them as LiDAR fiducial markers, but they are the same as the popular AprilTag and ArUco markers, thin sheets of paper that do not affect the 3D geometry of the environment. We first propose an improved adaptive threshold marker detection method to provide robust detection results when the viewpoints among point clouds change dramatically. Then, we formulate the unordered multiview point cloud registration problem as a maximum a-posteriori (MAP) problem and develop a framework consisting of two levels of graphs to address it. The first-level graph, constructed as a weighted graph, is designed to efficiently and optimally infer initial values of scan poses from the unordered set. The second-level graph is constructed as a factor graph. By globally optimizing the variables on the graph, including scan poses, marker poses, and marker corner positions, we tackle the MAP problem. We conduct qualitative and quantitative experiments to demonstrate that the proposed method exhibits superiority over competitors in four aspects: registration accuracy, instance reconstruction quality, localization accuracy, and robustness to the degraded scene. To benefit the community, we open-source our method and dataset at https://github.com/yorklyb/LiDAR-SFM.


title: The Good, the Bad, and the Hulk-like GPT: Analyzing Emotional Decisions of Large Language Models in Cooperation and Bargaining Games

abstract: Behavior study experiments are an important part of society modeling and understanding human interactions. In practice, many behavioral experiments encounter challenges related to internal and external validity, reproducibility, and social bias due to the complexity of social interactions and cooperation in human user studies. Recent advances in Large Language Models (LLMs) have provided researchers with a new promising tool for the simulation of human behavior. However, existing LLM-based simulations operate under the unproven hypothesis that LLM agents behave similarly to humans as well as ignore a crucial factor in human decision-making: emotions. In this paper, we introduce a novel methodology and the framework to study both, the decision-making of LLMs and their alignment with human behavior under emotional states. Experiments with GPT-3.5 and GPT-4 on four games from two different classes of behavioral game theory showed that emotions profoundly impact the performance of LLMs, leading to the development of more optimal strategies. While there is a strong alignment between the behavioral responses of GPT-3.5 and human participants, particularly evident in bargaining games, GPT-4 exhibits consistent behavior, ignoring induced emotions for rationality decisions. Surprisingly, emotional prompting, particularly with `anger' emotion, can disrupt the "superhuman" alignment of GPT-4, resembling human emotional responses.


title: Form factor bootstrap in the thermally perturbed tricritical Ising model

abstract: We derive a systematic construction for form factors of relevant fields in the thermal perturbation of the tricritical Ising model, an integrable model with scattering amplitudes described by the $E_7$ bootstrap. We find a new type of recursive structure encoding the information in the bound state fusion structure, which fully determines the form factors of the perturbing field and the order/disorder fields, for which we present a mathematical proof. Knowledge of these form factors enables the systematic computation of correlation functions and dynamical structure factors in systems whose dynamics is governed by the vicinity of a fixed point in the tricritical Ising universality class.


title: Effects of Mosaic Crystal Instrument Functions on X-ray Thomson Scattering Diagnostics

abstract: Mosaic crystals, with their high integrated reflectivities, are widely-employed in spectrometers used to diagnose high energy density systems. X-ray Thomson scattering (XRTS) has emerged as a powerful diagnostic tool of these systems, providing in principle direct access to important properties such as the temperature via detailed balance. However, the measured XRTS spectrum is broadened by the spectrometer instrument function (IF), and without careful consideration of the IF one risks misdiagnosing system conditions. Here, we consider in detail the IF of mosaic crystals and how the broadening varies across the spectrometer. Notably, we find a strong asymmetry in the shape of the IF towards higher energies. As an example, we consider the effect on the inferred temperature, and find that it can be overestimated if an approximate symmetric IF is used. We therefore expect a detailed consideration of the full IF will have an important impact on system properties inferred via XRTS in both forward modelling and model-free approaches.


title: Combining an experimental study with external data: study designs and identification strategies

abstract: There is increasing interest in combining information from experimental studies, including randomized and single-group trials, with information from external experimental or observational data sources. Such efforts are usually motivated by the desire to compare treatments evaluated in different studies -- for instance, through the introduction of external treatment groups -- or to estimate treatment effects with greater precision. Proposals to combine experimental studies with external data were made at least as early as the 1970s, but in recent years have come under increasing consideration by regulatory agencies involved in drug and device evaluation, particularly with the increasing availability of rich observational data. In this paper, we describe basic templates of study designs and data structures for combining information from experimental studies with external data, and use the potential (counterfactual) outcomes framework to elaborate identification strategies for potential outcome means and average treatment effects in these designs. In formalizing designs and identification strategies for combining information from experimental studies with external data, we hope to provide a conceptual foundation to support the systematic use and evaluation of such efforts.


title: Learning Visual Prompts for Guiding the Attention of Vision Transformers

abstract: Visual prompting infuses visual information into the input image to adapt models toward specific predictions and tasks. Recently, manually crafted markers such as red circles are shown to guide the model to attend to a target region on the image. However, these markers only work on models trained with data containing those markers. Moreover, finding these prompts requires guesswork or prior knowledge of the domain on which the model is trained. This work circumvents manual design constraints by proposing to learn the visual prompts for guiding the attention of vision transformers. The learned visual prompt, added to any input image would redirect the attention of the pre-trained vision transformer to its spatial location on the image. Specifically, the prompt is learned in a self-supervised manner without requiring annotations and without fine-tuning the vision transformer. Our experiments demonstrate the effectiveness of the proposed optimization-based visual prompting strategy across various pre-trained vision encoders.


title: Variational readout through quantum teleportation

abstract: Sensitivity of gravitational-wave detectors (GWDs) is constrained at low frequencies by quantum radiation-pressure noise, a manifestation of the measurement's back action. One strategy to mitigate this back action involves employing variational readout, which entails cross-correlating the measurement shot noise with radiation-pressure noise. Prior research has demonstrated that variational readout in GWDs can be accomplished through the use of a filter cavity. However, current gravitational-wave detectors necessitate filter cavity lengths on the order of $\sim 100$ meters, with future detectors anticipated to reach lengths of a few kilometers. This paper introduces a novel approach to variational readout utilizing principle of quantum teleportation, which eliminates the need for a filter cavity. *This document will not be published any journals, since it turned out to be not very useful for the real detectors. The main reason is that one does not need the EPR entanglement to obtain the same result, which does not even shows true variational readout. In other words, both schemes do not exceed the EPR squeezing. Nevertheless this document will be uploaded to stimulate discussions how to realize "true" back action evasion, such as variational readout or speed meter, via quantum entanglement.


title: Parametric Study of a Bladeless Fan Geometry: Investigating the Influence of Geometry Parameters on Discharge Ratio and Thrust Force

abstract: The innovative bladeless design of the AirMultiplier, patented by Dyson in 2009, has generated significant interest due to its unique approach to air circulation that leverages the Coanda effect. In this study, we present a comprehensive parametric analysis of a simplified bladeless fan geometry, with a specific focus on the discharge ratio and generated thrust force for small to medium radii (5 to 200mm) and a range of flow rates spanning from 1 to 100g/s. In addition to the radii and mass flow rates, this study also addresses the effect of the slit nozzle thickness on the discharge ratio and thrust force of the AirMultiplier. By exploring the influence of this additional parameter, we aim to provide a more complete understanding of the performance characteristics of the geometry and to offer insights that could inform the design and optimization of similar bladeless geometries.


title: Heisenberg-limited adaptive gradient estimation for multiple observables

abstract: In quantum mechanics, measuring the expectation value of a general observable has an inherent statistical uncertainty that is quantified by variance or mean squared error of measurement outcome. While the uncertainty can be reduced by averaging several samples, the number of samples should be minimized when each sample is very costly. This is especially the case for fault-tolerant quantum computing that involves measurement of multiple observables of non-trivial states in large quantum systems that exceed the capabilities of classical computers. In this work, we provide an adaptive quantum algorithm for estimating the expectation values of $M$ general observables within root mean squared error $\varepsilon$ simultaneously, using $\mathcal{O}(\varepsilon^{-1}\sqrt{M}\log M)$ queries to a state preparation oracle of a target state. This remarkably achieves the scaling of Heisenberg limit $1/\varepsilon$, a fundamental bound on the estimation precision in terms of mean squared error, together with the sublinear scaling of the number of observables $M$. The proposed method is an adaptive version of the quantum gradient estimation algorithm and has a resource-efficient implementation due to its adaptiveness. Specifically, the space overhead in the proposed method is $\mathcal{O}(M)$ which is independent from the estimation precision $\varepsilon$ unlike non-iterative algorithms. In addition, our method can avoid the numerical instability problem for constructing quantum circuits in a large-scale task (e.g., $\varepsilon\ll 1$ in our case), which appears in the actual implementation of many algorithms relying on quantum signal processing techniques. Our method paves a new way to precisely understand and predict various physical properties in complicated quantum systems using quantum computers.


title: Multi-Patch Isogeometric Convolution Hierarchical Deep-learning Neural Network

abstract: A seamless integration of neural networks with Isogeometric Analysis (IGA) was first introduced in [1] under the name of Hierarchical Deep-learning Neural Network (HiDeNN) and has systematically evolved into Isogeometric Convolution HiDeNN (in short, C-IGA) [2]. C-IGA achieves higher order approximations without increasing the degree of freedom. Due to the Kronecker delta property of C-IGA shape functions, one can refine the mesh in the physical domain like standard finite element method (FEM) while maintaining the exact geometrical mapping of IGA. In this article, C-IGA theory is generalized for multi-CAD-patch systems with a mathematical investigation of the compatibility conditions at patch interfaces and convergence of error estimates. Two compatibility conditions (nodal compatibility and G^0 (i.e., global C^0) compatibility) are presented and validated through numerical examples.


title: How Gaia sheds light on the Milky Way star cluster population

abstract: Star clusters are among the first celestial objects catalogued by early astronomers. As simple and coeval populations, their study has been instrumental in charting the properties of the Milky Way and providing insight into stellar evolution through the 20th century. Clusters were traditionally spotted as local stellar overdensities in the plane of the sky. In recent decades, for a limited number of nearby clusters, it became possible to identify cluster members through their clustering in proper motion space. With its astrometric data of unprecedented precision, the Gaia mission has completely revolutionised our ability to discover and characterise Milky Way star clusters, to map their large-scale distribution, and to investigate their internal structure. In this review we focus on the population of open clusters, residing in the Galactic disc. We summarise the current state of the Gaia-updated cluster census and studies of young clusters and associations. We discuss recent developments in techniques for cluster detection and age estimation. We also review results enabled by Gaia data concerning the dynamical evolution of gravitationally bound clusters and their stellar inventory.


title: Forward-backward algorithms devised by graphs

abstract: In this work, we present a methodology for devising forward-backward methods for finding zeros in the sum of a finite number of maximally monotone operators. We extend the framework and techniques from [SIAM J. Optim., 34 (2024), pp. 1569-1594] to cover the case involving a finite number of cocoercive operators, which should be directly evaluated instead of computing their resolvent. The algorithms are induced by three graphs that determine how the algorithm variables interact with each other and how they are combined to compute each resolvent. The hypotheses on these graphs ensure that the algorithms obtained have minimal lifting and are frugal, meaning that the ambient space of the underlying fixed point operator has minimal dimension and that each resolvent and each cocoercive operator is evaluated only once per iteration. This framework not only allows to recover some known methods, but also to generate new ones, as the forward-backward algorithm induced by a complete graph. We conclude with a numerical experiment showing how the choice of graphs influences the performance of the algorithms.


title: Photometric segregation of dwarf and giant FGK stars using the SVO Filter Profile Service and photometric tools

abstract: This paper is focused on the segregation of FGK dwarf and giant stars through narrow-band photometric data using the Spanish Virtual Observatory (SVO) Filter Profile Service and associated photometric tools. We selected spectra from the MILES, STELIB, and ELODIE stellar libraries, and used SVO photometric tools to derive the synthetic photometry in 15 J-PAS narrow filters, which were especially selected to cover spectral features sensitive to gravity changes. Using machine-learning techniques as the Gaussian mixture model and the support vector machine, we defined several criteria based on J-PAS colours to discriminate between dwarf and giant stars. We selected five colour-colour diagrams that presented the most promising separation between both samples. Our results show an overall accuracy in the studied sample of $\sim$0.97 for FGK stars, although a dependence on the luminosity type and the stellar effective temperature was found. We also defined a colour-temperature relation for dwarf stars with effective temperatures between 4\,000 and 7\,000\,K, which allows one to estimate the stellar effective temperature from four J-PAS filters ($J0450$, $J0510$, $J0550$, and $J0620$). Additionally, we extended the study to M-type giant and dwarf stars, achieving a similar accuracy to that for FGK stars.


title: Inhomogeneous SU(2) gluon matter under rotation

abstract: In this work a rotating SU(2) gluon system have been studied with the dyon ensemble in dilute limit. By solving the rotation-modified Yang-Mills equation we have obtained rotational corrections to the so-called dyon solutions with arbitrary centers to $\mathcal{O}(\omega^2)$ order and the corresponding semi-classical potential. The radial position dependent deconfinement temperature have been obtained by minimizing the semi-classical potential in both real and imaginary angular velocity cases. Although without the $\omega$-dependent coupling constant the critical temperature behaves different from the lattice simulation at each radial position as the rotation goes faster, its radial dependence is qualitatively the same as the lattice. That is in the real velocity case the outer layer will deconfine more difficult while the reverse is true in the imaginary velocity case.


title: On the sumsets of exceptional units in quaternion rings

abstract: We investigate sums of exceptional units in a quaternion ring $H(R)$ over a finite commutative ring $R$. We prove that in order to find the number of representations of an element in $H(R)$ as a sum of $k$ exceptional units for some integer $k \geq 2$, we can limit ourselves to studying the quaternion rings over local rings. For a local ring $R$ of even order, we find the number of representations of an element of $H(R)$ as a sum of $k$ exceptional units for any integer $k \geq 2$. For a local ring $R$ of odd order, we find either the number or the bounds for the number of representations of an element of $H(R)$ as a sum of $2$ exceptional units.


title: Weighted tensorized fractional Brownian textures

abstract: This paper presents a new model of textures, obtained as realizations of a new class of fractional Brownian fields. These fields, called weighted tensorized fractional Brownian fields, are obtained by a relaxation of the tensor-product structure that appears in the definition of fractional Brownian sheets. Statistical properties such as self-similarity, stationarity of rectangular increments and regularity properties are obtained. An operator scaling extension is defined and we provide simulations of the fields using their spectral representation.


title: Reproducibility study of FairAC

abstract: This work aims to reproduce the findings of the paper "Fair Attribute Completion on Graph with Missing Attributes" written by Guo, Chu, and Li arXiv:2302.12977 by investigating the claims made in the paper. This paper suggests that the results of the original paper are reproducible and thus, the claims hold. However, the claim that FairAC is a generic framework for many downstream tasks is very broad and could therefore only be partially tested. Moreover, we show that FairAC is generalizable to various datasets and sensitive attributes and show evidence that the improvement in group fairness of the FairAC framework does not come at the expense of individual fairness. Lastly, the codebase of FairAC has been refactored and is now easily applicable for various datasets and models.


title: Correlated states controlled by tunable van Hove singularity in moir\'e WSe2

abstract: Twisted bilayers of transition metal dichalcogenide (TMD) semiconductors have emerged as a highly tunable system for the studies of correlated and topological states of matter, such as superconductivity, ferromagnetism, correlated insulators, and topological and Chern insulators. However, the connection between these symmetry-breaking ground states and the underlying band structure singularity in these materials remains largely unexplored. Here, by combining exciton sensing and magnetic circular dichroism (MCD) measurements, we demonstrate how the magnetic properties and the correlated insulating states are controlled by the gate tunable van Hove singularity (VHS) in the band structure of twisted bilayer WSe2 (tWSe2). In particular, we demonstrate how the location of the VHS in the tWSe2 band structure can influence 1) the stability of Stoner ferromagnetism, 2) the valley polarizability and the stability of Chern insulators, as well as 3) the layer polarizability and the associated metal-insulator transition. The results are supported by continuum model band structure calculations. Our work highlights an important ingredient for understanding the electronic phase diagram in twisted bilayer TMDs.


title: Simultaneous Optimized Orthogonal Matching Pursuit with Application to ECG Compression

abstract: A greedy pursuit strategy which finds a common basis for approximating a set of similar signals is proposed. The strategy extends the Optimized Orthogonal Matching Pursuit approach to selecting the subspace containing the approximation of all the signals in the set. The method, called Simultaneous Optimized Orthogonal Matching Pursuit, is stepwise optimal in the sense of minimizing at each iteration the mean error norm of the joint approximation. When applied to compression of electrocardiograms, significant gains over other transformation based compression techniques are demonstrated on the MIT-BIH Arrhythmia dataset.


title: Save It for the "Hot" Day: An LLM-Empowered Visual Analytics System for Heat Risk Management

abstract: The escalating frequency and intensity of heat-related climate events, particularly heatwaves, emphasize the pressing need for advanced heat risk management strategies. Current approaches, primarily relying on numerical models, face challenges in spatial-temporal resolution and in capturing the dynamic interplay of environmental, social, and behavioral factors affecting heat risks. This has led to difficulties in translating risk assessments into effective mitigation actions. Recognizing these problems, we introduce a novel approach leveraging the burgeoning capabilities of Large Language Models (LLMs) to extract rich and contextual insights from news reports. We hence propose an LLM-empowered visual analytics system, Havior, that integrates the precise, data-driven insights of numerical models with nuanced news report information. This hybrid approach enables a more comprehensive assessment of heat risks and better identification, assessment, and mitigation of heat-related threats. The system incorporates novel visualization designs, such as "thermoglyph" and news glyph, enhancing intuitive understanding and analysis of heat risks. The integration of LLM-based techniques also enables advanced information retrieval and semantic knowledge extraction that can be guided by experts' analytics needs. Our case studies on two cities that faced significant heatwave events and interviews with five experts have demonstrated the usefulness of our system in providing in-depth and actionable insights for heat risk management.


title: Single-cycle, 643-mW average power THz source based on tilted pulse front in lithium niobate

abstract: We present, to the best of our knowledge, the highest average power from a laser-driven single-cycle THz source demonstrated so far, using optical rectification in the titled pulse-front geometry in cryogenically cooled lithium niobate, pumped by a commercially available 500 W ultrafast thin-disk Yb-amplifier. We study repetition rate dependent effects in our setup at 100 kHz and 40 kHz at this high average power, revealing different optimal fluence conditions for efficient conversion. The demonstrated sources with multi-100 mW average power at these high repetition rates combine high THz pulse energies and high repetition rate and is thus ideally suited for nonlinear THz spectroscopy experiments with significantly reduced measurement times. The presented result is a first benchmark for high average power THz time domain spectroscopy systems for nonlinear spectroscopy, driven by very high average power ultrafast Yb lasers.


title: Synchronized Optimal Transport for Joint Modeling of Dynamics Across Multiple Spaces

abstract: Optimal transport has been an essential tool for reconstructing dynamics from complex data. With the increasingly available multifaceted data, a system can often be characterized across multiple spaces. Therefore, it is crucial to maintain coherence in the dynamics across these diverse spaces. To address this challenge, we introduce Synchronized Optimal Transport (SyncOT), a novel approach to jointly model dynamics that represent the same system through multiple spaces. With given correspondence between the spaces, SyncOT minimizes the aggregated cost of the dynamics induced across all considered spaces. The problem is discretized into a finite-dimensional convex problem using a staggered grid. Primal-dual algorithm-based approaches are then developed to solve the discretized problem. Various numerical experiments demonstrate the capabilities and properties of SyncOT and validate the effectiveness of the proposed algorithms.


title: Detection of extended gamma-ray emission in the vicinity of Cl Danks 1 and 2

abstract: We report the detection of high-energy gamma-ray emission towards the G305 star-forming region. Using almost 15 years of observation data from {\sl Fermi} Large Area Telescope, we detected an extended gamma-ray source in this region with a significance of $\sim 13 \sigma$. The gamma-ray radiation reveals a clear pion-bump feature and can be fitted with the power law parent proton spectrum with an index of $-2.5$. The total cosmic ray (CR) proton energy in the gamma-ray production region is estimated to be the order of $10^{49}\ \rm erg$. We further derived the CR radial distribution from both the gamma-ray emission and gas distribution and found it roughly obeys the $1/r$ type profile, which is consistent with other similar systems and expected from the continuous injection of CRs by the central powerful young massive star cluster Danks 1 or Danks 2 in this region. Together with former detections of similar gamma-ray structures, such as Cygnus cocoon, Westerlund 1, Westerlund 2, NGC 3603, and W40, the detection supports the hypothesis that young massive star clusters are CR accelerators.


title: Decision synthesis in monetary policy

abstract: The macroeconomy is a sophisticated dynamic system involving significant uncertainties that complicate modelling. In response, decision makers consider multiple models that provide different predictions and policy recommendations which are then synthesized into a policy decision. In this setting, we introduce and develop Bayesian predictive decision synthesis (BPDS) to formalize monetary policy decision processes. BPDS draws on recent developments in model combination and statistical decision theory that yield new opportunities in combining multiple models, emphasizing the integration of decision goals, expectations and outcomes into the model synthesis process. Our case study concerns central bank policy decisions about target interest rates with a focus on implications for multi-step macroeconomic forecasting.


title: A Framework for Mapping Organisational Workforce Knowledge Profile in Cyber Security

abstract: A cyber security organisation needs to ensure that its workforce possesses the necessary knowledge to fulfil its cyber security business functions. Similarly, where an organisation chooses to delegate their cyber security tasks to a third party provider, they must ensure that the chosen entity possesses robust knowledge capabilities to effectively carry out the assigned tasks. Building a comprehensive cyber security knowledge profile is a distinct challenge; the field is ever evolving with a range of professional certifications, academic qualifications and on-the-job training. So far, there has been a lack of a well-defined methodology for systematically evaluating an organisation's cyber security knowledge, specifically derived from its workforce, against a standardised reference point. Prior research on knowledge profiling across various disciplines has predominantly utilised established frameworks such as SWEBOK. However, within the domain of cyber security, the absence of a standardised reference point is notable. In this paper, we advance a framework leveraging CyBOK, to construct an organisation's knowledge profile. The framework enables a user to identify areas of coverage and where gaps may lie, so that an organisation can consider targeted recruitment or training or, where such expertise may be outsourced, drawing in knowledge capability from third parties. In the latter case, the framework can also be used as a basis for assessing the knowledge capability of such a third party. We present the knowledge profiling framework, discussing three case studies in organisational teams underpinning its initial development, followed by its refinement through workshops with cyber security practitioners.


title: Comparative Benchmarking of Failure Detection Methods in Medical Image Segmentation: Unveiling the Role of Confidence Aggregation

abstract: Semantic segmentation is an essential component of medical image analysis research, with recent deep learning algorithms offering out-of-the-box applicability across diverse datasets. Despite these advancements, segmentation failures remain a significant concern for real-world clinical applications, necessitating reliable detection mechanisms. This paper introduces a comprehensive benchmarking framework aimed at evaluating failure detection methodologies within medical image segmentation. Through our analysis, we identify the strengths and limitations of current failure detection metrics, advocating for the risk-coverage analysis as a holistic evaluation approach. Utilizing a collective dataset comprising five public 3D medical image collections, we assess the efficacy of various failure detection strategies under realistic test-time distribution shifts. Our findings highlight the importance of pixel confidence aggregation and we observe superior performance of the pairwise Dice score (Roy et al., 2019) between ensemble predictions, positioning it as a simple and robust baseline for failure detection in medical image segmentation. To promote ongoing research, we make the benchmarking framework available to the community.


title: UDQL: Bridging The Gap between MSE Loss and The Optimal Value Function in Offline Reinforcement Learning

abstract: The Mean Square Error (MSE) is commonly utilized to estimate the solution of the optimal value function in the vast majority of offline reinforcement learning (RL) models and has achieved outstanding performance. However, we find that its principle can lead to overestimation phenomenon for the value function. In this paper, we first theoretically analyze overestimation phenomenon led by MSE and provide the theoretical upper bound of the overestimated error. Furthermore, to address it, we propose a novel Bellman underestimated operator to counteract overestimation phenomenon and then prove its contraction characteristics. At last, we propose the offline RL algorithm based on underestimated operator and diffusion policy model. Extensive experimental results on D4RL tasks show that our method can outperform state-of-the-art offline RL algorithms, which demonstrates that our theoretical analysis and underestimation way are effective for offline RL tasks.


title: EngineBench: Flow Reconstruction in the Transparent Combustion Chamber III Optical Engine

abstract: We present EngineBench, the first machine learning (ML) oriented database to use high quality experimental data for the study of turbulent flows inside combustion machinery. Prior datasets for ML in fluid mechanics are synthetic or use overly simplistic geometries. EngineBench is comprised of real-world particle image velocimetry (PIV) data that captures the turbulent airflow patterns in a specially-designed optical engine. However, in PIV data from internal flows, such as from engines, it is often challenging to achieve a full field of view and large occlusions can be present. In order to design optimal combustion systems, insight into the turbulent flows in these obscured areas is needed, which can be provided via inpainting models. Here we propose a novel inpainting task using random edge gaps, a technique that emphasises realism by introducing occlusions at random sizes and orientations at the edges of the PIV images. We test five ML methods on random edge gaps using pixel-wise, vector-based, and multi-scale performance metrics. We find that UNet-based models are more accurate than the industry-norm non-parametric approach and the context encoder at this task on both small and large gap sizes. The dataset and inpainting task presented in this paper support the development of more general-purpose pre-trained ML models for engine design problems. The method comparisons allow for more informed selection of ML models for problems in experimental flow diagnostics. All data and code are publicly available at https://eng.ox.ac.uk/tpsrg/research/enginebench/.


title: Calibrated absolute optical contrast for high-throughput characterization of horizontally aligned carbon nanotube arrays

abstract: Horizontally aligned carbon nanotube (HACNT) arrays hold significant potential for various applications in nanoelectronics and material science. However, their high-throughput characterization remains challenging due to the lack of methods with both high efficiency and high accuracy. Here, we present a novel technique, Calibrated Absolute Optical Contrast (CAOC), achieved through the implementation of differential principles to filter out stray signals and high-resolution calibration to endow optical contrast with physical significance. CAOC offers major advantages over previous characterization techniques, providing consistent and reliable measurements of HACNT array density with high throughput and non-destructive assessment. To validate its utility, we demonstrate wafer-scale uniformity assessment by rapid density mapping. This technique not only facilitates the practical evaluation of HACNT arrays but also provides insights into balancing high throughput and high resolution in nanomaterial characterization.


title: Neural density functionals: Local learning and pair-correlation matching

abstract: Recently Dijkman et al. (arXiv:2403.15007) proposed training classical neural density functionals via bulk pair-correlation matching. We show their method to be an efficient regularizer for neural functionals based on local learning of inhomogeneous one-body direct correlations [Samm\"uller et al., Proc. Natl. Acad. Sci. 120, e2312484120 (2023), doi:10.1073/pnas.2312484120]. While Dijkman et al. demonstrated pair-correlation matching of a global neural free energy functional, we argue in favor of local one-body learning for flexible neural modelling of the full Mermin-Evans density functional map. Using spatial localization gives access to accurate neural free energy functionals, including convolutional neural networks, that transcend the training box.


title: Leveraging Off-the-Shelf Silicon Chips for Quantum Computing

abstract: There is a growing demand for quantum computing across various sectors, including finance, materials and studying chemical reactions. A promising implementation involves semiconductor qubits utilizing quantum dots within transistors. While academic research labs currently produce their own devices, scaling this process is challenging, requires expertise, and results in devices of varying quality. Some initiatives are exploring the use of commercial transistors, offering scalability, improved quality, affordability, and accessibility for researchers. This paper delves into potential realizations and the feasibility of employing off-the-shelf commercial devices for qubits. It addresses challenges such as noise, coherence, limited customizability in large industrial fabs, and scalability issues. The exploration includes discussions on potential manufacturing approaches for early versions of small qubit chips. The use of state-of-the-art transistors as hosts for quantum dots, incorporating readout techniques based on charge sensing or reflectometry, and methods like electron shuttling for qubit connectivity are examined. Additionally, more advanced designs, including 2D arrays and crossbar or DRAM-like access arrays, are considered for the path toward accessible quantum computing.


title: Nonadiabatic Dynamics of Molecules Interacting with Metal Surfaces: Extending the Hierarchical Equations of Motion and Langevin Dynamics Approach to Position-Dependent Metal-Molecule Couplings

abstract: Electronic friction and Langevin dynamics is a popular mixed quantum-classical method for simulating the nonadiabatic dynamics of molecules interacting with metal surfaces, as it can be computationally more efficient than fully quantum approaches. Previous approaches to calculating the electronic friction and other forces, however, have been limited to either noninteracting molecular models or position-independent metal-molecule couplings. In this work, we extend the theory of electronic friction within the hierarchical equations of motion formalism to models with a position-dependent metal-molecule coupling. We show that the addition of a position-dependent metal-molecule coupling adds new contributions to the electronic friction and other forces, which are highly relevant for many physical processes. Our expressions for the electronic forces within the Langevin equation are valid both in and out of equilibrium and for molecular models containing strong interactions. We demonstrate the approach by applying it to different models of interest.


title: Rethinking Programming Paradigms in the QC-HPC Context

abstract: Programming for today's quantum computers is making significant strides toward modern workflows compatible with high performance computing (HPC), but fundamental challenges still remain in the integration of these vastly different technologies. Quantum computing (QC) programming languages share some common ground, as well as their emerging runtimes and algorithmic modalities. In this short paper, we explore avenues of refinement for the quantum processing unit (QPU) in the context of many-tasks management, asynchronous or otherwise, in order to understand the value it can play in linking QC with HPC. Through examples, we illustrate how its potential for scientific discovery might be realized.


title: Minimal U(1) two-Higgs-doublet models for quark and lepton flavour

abstract: In the context of the 2HDM, and assuming that neutrinos acquire masses via the Weinberg operator, we perform a systematic analysis to determine the minimal quark and lepton flavour patterns, compatible with masses, mixing and CP violation data, realisable by Abelian symmetries. We determine four minimal models for quarks, where the number of independent parameters matches the number of observables. For the lepton sector, three minimal predictive models are identified. Namely, we find scenarios with a preference for the upper/lower octant of the $\theta_{23}$ atmospheric mixing angle, that exhibit lower bounds on the lightest neutrino masses currently probed by cosmology and testable at future neutrinoless double beta decay experiments, even for a normally-ordered neutrino masses. We investigate the phenomenology of each model taking into account all relevant theoretical, electroweak precision observables, scalar sector constraints, as well as stringent quark flavour processes such as $\overline{B} \rightarrow X_s \gamma$, $B_s \rightarrow \mu^- \mu^+$ and meson oscillations, and the charged lepton flavour-violating decays $e_\alpha^{-} \rightarrow e_\beta^{-} e_\gamma^{+} e_\delta^{-}$ and $e_\alpha \rightarrow e_\beta \gamma$. We show that, in some cases, Abelian flavour symmetries provide a natural framework to suppress flavour-changing neutral couplings and lead to scenarios featuring heavy neutral/charged scalar masses below the TeV scale within the reach of current experiments.


title: Interpreting Mass and Radius Measurements of Neutron Stars with Dark Matter Halos

abstract: The high densities of neutron stars (NSs) could provide astrophysical locations for dark matter (DM) to accumulate. Depending on the DM model, these DM admixed NSs (DANSs) could have significantly different properties than pure baryonic NSs, accessible through X-ray observations of rotation-powered pulsars. We adopt the two-fluid formalism in general relativity to numerically simulate stable configurations of DANSs, assuming a fermionic equation of state (EOS) for the DM with repulsive self-interaction. The distribution of DM in the DANS as a halo affects the path of X-rays emitted from hot spots on the visible baryonic surface causing notable changes in the pulse profile observed by telescopes such as NICER, compared to pure baryonic NSs. We explore how various DM models affect the DM mass distribution, leading to different types of dark halos. We quantify the deviation in observed X-ray flux from stars with each of these halos and explain how to interpret mass and radius measurements of NSs inferred from electromagnetic radiation if these dark halos exist.


title: A Flexible Recursive Network for Video Stereo Matching Based on Residual Estimation

abstract: Due to the high similarity of disparity between consecutive frames in video sequences, the area where disparity changes is defined as the residual map, which can be calculated. Based on this, we propose RecSM, a network based on residual estimation with a flexible recursive structure for video stereo matching. The RecSM network accelerates stereo matching using a Multi-scale Residual Estimation Module (MREM), which employs the temporal context as a reference and rapidly calculates the disparity for the current frame by computing only the residual values between the current and previous frames. To further reduce the error of estimated disparities, we use the Disparity Optimization Module (DOM) and Temporal Attention Module (TAM) to enforce constraints between each module, and together with MREM, form a flexible Stackable Computation Structure (SCS), which allows for the design of different numbers of SCS based on practical scenarios. Experimental results demonstrate that with a stack count of 3, RecSM achieves a 4x speed improvement compared to ACVNet, running at 0.054 seconds based on one NVIDIA RTX 2080TI GPU, with an accuracy decrease of only 0.7%. Code is available at https://github.com/Y0uchenZ/RecSM.


title: Reparameterization invariance in approximate Bayesian inference

abstract: Current approximate posteriors in Bayesian neural networks (BNNs) exhibit a crucial limitation: they fail to maintain invariance under reparameterization, i.e. BNNs assign different posterior densities to different parametrizations of identical functions. This creates a fundamental flaw in the application of Bayesian principles as it breaks the correspondence between uncertainty over the parameters with uncertainty over the parametrized function. In this paper, we investigate this issue in the context of the increasingly popular linearized Laplace approximation. Specifically, it has been observed that linearized predictives alleviate the common underfitting problems of the Laplace approximation. We develop a new geometric view of reparametrizations from which we explain the success of linearization. Moreover, we demonstrate that these reparameterization invariance properties can be extended to the original neural network predictive using a Riemannian diffusion process giving a straightforward algorithm for approximate posterior sampling, which empirically improves posterior fit.


title: Entangled states are typically incomparable

abstract: Consider a bipartite quantum system, where Alice and Bob jointly possess a pure state $|\psi\rangle$. Using local quantum operations on their respective subsystems, and unlimited classical communication, Alice and Bob may be able to transform $|\psi\rangle$ into another state $|\phi\rangle$. Famously, Nielsen's theorem [Phys. Rev. Lett., 1999] provides a necessary and sufficient algebraic criterion for such a transformation to be possible (namely, the local spectrum of $|\phi\rangle$ should majorise the local spectrum of $|\psi\rangle$). In the paper where Nielsen proved this theorem, he conjectured that in the limit of large dimensionality, for almost all pairs of states $|\psi\rangle, |\phi\rangle$ (according to the natural unitary invariant measure) such a transformation is not possible. That is to say, typical pairs of quantum states $|\psi\rangle, |\phi\rangle$ are entangled in fundamentally different ways, that cannot be converted to each other via local operations and classical communication. Via Nielsen's theorem, this conjecture can be equivalently stated as a conjecture about majorisation of spectra of random matrices from the so-called trace-normalised complex Wishart-Laguerre ensemble. Concretely, let $X$ and $Y$ be independent $n \times m$ random matrices whose entries are i.i.d. standard complex Gaussians; then Nielsen's conjecture says that the probability that the spectrum of $X X^\dagger / \operatorname{tr}(X X^\dagger)$ majorises the spectrum of $Y Y^\dagger / \operatorname{tr}(Y Y^\dagger)$ tends to zero as both $n$ and $m$ grow large. We prove this conjecture, and we also confirm some related predictions of Cunden, Facchi, Florio and Gramegna [J. Phys. A., 2020; Phys. Rev. A., 2021].


title: Griddy-Gibbs sampling for Bayesian P-splines models with Poisson data

abstract: P-splines are appealing for smoothing Poisson distributed counts. They provide a flexible setting for modeling nonlinear model components based on a discretized penalty structure with a relatively simple computational backbone. Under a Bayesian inferential process relying on Markov chain Monte Carlo, estimates of spline coefficients are typically obtained by means of Metropolis-type algorithms, which may suffer from convergence issues if the proposal distribution is not properly chosen. To avoid such a sensitive calibration choice, we extend the Griddy-Gibbs sampler to Bayesian P-splines models with a Poisson response variable. In this model class, conditional posterior distributions of spline components are shown to have attractive mathematical properties. Despite their non-conjugate nature, conditional posteriors of spline coefficients can be efficiently explored with a Gibbs sampling scheme by relying on grid-based approximations. The proposed Griddy-Gibbs sampler for Bayesian P-splines (GGSBPS) algorithm is an interesting calibration-free tool for density estimation and histogram smoothing that is made available in a compact and user-friendly routine. The performance of our approach is assessed in different simulation settings and the GGSBPS algorithm is illustrated on two real datasets.


title: Identifying latent state transition in non-linear dynamical systems

abstract: This work aims to improve generalization and interpretability of dynamical systems by recovering the underlying lower-dimensional latent states and their time evolutions. Previous work on disentangled representation learning within the realm of dynamical systems focused on the latent states, possibly with linear transition approximations. As such, they cannot identify nonlinear transition dynamics, and hence fail to reliably predict complex future behavior. Inspired by the advances in nonlinear ICA, we propose a state-space modeling framework in which we can identify not just the latent states but also the unknown transition function that maps the past states to the present. We introduce a practical algorithm based on variational auto-encoders and empirically demonstrate in realistic synthetic settings that we can (i) recover latent state dynamics with high accuracy, (ii) correspondingly achieve high future prediction accuracy, and (iii) adapt fast to new environments.


title: Strength of Kitaev Interaction in Na$_3$Co$_2$SbO$_6$ and Na$_3$Ni$_2$BiO$_6$

abstract: Kitaev spin liquid is proposed to be promisingly realized in low spin-orbit coupling $3d$ systems, represented by Na$_3$Co$_2$SbO$_6$ and Na$_3$Ni$_2$BiO$_6$. However, the existence of Kitaev interaction is still debatable among experiments, and obtaining the strength of Kitaev interaction from first-principles calculations is also challenging. Here, we report the state-dependent anisotropy of Kitaev interaction, based on which a convenient method is developed to rapidly determine the strength of Kitaev interaction. Applying such method and density functional theory calculations, it is found that Na$_3$Co$_2$SbO$_6$ with $3d^7$ configuration exhibits considerable ferromagnetic Kitaev interaction. Moreover, by further applying the symmetry-adapted cluster expansion method, a realistic spin model is determined for Na$_3$Ni$_2$BiO$_6$ with $3d^8$ configuration. Such model indicates negligible small Kitaev interaction, but it predicts many properties, such as ground states and field effects, which are well consistent with measurements. Furthermore, we demonstrate that the heavy elements, Sb or Bi, located at the hollow sites of honeycomb lattice, do not contribute to emergence of Kitaev interaction through proximity, contradictory to common belief. The presently developed anisotropy method will be beneficial not only for computations but also for measurements.


title: The Challenges of Evaluating LLM Applications: An Analysis of Automated, Human, and LLM-Based Approaches

abstract: Chatbots have been an interesting application of natural language generation since its inception. With novel transformer based Generative AI methods, building chatbots have become trivial. Chatbots which are targeted at specific domains for example medicine and psychology are implemented rapidly. This however, should not distract from the need to evaluate the chatbot responses. Especially because the natural language generation community does not entirely agree upon how to effectively evaluate such applications. With this work we discuss the issue further with the increasingly popular LLM based evaluations and how they correlate with human evaluations. Additionally, we introduce a comprehensive factored evaluation mechanism that can be utilized in conjunction with both human and LLM-based evaluations. We present the results of an experimental evaluation conducted using this scheme in one of our chatbot implementations which consumed educational reports, and subsequently compare automated, traditional human evaluation, factored human evaluation, and factored LLM evaluation. Results show that factor based evaluation produces better insights on which aspects need to be improved in LLM applications and further strengthens the argument to use human evaluation in critical spaces where main functionality is not direct retrieval.