title: On the block size spectrum of the multiplicative Beta coalescent

abstract: In this work we introduce the dynamic $\Lambda$-random graph and the associated multiplicative $\Lambda$-coalescent. The dynamic $\Lambda$-random graph is an exchangeable and consistent random graph process, inspired by the classical $\Lambda$-coalescent studied in mathematical population genetics. Our main concern is the multiplicative $\Lambda$-coalescent, which accounts for the connected components (blocks) of the graph. This process is exchangeable but not consistent. We focus on the case where $\Lambda$ is the beta measure and prove a dynamic law of large numbers for the block size spectrum, which tracks the numbers of blocks containing $1,...,d$ elements. On top of that, we provide a functional limit theorem for the fluctuations around its deterministic trajectory. The limit process satisfies a stochastic differential equation of Ornstein-Uhlenbeck type.


title: XLand-100B: A Large-Scale Multi-Task Dataset for In-Context Reinforcement Learning

abstract: Following the success of the in-context learning paradigm in large-scale language and computer vision models, the recently emerging field of in-context reinforcement learning is experiencing a rapid growth. However, its development has been held back by the lack of challenging benchmarks, as all the experiments have been carried out in simple environments and on small-scale datasets. We present \textbf{XLand-100B}, a large-scale dataset for in-context reinforcement learning based on the XLand-MiniGrid environment, as a first step to alleviate this problem. It contains complete learning histories for nearly $30,000$ different tasks, covering $100$B transitions and $2.5$B episodes. It took $50,000$ GPU hours to collect the dataset, which is beyond the reach of most academic labs. Along with the dataset, we provide the utilities to reproduce or expand it even further. With this substantial effort, we aim to democratize research in the rapidly growing field of in-context reinforcement learning and provide a solid foundation for further scaling. The code is open-source and available under Apache 2.0 licence at https://github.com/dunno-lab/xland-minigrid-datasets.


title: Cascaded noise reduction and acoustic echo cancellation based on an extended noise reduction

abstract: In many speech recording applications, the recorded desired speech is corrupted by both noise and acoustic echo, such that combined noise reduction (NR) and acoustic echo cancellation (AEC) is called for. A common cascaded design corresponds to NR filters preceding AEC filters. These NR filters aim at reducing the near-end room noise (and possibly partially the echo) and operate on the microphones only, consequently requiring the AEC filters to model both the echo paths and the NR filters. In this paper, however, we propose a design with extended NR (NRext) filters preceding AEC filters under the assumption of the echo paths being additive maps, thus preserving the addition operation. Here, the NRext filters aim at reducing both the near-end room noise and the far-end room noise component in the echo, and operate on both the microphones and loudspeakers. We show that the succeeding AEC filters remarkably become independent of the NRext filters, such that the AEC filters are only required to model the echo paths, improving the AEC performance. Further, the degrees of freedom in the NRext filters scale with the number of loudspeakers, which is not the case for the NR filters, resulting in an improved NR performance.


title: Drift-diffusive resetting search process with stochastic returns: speed-up beyond optimal instantaneous return

abstract: Stochastic resetting has emerged as a useful strategy to reduce the completion time for a broad class of first passage processes. In the canonical setup, one intermittently resets a given system to its initial configuration only to start afresh and continue evolving in time until the target goal is met. This is, however, an instantaneous process and thus less feasible for any practical purposes. A crucial generalization in this regard is to consider a finite-time return process which has significant ramifications to the first passage properties. Intriguingly, it has recently been shown that for diffusive search processes, returning in finite but stochastic time can gain significant speed-up over the instantaneous resetting process. Unlike diffusion which has a diverging mean completion time, in this paper, we ask whether this phenomena can also be observed for a first passage process with finite mean completion time. To this end, we explore the set-up of a classical drift-diffusive search process in one dimension with stochastic resetting and further assume that the return phase is modulated by a potential $U(x)=\lambda |x|$ with $\lambda>0$. For this process, we compute the mean first passage time exactly and underpin its characteristics with respect to the resetting rate and potential strength. We find a unified phase space that allows us to explore and identify the system parameter regions where stochastic return supersedes over both the underlying process and the process under instantaneous resetting. Furthermore and quite interestingly, we find that for a range of parameters the mean completion time under stochastic return protocol can be reduced further than the \textit{optimally restarted} instantaneous processes. We thus believe that resetting with stochastic returns can serve as a better optimization strategy owing to its dominance over classical first passage under resetting.


title: Tits groups of affine Weyl groups

abstract: Let $G$ be a connected, reductive group over a non-archimedean local field $F$. Let $\breve F$ be the completion of the maximal unramified extension of $F$ contained in a separable closure $F_s$. In this article, we construct a Tits group of the affine Weyl group of $G(F)$ when the derived subgroup of $G_{\breve F}$ does not contain a simple factor of unitary type. If $G$ is a quasi-split ramified odd unitary group, we show that there always exist representatives in $G(F)$ of affine simple reflections that satisfy Coxeter relations (which is weaker than asking for the existence of a Tits group). If $G = U_{2r}, r \geq 3,$ is a quasi-split ramified even unitary group, we show that there don't even exist representatives in $G(F)$ of the affine simple reflections that satisfy Coxeter relations.


title: Signature of non-trivial band topology in Shubnikov--de Haas oscillations

abstract: We investigate the Shubnikov-de Haas (SdH) magneto-oscillations in the resistivity of two-dimensional topological insulators (TIs). Within the Bernevig-Hughes-Zhang (BHZ) model for TIs in the presence of a quantizing magnetic field, we obtain analytical expressions for the SdH oscillations by combining a semiclassical approach for the resistivity and a trace formula for the density of states. We show that when the non-trivial topology is produced by inverted bands with ''Mexican-hat'' shape, SdH oscillations show an anomalous beating pattern that is {\it solely} due to the non-trivial topology of the system. These beatings are robust against, and distinct from beatings originating from spin-orbit interactions. This provides a direct way to experimentally probe the non-trivial topology of 2D TIs entirely from a bulk measurement. Furthermore, the Fourier transform of the SdH oscillations as a function of the Fermi energy and quantum capacitance models allows for extracting both the topological gap and gap at zero momentum.


title: MURCA driven Bulk viscosity in neutrino trapped baryonic matter

abstract: We examine bulk viscosity, taking into account trapped neutrinos in baryonic matter, in the context of binary neutron star mergers. Following the merging event, the binary star can yield a remnant compact object with densities up to $5$ nuclear saturation density and temperature upto $50$ MeV resulting in the retention of neutrinos. We employ two relativistic mean field models, NL3 and DDME2, to describe the neutrino-trapped baryonic matter. The dissipation coefficient is determined by evaluating the Modified URCA interaction rate in the dense baryonic medium, and accounting for perturbations caused by density oscillations. We observe the resonant behavior of bulk viscosity as it varies with the temperature of the medium. The bulk viscosity peak remains within the temperature range of $\sim 13-50$ MeV, depending upon the underlying equation of states and lepton fractions. This temperature range corresponds to the relevant domain of binary neutron star mergers. We also note that in presence of neutrinos in the medium the bulk viscosity peak shifts towards higher temperature and the peak value of bulk viscosity also changes. The time scale of viscous dissipation is dictated by the beta-off-equilibrium susceptibilities derived from the nuclear equation of state. The resulting viscous decay time scale ranges from $32-100$ milliseconds, which aligns with the order of magnitude of the post-merger object's survival time in some specific scenarios.


title: Multi-Agent Software Development through Cross-Team Collaboration

abstract: The latest breakthroughs in Large Language Models (LLMs), eg., ChatDev, have catalyzed profound transformations, particularly through multi-agent collaboration for software development. LLM agents can collaborate in teams like humans, and follow the waterfall model to sequentially work on requirements analysis, development, review, testing, and other phases to perform autonomous software generation. However, for an agent team, each phase in a single development process yields only one possible outcome. This results in the completion of only one development chain, thereby losing the opportunity to explore multiple potential decision paths within the solution space. Consequently, this may lead to obtaining suboptimal results. To address this challenge, we introduce Cross-Team Collaboration (CTC), a scalable multi-team framework that enables orchestrated teams to jointly propose various decisions and communicate with their insights in a cross-team collaboration environment for superior content generation. Experimental results in software development reveal a notable increase in quality compared to state-of-the-art baselines, underscoring the efficacy of our framework. The significant improvements in story generation demonstrate the promising generalization ability of our framework across various domains. We anticipate that our work will guide LLM agents towards a cross-team paradigm and contribute to their significant growth in but not limited to software development. The code and data will be available at https://github.com/OpenBMB/ChatDev.


title: From Theory to Therapy: Reframing SBDD Model Evaluation via Practical Metrics

abstract: Recent advancements in structure-based drug design (SBDD) have significantly enhanced the efficiency and precision of drug discovery by generating molecules tailored to bind specific protein pockets. Despite these technological strides, their practical application in real-world drug development remains challenging due to the complexities of synthesizing and testing these molecules. The reliability of the Vina docking score, the current standard for assessing binding abilities, is increasingly questioned due to its susceptibility to overfitting. To address these limitations, we propose a comprehensive evaluation framework that includes assessing the similarity of generated molecules to known active compounds, introducing a virtual screening-based metric for practical deployment capabilities, and re-evaluating binding affinity more rigorously. Our experiments reveal that while current SBDD models achieve high Vina scores, they fall short in practical usability metrics, highlighting a significant gap between theoretical predictions and real-world applicability. Our proposed metrics and dataset aim to bridge this gap, enhancing the practical applicability of future SBDD models and aligning them more closely with the needs of pharmaceutical research and development.


title: Bayesian Inference of General Noise Model Parameters from Surface Code's Syndrome Statistics

abstract: Active research on the surface code shows that its decoding performance can be significantly enhanced by utilizing the information of the noise model and optimizing the grid shape and decoding algorithm. Usually, the parameters in the noise model for the quantum error correction code must be prepared separately using some method, such as the quantum process tomography. There is a strong need to perform noise model estimation in parallel with the syndrome measurement during decoding to avoid the demanding prior tomography procedure. While noise model estimation based on syndrome measurement statistics is well-explored for Pauli noise, it remains under-studied for more complex noise models like amplitude damping. In this paper, we propose general noise model Bayesian inference methods that integrate the surface code's tensor network simulator, which can efficiently simulate various noise models, with Monte Carlo sampling techniques. For stationary noise, where the noise parameters are constant and do not change, we propose a method based on the Markov chain Monte Carlo. For time-varying noise, which is a more realistic situation, we introduce another method based on the sequential Monte Carlo. We present the numerical results of applying the proposed methods to various noise models, such as static, time-varying, and non-uniform cases, and evaluate their performance in detail.


title: A Novel Quantum LSTM Network

abstract: The rapid evolution of artificial intelligence has led to the widespread adoption of Long Short-Term Memory (LSTM) networks, known for their effectiveness in processing sequential data. However, LSTMs are constrained by inherent limitations such as the vanishing gradient problem and substantial computational demands. The advent of quantum computing presents a revolutionary approach to overcoming these obstacles. This paper introduces the Quantum LSTM (qLSTM) model, which integrates quantum computing principles with traditional LSTM networks to significantly enhance computational efficiency and model performance in sequence learning tasks. Quantum computing leverages qubits, which can exist in multiple states simultaneously through superposition and entangle these states to represent complex correlations without direct physical interaction, offering a profound advancement over classical binary computing. Our qLSTM model aims to address the limitations of traditional LSTMs, providing a robust framework for more efficient and effective sequential data processing.


title: Thin-thick approach to martingale representations on progressively enlarged filtrations

abstract: We study the predictable representation property in the progressive enlargement F^\tau of a reference filtration F by a random time \tau. Our approach is based on the decomposition of any random time into two parts, one overlapping F-stopping times (thin part) and the other one that avoids F-stopping times (thick part). We assume that the F-thin part of \tau is nontrivial and prove a martingale representation theorem on F^\tau. We thus extend previous results dealing with F-avoiding random times. We collect some examples of application to the enlargement of the natural filtration of a L\'evy process.


title: Effective removal of global tilt from topography images of vicinal surfaces with narrow terraces

abstract: The main feature of vicinal surfaces of crystals characterized by the Miller indices $(h\,h\,m)$, is rather small width (less than 10 nm) and substantially large length (more than 200 nm) of atomically-flat terraces on sample surface. This makes difficult to apply standard methods of image processing and correct visualization of crystalline lattice at the terraces and multiatomic steps. Here we consider two procedures allowing us to minimize effects of both small-scale noise and global tilt of sample: (i) analysis of the difference of two Gaussian blurred images, and (ii) subtraction of the plane, whose parameters are determined by optimization of the histogram of the visible heights, from raw topography image. It is shown that both methods provide non-distorted images demonstrating atomic structures on vicinal ${\rm Si}(5\,5\,6)$ and ${\rm Si}(5\,5\,7)$ surfaces.


title: The Behavior of Tree-Width and Path-Width under Graph Operations and Graph Transformations

abstract: Tree-width and path-width are well-known graph parameters. Many NP-hard graph problems allow polynomial-time solutions, when restricted to graphs of bounded tree-width or bounded path-width. In this work, we study the behavior of tree-width and path-width under various unary and binary graph transformations. Doing so, for considered transformations we provide upper and lower bounds for the tree-width and path-width of the resulting graph in terms of the tree-width and path-width of the initial graphs or argue why such bounds are impossible to specify. Among the studied, unary transformations are vertex addition, vertex deletion, edge addition, edge deletion, subgraphs, vertex identification, edge contraction, edge subdivision, minors, powers of graphs, line graphs, edge complements, local complements, Seidel switching, and Seidel complementation. Among the studied, binary transformations we consider the disjoint union, join, union, substitution, graph product, 1-sum, and corona of two graphs.


title: On the weighted contraharmonic means

abstract: Let $\mathscr{A}$ be a unital $C^*$-algebra with unit $e$ and let $\nu\in(0, 1)$. We introduce the concept of the $\nu$-weighted contraharmonic of two positive definite elements $a$ and $b$ of $\mathscr{A}$ by \begin{align*} {C}_{\nu}(a, b):= (1-\nu)\nu^{-1}b + \nu (1-\nu)^{-1}a - \left((1-\nu)a^{-1}+\nu b^{-1}\right)^{-1}. \end{align*} We show that \begin{align*} {C}_{\nu}(a, b)= \displaystyle{\max_{x+y=e}}\left\{(1-\nu)^{-1}\left(\nu a - x^*ax\right) + \nu^{-1}\left((1-\nu)b - y^*by\right)\right\}, \end{align*} and then apply it to present some properties of this weighted mean.


title: Towards Next Era of Multi-objective Optimization: Large Language Models as Architects of Evolutionary Operators

abstract: Multi-objective optimization problems (MOPs) are prevalent in various real-world applications, necessitating sophisticated solutions that balance conflicting objectives. Traditional evolutionary algorithms (EAs), while effective, often rely on domain-specific expert knowledge and iterative tuning, which can impede innovation when encountering novel MOPs. Very recently, the emergence of Large Language Models (LLMs) has revolutionized software engineering by enabling the autonomous development and refinement of programs. Capitalizing on this advancement, we propose a new LLM-based framework for evolving EA operators, designed to address a wide array of MOPs. This framework facilitates the production of EA operators without the extensive demands for expert intervention, thereby streamlining the design process. To validate the efficacy of our approach, we have conducted extensive empirical studies across various categories of MOPs. The results demonstrate the robustness and superior performance of our LLM-evolved operators.


title: Probing the polarized emission from SMC X-1: the brightest X-ray pulsar observed by IXPE

abstract: Recent observations of X-ray pulsars (XRPs) performed by the Imaging X-ray Polarimetry Explorer (IXPE) have made it possible to investigate the intricate details of these objects in a new way, thanks to the added value of X-ray polarimetry. Here we present the results of the IXPE observations of SMC X-1, a member of the small group of XRPs displaying super-orbital variability. SMC X-1 was observed by IXPE three separate times during the high state of its super-orbital period. The observed luminosity in the 2-8 keV energy band of $L=2\times10^{38}$ erg/s makes SMC X-1 the brightest XRP ever observed by IXPE. We detect significant polarization in all three observations, with values of the phase-averaged polarization degree (PD) and polarization angle (PA) of $3.2\pm0.8$% and $97\deg\pm8\deg$ for Observation 1, $3.0\pm0.9$% and $90\deg\pm8\deg$ for Observation 2, and $5.5\pm1.1$% and $80\deg\pm6\deg$ for Observation 3, for the spectro-polarimetric analysis. The observed PD shows an increase over time with decreasing luminosity, while the PA decreases in decrements of 10\deg. The phase-resolved spectro-polarimetric analysis reveals significant detection of polarization in three out of seven phase bins, with the PD ranging between 2% and 10%, and a corresponding range in the PA from $\sim$70\deg\ to $\sim$100\deg. The pulse-phase resolved PD displays an apparent anti-correlation with the flux. Using the rotating vector model, we obtain constraints on the pulsar's geometrical properties for the individual observations. The position angle of the pulsar displays an evolution over time supporting the idea that we observe changes related to different super-orbital phases. Scattering in the wind of the precessing accretion disk may be responsible for the behavior of the polarimetric properties observed during the high-state of SMC X-1's super-orbital period.


title: ToneUnit: A Speech Discretization Approach for Tonal Language Speech Synthesis

abstract: Representing speech as discretized units has numerous benefits in supporting downstream spoken language processing tasks. However, the approach has been less explored in speech synthesis of tonal languages like Mandarin Chinese. Our preliminary experiments on Chinese speech synthesis reveal the issue of "tone shift", where a synthesized speech utterance contains correct base syllables but incorrect tones. To address the issue, we propose the ToneUnit framework, which leverages annotated data with tone labels as CTC supervision to learn tone-aware discrete speech units for Mandarin Chinese speech. Our findings indicate that the discrete units acquired through the TonUnit resolve the "tone shift" issue in synthesized Chinese speech and yield favorable results in English synthesis. Moreover, the experimental results suggest that finite scalar quantization enhances the effectiveness of ToneUnit. Notably, ToneUnit can work effectively even with minimal annotated data.


title: BTS: Building Timeseries Dataset: Empowering Large-Scale Building Analytics

abstract: Buildings play a crucial role in human well-being, influencing occupant comfort, health, and safety. Additionally, they contribute significantly to global energy consumption, accounting for one-third of total energy usage, and carbon emissions. Optimizing building performance presents a vital opportunity to combat climate change and promote human flourishing. However, research in building analytics has been hampered by the lack of accessible, available, and comprehensive real-world datasets on multiple building operations. In this paper, we introduce the Building TimeSeries (BTS) dataset. Our dataset covers three buildings over a three-year period, comprising more than ten thousand timeseries data points with hundreds of unique ontologies. Moreover, the metadata is standardized using the Brick schema. To demonstrate the utility of this dataset, we performed benchmarks on two tasks: timeseries ontology classification and zero-shot forecasting. These tasks represent an essential initial step in addressing challenges related to interoperability in building analytics. Access to the dataset and the code used for benchmarking are available here: https://github.com/cruiseresearchgroup/DIEF_BTS .


title: Ups and downs in the X-ray emission of the colliding wind binaries HD 168112 and HD 167971

abstract: The long-period O-star binary system HD 168112 and the triple O-star system HD 167971 are well-known sources of non-thermal radio emission that arises from a colliding wind interaction. The wind-wind collisions in these systems should result in phase-dependent X-ray emissions. The presence of a population of relativistic electrons in the wind interaction zone could affect the properties of the X-ray emission and make it deviate from the behaviour expected for adiabatic shocks. We investigate the X-ray emission of these systems with the goals of quantifying the fraction of the X-ray flux arising from wind interactions and determining whether these emissions follow the predictions for adiabatic wind-wind collisions. Six X-ray observations were collected with XMM-Newton. Three observations were scheduled around the most recent periastron passage of HD 168112. Spectra and light curves were analysed and compared with simple predictions of model calculations for X-ray emission from colliding wind systems. The X-ray emission of HD 168112 varies as the inverse of the orbital separation, as expected for an adiabatic wind interaction zone. The relative contribution of intrinsic X-ray emission from wind-embedded shocks varies between 38% at periastron to 81% at apastron. The wind-wind collision zone remains adiabatic even around periastron passage. The X-ray emission of HD 167971 displays variations on the orbital timescale of the inner eclipsing binary. The existing data of this system do not allow us to probe variations on the timescale of the outer orbit. Shock modification due to the action of relativistic electrons does not seem to be efficiently operating in the HD 168112 system. In the existing observations, a significant part of the emission of HD 167971 must arise in the inner eclipsing binary. The origin of this emission is as yet unclear.


title: Bilevel Optimization of the Kantorovich Problem and its Quadratic Regularization Part III: The Finite-Dimensional Case

abstract: As the title suggests, this is the third paper in a series addressing bilevel optimization problems that are governed by the Kantorovich problem of optimal transport. These tasks can be reformulated as mathematical problems with complementarity constraints in the space of regular Borel measures. Due to the nonsmoothness that is introduced by the complementarity constraints, such problems are often regularized, for instance, using entropic regularization. In this series of papers, however, we apply a quadratic regularization to the Kantorovich problem. By doing so, we enhance its numerical properties while preserving the sparsity structure of the optimal transportation plan as much as possible. While the first two papers in this series focus on the well-posedness of the regularized bilevel problems and the approximation of solutions to the bilevel optimization problem in the infinite-dimensional case, in this paper, we reproduce these results for the finite-dimensional case and present findings that go well beyond the ones of the previous papers and pave the way for the numerical treatment of the bilevel problems.


title: Classic GNNs are Strong Baselines: Reassessing GNNs for Node Classification

abstract: Graph Transformers (GTs) have recently emerged as popular alternatives to traditional message-passing Graph Neural Networks (GNNs), due to their theoretically superior expressiveness and impressive performance reported on standard node classification benchmarks, often significantly outperforming GNNs. In this paper, we conduct a thorough empirical analysis to reevaluate the performance of three classic GNN models (GCN, GAT, and GraphSAGE) against GTs. Our findings suggest that the previously reported superiority of GTs may have been overstated due to suboptimal hyperparameter configurations in GNNs. Remarkably, with slight hyperparameter tuning, these classic GNN models achieve state-of-the-art performance, matching or even exceeding that of recent GTs across 17 out of the 18 diverse datasets examined. Additionally, we conduct detailed ablation studies to investigate the influence of various GNN configurations, such as normalization, dropout, residual connections, network depth, and jumping knowledge mode, on node classification performance. Our study aims to promote a higher standard of empirical rigor in the field of graph machine learning, encouraging more accurate comparisons and evaluations of model capabilities.


title: Asymptotic Stability and Strict Passivity of Port-Hamiltonian Descriptor Systems via State Feedback

abstract: While port-Hamiltonian descriptor systems are known to be stable and passive, they may not be asymptotically stable or strictly passive. Necessary and sufficient conditions are presented when these properties as well as the regularity and the index one property can be achieved via state feedback while preserving the port-Hamiltonian structure.


title: Non-perturbative determination of the ${\cal N} = 1$ SUSY Yang-Mills gluino condensate at large $N$

abstract: We present the first non-perturbative large-$N$ calculation of the $\mathcal{N}=1$ supersymmetric (SUSY) $\mathrm{SU}(N)$ Yang-Mills gluino condensate, obtained by means of numerical simulations of the lattice-discretized theory, and exploiting large-$N$ twisted volume reduction. We present two different determinations based, respectively, on the Banks-Casher formula and on the Gell-Mann-Oakes-Renner relation, both giving perfectly consistent results. By matching the lattice and the Novikov-Shifman-Vainshtein-Zakharov (NSVZ) regularization schemes, we are able for the first time to compare numerical and analytic computations. Our most accurate determination gives $\Sigma_{\rm RGI} /\Lambda_{\rm NSVZ}^3 = 1.55(57)$, in very good agreement with the $N$-dependence and the value predicted by the weak coupling instanton-based approach $\Sigma_{\rm RGI} /\Lambda_{\rm NSVZ}^3 = 1$.


title: Introducing Brain-like Concepts to Embodied Hand-crafted Dialog Management System

abstract: Along with the development of chatbot, language models and speech technologies, there is a growing possibility and interest of creating systems able to interface with humans seamlessly through natural language or directly via speech. In this paper, we want to demonstrate that placing the research on dialog system in the broader context of embodied intelligence allows to introduce concepts taken from neurobiology and neuropsychology to define behavior architecture that reconcile hand-crafted design and artificial neural network and open the gate to future new learning approaches like imitation or learning by instruction. To do so, this paper presents a neural behavior engine that allows creation of mixed initiative dialog and action generation based on hand-crafted models using a graphical language. A demonstration of the usability of such brain-like inspired architecture together with a graphical dialog model is described through a virtual receptionist application running on a semi-public space.


title: Adaptive Temporal Motion Guided Graph Convolution Network for Micro-expression Recognition

abstract: Micro-expressions serve as essential cues for understanding individuals' genuine emotional states. Recognizing micro-expressions attracts increasing research attention due to its various applications in fields such as business negotiation and psychotherapy. However, the intricate and transient nature of micro-expressions poses a significant challenge to their accurate recognition. Most existing works either neglect temporal dependencies or suffer from redundancy issues in clip-level recognition. In this work, we propose a novel framework for micro-expression recognition, named the Adaptive Temporal Motion Guided Graph Convolution Network (ATM-GCN). Our framework excels at capturing temporal dependencies between frames across the entire clip, thereby enhancing micro-expression recognition at the clip level. Specifically, the integration of Adaptive Temporal Motion layers empowers our method to aggregate global and local motion features inherent in micro-expressions. Experimental results demonstrate that ATM-GCN not only surpasses existing state-of-the-art methods, particularly on the Composite dataset, but also achieves superior performance on the latest micro-expression dataset CAS(ME)$^3$.


title: Variational quantum Hamiltonian engineering

abstract: The Hamiltonian of a quantum system is represented in terms of operators corresponding to the kinetic and potential energies of the system. The expectation value of a Hamiltonian and Hamiltonian simulation are two of the most fundamental tasks in quantum computation. The overheads for realizing the two tasks are determined by the Pauli norm of Hamiltonian, which sums over all the absolute values of Pauli coefficients. In this work, we propose a variational quantum algorithm (VQA) called variational quantum Hamiltonian engineering (VQHE) to minimize the Pauli norm of Hamiltonian, such that the overhead for executing expectation value estimation and Hamiltonian simulation can be reduced. First, we develop a theory to encode the Pauli norm optimization problem into the vector L1-norm minimization problem. Then we devise an appropriate cost function and utilize the parameterized quantum circuits (PQC) to minimize the cost function. We also conduct numerical experiments to reduce the Pauli norm of the Ising Hamiltonian and molecules' Hamiltonian to show the efficiency of the proposed VQHE.


title: Electric-field-modulated topological phase transition in AlSb/InSe heterobilayers

abstract: Searching for controllable topological phase by means of external stimuli in two-dimensional (2D) material-based van der Waals (vdW) heterostructures is currently an active field for both the underlying physics and practical applications. Here, using first-principles calculations, we investigate electric-field-modulated topological phase transition in a vdW heterobilayer formed by vertically stacking 2D AlSb and InSe monolayers. The AlSb/InSe heterobilayer studied possesses both dynamical and thermal stabilities, which is a direct bandgap semiconductor and forms a Z-scheme heterojunction. With inclusion of spin-orbit coupling (SOC) and applying external electric field, the bandgap decreases at first and then increase, and a trivial insulator to topological insulator phase transition is observed. For the topological insulator phase, band inversion is ascribed to the strong SOC of p orbitals of Sb. Our work paves the way for the design and application of multifunctional nanoscale devices such as topological field effect transistor.


title: A Passwordless MFA Utlizing Biometrics, Proximity and Contactless Communication

abstract: Despite being more secure and strongly promoted, two-factor (2FA) or multi-factor (MFA) schemes either fail to protect against recent phishing threats such as real-time MITM, controls/relay MITM, malicious browser extension-based phishing attacks, and/or need the users to purchase and carry other hardware for additional account protection. Leveraging the unprecedented popularity of NFC and BLE-enabled smartphones, we explore a new horizon for designing an MFA scheme. This paper introduces an advanced authentication method for user verification that utilizes the user's real-time facial biometric identity, which serves as an inherent factor, together with BLE- NFC-enabled mobile devices, which operate as an ownership factor. We have implemented a prototype authentication system on a BLE-NFC-enabled Android device, and initial threat modeling suggests that it is safe against known phishing attacks. The scheme has been compared with other popular schemes using the Bonneau et al. assessment framework in terms of usability, deployability, and security.


title: Evaluation of Sparse Acoustic Array Geometries for the Application in Indoor Localization

abstract: Angle-of-Arrival estimation technology, with its potential advantages, emerges as an intriguing choice for indoor localization. Notably, it holds the promise of reducing installation costs. In contrast to ToF/TDoA based systems, AoA-based approaches require a reduced number of nodes for effective localization. This characteristic establishes a trade-off between installation costs and the complexity of hardware and software. Moreover, the appeal of acoustic localization is further heightened by its capacity to provide cost-effective hardware solutions while maintaining a high degree of accuracy. Consequently, acoustic AoA estimation technology stands out as a feasible and compelling option in the field of indoor localization. Sparse arrays additionally have the ability to estimate the DoA of more sources than available sensors by placing sensors in a specific geometry. In this contribution, we introduce a measurement platform designed to evaluate various sparse array geometries experimentally. The acoustic microphone array comprises 64 microphones arranged in an 8x8 grid, following an Uniform Rectangular Array (URA) configuration, with a grid spacing of 8.255 mm. This configuration achieves a spatial Nyquist frequency of approximately 20.8 kHz in the acoustic domain at room temperature. Notably, the array exhibits a mean spherical error of 1.26{\deg} when excluding higher elevation angles. The platform allows for masking sensors to simulate sparse array configurations. We assess four array geometries through simulations and experimental data, identifying the Open-Box and Nested array geometries as robust candidates. Additionally, we demonstrate the array's capability to concurrently estimate the directions of three emitting sources using experimental data, employing waveforms consisting of orthogonal codes.


title: Gatemonium: A Voltage-Tunable Fluxonium

abstract: We present a new fluxonium qubit design, gatemonium, based on an all superconductor-semiconductor hybrid platform exhibiting gate voltage tunability of $E_J$. We first show the principle of fluxonium operation in epitaxial Al/InAs heterostructure where the single Josephson junction can be controlled using gate voltage control, effectively tuning the "weight" of the fictitious phase particle. The spectroscopy of the qubit shows tunability between plasmons to fluxons and their hybrid spectrum. We study two gatemonium devices with different charging energies and extract inductance of InAs-based Josephson junctions array. We also discuss future directions implementing a gate voltage tunable superinductance.


title: Enhancing Cross-Modal Fine-Tuning with Gradually Intermediate Modality Generation

abstract: Large-scale pretrained models have proven immensely valuable in handling data-intensive modalities like text and image. However, fine-tuning these models for certain specialized modalities, such as protein sequence and cosmic ray, poses challenges due to the significant modality discrepancy and scarcity of labeled data. In this paper, we propose an end-to-end method, PaRe, to enhance cross-modal fine-tuning, aiming to transfer a large-scale pretrained model to various target modalities. PaRe employs a gating mechanism to select key patches from both source and target data. Through a modality-agnostic Patch Replacement scheme, these patches are preserved and combined to construct data-rich intermediate modalities ranging from easy to hard. By gradually intermediate modality generation, we can not only effectively bridge the modality gap to enhance stability and transferability of cross-modal fine-tuning, but also address the challenge of limited data in the target modality by leveraging enriched intermediate modality data. Compared with hand-designed, general-purpose, task-specific, and state-of-the-art cross-modal fine-tuning approaches, PaRe demonstrates superior performance across three challenging benchmarks, encompassing more than ten modalities.


title: Effect of measurements on quantum speed limit

abstract: Given the initial and final states of a quantum system, the speed of transportation of state vector in the projective Hilbert space governs the quantum speed limit. Here, we ask the question what happens to the quantum speed limit under continuous measurement process. We model the continuous measurement process by a non-Hermitian Hamiltonian which keeps the evolution of the system Schr{\"o}dinger-like even under the process of measurement. Using this specific measurement model, we prove that under continuous measurement, the speed of transportation of a quantum system tends to zero. Interestingly, we also find that for small time scale, there is an enhancement of quantum speed even if the measurement strength is finite. Our findings can have applications in quantum computing and quantum control where dynamics is governed by both unitary and measurement processes.


title: Privacy Aware Memory Forensics

abstract: In recent years, insider threats and attacks have been increasing in terms of frequency and cost to the corporate business. The utilization of end-to-end encrypted instant messaging applications (WhatsApp, Telegram, VPN) by malicious insiders raised data breach incidents exponentially. The Securities and Exchange Board of India (SEBI) investigated reports on such data leak incidents and reported about twelve companies where earnings data and financial information were leaked using WhatsApp messages. Recent surveys indicate that 60% of data breaches are primarily caused by malicious insider threats. Especially, in the case of the defense environment, information leaks by insiders will jeopardize the countrys national security. Sniffing of network and host-based activities will not work in an insider threat detection environment due to end-to-end encryption. Memory forensics allows access to the messages sent or received over an end-to-end encrypted environment but with a total compromise of the users privacy. In this research, we present a novel solution to detect data leakages by insiders in an organization. Our approach captures the RAM of the insiders device and analyses it for sensitive information leaks from a host system while maintaining the users privacy. Sensitive data leaks are identified with context using a deep learning model. The feasibility and effectiveness of the proposed idea have been demonstrated with the help of a military use case. The proposed architecture can however be used across various use cases with minor modifications.


title: Tunneling of Hawking Radiation in Starobinsky-Bel-Robinson gravity

abstract: We examine Hawking radiation for a Schwarszchild-type black hole in Starobinsky Bel Robinson (SBR) gravity and calculate the corrected Hawking Temperature using the tunnelling method. We then discuss the deviation of our Hawking temperature from the standard Schwarszchild result. We relate the corrections to the Hawking temperature beyond the semi-classical approximation. We highlight that starting with a modification of the classical black hole geometry and calculating the semi-classical Hawking temperature, yields temperature corrections comparable to those obtained when the classical background is kept unchanged and beyond semi-classical terms in the temperature are included.


title: Smooth structures on four-manifolds with finite cyclic fundamental groups

abstract: For each nonnegative integer m we show that any closed, oriented topological four-manifold with fundamental group Z_{4m+2} and odd intersection form, with possibly seven exceptions, either admits no smooth structure or admits infinitely many distinct smooth structures up to diffeomorphism. Moreover, we construct infinite families of non-complex irreducible fake projective planes with diverse fundamental groups.


title: LLM Reading Tea Leaves: Automatically Evaluating Topic Models with Large Language Models

abstract: Topic modeling has been a widely used tool for unsupervised text analysis. However, comprehensive evaluations of a topic model remain challenging. Existing evaluation methods are either less comparable across different models (e.g., perplexity) or focus on only one specific aspect of a model (e.g., topic quality or document representation quality) at a time, which is insufficient to reflect the overall model performance. In this paper, we propose WALM (Words Agreement with Language Model), a new evaluation method for topic modeling that comprehensively considers the semantic quality of document representations and topics in a joint manner, leveraging the power of large language models (LLMs). With extensive experiments involving different types of topic models, WALM is shown to align with human judgment and can serve as a complementary evaluation method to the existing ones, bringing a new perspective to topic modeling. Our software package will be available at https://github.com/Xiaohao-Yang/Topic_Model_Evaluation, which can be integrated with many widely used topic models.


title: Fredformer: Frequency Debiased Transformer for Time Series Forecasting

abstract: The Transformer model has shown leading performance in time series forecasting. Nevertheless, in some complex scenarios, it tends to learn low-frequency features in the data and overlook high-frequency features, showing a frequency bias. This bias prevents the model from accurately capturing important high-frequency data features. In this paper, we undertook empirical analyses to understand this bias and discovered that frequency bias results from the model disproportionately focusing on frequency features with higher energy. Based on our analysis, we formulate this bias and propose Fredformer, a Transformer-based framework designed to mitigate frequency bias by learning features equally across different frequency bands. This approach prevents the model from overlooking lower amplitude features important for accurate forecasting. Extensive experiments show the effectiveness of our proposed approach, which can outperform other baselines in different real-world time-series datasets. Furthermore, we introduce a lightweight variant of the Fredformer with an attention matrix approximation, which achieves comparable performance but with much fewer parameters and lower computation costs. The code is available at: https://github.com/chenzRG/Fredformer


title: A geometric approach to informed MCMC sampling

abstract: A Riemannian geometric framework for Markov chain Monte Carlo (MCMC) is developed where using the Fisher-Rao metric on the manifold of probability density functions (pdfs) informed proposal densities for Metropolis-Hastings (MH) algorithms are constructed. We exploit the square-root representation of pdfs under which the Fisher-Rao metric boils down to the standard $L^2$ metric on the positive orthant of the unit hypersphere. The square-root representation allows us to easily compute the geodesic distance between densities, resulting in a straightforward implementation of the proposed geometric MCMC methodology. Unlike the random walk MH that blindly proposes a candidate state using no information about the target, the geometric MH algorithms effectively move an uninformed base density (e.g., a random walk proposal density) towards different global/local approximations of the target density. We compare the proposed geometric MH algorithm with other MCMC algorithms for various Markov chain orderings, namely the covariance, efficiency, Peskun, and spectral gap orderings. The superior performance of the geometric algorithms over other MH algorithms like the random walk Metropolis, independent MH and variants of Metropolis adjusted Langevin algorithms is demonstrated in the context of various multimodal, nonlinear and high dimensional examples. In particular, we use extensive simulation and real data applications to compare these algorithms for analyzing mixture models, logistic regression models and ultra-high dimensional Bayesian variable selection models. A publicly available R package accompanies the article.


title: Finite-temperature properties of antiferroelectric perovskite $\rm PbZrO_3$ from deep learning interatomic potential

abstract: The prototypical antiferroelectric perovskite $\rm PbZrO_3$ (PZO) has garnered considerable attentions in recent years due to its significance in technological applications and fundamental research. Many unresolved issues in PZO are associated with large spatial and time scales, as well as finite temperatures, presenting significant challenges for first-principles density functional theory studies. Here, we introduce a deep learning interatomic potential of PZO, enabling investigation of finite-temperature properties through large-scale atomistic simulations. Trained using an elaborately designed dataset, the model successfully reproduces a large number of phases, in particular, the recently discovered 80-atom antiferroelectric $Pnam$ phase and ferrielectric $Ima2$ phase, providing precise predictions for their structural and dynamical properties. Using this model, we investigated phase transitions of multiple phases, including $Pbam$/$Pnam$, $Ima2$ and $R3c$, which show high similarity to the experimental observation. Our simulation results also highlight the crucial role of free-energy in determining the low-temperature phase of PZO, reconciling the apparent contradiction: $Pbam$ is the most commonly observed phase in experiments, while theoretical calculations predict other phases exhibiting even lower energy. Furthermore, in the temperature range where the $Pbam$ phase is thermodynamically stable, typical double polarization hysteresis loops for antiferroelectrics were obtained, along with a detailed elucidation of the dynamical evolution upon electric-field induced transitions between the non-polar $Pbam$ and polar $R3c$ phases.


title: Bayesian Statistical Modeling with Predictors from LLMs

abstract: State of the art large language models (LLMs) have shown impressive performance on a variety of benchmark tasks and are increasingly used as components in larger applications, where LLM-based predictions serve as proxies for human judgements or decision. This raises questions about the human-likeness of LLM-derived information, alignment with human intuition, and whether LLMs could possibly be considered (parts of) explanatory models of (aspects of) human cognition or language use. To shed more light on these issues, we here investigate the human-likeness of LLMs' predictions for multiple-choice decision tasks from the perspective of Bayesian statistical modeling. Using human data from a forced-choice experiment on pragmatic language use, we find that LLMs do not capture the variance in the human data at the item-level. We suggest different ways of deriving full distributional predictions from LLMs for aggregate, condition-level data, and find that some, but not all ways of obtaining condition-level predictions yield adequate fits to human data. These results suggests that assessment of LLM performance depends strongly on seemingly subtle choices in methodology, and that LLMs are at best predictors of human behavior at the aggregate, condition-level, for which they are, however, not designed to, or usually used to, make predictions in the first place.


title: Totally bounded sets in the absolute weak topology

abstract: In this paper, almost Dunford-Pettis operators with ranges in $c_0$ are used to identify totally bounded sets in the absolute weak topology. That is, a bounded subset $A$ of a Banach lattice $E$ is $|\sigma|(E,E^\prime)$-totally bounded if and only if $T(A)\subset c_0$ is relatively compact for every almost Dunford-Pettis operator $T:E\to{c_0}$. As an application, we show that for two Banach lattices $E$ and $F$ every positive operator from $E$ to $F$ dominated by a PL-compact operator is PL-compact if and only if either the norm of $E^{\,\prime}$ is order continuous or every order interval in $F$ is $|\sigma|(F,F^\prime)$-totally bounded.


title: Deep learning empowered sensor fusion to improve infant movement classification

abstract: There is a recent boom in the development of AI solutions to facilitate and enhance diagnostic procedures for established clinical tools. To assess the integrity of the developing nervous system, the Prechtl general movement assessment (GMA) is recognized for its clinical value in diagnosing neurological impairments in early infancy. GMA has been increasingly augmented through machine learning approaches intending to scale-up its application, circumvent costs in the training of human assessors and further standardize classification of spontaneous motor patterns. Available deep learning tools, all of which are based on single sensor modalities, are however still considerably inferior to that of well-trained human assessors. These approaches are hardly comparable as all models are designed, trained and evaluated on proprietary/silo-data sets. With this study we propose a sensor fusion approach for assessing fidgety movements (FMs) comparing three different sensor modalities (pressure, inertial, and visual sensors). Various combinations and two sensor fusion approaches (late and early fusion) for infant movement classification were tested to evaluate whether a multi-sensor system outperforms single modality assessments. The performance of the three-sensor fusion (classification accuracy of 94.5\%) was significantly higher than that of any single modality evaluated, suggesting the sensor fusion approach is a promising avenue for automated classification of infant motor patterns. The development of a robust sensor fusion system may significantly enhance AI-based early recognition of neurofunctions, ultimately facilitating automated early detection of neurodevelopmental conditions.


title: AMSA-UNet: An Asymmetric Multiple Scales U-net Based on Self-attention for Deblurring

abstract: The traditional ingle-scale U-Net often leads to the loss of spatial information during deblurring, which affects the deblurring accracy. Additionally, due to the convolutional method's limitation in capturing long-range dependencies, the quality of the recovered image is degraded. To address the above problems, an asymmetric multiple scales U-net based on self-attention (AMSA-UNet) is proposed to improve the accuracy and computational complexity. By introducing a multiple-scales U shape architecture, the network can focus on blurry regions at the global level and better recover image details at the local level. In order to overcome the limitations of traditional convolutional methods in capturing the long-range dependencies of information, a self-attention mechanism is introduced into the decoder part of the backbone network, which significantly increases the model's receptive field, enabling it to pay more attention to semantic information of the image, thereby producing more accurate and visually pleasing deblurred images. What's more, a frequency domain-based computation method was introduced to reduces the computation amount. The experimental results demonstrate that the proposed method exhibits significant improvements in both accuracy and speed compared to eight excellent methods


title: Cross-Modal Learning for Anomaly Detection in Fused Magnesium Smelting Process: Methodology and Benchmark

abstract: Fused Magnesium Furnace (FMF) is a crucial industrial equipment in the production of magnesia, and anomaly detection plays a pivotal role in ensuring its efficient, stable, and secure operation. Existing anomaly detection methods primarily focus on analyzing dominant anomalies using the process variables (such as arc current) or constructing neural networks based on abnormal visual features, while overlooking the intrinsic correlation of cross-modal information. This paper proposes a cross-modal Transformer (dubbed FmFormer), designed to facilitate anomaly detection in fused magnesium smelting processes by exploring the correlation between visual features (video) and process variables (current). Our approach introduces a novel tokenization paradigm to effectively bridge the substantial dimensionality gap between the 3D video modality and the 1D current modality in a multiscale manner, enabling a hierarchical reconstruction of pixel-level anomaly detection. Subsequently, the FmFormer leverages self-attention to learn internal features within each modality and bidirectional cross-attention to capture correlations across modalities. To validate the effectiveness of the proposed method, we also present a pioneering cross-modal benchmark of the fused magnesium smelting process, featuring synchronously acquired video and current data for over 2.2 million samples. Leveraging cross-modal learning, the proposed FmFormer achieves state-of-the-art performance in detecting anomalies, particularly under extreme interferences such as current fluctuations and visual occlusion caused by heavy water mist. The presented methodology and benchmark may be applicable to other industrial applications with some amendments. The benchmark will be released at https://github.com/GaochangWu/FMF-Benchmark.


title: A PCA based Keypoint Tracking Approach to Automated Facial Expressions Encoding

abstract: The Facial Action Coding System (FACS) for studying facial expressions is manual and requires significant effort and expertise. This paper explores the use of automated techniques to generate Action Units (AUs) for studying facial expressions. We propose an unsupervised approach based on Principal Component Analysis (PCA) and facial keypoint tracking to generate data-driven AUs called PCA AUs using the publicly available DISFA dataset. The PCA AUs comply with the direction of facial muscle movements and are capable of explaining over 92.83 percent of the variance in other public test datasets (BP4D-Spontaneous and CK+), indicating their capability to generalize facial expressions. The PCA AUs are also comparable to a keypoint-based equivalence of FACS AUs in terms of variance explained on the test datasets. In conclusion, our research demonstrates the potential of automated techniques to be an alternative to manual FACS labeling which could lead to efficient real-time analysis of facial expressions in psychology and related fields. To promote further research, we have made code repository publicly available.


title: Continuous time crystals as a PT symmetric state and the emergence of critical exceptional points

abstract: Continuous time-translation symmetry is often spontaneously broken in open quantum systems, and the condition for their emergence has been actively investigated. However, there are only a few cases in which its condition for appearance has been fully elucidated. In this Letter, we show that a Lindladian parity-time (PT) symmetry can generically produce persistent periodic oscillations, including dissipative continuous time crystals, in one-collective spin models. By making an analogy to non-reciprocal phase transitions, we demonstrate that a transition point from the dynamical phase is associated with spontaneous PT symmetry breaking and typically corresponds to a \textit{critical exceptional point}. Interestingly, the periodic orbits in the PT-symmetric phase are found to be center-type, implying an initial-state-dependent amplitude. These results are established by proving that the Lindbladian PT symmetry at the microscopic level implies a non-linear PT symmetry, and by performing a linear stability analysis near the transition point. This research will further our understanding of novel non-equilibrium phases of matter and phase transitions with spontaneous anti-unitary symmetry breaking.


title: Ground state energy of a dilute Bose gas with three-body hard-core interactions

abstract: We consider a gas of bosons interacting through a three-body hard-core potential in the thermodynamic limit. We derive an upper bound on the ground state energy of the system at the leading order using a Jastrow factor. Our result matches the lower bound proven by Nam-Ricaud-Triay and therefore resolves the leading order. Moreover, a straightforward adaptation of our proof can be used for systems interacting via combined two-body and three-body interactions to generalise Theorem 1.2. from arXiv:2402.05646 to hard-core potentials.


title: Meta-Learning an Evolvable Developmental Encoding

abstract: Representations for black-box optimisation methods (such as evolutionary algorithms) are traditionally constructed using a delicate manual process. This is in contrast to the representation that maps DNAs to phenotypes in biological organisms, which is at the hear of biological complexity and evolvability. Additionally, the core of this process is fundamentally the same across nearly all forms of life, reflecting their shared evolutionary origin. Generative models have shown promise in being learnable representations for black-box optimisation but they are not per se designed to be easily searchable. Here we present a system that can meta-learn such representation by directly optimising for a representation's ability to generate quality-diversity. In more detail, we show our meta-learning approach can find one Neural Cellular Automata, in which cells can attend to different parts of a "DNA" string genome during development, enabling it to grow different solvable 2D maze structures. We show that the evolved genotype-to-phenotype mappings become more and more evolvable, not only resulting in a faster search but also increasing the quality and diversity of grown artefacts.


title: Contextual Distillation Model for Diversified Recommendation

abstract: The diversity of recommendation is equally crucial as accuracy in improving user experience. Existing studies, e.g., Determinantal Point Process (DPP) and Maximal Marginal Relevance (MMR), employ a greedy paradigm to iteratively select items that optimize both accuracy and diversity. However, prior methods typically exhibit quadratic complexity, limiting their applications to the re-ranking stage and are not applicable to other recommendation stages with a larger pool of candidate items, such as the pre-ranking and ranking stages. In this paper, we propose Contextual Distillation Model (CDM), an efficient recommendation model that addresses diversification, suitable for the deployment in all stages of industrial recommendation pipelines. Specifically, CDM utilizes the candidate items in the same user request as context to enhance the diversification of the results. We propose a contrastive context encoder that employs attention mechanisms to model both positive and negative contexts. For the training of CDM, we compare each target item with its context embedding and utilize the knowledge distillation framework to learn the win probability of each target item under the MMR algorithm, where the teacher is derived from MMR outputs. During inference, ranking is performed through a linear combination of the recommendation and student model scores, ensuring both diversity and efficiency. We perform offline evaluations on two industrial datasets and conduct online A/B test of CDM on the short-video platform KuaiShou. The considerable enhancements observed in both recommendation quality and diversity, as shown by metrics, provide strong superiority for the effectiveness of CDM.


title: Towards Unified AI Models for MU-MIMO Communications: A Tensor Equivariance Framework

abstract: In this paper, we propose a unified framework based on equivariance for the design of artificial intelligence (AI)-assisted technologies in multi-user multiple-input-multiple-output (MU-MIMO) systems. We first provide definitions of multidimensional equivariance, high-order equivariance, and multidimensional invariance (referred to collectively as tensor equivariance). On this basis, by investigating the design of precoding and user scheduling, which are key techniques in MU-MIMO systems, we delve deeper into revealing tensor equivariance of the mappings from channel information to optimal precoding tensors, precoding auxiliary tensors, and scheduling indicators, respectively. To model mappings with tensor equivariance, we propose a series of plug-and-play tensor equivariant neural network (TENN) modules, where the computation involving intricate parameter sharing patterns is transformed into concise tensor operations. Building upon TENN modules, we propose the unified tensor equivariance framework that can be applicable to various communication tasks, based on which we easily accomplish the design of corresponding AI-assisted precoding and user scheduling schemes. Simulation results demonstrate that the constructed precoding and user scheduling methods achieve near-optimal performance while exhibiting significantly lower computational complexity and generalization to inputs with varying sizes across multiple dimensions. This validates the superiority of TENN modules and the unified framework.


title: Schur's Positive-Definite Network: Deep Learning in the SPD cone with structure

abstract: Estimating matrices in the symmetric positive-definite (SPD) cone is of interest for many applications ranging from computer vision to graph learning. While there exist various convex optimization-based estimators, they remain limited in expressivity due to their model-based approach. The success of deep learning has thus led many to use neural networks to learn to estimate SPD matrices in a data-driven fashion. For learning structured outputs, one promising strategy involves architectures designed by unrolling iterative algorithms, which potentially benefit from inductive bias properties. However, designing correct unrolled architectures for SPD learning is difficult: they either do not guarantee that their output has all the desired properties, rely on heavy computations, or are overly restrained to specific matrices which hinders their expressivity. In this paper, we propose a novel and generic learning module with guaranteed SPD outputs called SpodNet, that also enables learning a larger class of functions than existing approaches. Notably, it solves the challenging task of learning jointly SPD and sparse matrices. Our experiments demonstrate the versatility of SpodNet layers.


title: E(2)-Equivariant Features in Machine Learning for Morphological Classification of Radio Galaxies

abstract: With the growth of data from new radio telescope facilities, machine-learning approaches to the morphological classification of radio galaxies are increasingly being utilised. However, while widely employed deep-learning models using convolutional neural networks (CNNs) are equivariant to translations within images, neither CNNs nor most other machine-learning approaches are equivariant to additional isometries of the Euclidean plane, such as rotations and reflections. Recent work has attempted to address this by using G-steerable CNNs, designed to be equivariant to a specified subset of 2-dimensional Euclidean, E(2), transformations. Although this approach improved model performance, the computational costs were a recognised drawback. Here we consider the use of directly extracted E(2)-equivariant features for the classification of radio galaxies. Specifically, we investigate the use of Minkowski functionals (MFs), Haralick features (HFs) and elliptical Fourier descriptors (EFDs). We show that, while these features do not perform equivalently well to CNNs in terms of accuracy, they are able to inform the classification of radio galaxies, requiring ~50 times less computational runtime. We demonstrate that MFs are the most informative, EFDs the least informative, and show that combinations of all three result in only incrementally improved performance, which we suggest is due to information overlap between feature sets.


title: Site-Specific Radio Channel Representation -- Current State and Future Applications

abstract: A site-specific radio channel representation considers the surroundings of the communication system through the environment geometry, such as buildings, vegetation, and mobile objects including their material and surface properties. In this article, we focus on communication technologies for 5G and beyond that are increasingly able to exploit the specific environment geometry for both communication and sensing. We present methods for a site-specific radio channel representation that is spatially consistent, such that mobile transmitter and receveiver cause a correlated time-varying channel impulse response. When modelled as random, this channel impulse response has non-stationary statistical properties, i.e., a time-variant Doppler spectrum, power delay profile, K-factor and spatial correlation. A site-specific radio channel representation will enable research into emerging 5G and beyond technologies such as distributed multiple-input multiple-output systems, reconfigurable intelligent surfaces, multi-band communication, and joint communication and sensing. These 5G and beyond technologies will be deployed for a wide range of environments, from dense urban areas to railways, road transportation, industrial automation, and unmanned aerial vehicles.


title: Steganalysis on Digital Watermarking: Is Your Defense Truly Impervious?

abstract: Digital watermarking techniques are crucial for copyright protection and source identification of images, especially in the era of generative AI models. However, many existing watermarking methods, particularly content-agnostic approaches that embed fixed patterns regardless of image content, are vulnerable to steganalysis attacks that can extract and remove the watermark with minimal perceptual distortion. In this work, we categorize watermarking algorithms into content-adaptive and content-agnostic ones, and demonstrate how averaging a collection of watermarked images could reveal the underlying watermark pattern. We then leverage this extracted pattern for effective watermark removal under both graybox and blackbox settings, even when the collection contains multiple watermark patterns. For some algorithms like Tree-Ring watermarks, the extracted pattern can also forge convincing watermarks on clean images. Our quantitative and qualitative evaluations across twelve watermarking methods highlight the threat posed by steganalysis to content-agnostic watermarks and the importance of designing watermarking techniques resilient to such analytical attacks. We propose security guidelines calling for using content-adaptive watermarking strategies and performing security evaluation against steganalysis. We also suggest multi-key assignments as potential mitigations against steganalysis vulnerabilities.


title: Revisiting subregion holography using OPE blocks

abstract: In this short note, we revisit the entanglement wedge representation of AdS$_3$ bulk fields in terms of CFT operator product expansion (OPE) blocks for a general class of blocks. Given a boundary interval and its associated causal diamond, the OPEs involve boundary operators with or without spin, and located either at spacelike or timelike edges of the diamond. Only for a subset of these cases, can the OPE block be dual to a geodesic bulk field. We show that when applied to de Sitter, a suitable combination of Euclidean OPE blocks can represent a dS scalar integrated over the timelike extremal surfaces, which play an important role in defining pseudo-entropy. We also work out some simple higher dimensional examples.


title: From Biased to Unbiased Dynamics: An Infinitesimal Generator Approach

abstract: We investigate learning the eigenfunctions of evolution operators for time-reversal invariant stochastic processes, a prime example being the Langevin equation used in molecular dynamics. Many physical or chemical processes described by this equation involve transitions between metastable states separated by high potential barriers that can hardly be crossed during a simulation. To overcome this bottleneck, data are collected via biased simulations that explore the state space more rapidly. We propose a framework for learning from biased simulations rooted in the infinitesimal generator of the process and the associated resolvent operator. We contrast our approach to more common ones based on the transfer operator, showing that it can provably learn the spectral properties of the unbiased system from biased data. In experiments, we highlight the advantages of our method over transfer operator approaches and recent developments based on generator learning, demonstrating its effectiveness in estimating eigenfunctions and eigenvalues. Importantly, we show that even with datasets containing only a few relevant transitions due to sub-optimal biasing, our approach recovers relevant information about the transition mechanism.


title: Fair by design: A sociotechnical approach to justifying the fairness of AI-enabled systems across the lifecycle

abstract: Fairness is one of the most commonly identified ethical principles in existing AI guidelines, and the development of fair AI-enabled systems is required by new and emerging AI regulation. But most approaches to addressing the fairness of AI-enabled systems are limited in scope in two significant ways: their substantive content focuses on statistical measures of fairness, and they do not emphasize the need to identify and address fairness considerations across the whole AI lifecycle. Our contribution is to present an assurance framework and tool that can enable a practical and transparent method for widening the scope of fairness considerations across the AI lifecycle and move the discussion beyond mere statistical notions of fairness to consider a richer analysis in a practical and context-dependent manner. To illustrate this approach, we first describe and then apply the framework of Trustworthy and Ethical Assurance (TEA) to an AI-enabled clinical diagnostic support system (CDSS) whose purpose is to help clinicians predict the risk of developing hypertension in patients with Type 2 diabetes, a context in which several fairness considerations arise (e.g., discrimination against patient subgroups). This is supplemented by an open-source tool and a fairness considerations map to help facilitate reasoning about the fairness of AI-enabled systems in a participatory way. In short, by using a shared framework for identifying, documenting and justifying fairness considerations, and then using this deliberative exercise to structure an assurance case, research on AI fairness becomes reusable and generalizable for others in the ethical AI community and for sharing best practices for achieving fairness and equity in digital health and healthcare in particular.


title: CUER: Corrected Uniform Experience Replay for Off-Policy Continuous Deep Reinforcement Learning Algorithms

abstract: The utilization of the experience replay mechanism enables agents to effectively leverage their experiences on several occasions. In previous studies, the sampling probability of the transitions was modified based on their relative significance. The process of reassigning sample probabilities for every transition in the replay buffer after each iteration is considered extremely inefficient. Hence, in order to enhance computing efficiency, experience replay prioritization algorithms reassess the importance of a transition as it is sampled. However, the relative importance of the transitions undergoes dynamic adjustments when the agent's policy and value function are iteratively updated. Furthermore, experience replay is a mechanism that retains the transitions generated by the agent's past policies, which could potentially diverge significantly from the agent's most recent policy. An increased deviation from the agent's most recent policy results in a greater frequency of off-policy updates, which has a negative impact on the agent's performance. In this paper, we develop a novel algorithm, Corrected Uniform Experience Replay (CUER), which stochastically samples the stored experience while considering the fairness among all other experiences without ignoring the dynamic nature of the transition importance by making sampled state distribution more on-policy. CUER provides promising improvements for off-policy continuous control algorithms in terms of sample efficiency, final performance, and stability of the policy during the training.


title: A Comprehensive Graph Pooling Benchmark: Effectiveness, Robustness and Generalizability

abstract: Graph pooling has gained attention for its ability to obtain effective node and graph representations for various downstream tasks. Despite the recent surge in graph pooling approaches, there is a lack of standardized experimental settings and fair benchmarks to evaluate their performance. To address this issue, we have constructed a comprehensive benchmark that includes 15 graph pooling methods and 21 different graph datasets. This benchmark systematically assesses the performance of graph pooling methods in three dimensions, i.e., effectiveness, robustness, and generalizability. We first evaluate the performance of these graph pooling approaches across different tasks including graph classification, graph regression and node classification. Then, we investigate their performance under potential noise attacks and out-of-distribution shifts in real-world scenarios. We also involve detailed efficiency analysis and parameter analysis. Extensive experiments validate the strong capability and applicability of graph pooling approaches in various scenarios, which can provide valuable insights and guidance for deep geometric learning research. The source code of our benchmark is available at https://github.com/goose315/Graph_Pooling_Benchmark.


title: Stimulated magnon scattering by non-degenerate parametric excitation

abstract: Parametric spin wave excitation allows studying a variety of nonlinear phenomena, such as magnon scattering. In patterned micro- and nanostructures the magnon spectra is discrete and translational symmetry is broken, which means allowable scattering channels differ from those in continuous films. An example is non-degenerate scattering by which high-power transverse field pumping creates two magnons with distinct frequencies around half the pumping frequency. Through micromagnetics simulations, we show under certain conditions that combining two pumping frequencies generates new magnon modes through a process of stimulated magnon scattering. Such processes are found to depend on the film geometry and sequence of the pumping fields.


title: An alternative to purification in CFT

abstract: In conformal field theories, in contrast to \emph{adding} some auxiliary states into the bipartite mixed state $\rho_{AB}$ as the usual purifications do, we show a pure entangled state $\psi_{AB}$ can be constructed by \emph{subtracting} the undetectable regions. In this pure state $\psi_{AB}$, the von Neumann entropy $S_{\text{vN}}(A)$ naturally captures quantum entanglement between $A$ and $B$. We verify that $S_{\text{vN}}(A)$ is equal to the entanglement wedge cross-section $E_{W}$ in AdS spacetime, which is conjectured to be the holographic dual of the entanglement of purification. We show such constructed entanglement entropy has a phase transition. The ordinary entanglement entropies of critical and non-critical QFTs are simply limits of the two phases.


title: Topological roots of the Bernstein-Sato polynomial of plane curves

abstract: We study a set of topological roots of the local Bernstein-Sato polynomial of arbitrary plane curve singularities. These roots are characterized in terms of certain divisorial valuations and the numerical data of the minimal log resolution. In particular, this set of roots strictly contains both the opposites of the jumping numbers in $(0, 1)$ and the poles of the motivic zeta function counted with multiplicity. As a consequence, we prove the multiplicity part of the Strong Monodromy Conjecture for $n = 2$.


title: How Decentralization Affects User Agency on Social Platforms

abstract: Mainstream social media platforms function as "walled garden" ecosystems that restrict user agency, control, and data portability. They have demonstrated a lack of transparency that contributes to a multitude of online harms. Our research investigates how decentralization might present promise as an alternative model to walled garden platforms. Specifically, we describe the user-driven content moderation through blocks as an expression of agency on Bluesky, a decentralized social platform. We examine the impact of providing users with more granular control over their online experiences, including what they post, who can see it, and whose content they are exposed to. We describe the patterns identified in user-driven content moderation and suggest directions for further research.


title: Thermodynamic of the $f(Q)$ universe

abstract: We investigate thermodynamics of apparent horizon in the $f(Q)$ universe with trivial and nontrivial connections. We first explore the perspectives of the first law, generalized second law and $P-V$ phase transition with trivial connection. We show that the lowest-order correction of entropy has the same form as that in loop quantum gravity, and the critical exponents of the phase transition caused by the lowest-order correction are consistent with those in mean field theory. We then examine the thermodynamic implication of nontrivial connections. We find that nontrivial connections in the $f(Q)$ universe imply non-equilibrium states from the perspective of thermodynamics.


title: Evaluating Privacy, Security, and Trust Perceptions in Conversational AI: A Systematic Review

abstract: Conversational AI (CAI) systems which encompass voice- and text-based assistants are on the rise and have been largely integrated into people's everyday lives. Despite their widespread adoption, users voice concerns regarding privacy, security and trust in these systems. However, the composition of these perceptions, their impact on technology adoption and usage and the relationship between privacy, security and trust perceptions in the CAI context remain open research challenges. This study contributes to the field by conducting a Systematic Literature Review and offers insights into the current state of research on privacy, security and trust perceptions in the context of CAI systems. The review covers application fields and user groups and sheds light on empirical methods and tools used for assessment. Moreover, it provides insights into the reliability and validity of privacy, security and trust scales, as well as extensively investigating the subconstructs of each item as well as additional concepts which are concurrently collected. We point out that the perceptions of trust, privacy and security overlap based on the subconstructs we identified. While the majority of studies investigate one of these concepts, only a few studies were found exploring privacy, security and trust perceptions jointly. Our research aims to inform on directions to develop and use reliable scales for users' privacy, security and trust perceptions and contribute to the development of trustworthy CAI systems.


title: CGP++ : A Modern C++ Implementation of Cartesian Genetic Programming

abstract: The reference implementation of Cartesian Genetic Programming (CGP) was written in the C programming language. C inherently follows a procedural programming paradigm, which entails challenges in providing a reusable and scalable implementation model for complex structures and methods. Moreover, due to the limiting factors of C, the reference implementation of CGP does not provide a generic framework and is therefore restricted to a set of predefined evaluation types. Besides the reference implementation, we also observe that other existing implementations are limited with respect to the features provided. In this work, we therefore propose the first version of a modern C++ implementation of CGP that pursues object-oriented design and generic programming paradigm to provide an efficient implementation model that can facilitate the discovery of new problem domains and the implementation of complex advanced methods that have been proposed for CGP over time. With the proposal of our new implementation, we aim to generally promote interpretability, accessibility and reproducibility in the field of CGP.


title: Language-Driven Closed-Loop Grasping with Model-Predictive Trajectory Replanning

abstract: Combining a vision module inside a closed-loop control system for a \emph{seamless movement} of a robot in a manipulation task is challenging due to the inconsistent update rates between utilized modules. This task is even more difficult in a dynamic environment, e.g., objects are moving. This paper presents a \emph{modular} zero-shot framework for language-driven manipulation of (dynamic) objects through a closed-loop control system with real-time trajectory replanning and an online 6D object pose localization. We segment an object within $\SI{0.5}{\second}$ by leveraging a vision language model via language commands. Then, guided by natural language commands, a closed-loop system, including a unified pose estimation and tracking and online trajectory planning, is utilized to continuously track this object and compute the optimal trajectory in real-time. Our proposed zero-shot framework provides a smooth trajectory that avoids jerky movements and ensures the robot can grasp a non-stationary object. Experiment results exhibit the real-time capability of the proposed zero-shot modular framework for the trajectory optimization module to accurately and efficiently grasp moving objects, i.e., up to \SI{30}{\hertz} update rates for the online 6D pose localization module and \SI{10}{\hertz} update rates for the receding-horizon trajectory optimization. These advantages highlight the modular framework's potential applications in robotics and human-robot interaction; see the video in https://www.acin.tuwien.ac.at/en/6e64/.


title: FacEnhance: Facial Expression Enhancing with Recurrent DDPMs

abstract: Facial expressions, vital in non-verbal human communication, have found applications in various computer vision fields like virtual reality, gaming, and emotional AI assistants. Despite advancements, many facial expression generation models encounter challenges such as low resolution (e.g., 32x32 or 64x64 pixels), poor quality, and the absence of background details. In this paper, we introduce FacEnhance, a novel diffusion-based approach addressing constraints in existing low-resolution facial expression generation models. FacEnhance enhances low-resolution facial expression videos (64x64 pixels) to higher resolutions (192x192 pixels), incorporating background details and improving overall quality. Leveraging conditional denoising within a diffusion framework, guided by a background-free low-resolution video and a single neutral expression high-resolution image, FacEnhance generates a video incorporating the facial expression from the low-resolution video performed by the individual with background from the neutral image. By complementing lightweight low-resolution models, FacEnhance strikes a balance between computational efficiency and desirable image resolution and quality. Extensive experiments on the MUG facial expression database demonstrate the efficacy of FacEnhance in enhancing low-resolution model outputs to state-of-the-art quality while preserving content and identity consistency. FacEnhance represents significant progress towards resource-efficient, high-fidelity facial expression generation, Renewing outdated low-resolution methods to up-to-date standards.


title: ME-Switch: A Memory-Efficient Expert Switching Framework for Large Language Models

abstract: The typical process for developing LLMs involves pre-training a general foundation model on massive data, followed by fine-tuning on task-specific data to create specialized experts. Serving these experts poses challenges, as loading all experts onto devices is impractical, and frequent switching between experts in response to user requests incurs substantial I/O costs, increasing latency and expenses. Previous approaches decompose expert weights into pre-trained model weights and residual delta weights, then quantize the delta weights to reduce model size. However, these methods often lead to significant quantization errors at extremely low bitwidths and assume the appropriate model for a user request is known in advance, which is not practical. To address these issues, we introduce ME-Switch, a memory-efficient expert switching framework for LLM serving. ME-Switch uses mixed-precision quantization, selectively quantizing non-salient input channels of delta weights to extremely low bits while keeping salient ones intact, significantly reducing storage demands while maintaining performance. Additionally, we develop a routing method that efficiently directs user queries to the most suitable expert by transforming the model selection problem into a domain classification problem. Extensive experiments show ME-Switch's promising memory efficiency and routing performance. For example, when serving three models from the Mistral-7B family, ME-Switch reduces model size by 1.74x while maintaining nearly lossless performance on instruction, mathematical reasoning, and code generation tasks. Furthermore, ME-Switch can efficiently serve 16 models from the Mistral-7B family on a single NVIDIA A100 GPU.


title: Knowledge Graphs in the Digital Twin: A Systematic Literature Review About the Combination of Semantic Technologies and Simulation in Industrial Automation

abstract: The ongoing digitization of the industrial sector has reached a pivotal juncture with the emergence of Digital Twins, offering a digital representation of physical assets and processes. One key aspect of those digital representations are simulation models, enabling a deeper insight in the assets current state and its characteristics. This paper asserts that the next evolutionary step in this digitization journey involves the integration of intelligent linkages between diverse simulation models within the Digital Twin framework. Crucially, for the Digital Twin to be a scalable and cost-effective solution, there is a pressing need for automated adaption, (re-)configuration, and generation of simulation models. Recognizing the inherent challenges in achieving such automation, this paper analyses the utilization of knowledge graphs as a potentially very suitable technological solution. Knowledge graphs, acting as interconnected and interrelated databases, provide a means of seamlessly integrating different data sources, facilitating the efficient integration and automated adaption of data and (simulation) models in the Digital Twin. We conducted a comprehensive literature review to analyze the current landscape of knowledge graphs in the context of Digital Twins with focus on simulation models. By addressing the challenges associated with scalability and maintenance, this research contributes to the effective adaption of Digital Twins in the industrial sector, paving the way for enhanced efficiency, adaptability, and resilience in the face of evolving technological landscapes.


title: Language Models are Crossword Solvers

abstract: Crosswords are a form of word puzzle that require a solver to demonstrate a high degree of proficiency in natural language understanding, wordplay, reasoning, and world knowledge, along with adherence to character and length constraints. In this paper we tackle the challenge of solving crosswords with Large Language Models (LLMs). We demonstrate that the current generation of state-of-the art (SoTA) language models show significant competence at deciphering cryptic crossword clues, and outperform previously reported SoTA results by a factor of 2-3 in relevant benchmarks. We also develop a search algorithm that builds off this performance to tackle the problem of solving full crossword grids with LLMs for the very first time, achieving an accuracy of 93\% on New York Times crossword puzzles. Contrary to previous work in this area which concluded that LLMs lag human expert performance significantly, our research suggests this gap is a lot narrower.


title: MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning

abstract: Efficient finetuning of large language models (LLMs) aims to adapt the LLMs with reduced computation and memory cost. Previous LoRA-based approaches initialize the low-rank matrices with gaussian distribution and zero values, while keeping the original weight matrices frozen. However, the trainable model parameters optimized in an unguided subspace might have interference with the well-learned subspace of the pretrained weight matrix. In this paper, we propose MiLoRA, a simple yet effective LLM finetuning approach that only updates the minor singular components of the weight matrix while keeping the principle singular components frozen. It is observed that the minor matrix corresponds to the noisy or long-tail information, while the principle matrix contains important knowledge. The MiLoRA initializes the low-rank matrices within a subspace that is orthogonal to the principle matrix, thus the pretrained knowledge is expected to be well preserved. During finetuning, MiLoRA makes the most use of the less-optimized subspace for learning the finetuning dataset. Extensive experiments on commonsense reasoning, math reasoning and instruction following benchmarks present the superior performance of our method.


title: Pseudo-Nambu-Goldstone Boson Production from Inflaton Coupling during Reheating

abstract: The existence of pseudo-Nambu-Goldstone boson (pNGB) fields is a common feature in many models beyond the Standard Model, characterized by their exclusive derivative couplings. This paper investigates a scenario where a pNGB is coupled to the inflaton field during the reheating phase of the early universe. We calculate the perturbative decay rate of a coherently oscillating inflaton into pNGBs on a general basis, considering both constant and field-dependent couplings with monomial potentials at the minimum. As a concrete application, we explore the production of axions when the radial mode of the Peccei-Quinn (PQ) scalar serves as the inflaton, particularly in the presence of a large gravitational non-minimal coupling. Our findings suggest that the presence of pNGBs during reheating can lead to significant non-thermal relics, offering new constraints on inflationary reheating models and providing potential observational signatures in the form of dark radiation.


title: ExioML: Eco-economic dataset for Machine Learning in Global Sectoral Sustainability

abstract: The Environmental Extended Multi-Regional Input-Output analysis is the predominant framework in Ecological Economics for assessing the environmental impact of economic activities. This paper introduces ExioML, the first Machine Learning benchmark dataset designed for sustainability analysis, aimed at lowering barriers and fostering collaboration between Machine Learning and Ecological Economics research. A crucial greenhouse gas emission regression task was conducted to evaluate sectoral sustainability and demonstrate the usability of the dataset. We compared the performance of traditional shallow models with deep learning models, utilizing a diverse Factor Accounting table and incorporating various categorical and numerical features. Our findings reveal that ExioML, with its high usability, enables deep and ensemble models to achieve low mean square errors, establishing a baseline for future Machine Learning research. Through ExioML, we aim to build a foundational dataset supporting various Machine Learning applications and promote climate actions and sustainable investment decisions.


title: DeepJEB: 3D Deep Learning-based Synthetic Jet Engine Bracket Dataset

abstract: Recent advancements in artificial intelligence (AI) have significantly influenced various fields, including mechanical engineering. Nonetheless, the development of high-quality, diverse datasets for structural analysis still needs to be improved. Although traditional datasets, such as simulated jet engine bracket dataset, are useful, they are constrained by a small number of samples, which must be improved for developing robust data-driven surrogate models. This study presents the DeepJEB dataset, which has been created using deep generative models and automated engineering simulation pipelines, to overcome these challenges. Moreover, this study provides comprehensive 3D geometries and their corresponding structural analysis data. Key experiments validated the effectiveness of the DeepJEB dataset, demonstrating significant improvements in the prediction accuracy and reliability of surrogate models trained on this data. The enhanced dataset showed a broader design space and better generalization capabilities than traditional datasets. These findings highlight the potential of DeepJEB as a benchmark dataset for developing reliable surrogate models in structural engineering. The DeepJEB dataset supports advanced modeling techniques, such as graph neural networks (GNNs) and high-dimensional convolutional networks (CNNs), leveraging node-level field data for precise predictions. This dataset is set to drive innovation in engineering design applications, enabling more accurate and efficient structural performance predictions. The DeepJEB dataset is publicly accessible at: https://www.narnia.ai/dataset


title: Central Limit Theorem for Bayesian Neural Network trained with Variational Inference

abstract: In this paper, we rigorously derive Central Limit Theorems (CLT) for Bayesian two-layerneural networks in the infinite-width limit and trained by variational inference on a regression task. The different networks are trained via different maximization schemes of the regularized evidence lower bound: (i) the idealized case with exact estimation of a multiple Gaussian integral from the reparametrization trick, (ii) a minibatch scheme using Monte Carlo sampling, commonly known as Bayes-by-Backprop, and (iii) a computationally cheaper algorithm named Minimal VI. The latter was recently introduced by leveraging the information obtained at the level of the mean-field limit. Laws of large numbers are already rigorously proven for the three schemes that admits the same asymptotic limit. By deriving CLT, this work shows that the idealized and Bayes-by-Backprop schemes have similar fluctuation behavior, that is different from the Minimal VI one. Numerical experiments then illustrate that the Minimal VI scheme is still more efficient, in spite of bigger variances, thanks to its important gain in computational complexity.


title: Efficiently Deciding Algebraic Equivalence of Bow-Free Acyclic Path Diagrams

abstract: For causal discovery in the presence of latent confounders, constraints beyond conditional independences exist that can enable causal discovery algorithms to distinguish more pairs of graphs. Such constraints are not well-understood yet. In the setting of linear structural equation models without bows, we study algebraic constraints and argue that these provide the most fine-grained resolution achievable. We propose efficient algorithms that decide whether two graphs impose the same algebraic constraints, or whether the constraints imposed by one graph are a subset of those imposed by another graph.