title: State-Averaged Orbital-Optimized VQE: A quantum algorithm for the democratic description of ground and excited electronic states

abstract: The electronic structure problem is one of the main problems in modern theoretical chemistry. While there are many already-established methods both for the problem itself and its applications like semi-classical or quantum dynamics, it remains a computationally demanding task, effectively limiting the size of solved problems. Fortunately, it seems, that offloading some parts of the computation to Quantum Processing Units may offer significant speed-up, often referred to as quantum supremacy or quantum advantage. Together with the potential advantage, this approach simultaneously presents several problems, most notably naturally occurring quantum decoherence, hereafter denoted as quantum noise and lack of large-scale quantum computers, making it necessary to focus on Noisy-Intermediate Scale Quantum computers when developing algorithms aspiring to near-term applications. SA-OO-VQE package aims to answer both these problems with its hybrid quantum-classical conception based on a typical Variational Quantum Eigensolver approach, as only a part of the algorithm utilizes offload to QPUs and the rest is performed on a classical computer, thus partially avoiding both quantum noise and the lack of quantum bits. The SA-OO-VQE has the ability to treat degenerate (or quasi-degenerate) states on the same footing, thus avoiding known numerical optimization problems arising in state-specific approaches around avoided crossings or conical intersections.


title: Bootstrap prediction regions for daily curves of electricity demand and price using functional data

abstract: The aim of this paper is to compute one-day-ahead prediction regions for daily curves of electricity demand and price. Three model-based procedures to construct general prediction regions are proposed, all of them using bootstrap algorithms. The first proposed method considers any $L_p$ norm for functional data to measure the distance between curves, the second one is designed to take different variabilities along the curve into account, and the third one takes advantage of the notion of depth of a functional data. The regression model with functional response on which our proposed prediction regions are based is rather general: it allows to include both endogenous and exogenous functional variables, as well as exogenous scalar variables; in addition, the effect of such variables on the response one is modeled in a parametric, nonparametric or semi-parametric way. A comparative study is carried out to analyse the performance of these prediction regions for the electricity market of mainland Spain, in year 2012. This work extends and complements the methods and results in Aneiros et al. (2016) (focused on curve prediction) and Vilar et al. (2018) (focused on prediction intervals), which use the same database as here.


title: Time Localized Tilted Beams in Nearly-Degenerate Laser Cavities

abstract: We show that nearly degenerate Vertical External-Cavity Surface-Emitting Lasers emit tilted beams of time localized structures, i.e. mode-locked light pulses which can be individually addressed. These beams feature a Gaussian profile and they are emitted in pairs with opposite transverse k-vector. Because they are phase locked, their interference leads to a non homotetic pattern in the near-field emission of the laser. When a single pair is emitted this is a stripe pattern. Our analysis discloses the role of spherical aberrations of the cavity in stabilizing this spatio-temporal mode-locked regime and in selecting the value of the transverse wavevector.


title: $q$-Rational functions and interpolation with complete Nevanlinna Pick Kernels

abstract: In this paper we introduce the concept of matrix-valued $q$-rational functions. In comparison to the classic case we give different characterizations with principal emphasise on realizations and discuss algebraic manipulations. We also study the concept of Schur multipliers and complete Nevanlinna Pick kernels in this context and provide first applications in terms of an interpolation problem using Schur multipliers and complete Nevanlinna Pick kernels.


title: Multimodal Deep Learning of Word-of-Mouth Text and Demographics to Predict Customer Rating: Handling Consumer Heterogeneity in Marketing

abstract: In the marketing field, understanding consumer heterogeneity, which is the internal or psychological difference among consumers that cannot be captured by behavioral logs, has long been a critical challenge. However, a number of consumers today usually post their evaluation on the specific product on the online platform, which can be the valuable source of such unobservable differences among consumers. Several previous studies have shown the validity of the analysis on text modality, but on the other hand, such analyses may not necessarily demonstrate sufficient predictive accuracy for text alone, as they may not include information readily available from cross-sectional data, such as consumer profile data. In addition, recent advances in machine learning techniques, such as large-scale language models (LLMs) and multimodal learning have made it possible to deal with the various kind of dataset simultaneously, including textual data and the traditional cross-sectional data, and the joint representations can be effectively obtained from multiple modalities. Therefore, this study constructs a product evaluation model that takes into account consumer heterogeneity by multimodal learning of online product reviews and consumer profile information. We also compare multiple models using different modalities or hyper-parameters to demonstrate the robustness of multimodal learning in marketing analysis.


title: Laser-induced quenching of metastability at the Mott-insulator to metal transition

abstract: There is growing interest in strongly correlated insulator thin films because the intricate interplay of their intrinsic and extrinsic state variables causes memristive behavior that might be used for bio-mimetic devices in the emerging field of neuromorphic computing. In this study we find that laser irradiation tends to drive V$_2$O$_3$ from supercooled/superheated metastable states towards thermodynamic equilibrium, most likely in a non-thermal way. We study thin films of the prototypical Mott-insulator V$_2$O$_3$, which show spontaneous phase separation into metal-insulator herringbone domains during the Mott transition. Here, we use low-temperature microscopy to investigate how these metal-insulator domains can be modified by scanning a focused laser beam across the thin film surface. We find that the response depends on the thermal history: When the thin film is heated from below the Mott transition temperature, the laser beam predominantly induces metallic domains. On the contrary, when the thin film is cooled from a temperature above the transition, the laser beam predominantly induces insulating domains. Very likely, the V$_2$O$_3$ thin film is in a superheated or supercooled state, respectively, during the first-order phase transition, and the perturbation by a laser beam drives these metastable states into stable ones. This way, the thermal history is locally erased. Our findings are supported by a phenomenological model with a laser-induced lowering of the energy barrier between the metastable and equilibrium states.


title: Shape uncertainty quantification of Maxwell eigenvalues and -modes with application to TESLA cavities

abstract: We consider Maxwell eigenvalue problems on uncertain shapes with perfectly conducting TESLA cavities being the driving example. Due to the shape uncertainty the resulting eigenvalues and eigenmodes are also uncertain and it is well known that the eigenvalues may exhibit crossings or bifurcations under perturbation. We discuss how the shape uncertainties can be modelled using the domain mapping approach and how the deformation mapping can be expressed as coefficients in Maxwell's equations. Using derivatives of these coefficients and derivatives of the eigenpairs, we follow a perturbation approach to compute approximations of mean and covariance of the eigenpairs. For small perturbations these approximations are faster and more accurate than sampling or surrogate model strategies. For the implementation we use an approach based on isogeometric analysis, which allows for straightforward modelling of the domain deformations and computation of the required derivatives. Numerical experiments for a three-dimensional 9-cell TESLA cavity are presented.


title: Validation of Classical Transport Cross Section for Ion-Ion Interactions Under Repulsive Yukawa Potential

abstract: Value of cross section is a fundamental parameter to depict the transport of charged particles in matters. Due to masses of orders of magnitude higher than electrons and convenience of realistic calculation, the cross section of elastic nuclei-nuclei collision is usually treated via classical mechanics. The famous Bohr criterion was firstly proposed to judge whether the treatment via classical mechanics is reliable or not. Later, Lindhard generalized the results of Coulomb to screening potentials. Considering the increasing importance of detailed ion-ion interactions under modern simulation codes in inertial confinement fusion (ICF) researches, the validation of classical transport cross section for ion-ion interactions in a big range of parameter space is certainly required. In this work, the transport cross sections via classical mechanics under repulsive Yukawa potential are compared with those via quantum mechanics. Differences of differential cross sections are found with respect to scattering angles and velocities. Our results generally indicate that the classical picture fails at the cases of both low and high velocities, which represent a significant extension of the famous Bohr criterion and its generalized variations. Furthermore, the precise validation zones of classical picture is also analysed in this work. This work is of significant importance for benchmarking the modern ion-kinetic simulation codes in ICF researches, concerning the stopping power of $\alpha$ particles in DT fuels, ion-ion friction and viscous effects in the formation of kinetic shocks.


title: AI, insurance, discrimination and unfair differentiation. An overview and research agenda

abstract: Insurers increasingly use AI. We distinguish two situations in which insurers use AI: (i) data-intensive underwriting, and (ii) behaviour-based insurance. (i) First, insurers can use AI for data analysis to assess risks: data-intensive underwriting. Underwriting is, in short, calculating risks and amending the insurance premium accordingly. (ii) Second, insurers can use AI to monitor the behaviour of consumers in real-time: behaviour-based insurance. For example, some car insurers give a discount if a consumer agrees to being tracked by the insurer and drives safely. While the two trends bring many advantages, they may also have discriminatory effects. This paper focuses on the following question. Which discrimination-related effects may occur if insurers use data-intensive underwriting and behaviour-based insurance? We focus on two types of discrimination-related effects: discrimination and other unfair differentiation. (i) Discrimination harms certain groups who are protected by non-discrimination law, for instance people with certain ethnicities. (ii) Unfair differentiation does not harm groups that are protected by non-discrimination law, but it does seem unfair. We introduce four factors to consider when assessing the fairness of insurance practices. The paper builds on literature from various disciplines including law, philosophy, and computer science.


title: PolySilicate Porous Organic Polymers (PSiPOPs), a new family of porous, ordered 3D reticular materials with polysilicate nodes and organic linkers

abstract: Spherosilicate, consisting of a double 4-ring cyclosilicate core (D4R; Si8O20) with every corner functionalized with a dimethylsilyl chloride group (-SiMe2Cl), was used as node to construct an iso-reticular series of porous expanded network materials. Interconnecting the nodes with linear, aliphatic {\alpha},{\omega}-alkanediol linker molecules yields PolySilicate Porous Organic Polymers (PSiPOPs), a new type of ordered reticular material related to the well-known metal-organic and covalent organic frameworks (MOFs & COFs). In the synthesis, sacrificial hydrogen-bonded Si8O20 cyclosilicate crystals are first converted into silyl chloride terminated spherosilicate. In a second step, these nodes are linked up by alkanediol units via the intermediate formation of a Si-N bond with catalytic amines such as pyridine and dimethylformamide. Overall, the presented synthesis converts D4R cyclosilicate into an ordered reticular framework with [Si8O20]-[Si(CH3)2-]8 nodes and O-(CH2)n-O linkers. Example materials with ethylene glycol, 1,5-pentanediol, and 1,7-heptanediol as linker (n = 2, 5, and 7) were produced and characterized. On a macroscopic level, the synthesis yields porous frameworks exhibiting a thermal stability up to 400{\deg}C and a chemical stability between pH 1 and 12. N2 physisorption revealed a secondary mesopore structure, indicating future options to produce hierarchical materials using soft templates. The molecular level structure of these reticular PSiPOP materials was elucidated using an NMR crystallography approach implementing a combination of 1D and 2D 1H and 29Si solid-state MAS NMR spectroscopy experiments. Previously reported reticular COF/POP materials implementing D4R-based nodes, used Si8 octakis (phenyl) D4R POSS as a node, connecting it to the linker via a Si-C bond instead of a Si-O-C linkage.


title: Exact Normal Modes of Quantum Plasmas

abstract: The normal modes, i.e., the eigen solutions to the dispersion relation equation, are the most fundamental properties of a plasma, which also of key importance to many nonlinear effects such as parametric and two-plasmon decay, and Raman scattering. The real part indicates the intrinsic oscillation frequency while the imaginary part the Landau damping rate. In most of the literatures, the normal modes of quantum plasmas are obtained by means of small damping approximation (SDA), which is invalid for high-$k$ modes. In this paper, we solve the exact dispersion relations via the analytical continuation (AC) scheme, and, due to the multi-value nature of the Fermi-Dirac distribution, reformation of the complex Riemann surface is required. It is found that the change of the topological shape of the root locus in quantum plasmas is quite different from classical plasmas, in which both real and imaginary frequencies of high-$k$ modes increase with $k$ in a steeper way than the typical linear behaviour as appears in classical plasmas. As a result, the temporal evolution of a high-$k$ perturbation in quantum plasmas is dominated by the ballistic modes.


title: Hadronic vacuum polarization in the muon $g-2$: The short-distance contribution from lattice QCD

abstract: We present results for the short-distance window observable of the hadronic vacuum polarization contribution to the muon $g-2$, computed via the time-momentum representation (TMR) in lattice QCD. A key novelty of our calculation is the reduction of discretization effects by a suitable subtraction applied to the TMR kernel function, which cancels the leading $x_0^4$-behaviour at short distances. To compensate for the subtraction, one must substitute a term that can be reliably computed in perturbative QCD. We apply this strategy to our data for the vector current collected on ensembles generated with $2+1$ flavours of O($a$)-improved Wilson quarks at six values of the lattice spacing and pion masses in the range $130-420\,$MeV. Our estimate at the physical point contains a full error budget and reads $(a_\mu^{\rm hvp})^{\rm SD}=68.85(14)_{\rm stat}\,(42)_{\rm syst}\cdot10^{-10}$, which corresponds to a relative precision of 0.7\%. We discuss the implications of our result for the observed tensions between lattice and data-driven evaluations of the hadronic vacuum polarization.


title: Comparison of Model Output Statistics and Neural Networks to Postprocess Wind Gusts

abstract: Wind gust prediction plays an important role in warning strategies of national meteorological services due to the high impact of its extreme values. However, forecasting wind gusts is challenging because they are influenced by small-scale processes and local characteristics. To account for the different sources of uncertainty, meteorological centers run ensembles of forecasts and derive probabilities of wind gusts exceeding a threshold. These probabilities often exhibit systematic errors and require postprocessing. Model Output Statistics (MOS) is a common operational postprocessing technique, although more modern methods such as neural network-bases approaches have shown promising results in research studies. The transition from research to operations requires an exhaustive comparison of both techniques. Taking a first step into this direction, our study presents a comparison of a postprocessing technique based on linear and logistic regression approaches with different neural network methods proposed in the literature to improve wind gust predictions, specifically distributional regression networks and Bernstein quantile networks. We further contribute to investigating optimal design choices for neural network-based postprocessing methods regarding changes of the numerical model in the training period, the use of persistence predictors, and the temporal composition of training datasets. The performance of the different techniques is compared in terms of calibration, accuracy, reliability and resolution based on case studies of wind gust forecasts from the operational weather model of the German weather service and observations from 170 weather stations.


title: Towards Automatic Transformations of Coq Proof Scripts

abstract: Proof assistants like Coq are increasingly popular to help mathematicians carry out proofs of the results they conjecture. However, formal proofs remain highly technical and are especially difficult to reuse. In this paper, we present a framework to carry out a posteriori script transformations. These transformations are meant to be applied as an automated post-processing step, once the proof has been completed. As an example, we present a transformation which takes an arbitrary large proof script and produces an equivalent single-line proof script, which can be executed by Coq in one single step. Other applications, such as fully expanding a proof script (for debugging purposes), removing all named hypotheses, etc. could be developed within this framework. We apply our tool to various Coq proof scripts, including some from the GeoCoq library.


title: Automated Completion of Statements and Proofs in Synthetic Geometry: an Approach based on Constraint Solving

abstract: Conjecturing and theorem proving are activities at the center of mathematical practice and are difficult to separate. In this paper, we propose a framework for completing incomplete conjectures and incomplete proofs. The framework can turn a conjecture with missing assumptions and with an under-specified goal into a proper theorem. Also, the proposed framework can help in completing a proof sketch into a human-readable and machine-checkable proof. Our approach is focused on synthetic geometry, and uses coherent logic and constraint solving. The proposed approach is uniform for all three kinds of tasks, flexible and, to our knowledge, unique such approach.


title: Efficiency in random allocation with ordinal rules

abstract: We study ordinal rules for allocating indivisible goods via lottery. Ordinality requires a rule to consider only how agents rank degenerate lotteries and may be necessitated by cognitive, informational, or as we show, incentive constraints. The limited responsiveness of ordinal rules to agents' preferences means that they can only satisfy welfare properties based on first order stochastic dominance, which is incomplete. We define a new efficiency concept for ordinal rules. While ordinality and efficiency together are incompatible with the usual notions of fairness and somewhat limit randomization, they do leave room for a rich class of rules. We demonstrate this through a characterization of all ordinal, efficient, strategy-proof, non-bossy, boundedly invariant, and neutral rules.


title: Showing Proofs, Assessing Difficulty with GeoGebra Discovery

abstract: In our contribution we describe some on-going improvements concerning the Automated Reasoning Tools developed in GeoGebra Discovery, providing different examples of the performance of these new features. We describe the new ShowProof command, that outputs both the sequence of the different steps performed by GeoGebra Discovery to confirm a certain statement, as well as a number intending to grade the difficulty or interest of the assertion. The proposal of this assessment measure, involving the comparison of the expression of the thesis (or conclusion) as a combination of the hypotheses, will be developed.


title: ORBGRAND: Achievable Rate for General Bit Channels and Application in BICM

abstract: Guessing random additive noise decoding (GRAND) has received widespread attention recently, and among its variants, ordered reliability bits GRAND (ORBGRAND) is particularly attractive due to its efficient utilization of soft information and its amenability to hardware implementation. It has been recently shown that ORBGRAND is almost capacity-achieving in additive white Gaussian noise channels under antipodal input. In this work, we first extend the analysis of ORBGRAND achievable rate to memoryless binary-input bit channels with general output conditional probability distributions. The analytical result also sheds insight into understanding the gap between the ORBGRAND achievable rate and the channel mutual information. As an application of the analysis, we study the ORBGRAND achievable rate of bit-interleaved coded modulation (BICM). Numerical results indicate that for BICM, the gap between the ORBGRAND achievable rate and the channel mutual information is typically small, and hence suggest the feasibility of ORBGRAND for channels with high-order coded modulation schemes.


title: A Training-Free Defense Framework for Robust Learned Image Compression

abstract: We study the robustness of learned image compression models against adversarial attacks and present a training-free defense technique based on simple image transform functions. Recent learned image compression models are vulnerable to adversarial attacks that result in poor compression rate, low reconstruction quality, or weird artifacts. To address the limitations, we propose a simple but effective two-way compression algorithm with random input transforms, which is conveniently applicable to existing image compression models. Unlike the na\"ive approaches, our approach preserves the original rate-distortion performance of the models on clean images. Moreover, the proposed algorithm requires no additional training or modification of existing models, making it more practical. We demonstrate the effectiveness of the proposed techniques through extensive experiments under multiple compression models, evaluation metrics, and attack scenarios.


title: Automation of Triangle Ruler-and-Compass Constructions Using Constraint Solvers

abstract: In this paper, we present an approach to automated solving of triangle ruler-and-compass construction problems using finite-domain constraint solvers. The constraint model is described in the MiniZinc modeling language, and is based on the automated planning. The main benefit of using general constraint solvers for such purpose, instead of developing dedicated tools, is that we can rely on the efficient search that is already implemented within the solver, enabling us to focus on geometric aspects of the problem. We may also use the solver's built-in optimization capabilities to search for the shortest possible constructions. We evaluate our approach on 74 solvable problems from the Wernick's list, and compare it to the dedicated triangle construction solver ArgoTriCS. The results show that our approach is comparable to dedicated tools, while it requires much less effort to implement. Also, our model often finds shorter constructions, thanks to the optimization capabilities offered by the constraint solvers.


title: Towards an Independent Version of Tarski's System of Geometry

abstract: In 1926-1927, Tarski designed a set of axioms for Euclidean geometry which reached its final form in a manuscript by Schwabh\"auser, Szmielew and Tarski in 1983. The differences amount to simplifications obtained by Tarski and Gupta. Gupta presented an independent version of Tarski's system of geometry, thus establishing that his version could not be further simplified without modifying the axioms. To obtain the independence of one of his axioms, namely Pasch's axiom, he proved the independence of one of its consequences: the previously eliminated symmetry of betweenness. However, an independence model for the non-degenerate part of Pasch's axiom was provided by Szczerba for another version of Tarski's system of geometry in which the symmetry of betweenness holds. This independence proof cannot be directly used for Gupta's version as the statements of the parallel postulate differ. In this paper, we present our progress towards obtaining an independent version of a variant of Gupta's system. Compared to Gupta's version, we split Pasch's axiom into this previously eliminated axiom and its non-degenerate part and change the statement of the parallel postulate. We verified the independence properties by mechanizing counter-models using the Coq proof-assistant.


title: Considerations on Approaches and Metrics in Automated Theorem Generation/Finding in Geometry

abstract: The pursue of what are properties that can be identified to permit an automated reasoning program to generate and find new and interesting theorems is an interesting research goal (pun intended). The automatic discovery of new theorems is a goal in itself, and it has been addressed in specific areas, with different methods. The separation of the "weeds", uninteresting, trivial facts, from the "wheat", new and interesting facts, is much harder, but is also being addressed by different authors using different approaches. In this paper we will focus on geometry. We present and discuss different approaches for the automatic discovery of geometric theorems (and properties), and different metrics to find the interesting theorems among all those that were generated. After this description we will introduce the first result of this article: an undecidability result proving that having an algorithmic procedure that decides for every possible Turing Machine that produces theorems, whether it is able to produce also interesting theorems, is an undecidable problem. Consequently, we will argue that judging whether a theorem prover is able to produce interesting theorems remains a non deterministic task, at best a task to be addressed by program based in an algorithm guided by heuristics criteria. Therefore, as a human, to satisfy this task two things are necessary: an expert survey that sheds light on what a theorem prover/finder of interesting geometric theorems is, and - to enable this analysis - other surveys that clarify metrics and approaches related to the interestingness of geometric theorems. In the conclusion of this article we will introduce the structure of two of these surveys - the second result of this article - and we will discuss some future work.


title: Solving with GeoGebra Discovery an Austrian Mathematics Olympiad problem: Lessons Learned

abstract: We address, through the automated reasoning tools in GeoGebra Discovery, a problem from a regional phase of the Austrian Mathematics Olympiad 2023. Trying to solve this problem gives rise to four different kind of feedback: the almost instantaneous, automated solution of the proposed problem; the measure of its complexity, according to some recent proposals; the automated discovery of a generalization of the given assertion, showing that the same statement is true over more general polygons than those mentioned in the problem; and the difficulties associated to the analysis of the surprising and involved high number of degenerate cases that appear when using the LocusEquation command in this problem. In our communication we will describe and reflect on these diverse issues, enhancing its exemplar role for showing some of the advantages, problems, and current fields of development of GeoGebra Discovery.


title: DarkGEO: A Large-Scale Laser-Interferometric Axion Detector

abstract: Axions and axion-like particles (ALPs) are leading candidates for dark matter. They are well motivated in many extensions of the Standard Model and supported by astronomical observations. We propose an iterative transformation of the existing facilities of the gravitational-wave detector and technology testbed GEO600, located near Ruthe in Germany, into a kilometre-scale upgrade of the laser-interferometric axion detector LIDA. The final DarkGEO detector could search for coincident signatures of axions and ALPs and significantly surpass the current constraints of both direct searches and astrophysical observations in the measurement band from $10^{-16}$ to $10^{-8}$ $\text{eV}$. We discuss realistic parameters and design sensitivities for the configurations of the different iteration steps as well as technical challenges known from the first LIDA results. The proposed DarkGEO detector will be well suited to probe the parameter space associated with predictions from theoretical models, like grand-unified theories, as well as from astrophysical evidence, like the cosmic infrared background.


title: The Locus Story of a Rocking Camel in a Medical Center in the City of Freistadt

abstract: We give an example of automated geometry reasoning for an imaginary classroom project by using the free software package GeoGebra Discovery. The project is motivated by a publicly available toy, a rocking camel, installed at a medical center in Upper Austria. We explain how the process of a false conjecture, experimenting, modeling, a precise mathematical setup, and then a proof by automated reasoning could help extend mathematical knowledge at secondary school level and above.


title: 3D Space Trajectories and beyond: Abstract Art Creation with 3D Printing

abstract: We present simple models of trajectories in space, both in 2D and in 3D. The first examples, which model bicircular moves in the same direction, are classical curves (epicycloids, etc.). Then, we explore bicircular moves in reverse direction and tricircular moves in 2D and 3D, to explore complex visualisations of extraplanetary movements. These moves are studied in a plane setting. Then, adding increasing complexity, we explore them in a non planar setting (which is a closer model of the real situation). The exploration is followed by using these approaches for creating mathematical art in 2D and 3D printed objects, providing new ways of mathematical representations. Students' activities are organized around this exploration.


title: Improving Angular Speed Uniformity by Piecewise Radical Reparameterization

abstract: For a rational parameterization of a curve, it is desirable that its angular speed is as uniform as possible. Hence, given a rational parameterization, one wants to find re-parameterization with better uniformity. One natural way is to use piecewise rational reparameterization. However, it turns out that the piecewise rational reparameterization does not help when the angular speed of the given rational parameterization is zero at some points on the curve. In this paper, we show how to overcome the challenge by using piecewise radical reparameterization.


title: Blinded by Generated Contexts: How Language Models Merge Generated and Retrieved Contexts When Knowledge Conflicts?

abstract: While auxiliary information has become a key to enhancing Large Language Models (LLMs), relatively little is known about how LLMs merge these contexts, specifically contexts generated by LLMs and those retrieved from external sources. To investigate this, we formulate a systematic framework to identify whether LLMs' responses are attributed to either generated or retrieved contexts. To easily trace the origin of the response, we construct datasets with conflicting contexts, i.e., each question is paired with both generated and retrieved contexts, yet only one of them contains the correct answer. Our experiments reveal a significant bias in several LLMs (GPT-4/3.5 and Llama2) to favor generated contexts, even when they provide incorrect information. We further identify two key factors contributing to this bias: i) contexts generated by LLMs typically show greater similarity to the questions, increasing their likelihood of being selected; ii) the segmentation process used in retrieved contexts disrupts their completeness, thereby hindering their full utilization in LLMs. Our analysis enhances the understanding of how LLMs merge diverse contexts, offers valuable insights for advancing current LLM augmentation methods, and highlights the risk of generated misinformation for retrieval-augmented LLMs.


title: Local Diversity of Condorcet Domains

abstract: Several of the classical results in social choice theory demonstrate that in order for many voting systems to be well-behaved the set domain of individual preferences must satisfy some kind of restriction, such as being single-peaked on a political axis. As a consequence it becomes interesting to measure how diverse the preferences in a well-behaved domain can be. In this paper we introduce an egalitarian approach to measuring preference diversity, focusing on the abundance of distinct suborders one subsets of the alternative. We provide a common generalisation of the frequently used concepts of ampleness and copiousness. We give a detailed investigation of the abundance for Condorcet domains. Our theorems imply a ceiling for the local diversity in domains on large sets of alternatives, which show that in this measure Black's single-peaked domain is in fact optimal. We also demonstrate that for some numbers of alternatives, there are Condorcet domains which have largest local diversity without having maximum order.


title: Large receptive field strategy and important feature extraction strategy in 3D object detection

abstract: The enhancement of 3D object detection is pivotal for precise environmental perception and improved task execution capabilities in autonomous driving. LiDAR point clouds, offering accurate depth information, serve as a crucial information for this purpose. Our study focuses on key challenges in 3D target detection. To tackle the challenge of expanding the receptive field of a 3D convolutional kernel, we introduce the Dynamic Feature Fusion Module (DFFM). This module achieves adaptive expansion of the 3D convolutional kernel's receptive field, balancing the expansion with acceptable computational loads. This innovation reduces operations, expands the receptive field, and allows the model to dynamically adjust to different object requirements. Simultaneously, we identify redundant information in 3D features. Employing the Feature Selection Module (FSM) quantitatively evaluates and eliminates non-important features, achieving the separation of output box fitting and feature extraction. This innovation enables the detector to focus on critical features, resulting in model compression, reduced computational burden, and minimized candidate frame interference. Extensive experiments confirm that both DFFM and FSM not only enhance current benchmarks, particularly in small target detection, but also accelerate network performance. Importantly, these modules exhibit effective complementarity.


title: A Saliency Enhanced Feature Fusion based multiscale RGB-D Salient Object Detection Network

abstract: Multiscale convolutional neural network (CNN) has demonstrated remarkable capabilities in solving various vision problems. However, fusing features of different scales alwaysresults in large model sizes, impeding the application of multiscale CNNs in RGB-D saliency detection. In this paper, we propose a customized feature fusion module, called Saliency Enhanced Feature Fusion (SEFF), for RGB-D saliency detection. SEFF utilizes saliency maps of the neighboring scales to enhance the necessary features for fusing, resulting in more representative fused features. Our multiscale RGB-D saliency detector uses SEFF and processes images with three different scales. SEFF is used to fuse the features of RGB and depth images, as well as the features of decoders at different scales. Extensive experiments on five benchmark datasets have demonstrated the superiority of our method over ten SOTA saliency detectors.


title: Secure Multi-hop Telemetry Broadcasts for UAV Swarm Communication

abstract: Unmanned Aerial Vehicles (UAVs) are evolving as adaptable platforms for a wide range of applications such as precise inspections, emergency response, and remote sensing. Autonomous UAV swarms require efficient and stable communication during deployment for a successful mission execution. For instance, the periodic exchange of telemetry data between all swarm members provides the foundation for formation flight and collision avoidance. However, due to the mobility of the vehicles and instability of wireless transmissions, maintaining a secure and reliable all-to-all communication remains challenging. This paper investigates encrypted and authenticated multi-hop broadcast communication based on the transmission of custom IEEE 802.11 Wi-Fi data frames.


title: Collisional alignment and molecular rotation control chemi-ionization of individual conformers

abstract: The relationship between the shape of a molecule and its chemical reactivity is a central tenet in chemistry. However, the influence of the molecular geometry on reactivity can be subtle and result from several opposing effects. Using a novel crossed-molecular-beam experiment in which individual rotational quantum states of specific conformers of a molecule are separated, we study the chemi-ionization reaction of hydroquinone with metastable neon atoms. We show that collision-induced alignment of the reaction partners caused by geometry-dependent long-range forces crucially influences reaction pathways for distinct conformers which is, however, countered by molecular rotation. We demonstrate how the interplay between molecular geometry, chemical steering forces and rotational dynamics govern the outcome of reactions and illustrate the capability of advanced molecule-control techniques to unravel these effects.


title: Raviolo vertex algebras, cochains and conformal blocks

abstract: Raviolo vertex algebras were introduced recently by Garner and Williams in arXiv:2308.04414. Working at the level of cochain complexes, in the present paper we construct spaces of conformal blocks, or more precisely their duals, coinvariants, in the raviolo setting. We prove that the raviolo state-field map correctly captures the limiting behaviour of coinvariants as marked points collide.


title: Ultraknots and limit knots

abstract: We prove that every knot type in $\mathbb{R}^3$ can be parametrised by a smooth function $f:S^1\to\mathbb{R}^3$, $f(t)=(x(t),y(t),z(t))$ such that all derivatives $f^{(n)}(t)=(x^{(n)}(t),y^{(n)}(t),z^{(n)}(t))$, $n\in\mathbb{N}$, parametrise knots and every knot type appears in the corresponding sequence of knots. We also study knot types that arise as limits of such sequences.


title: Thermodynamic work of partial resetting

abstract: Partial resetting, whereby a state variable $x(t)$ is reset at random times to a value $a x (t)$, $0\leq a \leq 1$, generalizes conventional resetting by introducing the resetting strength $a$ as a parameter. Partial resetting generates a broad family of non-equilibrium steady states (NESS) that interpolates between the conventional NESS at strong resetting ($a=0$) and a Gaussian distribution at weak resetting ($a \to 1$). Here, such resetting processes are studied from a thermodynamic perspective, and the mean cost associated with maintaining such NESS are derived. The resetting phase of the dynamics is implemented by a resetting potential $\Phi(x)$ that mediates the resets in finite time. By working in an ensemble of trajectories with a fixed number of resets, we study both the steady-state properties of the propagator and its moments. The thermodynamic work needed to sustain the resulting NESS is then investigated. We find that different resetting traps can give rise to rates of work with widely different dependencies on the resetting strength $a$. Surprisingly, in the case of resets mediated by a harmonic trap with otherwise free diffusive motion, the asymptotic rate of work is insensitive to the value of $a$. For general anharmonic traps, the asymptotic rate of work can be either increasing or decreasing as a function of the strength $a$, depending on the degree of anharmonicity. Counter to intuition, the rate of work can therefore in some cases increase as the resetting becomes weaker $(a\to 1)$ although the work vanishes at $a=1$. Work in the presence of a background potential is also considered. Numerical simulations confirm our findings.


title: The quality assurance test of the SliT ASIC for the J-PARC muon $g-2$/EDM experiment

abstract: The SliT ASIC is a readout chip for the silicon strip detector to be used at the J-PARC muon $g-2$/EDM experiment. The production version of SliT128D was designed and mass production was finished. A quality assurance test method for bare SliT128D chips was developed to provide a sufficient number of chips for the experiment. The quality assurance test of the SliT128D chips was performed and 5735 chips were inspected. No defect was observed in chips of 84.3%. Accepting a few channels with poor time walk performance out of 128 channels per chip, more than 90% yield can be achieved, which is sufficient to construct the whole detector.


title: Maximizing Spectral and Energy Efficiency in Multi-user MIMO OFDM Systems with RIS and Hardware Impairment

abstract: An emerging technology to enhance the spectral efficiency (SE) and energy efficiency (EE) of wireless communication systems is reconfigurable intelligent surface (RIS), which is shown to be very powerful in single-carrier systems. However, in multi-user orthogonal frequency division multiplexing (OFDM) systems, RIS may not be as promising as in single-carrier systems since an independent optimization of RIS elements at each sub-carrier is impossible in multi-carrier systems. Thus, this paper investigates the performance of various RIS technologies like regular (reflective and passive), simultaneously transmit and reflect (STAR), and multi-sector beyond diagonal (BD) RIS in multi-user multiple-input multiple-output (MIMO) OFDM broadcast channels (BC). This requires to formulate and solve a joint MIMO precoding and RIS optimization problem. The obtained solution reveals that RIS can significantly improve the system performance even when the number of RIS elements is relatively low. Moreover, we develop resource allocation schemes for STAR-RIS and multi-sector BD-RIS in MIMO OFDM BCs, and show that these RIS technologies can outperform a regular RIS, especially when the regular RIS cannot assist the communications for all the users.


title: Universal scaling laws of quantum spatial search in complex networks

abstract: Since quantum spatial searches on complex networks have a strong network dependence, the question arises whether the universal perspective exists in this quantum algorithm for complex networks. Here, we uncover the universal scaling laws of the quantum spatial search on complex networks such as small-world and scale-free networks. The average path length, a key quantity in the complex network science, is useful to expose this universal feature, where the collapse plot can be generated for the optimal time, the maximal finding probability and the optimal hopping parameter. Based on the path integral method, we also clarify that the probability amplitude in the continuous-time quantum walk can be determined by the path length distribution. Our results demonstrate a new link between the quantum physics and the complex networks.


title: VirtuWander: Enhancing Multi-modal Interaction for Virtual Tour Guidance through Large Language Models

abstract: Tour guidance in virtual museums encourages multi-modal interactions to boost user experiences, concerning engagement, immersion, and spatial awareness. Nevertheless, achieving the goal is challenging due to the complexity of comprehending diverse user needs and accommodating personalized user preferences. Informed by a formative study that characterizes guidance-seeking contexts, we establish a multi-modal interaction design framework for virtual tour guidance. We then design VirtuWander, a two-stage innovative system using domain-oriented large language models to transform user inquiries into diverse guidance-seeking contexts and facilitate multi-modal interactions. The feasibility and versatility of VirtuWander are demonstrated with virtual guiding examples that encompass various touring scenarios and cater to personalized preferences. We further evaluate VirtuWander through a user study within an immersive simulated museum. The results suggest that our system enhances engaging virtual tour experiences through personalized communication and knowledgeable assistance, indicating its potential for expanding into real-world scenarios.


title: LCODE: Quasistatic code for simulating long-term evolution of three-dimensional plasma wakefields

abstract: A recently developed three-dimensional version of the quasistatic code LCODE has a novel feature that enables high-accuracy simulations of the long-term evolution of waves in plasma wakefield accelerators. Equations of plasma particle motion are modified to suppress clustering and numerical heating of macroparticles, which otherwise occur because the Debye length is not resolved by the numerical grid. The previously observed effects of premature wake chaotization and wavebreaking disappear with the modified equations.


title: Large deviations of the empirical spectral measure of supercritical sparse Wigner matrices

abstract: Let $\Xi$ be the adjacency matrix of an Erd\H{o}s-R\'enyi graph on $n$ vertices and with parameter $p$ and consider $A$ a $n\times n$ centered random symmetric matrix with bounded i.i.d. entries above the diagonal. When the mean degree $np$ diverges, the empirical spectral measure of the normalized Hadamard product $(A \circ \Xi)/\sqrt{np}$ converges weakly in probability to the semicircle law. In the regime where $p\ll 1$ and $ np \gg \log n$, we prove a large deviations principle for the empirical spectral measure with speed $n^2p$ and with a good rate function solution of a certain variational problem. The rate function reveals in particular that the only possible deviations at the exponential scale $n^2p$ are around measures coming from Quadratic Vector Equations. As a byproduct, we obtain a large deviations principle for the empirical spectral measure of supercritical Erd\H{o}s-R\'enyi graphs.


title: Gaussians for Electronic and Rovibrational Quantum Dynamics

abstract: The assumptions underpinning the adiabatic Born-Oppenheimer (BO) approximation are broken for molecules interacting with attosecond laser pulses, which generate complicated coupled electronic-nuclear wavepackets that generally will have components of electronic and dissociation continua as well as bound-state contributions. The conceptually most straightforward way to overcome this challenge is to treat the electronic and nuclear degrees of freedom on equal quantum-mechanical footing by not invoking the BO approximation at all. Explicitly correlated Gaussian (ECG) basis functions have proved successful for non-BO calculations of stationary molecular states and energies, reproducing rovibrational absorption spectra with very high accuracy. In this paper, we present a proof-of-principle study of the ability of fully flexible ECGs (FFECGs) to capture the intricate electronic and rovibrational dynamics generated by short, high-intensity laser pulses. By fitting linear combinations of FFECGs to accurate wave function histories obtained on a large real-space grid for a regularized 2D model of the hydrogen atom and for the 2D Morse potential we demonstrate that FFECGs provide a very compact description of laser-driven electronic and rovibrational dynamics.


title: Inertia drives concentration-wave turbulence in swimmer suspensions

abstract: We discover an instability mechanism in suspensions of self-propelled particles that does not involve active stress. Instead, it is driven by a subtle interplay of inertia, swimmer motility, and concentration fluctuations, through a crucial time lag between the velocity and the concentration field. The resulting time-persistent state seen in our high-resolution numerical simulations consists of self-sustained waves of concentration and orientation, transiting from regular oscillations to wave turbulence. We analyze the statistical features of this active turbulence, including an intriguing connection to the Batchelor spectrum of passive scalars.


title: Combination of searches for pair-produced leptoquarks at $\sqrt{s} = 13$ TeV with the ATLAS detector

abstract: A statistical combination of various searches for pair-produced leptoquarks is presented, using the full LHC Run 2 (2015-2018) data set of $139$ fb$^{-1}$ collected with the ATLAS detector from proton-proton collisions at a centre-of-mass energy of $\sqrt{s}=13$ TeV. All possible decays of the leptoquarks into quarks of the third generation and charged or neutral leptons of any generation are investigated. Since no significant deviations from the Standard Model expectation are observed in any of the individual analyses, combined exclusion limits are set on the production cross-sections for scalar and vector leptoquarks. The resulting lower bounds on leptoquark masses exceed those from the individual analyses by up to 100 GeV, depending on the signal hypothesis.


title: Parsimony or Capability? Decomposition Delivers Both in Long-term Time Series Forecasting

abstract: Long-term time series forecasting (LTSF) represents a critical frontier in time series analysis, characterized by extensive input sequences, as opposed to the shorter spans typical of traditional approaches. While longer sequences inherently offer richer information for enhanced predictive precision, prevailing studies often respond by escalating model complexity. These intricate models can inflate into millions of parameters, resulting in prohibitive parameter scales. Our study demonstrates, through both analytical and empirical evidence, that decomposition is key to containing excessive model inflation while achieving uniformly superior and robust results across various datasets. Remarkably, by tailoring decomposition to the intrinsic dynamics of time series data, our proposed model outperforms existing benchmarks, using over 99 \% fewer parameters than the majority of competing methods. Through this work, we aim to unleash the power of a restricted set of parameters by capitalizing on domain characteristics--a timely reminder that in the realm of LTSF, bigger is not invariably better.


title: On the existential theory of the completions of a global field

abstract: We discuss the common existential theory of all or almost all completions of a global function field.


title: A catalogue of low-mass X-ray binaries in the Galaxy: from the INTEGRAL to the Gaia era

abstract: Low-mass X-ray binaries (LMXBs) are high-energy sources that require multi-wavelength follow up campaigns to be fully characterized. New transients associated to LMXBs are regularly discovered, and previously known systems are often revisited by astronomers to constrain their intrinsic parameters. All of this information compiled into a catalogue may build up to a useful tool for subsequent studies on LMXBs and their population. We provide an update on past LMXB catalogues dating back 16 years and propose to the community a database on Galactic LMXBs with the most complete manually curated set of parameters and their original references. On top of a fixed version accessible through Vizier, we propose to host the catalogue independently on our GitHub collaboration, side-by-side with our previous catalogue on high-mass X-ray binaries. The database will be regularly updated based on new publications and community inputs. We build a working base by cross-matching previous LMXB catalogues and supplementing them with lists of hard X-ray sources detected in the past 20 years. We compile information from Simbad on LMXBs as a starting point for a thorough, manual search in the literature to retrieve important parameters that characterize LMXBs. We retrieve newly detected LMXBs and candidates directly from literature searches. Counterparts to these LMXBs are compiled from hard X-rays to infrared and radio domains. Every piece of information presented on the LMXBs is curated and backed by accurate references. We present a catalogue of 339 Galactic LMXBs listing their coordinates, companion star spectral type, systemic radial velocity, component masses and compact object nature, the presence of type I X-ray bursts as well as orbital data. Coordinates and identifiers of counterparts at various wavelengths are given, including 140 LMXBs detected in {\it Gaia} DR3.


title: Accelerating Causal Algorithms for Industrial-scale Data: A Distributed Computing Approach with Ray Framework

abstract: The increasing need for causal analysis in large-scale industrial datasets necessitates the development of efficient and scalable causal algorithms for real-world applications. This paper addresses the challenge of scaling causal algorithms in the context of conducting causal analysis on extensive datasets commonly encountered in industrial settings. Our proposed solution involves enhancing the scalability of causal algorithm libraries, such as EconML, by leveraging the parallelism capabilities offered by the distributed computing framework Ray. We explore the potential of parallelizing key iterative steps within causal algorithms to significantly reduce overall runtime, supported by a case study that examines the impact on estimation times and costs. Through this approach, we aim to provide a more effective solution for implementing causal analysis in large-scale industrial applications.


title: Large deviation full counting statistics in adiabatic open quantum dynamics

abstract: The state of an open quantum system undergoing an adiabatic process evolves by following the instantaneous stationary state of its time-dependent generator. This observation allows one to characterize, for a generic adiabatic evolution, the average dynamics of the open system. However, information about fluctuations of dynamical observables, such as the number of photons emitted or the time-integrated stochastic entropy production in single experimental runs, requires controlling the whole spectrum of the generator and not only the stationary state. Here, we show how such information can be obtained in adiabatic open quantum dynamics by exploiting tools from large deviation theory. We prove an adiabatic theorem for deformed generators, which allows us to encode, in a biased quantum state, the full counting statistics of generic time-integrated dynamical observables. We further compute the probability associated with an arbitrary "rare" time-history of the observable and derive a dynamics which realizes it in its typical behavior. Our results provide a way to characterize and engineer adiabatic open quantum dynamics and to control their fluctuations.


title: Systematic Performance Evaluation Framework for LEO Mega-Constellation Satellite Networks

abstract: Low Earth orbit (LEO) mega-constellation satellite networks have shown great potential to extend the coverage capability of conventional terrestrial networks. How to systematically define, quantify, and assess the technical performance of LEO mega-constellation satellite networks remains an open issue. In this paper, we propose a comprehensive key performance indicator (KPI) framework for mega-constellation based LEO satellite networks. An efficient LEO constellation oriented performance evaluation methodology is then carefully designed by resorting to the concept of interfering area and spherical geographic cell. We have carried out rigorous system-level simulations and provided numerical results to assess the KPI framework. It can be observed that the achieved area traffic capacity of the reference LEO constellation is around 4 Kbps/km2, with service availability ranging from 0.36 to 0.39. Besides, the average access success probability and handover failure rate is approximate to 96% and 10%, respectively, in the nearest satellite association scheme.


title: Two Determinant Distinguishable Cluster

abstract: A two reference determinant version of the distinguishable cluster with singles and doubles (DCSD) has been developed. We have implemented the two determinant distinguishable cluster (2D-DCSD) and the corresponding traditional 2D-CCSD method in a new open-source package written in Julia called ElemCo.jl. The methods were benchmarked on singlet and triplet excited states of valence and Rydberg character, as well as for singlet-triplet gaps of diradicals. It is demonstrated that the distinguishable cluster approximation improves the accuracy of 2D-CCSD.


title: The Definition of a Photon Surface in an Invariant Spin Frame

abstract: This paper defines the photon surface conditions using Cartan scalars within an invariant spin frame, offering a comprehensive description of the local spacetime geometry. By employing this approach, we gain novel insights into the geometry and dynamics of photon surfaces, independent of the global spacetime structure. We first discuss the photon surface conditions in a Petrov type-D spacetime manifold, and then we simplify those conditions assuming the existence of spherical symmetry. Finally, employing the simplified, spherically symmetric photon surface conditions, we explore the dynamics of photon surfaces in static, collapsing Lemaitre-Tolman-Bondi (LTB) spacetimes, and Vaidya spacetimes. Notably, we show that photon surfaces can emerge from the central singularity during the collapse of an inhomogeneous dust cloud modeled by a LTB spacetime. This underscores the significance of our findings in comprehending the potential observational implications of the physics near the ultra-high gravity region.


title: Influence of collisions on trapped-electron modes in tokamaks and low-shear stellarators

abstract: The influence of collisions on the growth rate of trapped-electron modes (TEMs) in core plasmas is assessed through both analytical linear gyrokinetics and linear gyrokinetic simulations. Both methods are applied to the magnetic geometry of the DIII-D tokamak, as well as the Helically Symmetric eXperiment (HSX) and Wendelstein 7-X (W7-X) stellarators, in the absence of temperature gradients. Here we analytically investigate the influence of collisions on the TEM eigenmode frequency by a perturbative approach in the response of trapped particles to the mode, using an energy-dependent Krook operator to model collisions. Although the resulting growth rates exceed perturbative thresholds, they reveal important qualitative dependencies: a geometry-dependent stabilization rate occurs for all wavenumbers at high collisionality, while at low collisionality, a geometry-sensitive mixture of collisionless, resonantly driven, and collisionally destabilized modes is found. Additionally, linear gyrokinetic simulations have been performed with a rigorous pitch-angle scattering operator for the same geometries. In the case of DIII-D and large wavenumber modes in HSX, the trends predicted by analytical theory are reproduced. Dissimilarities are, however, obtained in W7-X geometry and for low wavenumber modes in HSX, which are shown to be due to a collision-induced transition to the Universal Instability as the dominant instability at marginal collisionality.


title: Mysterious non-detection of HeI (23S) transit absorption of GJ436b

abstract: Possible reasons for the non-detection of absorption in the metastable HeI(2^3S) line at transit observations of warm Neptune GJ436b, in spite of the well pronounced strong absorption features measured earlier in Ly{\alpha} for this planet, are investigated. We perform numeric simulations of the escaping upper atmosphere of this planet and its HeI(2^3S) triplet absorption with a global 3D multi-fluid self-consistent hydrodynamic model. By fitting the model parameters to the lowest detection level of absorption measurements, we constrain an upper limit the He/H abundance three times smaller than the solar value. We demonstrate that neither the significant changes of the stellar wind related with possible stellar coronal mass ejections (CMEs), or possible variations in the stellar ionization radiation, nor the presence of heavy trace elements have crucial effect on the absorption at the 10830{\AA} line of HeI(2^3S) triplet. The main reason of weak signature is that the region populated by the absorbing metastable helium is rather small (<3R_p), as well as the small size of the planet itself, in comparison to the host star. We show that the radiation pressure force acting on the HeI(2^3S) atoms spreads them along the line of sight and around the planet, thus further reducing peak absorption.


title: A new proof of the Willmore inequality via a divergence inequality

abstract: We present a new proof of the Willmore inequality for an arbitrary bounded domain $\Omega\subset\mathbb{R}^{n}$ with smooth boundary. Our proof is based on a parametric geometric inequality involving the electrostatic potential for the domain $\Omega$; this geometric inequality is derived from a geometric differential inequality in divergence form. Our parametric geometric inequality also allows us to give new proofs of the quantitative Willmore-type and the weighted Minkowski inequalities by Agostiniani and Mazzieri.


title: Low-Tubal-Rank Tensor Recovery via Factorized Gradient Descent

abstract: This paper considers the problem of recovering a tensor with an underlying low-tubal-rank structure from a small number of corrupted linear measurements. Traditional approaches tackling such a problem require the computation of tensor Singular Value Decomposition (t-SVD), that is a computationally intensive process, rendering them impractical for dealing with large-scale tensors. Aim to address this challenge, we propose an efficient and effective low-tubal-rank tensor recovery method based on a factorization procedure akin to the Burer-Monteiro (BM) method. Precisely, our fundamental approach involves decomposing a large tensor into two smaller factor tensors, followed by solving the problem through factorized gradient descent (FGD). This strategy eliminates the need for t-SVD computation, thereby reducing computational costs and storage requirements. We provide rigorous theoretical analysis to ensure the convergence of FGD under both noise-free and noisy situations. Additionally, it is worth noting that our method does not require the precise estimation of the tensor tubal-rank. Even in cases where the tubal-rank is slightly overestimated, our approach continues to demonstrate robust performance. A series of experiments have been carried out to demonstrate that, as compared to other popular ones, our approach exhibits superior performance in multiple scenarios, in terms of the faster computational speed and the smaller convergence error.


title: Friedrichs systems on an interval

abstract: There has been significant developments in the classification of boundary conditions of positive symmetric systems, also known as Friedrichs systems, after the introduction of operator theoretic framework. We take a step forward towards applying the abstract theory to the classical framework by studying Friedrichs systems on an interval. Dealing with some difficulties related to the smoothness of eigenvectors, here we present an explicit expression for the dimensions of the kernels of Friedrichs operators only in terms of the values of the coefficients at the end-points of the interval. In particular, this allows for a characterisation of all admissible boundary conditions, i.e.~those leading to bijective realisations.


title: Single-Photon-Assisted Two-Photon Polymerization

abstract: Light-based additive manufacturing (AM) has revolutionized the fabrication of complex three-dimensional (3D) objects offering a cost-effective and high-speed alternative to traditional machining. One-photon polymerization is a key process in this advancement, standing out for rapid printing time, albeit with limited resolution. Two-photon polymerization (2PP) empowers AM with unprecedented resolution but is accompanied by a tradeoff of prolonged printing times. We propose combining the single-photon absorption (1PA) and 2PP to benefit from the dual capabilities, allowing for faster printing while maintaining high resolution and improved depth sectioning, respectively. In this study, we employ a blue light source to pre-excite a photocurable resin by 1PA followed by a precisely focused femtosecond (fs) beam to provide the missing energy necessary to reach the polymerization threshold to solidify the resin through two-photon absorption. First, we investigate the impact of pre-sensitization by blue light illumination on 2PP and demonstrate one order of magnitude faster printing time for a voxel size of 150 nm as compared to the same voxel size printed by 2PP only. Then, we build a custom 2PP printer utilizing blue light sensitization in a light-sheet mode and demonstrate successful 3D prints.


title: Benchmarking Large Multimodal Models against Common Corruptions

abstract: This technical report aims to fill a deficiency in the assessment of large multimodal models (LMMs) by specifically examining the self-consistency of their outputs when subjected to common corruptions. We investigate the cross-modal interactions between text, image, and speech, encompassing four essential generation tasks: text-to-image, image-to-text, text-to-speech, and speech-to-text. We create a comprehensive benchmark, named MMCBench, that covers more than 100 popular LMMs (totally over 150 model checkpoints). A thorough evaluation under common corruptions is critical for practical deployment and facilitates a better understanding of the reliability of cutting-edge LMMs. The benchmarking code is available at https://github.com/sail-sg/MMCBench


title: CMMMU: A Chinese Massive Multi-discipline Multimodal Understanding Benchmark

abstract: As the capabilities of large multimodal models (LMMs) continue to advance, evaluating the performance of LMMs emerges as an increasing need. Additionally, there is an even larger gap in evaluating the advanced knowledge and reasoning abilities of LMMs in non-English contexts such as Chinese. We introduce CMMMU, a new Chinese Massive Multi-discipline Multimodal Understanding benchmark designed to evaluate LMMs on tasks demanding college-level subject knowledge and deliberate reasoning in a Chinese context. CMMMU is inspired by and strictly follows the annotation and analysis pattern of MMMU. CMMMU includes 12k manually collected multimodal questions from college exams, quizzes, and textbooks, covering six core disciplines: Art & Design, Business, Science, Health & Medicine, Humanities & Social Science, and Tech & Engineering, like its companion, MMMU. These questions span 30 subjects and comprise 39 highly heterogeneous image types, such as charts, diagrams, maps, tables, music sheets, and chemical structures. CMMMU focuses on complex perception and reasoning with domain-specific knowledge in the Chinese context. We evaluate 11 open-source LLMs and one proprietary GPT-4V(ision). Even GPT-4V only achieves accuracies of 42%, indicating a large space for improvement. CMMMU will boost the community to build the next-generation LMMs towards expert artificial intelligence and promote the democratization of LMMs by providing diverse language contexts.


title: The Effect of Predictive Formal Modelling at Runtime on Performance in Human-Swarm Interaction

abstract: Formal Modelling is often used as part of the design and testing process of software development to ensure that components operate within suitable bounds even in unexpected circumstances. In this paper, we use predictive formal modelling (PFM) at runtime in a human-swarm mission and show that this integration can be used to improve the performance of human-swarm teams. We recruited 60 participants to operate a simulated aerial swarm to deliver parcels to target locations. In the PFM condition, operators were informed of the estimated completion times given the number of drones deployed, whereas in the No-PFM condition, operators did not have this information. The operators could control the mission by adding or removing drones from the mission and thereby, increasing or decreasing the overall mission cost. The evaluation of human-swarm performance relied on four key metrics: the time taken to complete tasks, the number of agents involved, the total number of tasks accomplished, and the overall cost associated with the human-swarm task. Our results show that PFM modelling at runtime improves mission performance without significantly affecting the operator's workload or the system's usability.


title: A Dynamic YOLO-Based Sequence-Matching Model for Efficient Coverless Image Steganography

abstract: Many existing coverless steganography methods establish a mapping relationship between cover images and hidden data. There exists an issue that the number of images stored in the database grows exponentially as the steganographic capacity rises. The need for a high steganographic capacity makes it challenging to build an image database. To improve the image library utilization and anti-attack capability of the steganography system, we present an efficient coverless scheme based on dynamically matched substrings. YOLO is employed for selecting optimal objects, and a mapping dictionary is established between these objects and scrambling factors. With the aid of this dictionary, each image is effectively assigned to a specific scrambling factor, which is used to scramble the receiver's sequence key. To achieve sufficient steganography capability based on a limited image library, all substrings of the scrambled sequences hold the potential to hide data. After completing the secret information matching, the ideal number of stego images will be obtained from the database. According to experimental results, this technology outperforms most previous works on data load, transmission security, and hiding capacity. Under typical geometric attacks, it can recover 79.85\% of secret information on average. Furthermore, only approximately 200 random images are needed to meet a capacity of 19 bits per image.


title: The N(1440) Roper resonance in the nuclear model with explicit mesons

abstract: We show that the N(1440) Roper resonance naturally appears in the nuclear model with explicit mesons as a structure in the continuum spectrum of the physical proton which in this calculation is made of a bare nucleon dressed with a pion cloud.


title: The Ensemble Kalman Filter for Dynamic Inverse Problems

abstract: In inverse problems, the goal is to estimate unknown model parameters from noisy observational data. Traditionally, inverse problems are solved under the assumption of a fixed forward operator describing the observation model. In this article, we consider the extension of this approach to situations where we have a dynamic forward model, motivated by applications in scientific computation and engineering. We specifically consider this extension for a derivative-free optimizer, the ensemble Kalman inversion (EKI). We introduce and justify a new methodology called dynamic-EKI, which is a particle-based method with a changing forward operator. We analyze our new method, presenting results related to the control of our particle system through its covariance structure. This analysis includes moment bounds and an ensemble collapse, which are essential for demonstrating a convergence result. We establish convergence in expectation and validate our theoretical findings through experiments with dynamic-EKI applied to a 2D Darcy flow partial differential equation.


title: Feature Denoising Diffusion Model for Blind Image Quality Assessment

abstract: Blind Image Quality Assessment (BIQA) aims to evaluate image quality in line with human perception, without reference benchmarks. Currently, deep learning BIQA methods typically depend on using features from high-level tasks for transfer learning. However, the inherent differences between BIQA and these high-level tasks inevitably introduce noise into the quality-aware features. In this paper, we take an initial step towards exploring the diffusion model for feature denoising in BIQA, namely Perceptual Feature Diffusion for IQA (PFD-IQA), which aims to remove noise from quality-aware features. Specifically, (i) We propose a {Perceptual Prior Discovery and Aggregation module to establish two auxiliary tasks to discover potential low-level features in images that are used to aggregate perceptual text conditions for the diffusion model. (ii) We propose a Perceptual Prior-based Feature Refinement strategy, which matches noisy features to predefined denoising trajectories and then performs exact feature denoising based on text conditions. Extensive experiments on eight standard BIQA datasets demonstrate the superior performance to the state-of-the-art BIQA methods, i.e., achieving the PLCC values of 0.935 ( vs. 0.905 in KADID) and 0.922 ( vs. 0.894 in LIVEC).


title: Calcite, vaterite and aragonite forming on cement hydration from liquid and gaseous phase

abstract: Cement hydration products were studied as influenced by the hydration conditions (hydration time in liquid phase; relative humidity, RH, in gaseous phase). The formation of calcium hydroxide (portlandite, P) and its transformation to calcium carbonates is mainly discussed here.


title: A Stabilised Semi-Implicit Double-Point Material Point Method for Soil-Water Coupled Problems

abstract: A semi-implicit two-phase double-point Material Point Method (MPM) formulation, based on the incremental fractional-step method to model large deformation geotechnical problems has been derived. The semi-implicit formulation has two advantages compared with the explicit approach: the time step is independent of the water phase, and the pore pressure field is more stable. The semi-implicit MPM models based on the incremental fractional-step method available in the literature consist of modelling the soil and water mixture using a single set of material points only, in order to save computational time. In this study, we further derive this formulation with two sets of material points to represent the soil and water phases separately. The stress oscillations that are frequently found in the water and soil phases are stabilised with this approach. A new stabilisation method is developed based on the modified F-bar method. The proposed method is validated with two numerical examples under small and large deformations, respectively. After that, Nor-Sand constitutive soil model is used to simulate landslides. Numerical examples show an excellent performance of the proposed coupled MPM and the stabilisation method. The formulation with two sets of material points yields significantly different but more reliable results in the landslides analysis, compared with the single-point approach. Additionally, this research shows that the additional computational cost caused by the additional water material points is acceptable. Therefore, it is recommended to use two sets of material points for certain large deformation geotechnical problems.


title: MITgcm-AD v2: Open source tangent linear and adjoint modeling framework for the oceans and atmosphere enabled by the Automatic Differentiation tool Tapenade

abstract: The Massachusetts Institute of Technology General Circulation Model (MITgcm) is widely used by the climate science community to simulate planetary atmosphere and ocean circulations. A defining feature of the MITgcm is that it has been developed to be compatible with an algorithmic differentiation (AD) tool, TAF, enabling the generation of tangent-linear and adjoint models. These provide gradient information which enables dynamics-based sensitivity and attribution studies, state and parameter estimation, and rigorous uncertainty quantification. Importantly, gradient information is essential for computing comprehensive sensitivities and performing efficient large-scale data assimilation, ensuring that observations collected from satellites and in-situ measuring instruments can be effectively used to optimize a large uncertain control space. As a result, the MITgcm forms the dynamical core of a key data assimilation product employed by the physical oceanography research community: Estimating the Circulation and Climate of the Ocean (ECCO) state estimate. Although MITgcm and ECCO are used extensively within the research community, the AD tool TAF is proprietary and hence inaccessible to a large proportion of these users. The new version 2 (MITgcm-AD v2) framework introduced here is based on the source-to-source AD tool Tapenade, which has recently been open-sourced. Another feature of Tapenade is that it stores required variables by default (instead of recomputing them) which simplifies the implementation of efficient, AD-compatible code. The framework has been integrated with the MITgcm model main branch and is now freely available.


title: On the steadiness of symmetric solutions to two dimensional dispersive models

abstract: In this paper, we consider the steadiness of symmetric solutions to two dispersive models in shallow water and hyperelastic mechanics, respectively. These models are derived previously in the two-dimensional setting and can be viewed as the generalization of the Camassa-Holm and Kadomtsev-Petviashvili equations. For these two models, we prove that symmetry of classical solutions implies steadiness in the horizontal direction. We also confirm the such connection between symmetry and steadiness in weak formulation, which includes in particular the peaked solutions.


title: RUMBoost: Gradient Boosted Random Utility Models

abstract: This paper introduces the RUMBoost model, a novel discrete choice modelling approach that combines the interpretability and behavioural robustness of Random Utility Models (RUMs) with the generalisation and predictive ability of deep learning methods. We obtain the full functional form of non-linear utility specifications by replacing each linear parameter in the utility functions of a RUM with an ensemble of gradient boosted regression trees. This enables piece-wise constant utility values to be imputed for all alternatives directly from the data for any possible combination of input variables. We introduce additional constraints on the ensembles to ensure three crucial features of the utility specifications: (i) dependency of the utilities of each alternative on only the attributes of that alternative, (ii) monotonicity of marginal utilities, and (iii) an intrinsically interpretable functional form, where the exact response of the model is known throughout the entire input space. Furthermore, we introduce an optimisation-based smoothing technique that replaces the piece-wise constant utility values of alternative attributes with monotonic piece-wise cubic splines to identify non-linear parameters with defined gradient. We demonstrate the potential of the RUMBoost model compared to various ML and Random Utility benchmark models for revealed preference mode choice data from London. The results highlight the great predictive performance and the direct interpretability of our proposed approach. Furthermore, the smoothed attribute utility functions allow for the calculation of various behavioural indicators and marginal utilities. Finally, we demonstrate the flexibility of our methodology by showing how the RUMBoost model can be extended to complex model specifications, including attribute interactions, correlation within alternative error terms and heterogeneity within the population.


title: Weighted holomorphic polynomial approximation

abstract: For $G$ an open set in $\mathbb{C}$ and $W$ a non-vanishing holomorphic function in $G$, in the late 1990's, Pritsker and Varga characterized pairs $(G,W)$ having the property that any $f$ holomorphic in $G$ can be locally uniformly approximated in $G$ by weighted holomorphic polynomials $\{W(z)^np_n(z)\}, \ deg(p_n)\leq n$. We further develop their theory in first proving a quantitative Bernstein-Walsh type theorem for certain pairs $(G,W)$. Then we consider the special case where $W(z)=1/(1+z)$ and $G$ is a loop of the lemniscate $\{z\in \mathbb{C}: |z(z+1)|=1/4\}$. We show the normalized measures associated to the zeros of the $n-th$ order Taylor polynomial about $0$ of the function $(1+z)^{-n}$ converge to the weighted equilibrium measure of $\overline G$ with weight $|W|$ as $n\to \infty$. This mimics the motivational case of Pritsker and Varga where $G$ is the inside of the Szego curve and $W(z)=e^{-z}$. Lastly, we initiate a study of weighted holomorphic polynomial approximation in $\mathbb{C}^n, \ n>1$.


title: Biquandle Power Brackets

abstract: In this paper, we introduce biquandle power brackets, an infinite family of invariants of oriented links containing the classical skein invariants and the quandle and biquandle 2-cocycle invariants as special cases. Biquandle power brackets are generalizations of biquandle brackets in which the values of Kauffman states also depend on the biquandle colors they admit. We provide example computations and discuss the relationship between these new invariants and the previous cases.


title: Gravitational collapse of matter in the presence of non-minimally coupled Quintessence and Phantom-like scalar fields

abstract: This paper explores the evolution of the over-dense region of dark matter in the presence of a non-minimally coupled scalar field which is used to model quintessence and phantom-like dark energy. We focus on algebraic coupling, where the interaction Lagrangian is independent of the derivatives of the scalar field. To make our model more relativistic, like the minimal coupling scenario we studied earlier, we consider a spacetime structure that is internally closed Friedmann-Lemaitre-Robertson-Walker (FLRW) spacetime and externally the generalized Vaidya spacetime. This structure allows non-zero matter flux at the boundary of the over-dense region. Our investigation reveals that an increment of the coupling strength causes dark energy to cluster with dark matter at a certain cosmological scale where the influence of dark energy cannot be ignored. This phenomenon arises from the specific nature of the non-minimal coupling considered in this paper. While the evolution of matter's energy density remains unchanged, the scalar field's Klein-Gordon equation is modified, causing dark energy to deviate from its homogeneous state and cluster with dark matter. Similar to minimal coupling scenarios, closed spherical regions do not collapse within certain parameter ranges, exhibiting eternal expansion within the spatially flat FLRW spacetime acting as voids with decreasing matter density. The study extends our understanding of the cosmological scenarios where the virialization of the over-dense regions of dark matter is influenced by the non-minimally coupled dark energy.


title: General duality and dual attainment for adapted transport

abstract: We investigate duality and existence of dual optimizers for several adapted optimal transport problems under minimal assumptions. This includes the causal and bicausal transport, the barycenter problem, and a general multimarginal problem incorporating causality constraints. Moreover, we discuss applications of our results in robust finance. We consider a non-dominated model of several financial markets where stocks are traded dynamically, but the joint stock dynamics are unknown. We show that a no-arbitrage assumption in a quasi-sure sense naturally leads to sets of multicausal couplings. Consequently, computing the robust superhedging price is equivalent to solving an adapted transport problem, and finding a superhedging strategy means solving the corresponding dual.


title: Rogue waves and instability arising from long-wave-short-wave resonance beyond the integrable regime

abstract: We consider instability and localized patterns arising from long wave-short wave (LWSW) resonance in the non-integrable regime numerically. We study the stability and instability of elliptic-function periodic waves with respect to subharmonic perturbations, whose period is a multiple of the period of the elliptic waves. We thus find the modulational instability (MI) of the corresponding dnoidal waves. Upon varying parameters of dnoidal waves, spectrally unstable ones can be transformed into stable states via the Hamiltonian Hopf bifurcation. For snoidal waves, we find a transition of the dominant instability scenario between the MI and instability with a bubble-like spectrum. For cnoidal waves, we produce three variants of the MI. Evolution of the unstable states is also considered, leading to formation of rogue waves on top of the elliptic-wave and continuous-wave backgrounds.


title: Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method

abstract: Downscaling (DS) of meteorological variables involves obtaining high-resolution states from low-resolution meteorological fields and is an important task in weather forecasting. Previous methods based on deep learning treat downscaling as a super-resolution task in computer vision and utilize high-resolution gridded meteorological fields as supervision to improve resolution at specific grid scales. However, this approach has struggled to align with the continuous distribution characteristics of meteorological fields, leading to an inherent systematic bias between the downscaled results and the actual observations at meteorological stations. In this paper, we extend meteorological downscaling to arbitrary scattered station scales, establish a brand new benchmark and dataset, and retrieve meteorological states at any given station location from a coarse-resolution meteorological field. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Building on this foundation, we propose a new downscaling model based on hypernetwork architecture, namely HyperDS, which efficiently integrates different observational information into the model training, achieving continuous scale modeling of the meteorological field. Through extensive experiments, our proposed method outperforms other specially designed baseline models on multiple surface variables. Notably, the mean squared error (MSE) for wind speed and surface pressure improved by 67% and 19.5% compared to other methods. We will release the dataset and code subsequently.


title: Enhancing Safety in Nonlinear Systems: Design and Stability Analysis of Adaptive Cruise Control

abstract: The safety of autonomous driving systems, particularly self-driving vehicles, remains of paramount concern. These systems exhibit affine nonlinear dynamics and face the challenge of executing predefined control tasks while adhering to state and input constraints to mitigate risks. However, achieving safety control within the framework of control input constraints, such as collision avoidance and maintaining system states within secure boundaries, presents challenges due to limited options. In this study, we introduce a novel approach to address safety concerns by transforming safety conditions into control constraints with a relative degree of 1. This transformation is facilitated through the design of control barrier functions, enabling the creation of a safety control system for affine nonlinear networks. Subsequently, we formulate a robust control strategy that incorporates safety protocols and conduct a comprehensive analysis of its stability and reliability. To illustrate the effectiveness of our approach, we apply it to a specific problem involving adaptive cruise control. Through simulations, we validate the efficiency of our model in ensuring safety without compromising control performance. Our approach signifies significant progress in the field, providing a practical solution to enhance safety for autonomous driving systems operating within the context of affine nonlinear dynamics.


title: A finiteness principle for distance functions on Riemannian surfaces with H\"older continuous curvature

abstract: We study distance functions from geodesics to points on Riemannian surfaces with H\"older continuous Gauss curvature, and prove a finiteness principle in the spirit of Whitney extension theory for such functions. Our result can be viewed as a finiteness principle for isometric embedding of a certain type of metric spaces into Riemannian surfaces, with control over the H\"older seminorm of the Gauss curvature.


title: Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithms

abstract: Evolutionary Reinforcement Learning (ERL), which integrates Evolutionary Algorithms (EAs) and Reinforcement Learning (RL) for optimization, has demonstrated remarkable performance advancements. By fusing both approaches, ERL has emerged as a promising research direction. This survey offers a comprehensive overview of the diverse research branches in ERL. Specifically, we systematically summarize recent advancements in related algorithms and identify three primary research directions: EA-assisted Optimization of RL, RL-assisted Optimization of EA, and synergistic optimization of EA and RL. Following that, we conduct an in-depth analysis of each research direction, organizing multiple research branches. We elucidate the problems that each branch aims to tackle and how the integration of EAs and RL addresses these challenges. In conclusion, we discuss potential challenges and prospective future research directions across various research directions. To facilitate researchers in delving into ERL, we organize the algorithms and codes involved on https://github.com/yeshenpy/Awesome-Evolutionary-Reinforcement-Learning.


title: Fried-Yennie gauge in pseudo-QED

abstract: The Fried-Yennie gauge is a covariant gauge for which the mass-shell renormalization procedure can be performed without introducing spurious infrared divergences to the theory. It is usually applied in calculations in regular Quantum-Electrodynamics (QED), but it is particularly interesting to be employed in the framework of pseudo-QED (PQED), where fermions are constrained to 2+1 dimensions while external fields interacting with these fermions live in the bulk of a 3+1 space. In this context, the gauge parameter can be adjusted to match the power of the external momentum in the denominator of the photon propagator, simplifying the infrared region without the need of a photon mass. In this work we apply for the first time this machinery to PQED, generalizing the procedure to calculate the self energy in arbitrary dimensions, allowing of course for different dimensionality of fermions and gauge fields.


title: Coexistence of Topological and Normal Insulating Phases in Electro-Optically Tuned InAs/GaSb Bilayer Quantum Wells

abstract: We report on the coexistence of both normal and topological insulating phases in InAs/GaSb bilayer quantum well induced by the built-in electric field tuned optically and electrically. The emergence of topological and normal insulating phases is assessed based on the evolution of the charge carrier densities, the resistivity dependence of the gap via in-plane magnetic fields and the thermal activation of carriers. For the Hall bar device tuned optically, we observe the fingerprints associated with the presence of only the topological insulating phase. For another Hall bar processed identically but with an additional top gate, the coexistence of normal and topological insulating phases is found by electrical tuning. Our finding paves the way for utilizing a new electro-optical tuning scheme to manipulate InAs/GaSb bilayer quantum wells to obtain trivial-topological insulating interfaces in the bulk rather than at the physical edge of the device.


title: Not all Probability Density Functions are Tomograms

abstract: This paper delves into the significance of the tomographic probability density function (pdf) representation of quantum states, shedding light on the special classes of pdfs that can be tomograms. Instead of using wave functions or density operators on Hilbert spaces, tomograms, which are the true pdfs, are used to completely describe the states of quantum systems. Unlike quasi-pdfs, like the Wigner function, tomograms can be analysed using all the tools of classical probability theory for pdf estimation, which can allow a better quality of state reconstruction. This is particularly useful when dealing with non-Gaussian states where the pdfs are multi-mode. The knowledge of the family of distributions plays an important role in the application of both parametric and non-parametric density estimation methods. We show that not all pdfs can play the role of tomograms of quantum states and introduce the conditions that must be fulfilled by pdfs to be "quantum".


title: Exploring descriptors for titanium microstructure via digital fingerprints from variational autoencoders

abstract: Microstructure is key to controlling and understanding the properties of metallic materials, but traditional approaches to describing microstructure capture only a small number of features. To enable data-centric approaches to materials discovery, allow efficient storage of microstructural data and assist in quality control in metals processing, we require more complete descriptors of microstructure. The concept of microstructural fingerprinting, using machine learning (ML) to develop quantitative, low-dimensional descriptors of microstructures, has recently attracted significant attention. However, it is difficult to interpret conclusions drawn by ML algorithms, which are commonly referred to as "black boxes". Here we explore variational autoencoders (VAEs), which can be trained to produce microstructural fingerprints in a continuous latent space. VAEs enable the reconstruction of images from fingerprints, allowing us to explore how key features of microstructure are encoded. We develop a VAE architecture based on ResNet18 and train it on Ti-6Al-4V optical micrographs as an example of an industrially important alloy where microstructural control is critical to performance. The latent space is explored in several ways, including by supplying interpolated and randomly perturbed fingerprints to the trained decoder and via dimensionality reduction to explore the distribution of microstructural features within the latent space of fingerprints. We show that the VAE fingerprints exhibit smooth, interpolable behaviour with stability to local perturbations, supporting their suitability as general purpose descriptors for microstructure. We also show that key properties of the microstructures are strongly correlated with position in the latent space, supporting the use of VAE fingerprints for quantitative exploration of process-structure-property relationships.


title: Effective Intrusion Detection in Heterogeneous Internet-of-Things Networks via Ensemble Knowledge Distillation-based Federated Learning

abstract: With the rapid development of low-cost consumer electronics and cloud computing, Internet-of-Things (IoT) devices are widely adopted for supporting next-generation distributed systems such as smart cities and industrial control systems. IoT devices are often susceptible to cyber attacks due to their open deployment environment and limited computing capabilities for stringent security controls. Hence, Intrusion Detection Systems (IDS) have emerged as one of the effective ways of securing IoT networks by monitoring and detecting abnormal activities. However, existing IDS approaches rely on centralized servers to generate behaviour profiles and detect anomalies, causing high response time and large operational costs due to communication overhead. Besides, sharing of behaviour data in an open and distributed IoT network environment may violate on-device privacy requirements. Additionally, various IoT devices tend to capture heterogeneous data, which complicates the training of behaviour models. In this paper, we introduce Federated Learning (FL) to collaboratively train a decentralized shared model of IDS, without exposing training data to others. Furthermore, we propose an effective method called Federated Learning Ensemble Knowledge Distillation (FLEKD) to mitigate the heterogeneity problems across various clients. FLEKD enables a more flexible aggregation method than conventional model fusion techniques. Experiment results on the public dataset CICIDS2019 demonstrate that the proposed approach outperforms local training and traditional FL in terms of both speed and performance and significantly improves the system's ability to detect unknown attacks. Finally, we evaluate our proposed framework's performance in three potential real-world scenarios and show FLEKD has a clear advantage in experimental results.