title: Hybridizing anomalous Nernst effect in artificially tilted multilayer based on magnetic topological material

abstract: Transverse thermoelectric conversion holds significant potential in addressing complex challenges faced by classical Seebeck/Peltier modules. A promising transverse thermoelectric phenomenon is the anomalous Nernst effect (ANE) originating from nontrivial band structures in magnetic topological materials. However, the currently reported performance for ANE in topological materials, e.g., Co$_2$MnGa, remains insufficient for practical thermoelectric applications. Here, we unveil a new availability for ANE by integrating magnetic topological materials into artificially tilted multilayers (ATMLs), known to exhibit the structure-induced transverse thermoelectric conversion due to the off-diagonal Seebeck effect. Our experiments reveal that the transverse thermoelectric performance in Co$_2$MnGa-based ATMLs is improved through the hybrid action of ANE and the off-diagonal Seebeck effect, with the modulation of performance dependent on magnetization being significantly greater than the performance achievable with ANE alone. This unconventional synergy underscores the importance of hybrid transverse thermoelectric conversion and paves a way for advancing thermoelectric applications using magnetic materials.


title: A Berry-Esseen theorem for incomplete U-statistics with Bernoulli sampling

abstract: There has been a resurgence of interest in the asymptotic normality of incomplete U-statistics that only sum over roughly as many kernel evaluations as there are data samples, due to its computational efficiency and usefulness in quantifying the uncertainty for ensemble-based predictions. In this paper, we focus on the normal convergence of one such construction, the incomplete U-statistic with Bernoulli sampling, based on a raw sample of size $n$ and a computational budget $N$ in the same order as $n$. Under a minimalistic third moment assumption on the kernel, we offer an accompanying Berry-Esseen bound of the natural rate $1/\sqrt{\min(N, n)}$ that characterizes the normal approximating accuracy involved. Our key techniques include Stein's method specialized for the so-called Studentized nonlinear statistics, and an exponential lower tail bound for non-negative kernel U-statistics.


title: Dynamic importance learning using fisher information gain for nonlinear system identification

abstract: The Fisher Information Matrix (FIM) provides a way for quantifying the information content of an observable random variable concerning unknown parameters within a model that characterizes the variable. When parameters in a model are directly linked to individual features, the diagonal elements of the FIM can signify the relative importance of each feature. However, in scenarios where feature interactions may exist, a comprehensive exploration of the full FIM is necessary rather than focusing solely on its diagonal elements. This paper presents an end-to-end black box system identification approach that integrates the FIM into the training process to gain insights into dynamic importance and overall model structure. A decision module is added to the first layer of the network to determine the relevance scores using the entire FIM as input. The forward propagation is then performed on element-wise multiplication of inputs and relevance scores. Simulation results demonstrate that the proposed methodology effectively captures various types of interactions between dynamics, outperforming existing methods limited to polynomial interactions. Moreover, the effectiveness of this novel approach is confirmed through its application in identifying a real-world industrial system, specifically the PH neutralization process.


title: Mean-field Chaos Diffusion Models

abstract: In this paper, we introduce a new class of score-based generative models (SGMs) designed to handle high-cardinality data distributions by leveraging concepts from mean-field theory. We present mean-field chaos diffusion models (MF-CDMs), which address the curse of dimensionality inherent in high-cardinality data by utilizing the propagation of chaos property of interacting particles. By treating high-cardinality data as a large stochastic system of interacting particles, we develop a novel score-matching method for infinite-dimensional chaotic particle systems and propose an approximation scheme that employs a subdivision strategy for efficient training. Our theoretical and empirical results demonstrate the scalability and effectiveness of MF-CDMs for managing large high-cardinality data structures, such as 3D point clouds.


title: Metamorphic Relation Generation: State of the Art and Visions for Future Research

abstract: Metamorphic testing has become one mainstream technique to address the notorious oracle problem in software testing, thanks to its great successes in revealing real-life bugs in a wide variety of software systems. Metamorphic relations, the core component of metamorphic testing, have continuously attracted research interests from both academia and industry. In the last decade, a rapidly increasing number of studies have been conducted to systematically generate metamorphic relations from various sources and for different application domains. In this article, based on the systematic review on the state of the art for metamorphic relations' generation, we summarize and highlight visions for further advancing the theory and techniques for identifying and constructing metamorphic relations, and discuss potential research trends in related areas.


title: Evaluation of Posits for Spectral Analysis Using a Software-Defined Dataflow Architecture

abstract: Spectral analysis plays an important role in detection of damage in structures and deep learning. The choice of a floating-point format plays a crucial role in determining the accuracy and performance of spectral analysis. The IEEE Std 754\textsuperscript{TM} floating-point format (IEEE~754 for short) is supported by most major hardware vendors for ``normal'' floats. However, it has several limitations. Previous work has attempted to evaluate posit format with respect to accuracy and performance. The accuracy of the posit has been established over IEEE~754 for a variety of applications. For example, our analysis of the Fast Fourier Transform shows 2x better accuracy when using a 32-bit posit vs. a 32-bit IEEE754 format. For spectral analysis, 32-bit posits are substantially more accurate than 32-bit IEEE~754 floats. Although posit has shown better accuracy than IEEE~754, a fair evaluation of posit with IEEE~754 format using a real hardware implementation has been lacking so far. A software simulation of posit format on an x86 CPU is about $\mathbf{69.3\times}$ slower than native IEEE~754 hardware for normal floats for a Fast Fourier Transform (FFT) of $\mathbf{2^{28}}$ points. We propose the use of a software-defined dataflow architecture to evaluate performance and accuracy of posits in spectral analysis. Our dataflow architecture uses reconfigurable logical elements that express algorithms using only integer operations. Our architecture does not have an FPU, and we express both IEEE~754 and posit arithmetic using the same integer operations within the hardware. On our dataflow architecture, the posit format is only $\mathbf{1.8\times}$ slower than IEEE~754 for a Fast Fourier Transform (FFT) of $\mathbf{2^{28}\approx 268}$ million points. With this implementation, we empirically propose a new lower bound for the performance of posit compared to IEEE~754 format.


title: High-precision simulation of finite-size thermalizing systems at long times

abstract: To simulate thermalizing systems at long times, the most straightforward approach is to calculate the thermal properties at the corresponding energy. In a quantum many-body system of size $N$, for local observables and many initial states, this approach has an error of $O(1/N)$, which is reminiscent of the finite-size error of the equivalence of ensembles. In this paper, we propose a simple and efficient numerical method so that the simulation error is of higher order in $1/N$. This finite-size error scaling is proved by assuming the eigenstate thermalization hypothesis.


title: Metric Convolutions: A Unifying Theory to Adaptive Convolutions

abstract: Standard convolutions are prevalent in image processing and deep learning, but their fixed kernel design limits adaptability. Several deformation strategies of the reference kernel grid have been proposed. Yet, they lack a unified theoretical framework. By returning to a metric perspective for images, now seen as two-dimensional manifolds equipped with notions of local and geodesic distances, either symmetric (Riemannian metrics) or not (Finsler metrics), we provide a unifying principle: the kernel positions are samples of unit balls of implicit metrics. With this new perspective, we also propose metric convolutions, a novel approach that samples unit balls from explicit signal-dependent metrics, providing interpretable operators with geometric regularisation. This framework, compatible with gradient-based optimisation, can directly replace existing convolutions applied to either input images or deep features of neural networks. Metric convolutions typically require fewer parameters and provide better generalisation. Our approach shows competitive performance in standard denoising and classification tasks.


title: Should you use a probabilistic duration model in TTS? Probably! Especially for spontaneous speech

abstract: Converting input symbols to output audio in TTS requires modelling the durations of speech sounds. Leading non-autoregressive (NAR) TTS models treat duration modelling as a regression problem. The same utterance is then spoken with identical timings every time, unlike when a human speaks. Probabilistic models of duration have been proposed, but there is mixed evidence of their benefits. However, prior studies generally only consider speech read aloud, and ignore spontaneous speech, despite the latter being both a more common and a more variable mode of speaking. We compare the effect of conventional deterministic duration modelling to durations sampled from a powerful probabilistic model based on conditional flow matching (OT-CFM), in three different NAR TTS approaches: regression-based, deep generative, and end-to-end. Across four different corpora, stochastic duration modelling improves probabilistic NAR TTS approaches, especially for spontaneous speech. Please see https://shivammehta25.github.io/prob_dur/ for audio and resources.


title: Self-Adaptive Integrated Photonic Receiver for Turbulence Compensation in Free Space Optical Links

abstract: In Free Space Optical (FSO) communication systems, atmospheric turbulence distorts the propagating beams, causing a random fading in the received power. This perturbation can be compensated using a multi-aperture receiver that samples the distorted wavefront on different points and adds the various signals coherently. In this work, we report on an adaptive optical receiver that compensates in real time for scintillation in FSO links. The optical front-end of the receiver is entirely integrated in a silicon photonic chip hosting a 2D Optical Antenna Array and a self-adaptive analog Programmable Optical Processor made of a mesh of tunable Mach-Zehnder interferometers. The photonic chip acts as an adaptive interface to couple turbulent FSO beams to single-mode guided optics, enabling energy and cost-effective operation, scalability to systems with a larger number of apertures, modulation-format and data-protocol transparency, and pluggability with commercial fiber optics transceivers. Experimental results demonstrate the effectiveness of the proposed receiver with optical signals at a data rate of 10 Gbit/s transmitted in indoor FSO links where different turbulent conditions, even stronger than those expected in outdoor links of hundreds of meters, are reproduced.


title: SemPat: Using Hyperproperty-based Semantic Analysis to Generate Microarchitectural Attack Patterns

abstract: Microarchitectural security verification of software has seen the emergence of two broad classes of approaches. The first is based on semantic security properties (e.g., non-interference) which are verified for a given program and a specified abstract model of the hardware microarchitecture. The second is based on attack patterns, which, if found in a program execution, indicates the presence of an exploit. While the former uses a formal specification that can capture several gadget variants targeting the same vulnerability, it is limited by the scalability of verification. Patterns, while more scalable, must be currently constructed manually, as they are narrower in scope and sensitive to gadget-specific structure. This work develops a technique that, given a non-interference-based semantic security hyperproperty, automatically generates attack patterns up to a certain complexity parameter (called the skeleton size). Thus, we combine the advantages of both approaches: security can be specified by a hyperproperty that uniformly captures several gadget variants, while automatically generated patterns can be used for scalable verification. We implement our approach in a tool and demonstrate the ability to generate new patterns, (e.g., for SpectreV1, SpectreV4) and improved scalability using the generated patterns over hyperproperty-based verification.


title: Layered Image Vectorization via Semantic Simplification

abstract: This work presents a novel progressive image vectorization technique aimed at generating layered vectors that represent the original image from coarse to fine detail levels. Our approach introduces semantic simplification, which combines Score Distillation Sampling and semantic segmentation to iteratively simplify the input image. Subsequently, our method optimizes the vector layers for each of the progressively simplified images. Our method provides robust optimization, which avoids local minima and enables adjustable detail levels in the final output. The layered, compact vector representation enhances usability for further editing and modification. Comparative analysis with conventional vectorization methods demonstrates our technique's superiority in producing vectors with high visual fidelity, and more importantly, maintaining vector compactness and manageability. The project homepage is https://szuviz.github.io/layered_vectorization/.


title: Robust Conformal Prediction Using Privileged Information

abstract: We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to construct prediction sets that are valid under the i.i.d assumption. Importantly, naively applying conformal prediction does not provide reliable predictions in this setting, due to the distribution shift induced by the corruptions. To account for the distribution shift, we assume access to privileged information (PI). The PI is formulated as additional features that explain the distribution shift, however, they are only available during training and absent at test time. We approach this problem by introducing a novel generalization of weighted conformal prediction and support our method with theoretical coverage guarantees. Empirical experiments on both real and synthetic datasets indicate that our approach achieves a valid coverage rate and constructs more informative predictions compared to existing methods, which are not supported by theoretical guarantees.


title: Schottky Anomaly of Reissner-Nordstr\"{o}m-de Sitter spacetime

abstract: In the extended thermodynamics of black holes, there exists a thermodynamical pressure and its conjugate volume. Extensive studies have been conducted on the phase structure of numerous black holes, which have demonstrated striking similarities to the phase structure of various ordinary matter systems. A comparison of the thermodynamic properties of spherically symmetric AdS black holes with those of ordinary thermodynamic systems reveals that the isovolumetric heat capacity of the former is zero, whereas that of the latter is non-zero. It is a subject of interest for the intrinsic reason for this discrepancy. The effective thermodynamic quantities, based on the context of the boundary between the black hole horizon and the cosmological horizon in dS spacetime, as well as the interaction between the two horizons, are presented. The heat capacity in the Reissner-N\"{o}rdstrom-de Sitter (RN-dS) spacetime is then investigated, and it is demonstrated that the behavior of the heat capacity in the RN-dS spacetime is analogous to that of Schottky specific heat. Treating the two horizon interfaces in the RN-dS spacetime as two distinct energy levels in a two-energy system, and the thermodynamic properties in the RN-dS spacetime are discussed with the method of studying the thermodynamic properties in an ordinary two-energy system, to elucidate the intrinsic reasons for the occurrence of Schottky specific heat in the RN-dS spacetime. The heat capacity observed in the RN-dS spacetime is not only consistent with that of the Schottky specific heat described by the effective thermodynamic quantities in the RN-dS spacetime, but also with that of the heat capacity in an ordinary two-energy-level system. The quantum properties in the RN-dS spacetime are reflected, thereby providing a new avenue for further in-depth study of the quantum properties of black holes and dS spacetime.


title: Exact quantization of topological order parameter in SU($N$) spin models, $N$-ality transformation and ingappabilities

abstract: We show that the ground-state expectation value of twisting operator is a topological order parameter for $\text{U}(1)$- and $\mathbb{Z}_{N}$-symmetric symmetry-protected topological (SPT) phases in one-dimensional ``spin'' systems -- it is quantized in the thermodynamic limit and can be used to identify different SPT phases and to diagnose phase transitions among them. We prove that this (non-local) order parameter must take values in $N$-th roots of unity, and its value can be changed by a generalized lattice translation acting as an $N$-ality transformation connecting distinct phases. This result also implies the Lieb-Schultz-Mattis ingappability for SU($N$) spins if we further impose a general translation symmetry. Furthermore, our exact result for the order parameter of SPT phases can predict a large number of LSM ingappabilities by the general lattice translation. We also apply the $N$-ality property to provide an efficient way to construct possible multi-critical phase transitions starting from a single Hamiltonian with a unique gapped ground state.

categories: cond-mat.str-el cond-mat.stat-mech hep-th math-ph math.MP


title: Human Learning about AI Performance

abstract: How do humans assess the performance of Artificial Intelligence (AI) across different tasks? AI has been noted for its surprising ability to accomplish very complex tasks while failing seemingly trivial ones. We show that humans engage in ``performance anthropomorphism'' when assessing AI capabilities: they project onto AI the ability model that they use to assess humans. In this model, observing an agent fail an easy task is highly diagnostic of a low ability, making them unlikely to succeed at any harder task. Conversely, a success on a hard task makes successes on any easier task likely. We experimentally show that humans project this model onto AI. Both prior beliefs and belief updating about AI performance on standardized math questions appear consistent with the human ability model. This contrasts with actual AI performance, which is uncorrelated with human difficulty in our context, and makes such beliefs misspecified. Embedding our framework into an adoption model, we show that patterns of under- and over-adoption can be sustained in an equilibrium with anthropomorphic beliefs.


title: Natural Language-Oriented Programming (NLOP): Towards Democratizing Software Creation

abstract: As generative Artificial Intelligence (AI) technologies evolve, they offer unprecedented potential to automate and enhance various tasks, including coding. Natural Language-Oriented Programming (NLOP), a vision introduced in this paper, harnesses this potential by allowing developers to articulate software requirements and logic in their natural language, thereby democratizing software creation. This approach streamlines the development process and significantly lowers the barrier to entry for software engineering, making it feasible for non-experts to contribute effectively to software projects. By simplifying the transition from concept to code, NLOP can accelerate development cycles, enhance collaborative efforts, and reduce misunderstandings in requirement specifications. This paper reviews various programming models, assesses their contributions and limitations, and highlights that natural language will be the new programming language. Through this comparison, we illustrate how NLOP stands to transform the landscape of software engineering by fostering greater inclusivity and innovation.


title: MLLM-SR: Conversational Symbolic Regression base Multi-Modal Large Language Models

abstract: Formulas are the language of communication between humans and nature. It is an important research topic of artificial intelligence to find expressions from observed data to reflect the relationship between each variable in the data, which is called a symbolic regression problem. The existing symbolic regression methods directly generate expressions according to the given observation data, and we cannot require the algorithm to generate expressions that meet specific requirements according to the known prior knowledge. For example, the expression needs to contain $\sin$ or be symmetric, and so on. Even if it can, it often requires very complex operations, which is very inconvenient. In this paper, based on multi-modal large language models, we propose MLLM-SR, a conversational symbolic regression method that can generate expressions that meet the requirements simply by describing the requirements with natural language instructions. By experimenting on the Nguyen dataset, we can demonstrate that MLLM-SR leads the state-of-the-art baselines in fitting performance. More notably, we experimentally demonstrate that MLLM-SR can well understand the prior knowledge we add to the natural language instructions. Moreover, the addition of prior knowledge can effectively guide MLLM-SR to generate correct expressions.


title: Generalized symmetry in non-Hermitian systems

abstract: Despite acute interest in the dynamics of non-Hermitian systems, there is a lack of consensus in the mathematical formulation of non-Hermitian quantum mechanics in the community. Different methodologies are used in the literature to study non-Hermitian dynamics. This ranges from consistent frameworks like biorthogonal quantum mechanics and metric approach characterized by modified inner products, to normalization by time-dependent norms inspired by open quantum systems. In this work, we systematically explore the similarities and differences among these various methods. Utilizing illustrative models with exact solutions, we demonstrate that these methods produce not only quantitatively different results but also distinct physical interpretations. For dissipative systems where non-Hermiticity arises as an approximation, we find that the normalization method in the $\mathcal{PT}$-broken regime closely aligns with the full master equation solutions. In contrast, for quantum systems where non-Hermiticity can be engineered exactly, incorporating metric dynamics is crucial for the probabilistic interpretation of quantum mechanics, necessitating the generalization of unitary symmetry to non-Hermitian systems. This study lays the groundwork for further exploration of non-Hermitian Hamiltonians, potentially leveraging generalized symmetries for novel physical phenomena.


title: Select-Mosaic: Data Augmentation Method for Dense Small Object Scenes

abstract: Data augmentation refers to the process of applying a series of transformations or expansions to original data to generate new samples, thereby increasing the diversity and quantity of the data, effectively improving the performance and robustness of models. As a common data augmentation method, Mosaic data augmentation technique stitches multiple images together to increase the diversity and complexity of training data, thereby reducing the risk of overfitting. Although Mosaic data augmentation achieves excellent results in general detection tasks by stitching images together, it still has certain limitations for specific detection tasks. This paper addresses the challenge of detecting a large number of densely distributed small objects in aerial images by proposing the Select-Mosaic data augmentation method, which is improved with a fine-grained region selection strategy. The improved Select-Mosaic method demonstrates superior performance in handling dense small object detection tasks, significantly enhancing the accuracy and stability of detection models. Code is available at https://github.com/malagoutou/Select-Mosaic.


title: Discover Your Neighbors: Advanced Stable Test-Time Adaptation in Dynamic World

abstract: Despite progress, deep neural networks still suffer performance declines under distribution shifts between training and test domains, leading to a substantial decrease in Quality of Experience (QoE) for multimedia applications. Existing test-time adaptation (TTA) methods are challenged by dynamic, multiple test distributions within batches. This work provides a new perspective on analyzing batch normalization techniques through class-related and class-irrelevant features, our observations reveal combining source and test batch normalization statistics robustly characterizes target distributions. However, test statistics must have high similarity. We thus propose Discover Your Neighbours (DYN), the first backward-free approach specialized for dynamic TTA. The core innovation is identifying similar samples via instance normalization statistics and clustering into groups which provides consistent class-irrelevant representations. Specifically, Our DYN consists of layer-wise instance statistics clustering (LISC) and cluster-aware batch normalization (CABN). In LISC, we perform layer-wise clustering of approximate feature samples at each BN layer by calculating the cosine similarity of instance normalization statistics across the batch. CABN then aggregates SBN and TCN statistics to collaboratively characterize the target distribution, enabling more robust representations. Experimental results validate DYN's robustness and effectiveness, demonstrating maintained performance under dynamic data stream patterns.


title: Angular Momentum-Resolved Inelastic Electron Scattering for Nuclear Giant Resonances

abstract: Giant resonances (GRs) provide crucial insights into nuclear physics and astrophysics. Exciting GRs using particles like electrons is effective, yet the angular momentum (AM) transfer of electrons, including both intrinsic spin and orbital degrees of freedom in inelastic scattering, has never been studied. Here, we investigate AM transfer in GRs excited by plane-wave and vortex electrons, developing a comprehensive AM-resolved inelastic electron scattering theory. We find that even plane-wave electrons can model-independently extract transition strengths of higher multipolarity by selecting specific AM states of scattered electrons. Additionally, relativistic vortex electrons with orbital angular momentum (OAM) $\pm1$ can be efficiently generated. Vortex electrons can also be used to extract GR transition strength as in the plane-wave case, regardless of the position of nucleus relative to the beam axis. Furthermore, relativistic vortex electrons with larger OAM can be generated for on-axis nuclei due to AM conservation. Our method offers new perspectives for nuclear structure research and paves the way for generating vortex particles.


title: Low-cost wind turbine aeroacoustic predictions using actuator lines

abstract: Aerodynamic noise is a limitation for further exploitation of wind energy resources. As this type of noise is caused by the interaction of turbulent flow with the airframe, a detailed resolution of the flow is necessary to obtain an accurate prediction of the far-field noise. Computational fluid dynamic (CFD) solvers simulate the flow field but only at a high computational cost, which is much increased when the acoustic field is resolved. Therefore, wind turbine noise predictions using numerical approaches remain a challenge. This paper presents a methodology that couples (relatively fast) wind turbine CFD simulations using actuator lines with a fast turn-around noise prediction method. The flow field is simulated using actuator lines and large eddy simulations. The noise prediction method is based on the Amiet-Schlinker's theory for rotatory noise sources, considering leading- and trailing-edge noise as unique noise sources. A 2D panel code (XFOIL) calculates the sectional forces and boundary layer quantities. The resulting methodology for the noise prediction method is of high fidelity since the wind turbine geometry is accounted for in both flow and acoustics predictions. Results are compared with field measurements of a full-scale wind turbine for two operational conditions, validating the results of this research.


title: Focusing of concentric free-surface waves

abstract: Gravito-capillary waves at free-surfaces are ubiquitous in several natural and industrial processes involving quiescent liquid pools bounded by cylindrical walls. These waves emanate from the relaxation of initial interface distortions, which often take the form of a cavity (depression) centred on the symmetry axis of the container. These surface waves reflect from the container walls leading to a radially inward propagating wave-train converging (focussing) onto the symmetry axis. Under the inviscid approximation and for sufficiently shallow cavities, the relaxation is well-described by the linearised potential-flow equations. Naturally, adding viscosity to such a system introduces viscous dissipation that enervates energy and dampens the oscillations at the symmetry axis. However, for viscous liquids and deeper cavities, these equations are qualitatively inaccurate. In this study, we elucidate a modal approach to study the initial-value problem for concentric gravito-capillary waves generated on a free-surface for inviscid as well as viscous liquids. For a sufficiently deep cavity, the inward focusing of waves results in large interfacial oscillations at the axis, necessitating a second-order nonlinear theory. We demonstrate that this theory effectively models the interfacial behavior and highlights the crucial role of nonlinearity near the symmetry axis. Contrary to expectations, the addition of slight viscosity further intensifies the oscillations at the symmetry axis. This finding underscores the limitations of the potential flow model and suggests avenues for more accurate modelling of such complex free-surface flows.


title: Optimizing Navigational Graph Queries

abstract: We study the optimization of navigational graph queries, i.e., queries which combine recursive and pattern-matching fragments. Current approaches to their evaluation are not effective in practice. Towards addressing this, we present a number of novel powerful optimization techniques which aim to constrain the intermediate results during query evaluation. We show how these techniques can be planned effectively and executed efficiently towards the first practical evaluation solution for complex navigational queries on real-world workloads. Indeed, our experimental results show several orders of magnitude improvement in query evaluation performance over state-of-the-art techniques on a wide range of queries on diverse datasets.


title: Multi-attribute Auction-based Resource Allocation for Twins Migration in Vehicular Metaverses: A GPT-based DRL Approach

abstract: Vehicular Metaverses are developed to enhance the modern automotive industry with an immersive and safe experience among connected vehicles and roadside infrastructures, e.g., RoadSide Units (RSUs). For seamless synchronization with virtual spaces, Vehicle Twins (VTs) are constructed as digital representations of physical entities. However, resource-intensive VTs updating and high mobility of vehicles require intensive computation, communication, and storage resources, especially for their migration among RSUs with limited coverages. To address these issues, we propose an attribute-aware auction-based mechanism to optimize resource allocation during VTs migration by considering both price and non-monetary attributes, e.g., location and reputation. In this mechanism, we propose a two-stage matching for vehicular users and Metaverse service providers in multi-attribute resource markets. First, the resource attributes matching algorithm obtains the resource attributes perfect matching, namely, buyers and sellers can participate in a double Dutch auction (DDA). Then, we train a DDA auctioneer using a generative pre-trained transformer (GPT)-based deep reinforcement learning (DRL) algorithm to adjust the auction clocks efficiently during the auction process. We compare the performance of social welfare and auction information exchange costs with state-of-the-art baselines under different settings. Simulation results show that our proposed GPT-based DRL auction schemes have better performance than others.


title: Foundations of iterated star maps and their use in combinatorics

abstract: We develop a framework for nonstandard analysis that gives foundations to the interplay between external and internal iterations of the star map, and we present a few examples to show the strength and flexibility of such a nonstandard technique for applications in combinatorial number theory.


title: Probing Ferroelectric Phase Transitions in Barium Titanate Single Crystals via $\it{in-situ}$ Second Harmonic Generation Microscopy

abstract: Ferroelectric materials play a crucial role in a broad range of technologies due to their unique properties that are deeply connected to the pattern and behavior of their ferroelectric (FE) domains. Chief among them, barium titanate (BaTiO$_3$; BTO) sees widespread applications such as in electronics but equally is a ferroelectric model system for fundamental research, e.g., to study the interplay of such FE domains, the domain walls (DWs), and their macroscopic properties, owed to BTO's multiple and experimentally accessible phase transitions. Here, we employ Second Harmonic Generation Microscopy (SHGM) to $\it{in-situ}$ investigate the cubic-to-tetragonal (at $\sim$126$^\circ$C) and the tetragonal-to-orthorhombic (at $\sim$5$^\circ$C) phase transition in single-crystalline BTO via 3-dimensional (3D) DW mapping. We demonstrate that SHGM imaging provides the direct visualization of FE domain switching as well as the domain dynamics in 3D, shedding light on the interplay of the domain structure and the phase transition. These results allow us to extract the different transition temperatures locally, to unveil the hysteresis behavior, and to determine the type of phase transition at play (1st/2nd order) from the recorded SHGM data. The capabilities of SHGM in uncovering these crucial phenomena can easily be applied to other ferroelectrics to provide new possibilities for $\it{in-situ}$ engineering of advanced ferroic devices.


title: 3D MRI Synthesis with Slice-Based Latent Diffusion Models: Improving Tumor Segmentation Tasks in Data-Scarce Regimes

abstract: Despite the increasing use of deep learning in medical image segmentation, the limited availability of annotated training data remains a major challenge due to the time-consuming data acquisition and privacy regulations. In the context of segmentation tasks, providing both medical images and their corresponding target masks is essential. However, conventional data augmentation approaches mainly focus on image synthesis. In this study, we propose a novel slice-based latent diffusion architecture designed to address the complexities of volumetric data generation in a slice-by-slice fashion. This approach extends the joint distribution modeling of medical images and their associated masks, allowing a simultaneous generation of both under data-scarce regimes. Our approach mitigates the computational complexity and memory expensiveness typically associated with diffusion models. Furthermore, our architecture can be conditioned by tumor characteristics, including size, shape, and relative position, thereby providing a diverse range of tumor variations. Experiments on a segmentation task using the BRATS2022 confirm the effectiveness of the synthesized volumes and masks for data augmentation.


title: Diffusion-based Reinforcement Learning for Dynamic UAV-assisted Vehicle Twins Migration in Vehicular Metaverses

abstract: Air-ground integrated networks can relieve communication pressure on ground transportation networks and provide 6G-enabled vehicular Metaverses services offloading in remote areas with sparse RoadSide Units (RSUs) coverage and downtown areas where users have a high demand for vehicular services. Vehicle Twins (VTs) are the digital twins of physical vehicles to enable more immersive and realistic vehicular services, which can be offloaded and updated on RSU, to manage and provide vehicular Metaverses services to passengers and drivers. The high mobility of vehicles and the limited coverage of RSU signals necessitate VT migration to ensure service continuity when vehicles leave the signal coverage of RSUs. However, uneven VT task migration might overload some RSUs, which might result in increased service latency, and thus impactive immersive experiences for users. In this paper, we propose a dynamic Unmanned Aerial Vehicle (UAV)-assisted VT migration framework in air-ground integrated networks, where UAVs act as aerial edge servers to assist ground RSUs during VT task offloading. In this framework, we propose a diffusion-based Reinforcement Learning (RL) algorithm, which can efficiently make immersive VT migration decisions in UAV-assisted vehicular networks. To balance the workload of RSUs and improve VT migration quality, we design a novel dynamic path planning algorithm based on a heuristic search strategy for UAVs. Simulation results show that the diffusion-based RL algorithm with UAV-assisted performs better than other baseline schemes.


title: Generic injectivity of Hessian maps of ternary forms

abstract: We prove that any planar projective curve of degree $d \ge 4$ and with a smooth Hessian curve $H_f$ is uniquely determined by $H_f$. Taking into account that the Hessian curve is the ramification divisor associated with the polar map, we prove the statement using a geometric description of the graph of such a map. It turns out that in degree $d\ge 4$ two curves have the same smooth Hessian if and only if they have the same Jacobian ideal. The latter curves have been classified by C. Mammana, and they all have a reducible, hence singular, Hessian curve. As a consequence, the Hessian map, associating with a proportionality class of a ternary form the class of its Hessian determinant, is injective on the open locus corresponding to curves with smooth Hessian curve. This confirms a conjecture posed by C. Ciliberto and G. Ottaviani.


title: Recent advancements in computational morphology : A comprehensive survey

abstract: Computational morphology handles the language processing at the word level. It is one of the foundational tasks in the NLP pipeline for the development of higher level NLP applications. It mainly deals with the processing of words and word forms. Computational Morphology addresses various sub problems such as morpheme boundary detection, lemmatization, morphological feature tagging, morphological reinflection etc. In this paper, we present exhaustive survey of the methods for developing computational morphology related tools. We survey the literature in the chronological order starting from the conventional methods till the recent evolution of deep neural network based approaches. We also review the existing datasets available for this task across the languages. We discuss about the effectiveness of neural model compared with the traditional models and present some unique challenges associated with building the computational morphology tools. We conclude by discussing some recent and open research issues in this field.


title: Categorical Theory of $(\infty,\omega)$-Categories

abstract: This text is dedicated to the development of the theory of $(\infty,\omega)$-categories. We present generalizations of standard results from category theory, such as the lax Grothendieck construction, the Yoneda lemma, lax (co)limits and lax Kan extensions, among others.


title: Baking Symmetry into GFlowNets

abstract: GFlowNets have exhibited promising performance in generating diverse candidates with high rewards. These networks generate objects incrementally and aim to learn a policy that assigns probability of sampling objects in proportion to rewards. However, the current training pipelines of GFlowNets do not consider the presence of isomorphic actions, which are actions resulting in symmetric or isomorphic states. This lack of symmetry increases the amount of samples required for training GFlowNets and can result in inefficient and potentially incorrect flow functions. As a consequence, the reward and diversity of the generated objects decrease. In this study, our objective is to integrate symmetries into GFlowNets by identifying equivalent actions during the generation process. Experimental results using synthetic data demonstrate the promising performance of our proposed approaches.


title: Decision Mamba: A Multi-Grained State Space Model with Self-Evolution Regularization for Offline RL

abstract: While the conditional sequence modeling with the transformer architecture has demonstrated its effectiveness in dealing with offline reinforcement learning (RL) tasks, it is struggle to handle out-of-distribution states and actions. Existing work attempts to address this issue by data augmentation with the learned policy or adding extra constraints with the value-based RL algorithm. However, these studies still fail to overcome the following challenges: (1) insufficiently utilizing the historical temporal information among inter-steps, (2) overlooking the local intrastep relationships among states, actions and return-to-gos (RTGs), (3) overfitting suboptimal trajectories with noisy labels. To address these challenges, we propose Decision Mamba (DM), a novel multi-grained state space model (SSM) with a self-evolving policy learning strategy. DM explicitly models the historical hidden state to extract the temporal information by using the mamba architecture. To capture the relationship among state-action-RTG triplets, a fine-grained SSM module is designed and integrated into the original coarse-grained SSM in mamba, resulting in a novel mamba architecture tailored for offline RL. Finally, to mitigate the overfitting issue on noisy trajectories, a self-evolving policy is proposed by using progressive regularization. The policy evolves by using its own past knowledge to refine the suboptimal actions, thus enhancing its robustness on noisy demonstrations. Extensive experiments on various tasks show that DM outperforms other baselines substantially.


title: Information-Theoretic Thresholds for the Alignments of Partially Correlated Graphs

abstract: This paper studies the problem of recovering the hidden vertex correspondence between two correlated random graphs. We propose the partially correlated Erd\H{o}s-R\'enyi graphs model, wherein a pair of induced subgraphs with a certain number are correlated. We investigate the information-theoretic thresholds for recovering the latent correlated subgraphs and the hidden vertex correspondence. We prove that there exists an optimal rate for partial recovery for the number of correlated nodes, above which one can correctly match a fraction of vertices and below which correctly matching any positive fraction is impossible, and we also derive an optimal rate for exact recovery. In the proof of possibility results, we propose correlated functional digraphs, which partition the edges of the intersection graph into two types of components, and bound the error probability by lower-order cumulant generating functions. The proof of impossibility results build upon the generalized Fano's inequality and the recovery thresholds settled in correlated Erd\H{o}s-R\'enyi graphs model.


title: Central limit theorems for lattice point counting on tessellated domains

abstract: Following the approach of Bj$\ddot{\text{o}}$rklund and Gorodnik, we have considered the discrepancy function for lattice point counting on domains that can be nicely tessellated by the action of a diagonal semigroup. We have shown that suitably normalized discrepancy functions for lattice point counting on certain tessellated domains satisfy a non-degenerate central limit theorem. Furthermore, we have also addressed the same problem for affine and congruence lattice point counting, proving analogous non-degenerate central limit theorems for them. The main ingredients of the proofs are the method of cumulants and quantitative multiple mixing estimates.


title: Large Eddy Simulations of Flow over Additively Manufactured Surfaces: Impact of Roughness and Skewness on Turbulent Heat Transfer

abstract: Additive manufacturing creates surfaces with random roughness, impacting heat transfer and pressure loss differently than traditional sand-grain roughness. We conducted high-fidelity heat transfer simulations over three-dimensional additive manufactured surfaces with varying roughness heights and skewness. Based on an additive manufactured Inconel 939 sample from Siemens Energy AB, we created six surfaces with different normalized roughness heights, $R_a/D = 0.001, 0.006, 0.012, 0.015, 0.020,$ and $0.028$, and a fixed skewness, ${s_k} = 0.424$. Each surface was also flipped to obtain negatively skewed counterparts (${s_k} = -0.424)$. Simulations were conducted at a constant Reynolds number of 8000 and with temperature treated as a passive scalar. We analyzed temperature, velocity profiles and heat fluxes to understand the impact of roughness height and skewness on heat and momentum transfer. The inner-scaled mean temperature profiles are of larger magnitude than the mean velocity profiles both inside and outside the roughness layer. This means the temperature wall roughness function differs from the momentum wall roughness function. Surfaces with positive and negative skewness yielded different estimates of equivalent sand-grain roughness for the same $R_a/D$ values, suggesting a strong influence of slope and skewness on the relationship between roughness function and equivalent sand-grain roughness. Analysis of the heat and momentum transfer mechanisms indicated an increased effective Prandtl number within the rough surface in which the momentum diffusivity is larger than the corresponding thermal diffusivity due to the combined effects of turbulence and dispersion. Results consistently indicated improved heat transfer with increasing roughness height and positively skewed surfaces performing better beyond a certain roughness threshold than negatively skewed ones.


title: MaTableGPT: GPT-based Table Data Extractor from Materials Science Literature

abstract: Efficiently extracting data from tables in the scientific literature is pivotal for building large-scale databases. However, the tables reported in materials science papers exist in highly diverse forms; thus, rule-based extractions are an ineffective approach. To overcome this challenge, we present MaTableGPT, which is a GPT-based table data extractor from the materials science literature. MaTableGPT features key strategies of table data representation and table splitting for better GPT comprehension and filtering hallucinated information through follow-up questions. When applied to a vast volume of water splitting catalysis literature, MaTableGPT achieved an extraction accuracy (total F1 score) of up to 96.8%. Through comprehensive evaluations of the GPT usage cost, labeling cost, and extraction accuracy for the learning methods of zero-shot, few-shot and fine-tuning, we present a Pareto-front mapping where the few-shot learning method was found to be the most balanced solution owing to both its high extraction accuracy (total F1 score>95%) and low cost (GPT usage cost of 5.97 US dollars and labeling cost of 10 I/O paired examples). The statistical analyses conducted on the database generated by MaTableGPT revealed valuable insights into the distribution of the overpotential and elemental utilization across the reported catalysts in the water splitting literature.


title: Regularized Training with Generated Datasets for Name-Only Transfer of Vision-Language Models

abstract: Recent advancements in text-to-image generation have inspired researchers to generate datasets tailored for perception models using generative models, which prove particularly valuable in scenarios where real-world data is limited. In this study, our goal is to address the challenges when fine-tuning vision-language models (e.g., CLIP) on generated datasets. Specifically, we aim to fine-tune vision-language models to a specific classification model without access to any real images, also known as name-only transfer. However, despite the high fidelity of generated images, we observed a significant performance degradation when fine-tuning the model using the generated datasets due to the domain gap between real and generated images. To overcome the domain gap, we provide two regularization methods for training and post-training, respectively. First, we leverage the domain-agnostic knowledge from the original pre-trained vision-language model by conducting the weight-space ensemble of the fine-tuned model on the generated dataset with the original pre-trained model at the post-training. Secondly, we reveal that fine-tuned models with high feature diversity score high performance in the real domain, which indicates that increasing feature diversity prevents learning the generated domain-specific knowledge. Thus, we encourage feature diversity by providing additional regularization at training time. Extensive experiments on various classification datasets and various text-to-image generation models demonstrated that our analysis and regularization techniques effectively mitigate the domain gap, which has long been overlooked, and enable us to achieve state-of-the-art performance by training with generated images. Code is available at https://github.com/pmh9960/regft-for-gen


title: Large Language Model Assisted Adversarial Robustness Neural Architecture Search

abstract: Motivated by the potential of large language models (LLMs) as optimizers for solving combinatorial optimization problems, this paper proposes a novel LLM-assisted optimizer (LLMO) to address adversarial robustness neural architecture search (ARNAS), a specific application of combinatorial optimization. We design the prompt using the standard CRISPE framework (i.e., Capacity and Role, Insight, Statement, Personality, and Experiment). In this study, we employ Gemini, a powerful LLM developed by Google. We iteratively refine the prompt, and the responses from Gemini are adapted as solutions to ARNAS instances. Numerical experiments are conducted on NAS-Bench-201-based ARNAS tasks with CIFAR-10 and CIFAR-100 datasets. Six well-known meta-heuristic algorithms (MHAs) including genetic algorithm (GA), particle swarm optimization (PSO), differential evolution (DE), and its variants serve as baselines. The experimental results confirm the competitiveness of the proposed LLMO and highlight the potential of LLMs as effective combinatorial optimizers. The source code of this research can be downloaded from \url{https://github.com/RuiZhong961230/LLMO}.


title: Unsupervised learning of Data-driven Facial Expression Coding System (DFECS) using keypoint tracking

abstract: The development of existing facial coding systems, such as the Facial Action Coding System (FACS), relied on manual examination of facial expression videos for defining Action Units (AUs). To overcome the labor-intensive nature of this process, we propose the unsupervised learning of an automated facial coding system by leveraging computer-vision-based facial keypoint tracking. In this novel facial coding system called the Data-driven Facial Expression Coding System (DFECS), the AUs are estimated by applying dimensionality reduction to facial keypoint movements from a neutral frame through a proposed Full Face Model (FFM). FFM employs a two-level decomposition using advanced dimensionality reduction techniques such as dictionary learning (DL) and non-negative matrix factorization (NMF). These techniques enhance the interpretability of AUs by introducing constraints such as sparsity and positivity to the encoding matrix. Results show that DFECS AUs estimated from the DISFA dataset can account for an average variance of up to 91.29 percent in test datasets (CK+ and BP4D-Spontaneous) and also surpass the variance explained by keypoint-based equivalents of FACS AUs in these datasets. Additionally, 87.5 percent of DFECS AUs are interpretable, i.e., align with the direction of facial muscle movements. In summary, advancements in automated facial coding systems can accelerate facial expression analysis across diverse fields such as security, healthcare, and entertainment. These advancements offer numerous benefits, including enhanced detection of abnormal behavior, improved pain analysis in healthcare settings, and enriched emotion-driven interactions. To facilitate further research, the code repository of DFECS has been made publicly accessible.


title: Two-weighted estimates for some sublinear operators on generalized weighted Morrey Spaces and applications

abstract: In this paper we investigate the boundedness of sublinear operators generated by fractional integrals as well as sublinear operators generated by Calder\`on-Zygmund operators on generalized weighted Morrey spaces and generalized weighted mixed-Morrey spaces. In particular we are interested in the strong-type estimate for $1<p<\infty$ and the weak estimate for $p=1$. Under some assumptions, we prove that the operators and their commutator with a BMO function are bounded on those function spaces with different weights. The results then imply the boundedness of fractional integrals with Gaussian kernel bounds as well as with rough kernels, fractional maximal integrals with rough kernels, and sublinear operators with rough kernels generated by Calder\`on-Zygmund operators. Using the results, we obtain some regularity properties of the solution of some partial differential equations.


title: Introducing Competitive Mechanism to Differential Evolution for Numerical Optimization

abstract: This paper introduces a novel competitive mechanism into differential evolution (DE), presenting an effective DE variant named competitive DE (CDE). CDE features a simple yet efficient mutation strategy: DE/winner-to-best/1. Essentially, the proposed DE/winner-to-best/1 strategy can be recognized as an intelligent integration of the existing mutation strategies of DE/rand-to-best/1 and DE/cur-to-best/1. The incorporation of DE/winner-to-best/1 and the competitive mechanism provide new avenues for advancing DE techniques. Moreover, in CDE, the scaling factor $F$ and mutation rate $Cr$ are determined by a random number generator following a normal distribution, as suggested by previous research. To investigate the performance of the proposed CDE, comprehensive numerical experiments are conducted on CEC2017 and engineering simulation optimization tasks, with CMA-ES, JADE, and other state-of-the-art optimizers and DE variants employed as competitor algorithms. The experimental results and statistical analyses highlight the promising potential of CDE as an alternative optimizer for addressing diverse optimization challenges.


title: From Analog to Digital: Multi-Order Digital Joint Coding-Modulation for Semantic Communication

abstract: Recent studies in joint source-channel coding (JSCC) have fostered a fresh paradigm in end-to-end semantic communication. Despite notable performance achievements, present initiatives in building semantic communication systems primarily hinge on the transmission of continuous channel symbols, thus presenting challenges in compatibility with established digital systems. In this paper, we introduce a novel approach to address this challenge by developing a multi-order digital joint coding-modulation (MDJCM) scheme for semantic communications. Initially, we construct a digital semantic communication system by integrating a multi-order modulation/demodulation module into a nonlinear transform source-channel coding (NTSCC) framework. Recognizing the non-differentiable nature of modulation/demodulation, we propose a novel substitution training strategy. Herein, we treat modulation/demodulation as a constrained quantization process and introduce scaling operations alongside manually crafted noise to approximate this process. As a result, employing this approximation in training semantic communication systems can be deployed in practical modulation/demodulation scenarios with superior performance. Additionally, we demonstrate the equivalence by analyzing the involved probability distribution. Moreover, to further upgrade the performance, we develop a hierarchical dimension-reduction strategy to provide a gradual information extraction process. Extensive experimental evaluations demonstrate the superiority of our proposed method over existing digital and non-digital JSCC techniques.


title: A Roadmap for Software Testing in Open Collaborative Development Environments

abstract: Amidst the ever-expanding digital sphere, the evolution of the Internet has not only fostered an atmosphere of information transparency and sharing but has also sparked a revolution in software development practices. The distributed nature of open collaborative development, along with its diverse contributors and rapid iterations, presents new challenges for ensuring software quality. This paper offers a comprehensive review and analysis of recent advancements in software quality assurance within open collaborative development environments. Our examination covers various aspects, including process management, personnel dynamics, and technological advancements, providing valuable insights into effective approaches for maintaining software quality in such collaborative settings. Furthermore, we delve into the challenges and opportunities arising from emerging technologies such as LLMs and the AI model-centric development paradigm. By addressing these topics, our study contributes to a deeper understanding of software quality assurance in open collaborative environments and lays the groundwork for future exploration and innovation.


title: A Scalable and Near-Optimal Conformance Checking Approach for Long Traces

abstract: Long traces and large event logs that originate from sensors and prediction models are becoming more common in our data-rich world. In such circumstances, conformance checking, a key task in process mining, can become computationally infeasible due to the exponential complexity of finding an optimal alignment. This paper introduces a novel sliding window approach to address these scalability challenges while preserving the interpretability of alignment-based methods. By breaking down traces into manageable subtraces and iteratively aligning each with the process model, our method significantly reduces the search space. The approach uses global information that captures structural properties of the trace and the process model to make informed alignment decisions, discarding unpromising alignments even if they are optimal for a local subtrace. This improves the overall accuracy of the results. Experimental evaluations demonstrate that the proposed method consistently finds optimal alignments in most cases and highlight its scalability. This is further supported by a theoretical complexity analysis, which shows the reduced growth of the search space compared to other common conformance checking methods. This work provides a valuable contribution towards efficient conformance checking for large-scale process mining applications.


title: Finite-Sample Identification of Linear Regression Models with Residual-Permuted Sums

abstract: This letter studies a distribution-free, finite-sample data perturbation (DP) method, the Residual-Permuted Sums (RPS), which is an alternative of the Sign-Perturbed Sums (SPS) algorithm, to construct confidence regions. While SPS assumes independent (but potentially time-varying) noise terms which are symmetric about zero, RPS gets rid of the symmetricity assumption, but assumes i.i.d. noises. The main idea is that RPS permutes the residuals instead of perturbing their signs. This letter introduces RPS in a flexible way, which allows various design-choices. RPS has exact finite sample coverage probabilities and we provide the first proof that these permutation-based confidence regions are uniformly strongly consistent under general assumptions. This means that the RPS regions almost surely shrink around the true parameters as the sample size increases. The ellipsoidal outer-approximation (EOA) of SPS is also extended to RPS, and the effectiveness of RPS is validated by numerical experiments, as well.


title: Two identities for Poisson Point Processes and Voronoi Tessellations with Applications

abstract: In this paper, we introduce two identities one pertaining to the state space of Poisson Point Processes (PPPs), and the other for the Voronoi tessellations formed by PPPs. Then, we explore several applications of these identities within the context of wireless cellular networks.


title: Kurt G\"odel and the Logic of Concepts

abstract: The literature dealing with G\"{o}del's legacy is largely preoccupied with challenging his philosophical views, regarding them as outdated. We believe that such an approach prevents us from seeing G\"{o}del's views in the right light and understanding their rationale. In this article, his views are discussed in the philosophical realm in which he himself understood them. We explore the consequences of G\"{o}del's incompleteness theorems for the question of the objectivity of mathematics and its epistemology. Taking set theory as the paradigm of formal mathematical theories, we examine the relationship between its incompleteness and extensionality. We argue, based on his philosophical views, that G\"{o}del believed incompleteness can be overcome only by some intensional considerations about concepts from the basis of mathematical theories. These considerations should eventually lead to founding the so-called logic of concepts.


title: Novel Approach to Intrusion Detection: Introducing GAN-MSCNN-BILSTM with LIME Predictions

abstract: This paper introduces an innovative intrusion detection system that harnesses Generative Adversarial Networks (GANs), Multi-Scale Convolutional Neural Networks (MSCNNs), and Bidirectional Long Short-Term Memory (BiLSTM) networks, supplemented by Local Interpretable Model-Agnostic Explanations (LIME) for interpretability. Employing a GAN, the system generates realistic network traffic data, encompassing both normal and attack patterns. This synthesized data is then fed into an MSCNN-BiLSTM architecture for intrusion detection. The MSCNN layer extracts features from the network traffic data at different scales, while the BiLSTM layer captures temporal dependencies within the traffic sequences. Integration of LIME allows for explaining the model's decisions. Evaluation on the Hogzilla dataset, a standard benchmark, showcases an impressive accuracy of 99.16\% for multi-class classification and 99.10\% for binary classification, while ensuring interpretability through LIME. This fusion of deep learning and interpretability presents a promising avenue for enhancing intrusion detection systems by improving transparency and decision support in network security.


title: A Generalized Pointing Error Model for FSO Links with Fixed-Wing UAVs for 6G: Analysis and Trajectory Optimization

abstract: Free-space optical (FSO) communication is a promising solution to support wireless backhaul links in emerging 6G non-terrestrial networks. At the link level, pointing errors in FSO links can significantly impact capacity, making accurate modeling of these errors essential for both assessing and enhancing communication performance. In this paper, we introduce a novel model for FSO pointing errors in unmanned aerial vehicles (UAVs) that incorporates three-dimensional (3D) jitter, including roll, pitch, and yaw angle jittering. We derive a probability density function for the pointing error angle based on the relative position and posture of the UAV to the ground station. This model is then integrated into a trajectory optimization problem designed to maximize energy efficiency while meeting constraints on speed, acceleration, and elevation angle. Our proposed optimization method significantly improves energy efficiency by adjusting the UAV's flight trajectory to minimize exposure to directions highly affected by jitter. The simulation results emphasize the importance of using UAV-specific 3D jitter models in achieving accurate performance measurements and effective system optimization in FSO communication networks. Utilizing our generalized model, the optimized trajectories achieve up to 11.8 percent higher energy efficiency compared to those derived from conventional Gaussian pointing error models.


title: A Generalization of Inoue Surfaces $S^+$

abstract: Using Lie groups with left-invariant complex structure, we construct new examples of compact complex manifolds with flat affine structure in arbitrarly high dimensions. In the 2-dimensional case, we retrieve the Inoue surfaces $S^+$.


title: Design of reliable technology valuation model with calibrated machine learning of patent indicators

abstract: Machine learning (ML) has revolutionized the digital transformation of technology valuation by predicting the value of patents with high accuracy. However, the lack of validation regarding the reliability of these models hinders experts from fully trusting the confidence of model predictions. To address this issue, we propose an analytical framework for reliable technology valuation using calibrated ML models, which provide robust confidence levels in model predictions. We extract quantitative patent indicators that represent various technology characteristics as input data, using the patent maintenance period as a proxy for technology values. Multiple ML models are developed to capture the nonlinear relationship between patent indicators and technology value. The reliability and accuracy of these models are evaluated, presenting a Pareto-front map where the expected calibration error, Matthews correlation coefficient and F1-scores are compared. After identifying the best-performing model, we apply SHapley Additive exPlanation (SHAP) analysis to pinpoint the most significant input features by confidence bin. Through a case study, we confirmed that the proposed approach offers a practical guideline for developing reliable and accurate ML-based technology valuation models, with significant implications for both academia and industry.


title: The PLATO Mission

abstract: PLATO (PLAnetary Transits and Oscillations of stars) is ESA's M3 mission designed to detect and characterise extrasolar planets and perform asteroseismic monitoring of a large number of stars. PLATO will detect small planets (down to <2 R_(Earth)) around bright stars (<11 mag), including terrestrial planets in the habitable zone of solar-like stars. With the complement of radial velocity observations from the ground, planets will be characterised for their radius, mass, and age with high accuracy (5 %, 10 %, 10 % for an Earth-Sun combination respectively). PLATO will provide us with a large-scale catalogue of well-characterised small planets up to intermediate orbital periods, relevant for a meaningful comparison to planet formation theories and to better understand planet evolution. It will make possible comparative exoplanetology to place our Solar System planets in a broader context. In parallel, PLATO will study (host) stars using asteroseismology, allowing us to determine the stellar properties with high accuracy, substantially enhancing our knowledge of stellar structure and evolution. The payload instrument consists of 26 cameras with 12cm aperture each. For at least four years, the mission will perform high-precision photometric measurements. Here we review the science objectives, present PLATO's target samples and fields, provide an overview of expected core science performance as well as a description of the instrument and the mission profile at the beginning of the serial production of the flight cameras. PLATO is scheduled for a launch date end 2026. This overview therefore provides a summary of the mission to the community in preparation of the upcoming operational phases.


title: Reconsideration of optimization for reduction of traffic congestion

abstract: One of the most impressive applications of a quantum annealer was optimizing a group of Volkswagen to reduce traffic congestion using a D-Wave system. A simple formulation of a quadratic term was proposed to reduce traffic congestion. This quadratic term was useful for determining the shortest routes among several candidates. The original formulation produced decreases in the total lengths of car tours and traffic congestion. In this study, we reformulated the cost function with the sole focus on reducing traffic congestion. We then found a unique cost function for expressing the quadratic function with a dead zone and an inequality constraint.


title: Anderson localization for CMV matrices with Verblunsky coefficients defined by the hyperbolic toral automorphism

abstract: In this paper, we prove the large deviation estimates and Anderson localization for CMV matrices on $\ell^2(\mathbb{Z}_+)$ with Verblunsky coefficients defined dynamically by the hyperbolic toral automorphism. Part of positivity results on the Lyapunov exponents of Chulaevsky-Spencer and Anderson localization results of Bourgain-Schlag on Schr\"{o}dinger operators with strongly mixing potentials are extended to CMV matrices.


title: Well-balanced high order finite difference WENO schemes for a first-order Z4 formulation of the Einstein field equations

abstract: In this work we aim at developing a new class of high order accurate well-balanced finite difference (FD) Weighted Essentially Non-Oscillatory (WENO) methods for numerical general relativity, which can be applied to any first--order reduction of the Einstein field equations, even if non--conservative terms are present. We choose the first--order non--conservative Z4 formulation of the Einstein equations, which has a built--in cleaning procedure that accounts for the Einstein constraints and that has already shown its ability in keeping stationary solutions stable over long timescales. Upon the introduction of auxiliary variables, the vacuum Einstein equations in first order form constitute a ...


title: PrivacyCube: Data Physicalization for Enhancing Privacy Awareness in IoT

abstract: People are increasingly bringing Internet of Things (IoT) devices into their homes without understanding how their data is gathered, processed, and used. We describe PrivacyCube, a novel data physicalization designed to increase privacy awareness within smart home environments. PrivacyCube visualizes IoT data consumption by displaying privacy-related notices. PrivacyCube aims to assist smart home occupants to (i) understand their data privacy better and (ii) have conversations around data management practices of IoT devices used within their homes. Using PrivacyCube, households can learn and make informed privacy decisions collectively. To evaluate PrivacyCube, we used multiple research methods throughout the different stages of design. We first conducted a focus group study in two stages with six participants to compare PrivacyCube to text and state-of-the-art privacy policies. We then deployed PrivacyCube in a 14-day-long field study with eight households. Our results show that PrivacyCube helps home occupants comprehend IoT privacy better with significantly increased privacy awareness at p < .05 (p=0.00041, t= -5.57). Participants preferred PrivacyCube over text privacy policies because it was comprehensive and easier to use. PrivacyCube and Privacy Label, a state-of-the-art approach, both received positive reviews from participants, with PrivacyCube being preferred for its interactivity and ability to encourage conversations. PrivacyCube was also considered by home occupants as a piece of home furniture, encouraging them to socialize and discuss IoT privacy implications using this device.


title: Near-Field Channel Estimation for Extremely Large-Scale Terahertz Communications

abstract: Future Terahertz communications exhibit significant potential in accommodating ultra-high-rate services. Employing extremely large-scale array antennas is a key approach to realize this potential, as they can harness substantial beamforming gains to overcome the severe path loss and leverage the electromagnetic advantages in the near field. This paper proposes novel estimation methods designed to enhance efficiency in Terahertz widely-spaced multi-subarray (WSMS) systems. Initially, we introduce three sparse channel representation methods: polar-domain representation (PD-R), multi-angular-domain representation (MAD-R), and two-dimensional polar-angular-domain representation (2D-PAD-R). Each method is meticulously developed for near-field WSMS channels, capitalizing on their sparsity characteristics. Building on this, we propose four estimation frameworks using the sparse recovery theory: polar-domain estimation (PD-E), multi-angular-domain estimation (MAD-E), two-stage polar-angular-domain estimation (TS-PAD-E), and two-dimensional polar-angular-domain estimation (2D-PAD-E). Particularly, 2D-PAD-E, integrating a 2D dictionary process, and TS-PAD-E, with its sequential approach to angle and distance estimation, stand out as particularly effective for near-field angle-distance estimation, enabling decoupled calculation of these parameters. Overall, these frameworks provide versatile and efficient solutions for WSMS channel estimation, balancing low complexity with high-performance outcomes. Additionally, they represent a fresh perspective on near-field signal processing.


title: 2D BAO vs 3D BAO: Hints for new physics?

abstract: In the era of tensions, when precision cosmology is blooming, numerous new theoretical models are emerging. However, it's crucial to pause and question the extent to which the observational data we rely on are model-dependent. In this work, we study the comoving position of the acoustic peak, a cornerstone standard ruler in cosmology. We considered BAO observational datasets from two distinct teams and calculated the product $hr_d$ with the help of each BAO data set along with SN I-a data from the Pantheon Plus sample. Our conclusion at present is that 2D and 3D BAO datasets are compatible with each other. Considering, no systematics in BAO, interpreting $\Omega_{m0}-hr_d$ plane may require physics beyond $\Lambda$CDM not just while using observational BAO data but also while observing it.


title: Generating Lattice Non-invertible Symmetries

abstract: Lattice non-invertible symmetries have rich fusion structures and play important roles in understanding various exotic topological phases. In this paper, we explore methods to generate new lattice non-invertible transformations/symmetries from a given non-invertible seed transformation/symmetry. The new lattice non-invertible symmetry is constructed by composing the seed transformations on different sites or sandwiching a unitary transformation between the transformations on the same sites. In addition to known non-invertible symmetries with fusion algebras of Tambara-Yamagami $\mathbb Z_N\times\mathbb Z_N$ type, we obtain a new non-invertible symmetry in models with $\mathbb Z_N$ dipole symmetries. We name the latter the dipole Kramers-Wannier symmetry because it arises from gauging the dipole symmetry. We further study the dipole Kramers-Wannier symmetry in depth, including its topological defect, its anomaly and its associated generalized Kennedy-Tasaki transformation.


title: Gradient-based algorithms for multi-objective bi-level optimization

abstract: Multi-Objective Bi-Level Optimization (MOBLO) addresses nested multi-objective optimization problems common in a range of applications. However, its multi-objective and hierarchical bilevel nature makes it notably complex. Gradient-based MOBLO algorithms have recently grown in popularity, as they effectively solve crucial machine learning problems like meta-learning, neural architecture search, and reinforcement learning. Unfortunately, these algorithms depend on solving a sequence of approximation subproblems with high accuracy, resulting in adverse time and memory complexity that lowers their numerical efficiency. To address this issue, we propose a gradient-based algorithm for MOBLO, called gMOBA, which has fewer hyperparameters to tune, making it both simple and efficient. Additionally, we demonstrate the theoretical validity by accomplishing the desirable Pareto stationarity. Numerical experiments confirm the practical efficiency of the proposed method and verify the theoretical results. To accelerate the convergence of gMOBA, we introduce a beneficial L2O neural network (called L2O-gMOBA) implemented as the initialization phase of our gMOBA algorithm. Comparative results of numerical experiments are presented to illustrate the performance of L2O-gMOBA.


title: Predictions and Tests for Semi-leptonic Decays of Beauty Hadrons,

abstract: We compare the features of the semi-leptonic decays $B\to D^{(*)} l \bar{\nu}_l$ and $\Lambda_b\to \Lambda_c l \bar{\nu}_l$, with $l$ = $e$, $\mu$ and $\tau$. Firstly, we study such processes according to the $\ell-s$ scheme. Then, we write the angular distributions of those decays in the helicity formalism; we focus especially on the case of $l$ = $\tau$ and suggest for each decay some tests for distinguishing among the various Dirac operators which may explain the tension with the standard model. In particular, as regards the $\Lambda_b$ semi-leptonic decay, we single out five observables, which assume different values for each new-physics interaction; one such observable is related to the longitudinal polarization of the $\tau-\bar{\nu}_\tau$ system, which can be compared with the $D^*$ longitudinal polarization in the $B\to D^* l \bar{\nu}_l$ decay. Moreover, we perform a phenomenological analysis of the decays, particularly of $\Lambda_b$, starting from an assumption which agrees with previous theoretical calculations and has a predictive power about the total widths of several decays; we give also a theoretical explanation to some results that were found in preceding analyses about the above mentioned $B$-decays.


title: Menger and consonant sets in the Sacks model

abstract: Using an iterated Sacks forcing and topological games, we prove that the existence of a totally imperfect Menger set in the Cantor cube with cardinality continuum, is independent from ZFC. We also analyze structures of Hurewicz or consonant subsets of the Cantor cube in the Sacks model.


title: A class of Taub-NUT metrics in the presence of a scalar field

abstract: We derive a class of Taub-NUT metrics in the presence of a scalar field (TNS) by applying the Ehlers transformation on the exact solutions that was recently introduced in arXiv: 2307.09328 and arXiv: 2307.13588. Furthermore, we investigate the effective potential, geodesics, topological charge, and quasinormal modes (QNMs) for the obtained TNS metrics. We also use conformal transformations to generate a new class of exact solutions of the Einstein-conformal-scalar theory by using the obtained TNS solutions as seed metrics. Finally we compare QNMs of the class of exact solutions.


title: PriviFy: Designing Tangible Interfaces for Configuring IoT Privacy Preferences

abstract: The Internet of Things (IoT) devices, such as smart speakers can collect sensitive user data, necessitating the need for users to manage their privacy preferences. However, configuring these preferences presents users with multiple challenges. Existing privacy controls often lack transparency, are hard to understand, and do not provide meaningful choices. On top of that, users struggle to locate privacy settings due to multiple menus or confusing labeling, which discourages them from using these controls. We introduce PriviFy (Privacy Simplify-er), a novel and user-friendly tangible interface that can simplify the configuration of smart devices privacy settings. PriviFy is designed to propose an enhancement to existing hardware by integrating additional features that improve privacy management. We envision that positive feedback and user experiences from our study will inspire consumer product developers and smart device manufacturers to incorporate the useful design elements we have identified. Using fidelity prototyping, we iteratively designed PriviFy prototype with 20 participants to include interactive features such as knobs, buttons, lights, and notifications that allow users to configure their data privacy preferences and receive confirmation of their choices. We further evaluated PriviFy high-fidelity prototype with 20 more participants. Our results show that PriviFy helps simplify the complexity of privacy preferences configuration with a significant usability score at p < .05 (P = 0.000000017, t = -8.8639). PriviFy successfully met users privacy needs and enabled them to regain control over their data. We conclude by recommending the importance of designing specific privacy configuration options.


title: Fighting Against the Repetitive Training and Sample Dependency Problem in Few-shot Named Entity Recognition

abstract: Few-shot named entity recognition (NER) systems recognize entities using a few labeled training examples. The general pipeline consists of a span detector to identify entity spans in text and an entity-type classifier to assign types to entities. Current span detectors rely on extensive manual labeling to guide training. Almost every span detector requires initial training on basic span features followed by adaptation to task-specific features. This process leads to repetitive training of the basic span features among span detectors. Additionally, metric-based entity-type classifiers, such as prototypical networks, typically employ a specific metric that gauges the distance between the query sample and entity-type referents, ultimately assigning the most probable entity type to the query sample. However, these classifiers encounter the sample dependency problem, primarily stemming from the limited samples available for each entity-type referent. To address these challenges, we proposed an improved few-shot NER pipeline. First, we introduce a steppingstone span detector that is pre-trained on open-domain Wikipedia data. It can be used to initialize the pipeline span detector to reduce the repetitive training of basic features. Second, we leverage a large language model (LLM) to set reliable entity-type referents, eliminating reliance on few-shot samples of each type. Our model exhibits superior performance with fewer training steps and human-labeled data compared with baselines, as demonstrated through extensive experiments on various datasets. Particularly in fine-grained few-shot NER settings, our model outperforms strong baselines, including ChatGPT. We will publicly release the code, datasets, LLM outputs, and model checkpoints.


title: Pyroresistive response of percolating conductive polymer composites

abstract: The pyroresistive response of conductive polymer composites (CPCs) has attracted much interest because of its potential applications in many electronic devices requiring a significant responsiveness to changes in external physical parameters such as temperature or electric fields. Although extensive research has been conducted to study how the properties of the polymeric matrix and conductive fillers affect the positive temperature coefficient pyroresistive effect, the understanding of the microscopic mechanism governing such a phenomenon is still incomplete. In particular, to date, there is little body of theoretical research devoted to investigating the effect of the polymer thermal expansion on the electrical connectivity of the conductive phase. Here, we present the results of simulations of model CPCs in which rigid conductive fillers are dispersed in an insulating amorphous matrix. By employing a meshless algorithm to analyze the thermoelastic response of the system, we couple the computed strain field to the electrical connectedness of the percolating conductive particles. We show that the electrical conductivity responds to the local strains that are generated by the mismatch between the thermal expansion of the polymeric and conductive phases and that the conductor-insulator transition is caused by a sudden and global disconnection of the electrical contacts forming the percolating network.


title: MatrixGate: A High-performance Data Ingestion Tool for Time-series Databases

abstract: Recent years have seen massive time-series data generated in many areas. This different scenario brings new challenges, particularly in terms of data ingestion, where existing technologies struggle to handle such massive time-series data, leading to low loading speed and poor timeliness. To address these challenges, this paper presents MatrixGate, a new and efficient data ingestion approach for massive time-series data. MatrixGate implements both single-instance and multi-instance parallel procedures, which is based on its unique ingestion strategies. First, MatrixGate uses policies to tune the slots that are synchronized with segments to ingest data, which eliminates the cost of starting transactions and enhance the efficiency. Second, multi-coroutines are responsible for transfer data, which can increase the degree of parallelism significantly. Third, lock-free queues are used to enable direct data transfer without the need for disk storage or lodging in the master instance. Experiment results on multiple datasets show that MatrixGate outperforms state-of-the-art methods by 3 to 100 times in loading speed, and cuts down about 80% query latency. Furthermore, MatrixGate scales out efficiently under distributed architecture, achieving scalability of 86%.


title: Polaron-assisted dielectric relaxation processes in donor-doped BaTiO3-based ceramics

abstract: Perovskite structure materials based on the Ba1-xGdxTiO3 system, where x = 0.001, 0.002, 0.003, 0.004 and 0.005, were prepared via the Pechini chemical synthesis route. The dielectric properties have been analyzed over a wide temperature and frequency range, revealing a significant contribution of the conduction mechanisms in the dielectric response of the studied ceramics. In fact, by using the Davidson-Cole formalism, the observed electrical behavior was found to be associated with relaxation processes related to intrinsic defects mobility promoted by a thermally-activated polaronic mechanism. The obtained values of the activation energy for the relaxation processes, estimated from the Arrhenius law for the mean relaxation time, revealed a decrease from 0.29 up to 0.21 eV as the Gd-doping concentration increases, which suggests the conduction process to be associated with the polaronic effects due to the coexistence of Ti4+ and Ti3+ ions in the structure. Analysis from the conductivity formalism, by using the Jonscher universal power-law, confirmed the polaron-type conduction mechanism for the dielectric dispersion, as suggested by the dielectric analysis, being the nature of the hopping mechanism governed by small polaron hopping (SPH) charge transport in the studied Ba1-xGdxTiO3 ceramics.


title: DAISY: Data Adaptive Self-Supervised Early Exit for Speech Representation Models

abstract: Self-supervised speech models have shown to be useful for various tasks, but their large size limits the use in devices with low computing power and memory. In this work, we explore early exit, an approach for reducing latency by exiting the forward process of a network early. Most approaches of early exit need a separate early exit model for each task, with some even requiring fine-tuning of the entire pretrained model. We introduce Data Adaptive Self-Supervised Early Exit (DAISY), an approach that decides when to exit based on the self-supervised loss, eliminating the need for multiple round of training and fine-tuning. DAISY matches the performance of HuBERT on the MiniSUPERB benchmark, but with much faster inference times. Our analysis on the adaptivity of DAISY shows that the model exits early (using fewer layers) on clean data while exits late (using more layers) on noisy data, dynamically adjusting the computational cost of inference based on the noise level of each sample.


title: Metaverse for Safer Roadways: An Immersive Digital Twin Framework for Exploring Human-Autonomy Coexistence in Urban Transportation Systems

abstract: Societal-scale deployment of autonomous vehicles requires them to coexist with human drivers, necessitating mutual understanding and coordination among these entities. However, purely real-world or simulation-based experiments cannot be employed to explore such complex interactions due to safety and reliability concerns, respectively. Consequently, this work presents an immersive digital twin framework to explore and experiment with the interaction dynamics between autonomous and non-autonomous traffic participants. Particularly, we employ a mixed-reality human-machine interface to allow human drivers and autonomous agents to observe and interact with each other for testing edge-case scenarios while ensuring safety at all times. To validate the versatility of the proposed framework's modular architecture, we first present a discussion on a set of user experience experiments encompassing 4 different levels of immersion with 4 distinct user interfaces. We then present a case study of uncontrolled intersection traversal to demonstrate the efficacy of the proposed framework in validating the interactions of a primary human-driven, autonomous, and connected autonomous vehicle with a secondary semi-autonomous vehicle. The proposed framework has been openly released to guide the future of autonomy-oriented digital twins and research on human-autonomy coexistence.


title: Stabilizing period-doubled density waves by spin-orbit coupling in Bose-Einstein condensates in optical lattices

abstract: In atomic Bose-Einstein condensates in optical lattices, mean-field energy can support the existence of period-doubled density waves, which are similar to Bloch waves but have the double periodicity of the underlying lattice potentials. However, they are dynamically unstable. Here, we propose to use the spin-orbit coupling to stabilize the period-doubled density waves. The stabilization mechanism is revealed to relate to interaction-induced spontaneous symmetry breaking of the spin-flip parity symmetry.


title: Prevalence of non-standard collapsing of strong Langmuir turbulence in solar corona plasmas

abstract: We present a fully-kinetic simulation of the full life cycle of strong Langmuir turbulence (SLT) excited by electron beams that are accelerated under the solar corona conditions. We find that (1) most packets ($\sim$80%) are affected by their neighbors during their collapse, as a result, their spatial scale variations present non-standard evolutionary features, i.e., deviating away from what was predicted by the Zakharov model; (2) the collapsing cavity is too shallow to trap the wave packet due to the growth of the Coulomb force, as a result a majority ($\sim$70%) of the packet energy runs away and a secondary localization may occur. The study indicates that the non-standard Langmuir collapse may play an important role in coronal plasmas interacting with an intense electron beam, that may be eventually confirmed by humanity's first mission to fly through the corona.


title: Contributions of greenhouse gases and solar activity to global climate change from CMIP6 models simulations

abstract: Quantitative estimates of the contributions of the anthropogenic forcing, characterized by changes in the radiative forcing of atmospheric greenhouse gases (CO2, in particular), and solar activity variations to the trends of the global surface temperature on secular temporal horizons are obtained with the aid of autoregressive models from simulations with climate models of the CMIP6 ensemble and from long-term observational data since the 19th century. The results for the simulations with climate models characterized by low, medium and high temperature sensitivity to changes in the CO2 content are compared. It is found, in particular, that the estimates from observation data revealing the determinative contribution of the CO2 content to the global surface temperature trends on half-century and century-long time intervals are most consistent with the estimates from simulations with the climate model with the lowest sensitivity of the global surface temperature to doubling the CO2 atmospheric content.


title: Bayesian vs. PAC-Bayesian Deep Neural Network Ensembles

abstract: Bayesian neural networks address epistemic uncertainty by learning a posterior distribution over model parameters. Sampling and weighting networks according to this posterior yields an ensemble model referred to as Bayes ensemble. Ensembles of neural networks (deep ensembles) can profit from the cancellation of errors effect: Errors by ensemble members may average out and the deep ensemble achieves better predictive performance than each individual network. We argue that neither the sampling nor the weighting in a Bayes ensemble are particularly well-suited for increasing generalization performance, as they do not support the cancellation of errors effect, which is evident in the limit from the Bernstein-von~Mises theorem for misspecified models. In contrast, a weighted average of models where the weights are optimized by minimizing a PAC-Bayesian generalization bound can improve generalization performance. This requires that the optimization takes correlations between models into account, which can be achieved by minimizing the tandem loss at the cost that hold-out data for estimating error correlations need to be available. The PAC-Bayesian weighting increases the robustness against correlated models and models with lower performance in an ensemble. This allows us to safely add several models from the same learning process to an ensemble, instead of using early-stopping for selecting a single weight configuration. Our study presents empirical results supporting these conceptual considerations on four different classification datasets. We show that state-of-the-art Bayes ensembles from the literature, despite being computationally demanding, do not improve over simple uniformly weighted deep ensembles and cannot match the performance of deep ensembles weighted by optimizing the tandem loss, which additionally come with non-vacuous generalization guarantees.


title: RandONet: Shallow-Networks with Random Projections for learning linear and nonlinear operators

abstract: Deep Operator Networks (DeepOnets) have revolutionized the domain of scientific machine learning for the solution of the inverse problem for dynamical systems. However, their implementation necessitates optimizing a high-dimensional space of parameters and hyperparameters. This fact, along with the requirement of substantial computational resources, poses a barrier to achieving high numerical accuracy. Here, inpsired by DeepONets and to address the above challenges, we present Random Projection-based Operator Networks (RandONets): shallow networks with random projections that learn linear and nonlinear operators. The implementation of RandONets involves: (a) incorporating random bases, thus enabling the use of shallow neural networks with a single hidden layer, where the only unknowns are the output weights of the network's weighted inner product; this reduces dramatically the dimensionality of the parameter space; and, based on this, (b) using established least-squares solvers (e.g., Tikhonov regularization and preconditioned QR decomposition) that offer superior numerical approximation properties compared to other optimization techniques used in deep-learning. In this work, we prove the universal approximation accuracy of RandONets for approximating nonlinear operators and demonstrate their efficiency in approximating linear nonlinear evolution operators (right-hand-sides (RHS)) with a focus on PDEs. We show, that for this particular task, RandONets outperform, both in terms of numerical approximation accuracy and computational cost, the ``vanilla" DeepOnets.


title: Monge-Amp\`ere equation with Guillemin boundary condition in high dimension

abstract: The Guillemin boundary condition appears naturally in the study of K\"ahler geometry of toric manifolds. In the present paper, the following Guillemin boundary value problem is investigated \begin{align} \label{eq1} &\det D^2 u=\frac{h(x)}{\prod_{i=1}^N l_i(x)},\quad\text{in}\quad\quad P\subset\mathbb R^n, \quad\quad \quad \quad\quad \quad \quad \quad\quad (1)\\ \label{bdy1} &u(x)-\sum_{i=1}^N l_i(x)\ln l_i(x)\in C^\infty(\overline{P}). \quad\quad\quad\quad \quad \quad\quad \quad \quad \quad\quad\quad (2) \end{align} Here \begin{equation*} 0<h(x)\in C^\infty(\overline{P}),\quad P=\cap_{i=1}^N \{l_i(x)>0\} \end{equation*} is a simple convex polytope in $\mathbb R^n$. The solvability of (1)-(2) is given under the necessary and sufficient condition. The key issue in the proof is to obtain the boundary regularity of $u(x)-\displaystyle \sum_{i=1}^N l_i(x)\ln l_i(x)$. Due to the difficulty caused by the structure of the equation itself and the singularity of $\partial P$, we need to pay special attention to the influence of the difference of singularity types at different positions on $\partial P$ on the behavior of $u$ in its vicinity.