title: Radar Spectra-Language Model for Automotive Scene Parsing

abstract: Radar sensors are low cost, long-range, and weather-resilient. Therefore, they are widely used for driver assistance functions, and are expected to be crucial for the success of autonomous driving in the future. In many perception tasks only pre-processed radar point clouds are considered. In contrast, radar spectra are a raw form of radar measurements and contain more information than radar point clouds. However, radar spectra are rather difficult to interpret. In this work, we aim to explore the semantic information contained in spectra in the context of automated driving, thereby moving towards better interpretability of radar spectra. To this end, we create a radar spectra-language model, allowing us to query radar spectra measurements for the presence of scene elements using free text. We overcome the scarcity of radar spectra data by matching the embedding space of an existing vision-language model (VLM). Finally, we explore the benefit of the learned representation for scene parsing, and obtain improvements in free space segmentation and object detection merely by injecting the spectra embedding into a baseline model.


title: Quantum Statistical Effects on Warm Dark Matter and the Mass Constraint from the Cosmic Large Scale Structure

abstract: The suppression of small-scale matter power spectrum is a distinct feature of Warm Dark Matter (WDM), which permits a constraint on the WDM mass from galaxy surveys. In the thermal relic WDM scenario, quantum statistical effects are not manifest. In a unified framework, we investigate the quantum statistical effects for a fermion case with a degenerate pressure and a boson case with a Bose-Einstein condensation (BEC). Compared to the thermal relic case, the degenerate fermion case only slightly lowers the mass bound while the boson case with a high initial BEC fraction ($\gtrsim90\%$) significantly lowers it. On the other hand, the BEC fraction drops during the relativistic-to-nonrelativistic transition and completely disappears if the initial fraction is below $\sim64\%$. Given the rising interest in resolving the late-time galaxy-scale problems with boson condensation, a question is posed on how a high initial BEC fraction can be dynamically created so that a DM condensed component remains today.


title: Word equations, constraints, and formal languages

abstract: In this short survey we describe recent advances on word equations with non-rational constraints in groups and monoids, highlighting the important role that formal languages play in this area.


title: An Observability-Constrained Magnetic-Field-Aided Inertial Navigation System

abstract: A method to construct an observability-constrained magnetic-field-aided inertial navigation system is proposed. The proposed method builds upon the previously proposed observability-constrained extended Kalman filter and extends it to work with a magnetic-field-based odometry-aided inertial navigation system. The proposed method is evaluated using simulation and real-world data, showing that (i) the system observability properties are preserved, (ii) the estimation accuracy increases, and (iii) the perceived uncertainty calculated by the EKF is more consistent with the true uncertainty of the filter estimates.


title: BiVocoder: A Bidirectional Neural Vocoder Integrating Feature Extraction and Waveform Generation

abstract: This paper proposes a novel bidirectional neural vocoder, named BiVocoder, capable both of feature extraction and reverse waveform generation within the short-time Fourier transform (STFT) domain. For feature extraction, the BiVocoder takes amplitude and phase spectra derived from STFT as inputs, transforms them into long-frame-shift and low-dimensional features through convolutional neural networks. The extracted features are demonstrated suitable for direct prediction by acoustic models, supporting its application in text-to-speech (TTS) task. For waveform generation, the BiVocoder restores amplitude and phase spectra from the features by a symmetric network, followed by inverse STFT to reconstruct the speech waveform. Experimental results show that our proposed BiVocoder achieves better performance compared to some baseline vocoders, by comprehensively considering both synthesized speech quality and inference speed for both analysis-synthesis and TTS tasks.


title: Pairwise Ranking Loss for Multi-Task Learning in Recommender Systems

abstract: Multi-Task Learning (MTL) plays a crucial role in real-world advertising applications such as recommender systems, aiming to achieve robust representations while minimizing resource consumption. MTL endeavors to simultaneously optimize multiple tasks to construct a unified model serving diverse objectives. In online advertising systems, tasks like Click-Through Rate (CTR) and Conversion Rate (CVR) are often treated as MTL problems concurrently. However, it has been overlooked that a conversion ($y_{cvr}=1$) necessitates a preceding click ($y_{ctr}=1$). In other words, while certain CTR tasks are associated with corresponding conversions, others lack such associations. Moreover, the likelihood of noise is significantly higher in CTR tasks where conversions do not occur compared to those where they do, and existing methods lack the ability to differentiate between these two scenarios. In this study, exposure labels corresponding to conversions are regarded as definitive indicators, and a novel task-specific loss is introduced by calculating a \textbf{p}air\textbf{wise} \textbf{r}anking (PWiseR) loss between model predictions, manifesting as pairwise ranking loss, to encourage the model to rely more on them. To demonstrate the effect of the proposed loss function, experiments were conducted on different MTL and Single-Task Learning (STL) models using four distinct public MTL datasets, namely Alibaba FR, NL, US, and CCP, along with a proprietary industrial dataset. The results indicate that our proposed loss function outperforms the BCE loss function in most cases in terms of the AUC metric.


title: Sparse Recovery for Holographic MIMO Channels: Leveraging the Clustered Sparsity

abstract: Envisioned as the next-generation transceiver technology, the holographic multiple-input-multiple-output (HMIMO) garners attention for its superior capabilities of fabricating electromagnetic (EM) waves. However, the densely packed antenna elements significantly increase the dimension of the HMIMO channel matrix, rendering traditional channel estimation methods inefficient. While the dimension curse can be relieved to avoid the proportional increase with the antenna density using the state-of-the-art wavenumber-domain sparse representation, the sparse recovery complexity remains tied to the order of non-zero elements in the sparse channel, which still considerably exceeds the number of scatterers. By modeling the inherent clustered sparsity using a Gaussian mixed model (GMM)-based von Mises-Fisher (vMF) distribution, the to-be-estimated channel characteristics can be compressed to the scatterer level. Upon the sparsity extraction, a novel wavenumber-domain expectation-maximization (WD-EM) algorithm is proposed to implement the cluster-by-cluster variational inference, thus significantly reducing the computational complexity. Simulation results verify the robustness of the proposed scheme across overheads and signal-to-noise ratio (SNR).


title: SaVeR: Optimal Data Collection Strategy for Safe Policy Evaluation in Tabular MDP

abstract: In this paper, we study safe data collection for the purpose of policy evaluation in tabular Markov decision processes (MDPs). In policy evaluation, we are given a \textit{target} policy and asked to estimate the expected cumulative reward it will obtain. Policy evaluation requires data and we are interested in the question of what \textit{behavior} policy should collect the data for the most accurate evaluation of the target policy. While prior work has considered behavior policy selection, in this paper, we additionally consider a safety constraint on the behavior policy. Namely, we assume there exists a known default policy that incurs a particular expected cost when run and we enforce that the cumulative cost of all behavior policies ran is better than a constant factor of the cost that would be incurred had we always run the default policy. We first show that there exists a class of intractable MDPs where no safe oracle algorithm with knowledge about problem parameters can efficiently collect data and satisfy the safety constraints. We then define the tractability condition for an MDP such that a safe oracle algorithm can efficiently collect data and using that we prove the first lower bound for this setting. We then introduce an algorithm SaVeR for this problem that approximates the safe oracle algorithm and bound the finite-sample mean squared error of the algorithm while ensuring it satisfies the safety constraint. Finally, we show in simulations that SaVeR produces low MSE policy evaluation while satisfying the safety constraint.


title: Whistle: Data-Efficient Multilingual and Crosslingual Speech Recognition via Weakly Phonetic Supervision

abstract: There exist three approaches for multilingual and crosslingual automatic speech recognition (MCL-ASR) - supervised pre-training with phonetic or graphemic transcription, and self-supervised pre-training. We find that pre-training with phonetic supervision has been underappreciated so far for MCL-ASR, while conceptually it is more advantageous for information sharing between different languages. This paper explores the approach of pre-training with weakly phonetic supervision towards data-efficient MCL-ASR, which is called Whistle. We relax the requirement of gold-standard human-validated phonetic transcripts, and obtain International Phonetic Alphabet (IPA) based transcription by leveraging the LanguageNet grapheme-to-phoneme (G2P) models. We construct a common experimental setup based on the CommonVoice dataset, called CV-Lang10, with 10 seen languages and 2 unseen languages. A set of experiments are conducted on CV-Lang10 to compare, as fair as possible, the three approaches under the common setup for MCL-ASR. Experiments demonstrate the advantages of phoneme-based models (Whistle) for MCL-ASR, in terms of speech recognition for seen languages, crosslingual performance for unseen languages with different amounts of few-shot data, overcoming catastrophic forgetting, and training efficiency.It is found that when training data is more limited, phoneme supervision can achieve better results compared to subword supervision and self-supervision, thereby providing higher data-efficiency. To support reproducibility and promote future research along this direction, we will release the code, models and data for the whole pipeline of Whistle at https://github.com/thu-spmi/CAT upon publication.


title: ERes2NetV2: Boosting Short-Duration Speaker Verification Performance with Computational Efficiency

abstract: Speaker verification systems experience significant performance degradation when tasked with short-duration trial recordings. To address this challenge, a multi-scale feature fusion approach has been proposed to effectively capture speaker characteristics from short utterances. Constrained by the model's size, a robust backbone Enhanced Res2Net (ERes2Net) combining global and local feature fusion demonstrates sub-optimal performance in short-duration speaker verification. To further improve the short-duration feature extraction capability of ERes2Net, we expand the channel dimension within each stage. However, this modification also increases the number of model parameters and computational complexity. To alleviate this problem, we propose an improved ERes2NetV2 by pruning redundant structures, ultimately reducing both the model parameters and its computational cost. A range of experiments conducted on the VoxCeleb datasets exhibits the superiority of ERes2NetV2, which achieves EER of 0.61% for the full-duration trial, 0.98% for the 3s-duration trial, and 1.48% for the 2s-duration trial on VoxCeleb1-O, respectively.


title: Normal Modes of Rouse-Ham Symmetric Star Polymer Model

abstract: The Rouse-Ham model is a simple yet useful dynamics model for an unentangled branched polymer. In this work, we study the normal modes of the Rouse-Ham type coarse-grained symmetric star polymer model. We model a star polymer by connecting multiple arm beads to a center bead by harmonic springs. In the Rouse-Ham model, the dynamics of the bead positions can be decomposed into the normal modes, which are chosen to be orthogonal to each other. Due to the existence of degenerate eigenvalues, the eigenmodes do not directly correspond to the normal modes. We propose several methods to construct the normal modes for the coarse-grained symmetric star polymer model. We show that we can construct the normal modes by using a simple permutation or the Hadamard matrix. These methods give symple and highly symmetric orthogonal modes, but work just for a special number of arms. We also show that we can construct the normal modes by using the discrete Fourier transform (DFT) matrix. This method is applicable for an arbitrary number of arms.


title: A multilingual dataset for offensive language and hate speech detection for hausa, yoruba and igbo languages

abstract: The proliferation of online offensive language necessitates the development of effective detection mechanisms, especially in multilingual contexts. This study addresses the challenge by developing and introducing novel datasets for offensive language detection in three major Nigerian languages: Hausa, Yoruba, and Igbo. We collected data from Twitter and manually annotated it to create datasets for each of the three languages, using native speakers. We used pre-trained language models to evaluate their efficacy in detecting offensive language in our datasets. The best-performing model achieved an accuracy of 90\%. To further support research in offensive language detection, we plan to make the dataset and our models publicly available.


title: MIMO Capacity Maximization with Beyond-Diagonal RIS

abstract: This paper addresses the problem of maximizing the capacity of a multiple-input multiple-output (MIMO) link assisted by a beyond-diagonal reconfigurable intelligent surface (BD-RIS). We maximize the capacity by alternately optimizing the transmit covariance matrix, and the BD-RIS scattering matrix, which, according to network theory, should be unitary and symmetric. These constraints make the optimization of BD-RIS more challenging than that of diagonal RIS. To find a stationary point of the capacity we maximize a sequence of quadratic problems in the manifold of unitary matrices. This leads to an efficient algorithm that always improves the capacity obtained by a diagonal RIS. Through simulation examples, we study the capacity improvement provided by a passive BD-RIS architecture over the conventional RIS model in which the phase shift matrix is diagonal.


title: A Multipurpose Interface for Close- and Far-Proximity Control of Mobile Collaborative Robots

abstract: This letter introduces an innovative visuo-haptic interface to control Mobile Collaborative Robots (MCR). Thanks to a passive detachable mechanism, the interface can be attached/detached from a robot, offering two control modes: local control (attached) and teleoperation (detached). These modes are integrated with a robot whole-body controller and presented in a unified close- and far-proximity control framework for MCR. The earlier introduction of the haptic component in this interface enabled users to execute intricate loco-manipulation tasks via admittance-type control, effectively decoupling task dynamics and enhancing human capabilities. In contrast, this ongoing work proposes a novel design that integrates a visual component. This design utilizes Visual-Inertial Odometry (VIO) for teleoperation, estimating the interface's pose through stereo cameras and an Inertial Measurement Unit (IMU). The estimated pose serves as the reference for the robot's end-effector in teleoperation mode. Hence, the interface offers complete flexibility and adaptability, enabling any user to operate an MCR seamlessly without needing expert knowledge. In this letter, we primarily focus on the new visual feature, and first present a performance evaluation of different VIO-based methods for teleoperation. Next, the interface's usability is analyzed in a home-care application and compared to an alternative designed by a commercial MoCap system. Results show comparable performance in terms of accuracy, completion time, and usability. Nevertheless, the proposed interface is low-cost, poses minimal wearability constraints, and can be used anywhere and anytime without needing external devices or additional equipment, offering a versatile and accessible solution for teleoperation.


title: Layer-2 Arbitrage: An Empirical Analysis of Swap Dynamics and Price Disparities on Rollups

abstract: This paper explores the dynamics of Decentralized Finance (DeFi) within the Layer-2 ecosystem, focusing on Automated Market Makers (AMM) and arbitrage on Ethereum rollups. We observe significant shifts in trading activity from Ethereum to rollups, with swaps on rollups happening 2-3 times more often, though, with lower trade volume. By examining the price differences between AMMs and centralized exchanges, we discover over 0.5 million unexploited arbitrage opportunities on rollups. Remarkably, we observe that these opportunities last, on average, 10 to 20 blocks, requiring adjustments to the LVR metrics to avoid double-counting arbitrage. Our results show that arbitrage in Arbitrum, Base, and Optimism pools ranges from 0.03% to 0.05% of trading volume, while in zkSync Era it oscillates around 0.25%, with the LVR metric overestimating arbitrage by a factor of five. Rollups offer not only lower gas fees, but also provide faster block production, leading to significant differences compared to the trading and arbitrage dynamics of Ethereum.


title: Learning the Hodgkin-Huxley Model with Operator Learning Techniques

abstract: We construct and compare three operator learning architectures, DeepONet, Fourier Neural Operator, and Wavelet Neural Operator, in order to learn the operator mapping a time-dependent applied current to the transmembrane potential of the Hodgkin- Huxley ionic model. The underlying non-linearity of the Hodgkin-Huxley dynamical system, the stiffness of its solutions, and the threshold dynamics depending on the intensity of the applied current, are some of the challenges to address when exploiting artificial neural networks to learn this class of complex operators. By properly designing these operator learning techniques, we demonstrate their ability to effectively address these challenges, achieving a relative L2 error as low as 1.4% in learning the solutions of the Hodgkin-Huxley ionic model.


title: Incremental units-of-measure verification

abstract: Despite an abundance of proposed systems, the verification of units-of-measure within programs remains rare in scientific computing. We attempt to address this issue by providing a lightweight static verification system for units-of-measure in Fortran programs which supports incremental annotation of large projects. We take the opposite approach to the most mainstream existing deployment of units-of-measure typing (in F#) and generate a global, rather than local, constraints system for a program. We show that such a system can infer (and check) polymorphic units specifications for under-determined parts of the program. Not only does this ability allow checking of partially annotated programs but it also allows the global constraint problem to be partitioned. This partitioning means we can scale to large programs by solving constraints for each program module independently and storing inferred units at module boundaries (separate verification). We provide an implementation of our approach as an extension to an open-source Fortran analysis tool.


title: Branches: A Fast Dynamic Programming and Branch & Bound Algorithm for Optimal Decision Trees

abstract: Decision Tree Learning is a fundamental problem for Interpretable Machine Learning, yet it poses a formidable optimization challenge. Despite numerous efforts dating back to the early 1990's, practical algorithms have only recently emerged, primarily leveraging Dynamic Programming (DP) and Branch & Bound (B&B) techniques. These breakthroughs led to the development of two distinct approaches. Algorithms like DL8.5 and MurTree operate on the space of nodes (or branches), they are very fast, but do not penalise complex Decision Trees, i.e. they do not solve for sparsity. On the other hand, algorithms like OSDT and GOSDT operate on the space of Decision Trees, they solve for sparsity but at the detriment of speed. In this work, we introduce Branches, a novel algorithm that integrates the strengths of both paradigms. Leveraging DP and B&B, Branches achieves exceptional speed while also solving for sparsity. Central to its efficiency is a novel analytical bound enabling substantial pruning of the search space. Furthermore, Branches does not necessitate binary features. Theoretical analysis demonstrates that Branches has a lower complexity bound compared to state-of-the-art methods, a claim validated through extensive empirical evaluation. Our results illustrate that Branches outperforms the state of the art in terms of speed and number of iterations while consistently yielding optimal Decision Trees.


title: AROMA: Preserving Spatial Structure for Latent PDE Modeling with Local Neural Fields

abstract: We present AROMA (Attentive Reduced Order Model with Attention), a framework designed to enhance the modeling of partial differential equations (PDEs) using local neural fields. Our flexible encoder-decoder architecture can obtain smooth latent representations of spatial physical fields from a variety of data types, including irregular-grid inputs and point clouds. This versatility eliminates the need for patching and allows efficient processing of diverse geometries. The sequential nature of our latent representation can be interpreted spatially and permits the use of a conditional transformer for modeling the temporal dynamics of PDEs. By employing a diffusion-based formulation, we achieve greater stability and enable longer rollouts compared to conventional MSE training. AROMA's superior performance in simulating 1D and 2D equations underscores the efficacy of our approach in capturing complex dynamical behaviors.


title: One-Shot Federated Learning with Bayesian Pseudocoresets

abstract: Optimization-based techniques for federated learning (FL) often come with prohibitive communication cost, as high dimensional model parameters need to be communicated repeatedly between server and clients. In this paper, we follow a Bayesian approach allowing to perform FL with one-shot communication, by solving the global inference problem as a product of local client posteriors. For models with multi-modal likelihoods, such as neural networks, a naive application of this scheme is hampered, since clients will capture different posterior modes, causing a destructive collapse of the posterior on the server side. Consequently, we explore approximate inference in the function-space representation of client posteriors, hence suffering less or not at all from multi-modality. We show that distributed function-space inference is tightly related to learning Bayesian pseudocoresets and develop a tractable Bayesian FL algorithm on this insight. We show that this approach achieves prediction performance competitive to state-of-the-art while showing a striking reduction in communication cost of up to two orders of magnitude. Moreover, due to its Bayesian nature, our method also delivers well-calibrated uncertainty estimates.


title: Audio Mamba: Selective State Spaces for Self-Supervised Audio Representations

abstract: Despite its widespread adoption as the prominent neural architecture, the Transformer has spurred several independent lines of work to address its limitations. One such approach is selective state space models, which have demonstrated promising results for language modelling. However, their feasibility for learning self-supervised, general-purpose audio representations is yet to be investigated. This work proposes Audio Mamba, a selective state space model for learning general-purpose audio representations from randomly masked spectrogram patches through self-supervision. Empirical results on ten diverse audio recognition downstream tasks show that the proposed models, pretrained on the AudioSet dataset, consistently outperform comparable self-supervised audio spectrogram transformer (SSAST) baselines by a considerable margin and demonstrate better performance in dataset size, sequence length and model size comparisons.


title: Abundances of trace constituents in Jupiter's atmosphere inferred from Herschel/PACS observations

abstract: $Context.$ On October 31, 2009, the Photodetector Array Camera and Spectrometer (PACS) on board the Herschel Space Observatory observed far-infrared spectra of Jupiter between 50 and 220$\,\mu$m as part of the program "Water and Related Chemistry in the Solar System". $Aims.$ We investigate the disk-averaged chemical composition of Jupiter's atmosphere as a function of height using these observations. $Methods.$ We used the Planetary Spectrum Generator (PSG) and the least-squares fitting technique to infer the abundances of trace constituents. $Results.$ The PACS data include numerous spectral lines attributable to ammonia (NH$_3$), methane (CH$_4$), phosphine (PH$_3$), water (H$_2$O), and deuterated hydrogen (HD) in the Jovian atmosphere. We infer an ammonia abundance profile that decreases from a mole fraction of $(1.7\pm 0.8)\times 10^{-4}$ at $p\sim 900\,$mbar to $(1.7\pm 0.9)\times 10^{-8}$ at $p\sim 275\,$mbar, following a fractional scale height of about 0.114. For phosphine, we find a mole fraction of $(7.2\pm 1.2)\times 10^{-7}$ at pressures higher than $(550\pm 100)\,$mbar and a decrease of its abundance at lower pressures following a fractional scale height of $(0.09\pm 0.02)$. Our analysis delivers a methane mole fraction of $(1.49\pm 0.09)\times 10^{-3}$. Analyzing the HD $R(0)$ line at $112.1\,\mu$m yields a new measurement of Jupiter's D/H ratio, $\text{D/H}=(1.5\pm 0.6)\times 10^{-5}$. Finally, the PACS data allow us to put the most stringent $3\sigma$ upper limits yet on the mole fractions of hydrogen halides in the Jovian troposphere. These new upper limits are $<1.1\times 10^{-11}$ for hydrogen fluoride (HF), $<6.0\times 10^{-11}$ for hydrogen chloride (HCl), $<2.3\times 10^{-10}$ for hydrogen bromide (HBr) and $<1.2\times 10^{-9}$ for hydrogen iodide (HI) and support the proposed condensation of hydrogen halides into ammonium halide salts in the Jovian troposphere.


title: On The Statistical Representation Properties Of The Perturb-Softmax And The Perturb-Argmax Probability Distributions

abstract: The Gumbel-Softmax probability distribution allows learning discrete tokens in generative learning, while the Gumbel-Argmax probability distribution is useful in learning discrete structures in discriminative learning. Despite the efforts invested in optimizing these probability models, their statistical properties are under-explored. In this work, we investigate their representation properties and determine for which families of parameters these probability distributions are complete, i.e., can represent any probability distribution, and minimal, i.e., can represent a probability distribution uniquely. We rely on convexity and differentiability to determine these statistical conditions and extend this framework to general probability models, such as Gaussian-Softmax and Gaussian-Argmax. We experimentally validate the qualities of these extensions, which enjoy a faster convergence rate. We conclude the analysis by identifying two sets of parameters that satisfy these assumptions and thus admit a complete and minimal representation. Our contribution is theoretical with supporting practical evaluation.


title: Plasmonic properties of electrochromic doped metal oxides investigated through Kubelka Munk formalism

abstract: Materials with broadband tunable optical properties are looked for in smart windows applications. Doped metal oxides presenting dual band visible (VIS) near infrared (NIR) electrochromic properties can be used for solving such a challenge, and their accurate optical characterization is therefore of prime importance. Kubelka Munk model is a state of the art way to optically quantify the absorption properties of materials and is occasionally applied to plasmonic materials, even if great care should be taken to meet the formalism hypotheses. In the present work, Kubelka Munk theory is discussed in the context of particles of indium tin oxide and molybdenum tungsten oxide formulations that are used as single NIR and both VIS and NIR active advanced electrochromic materials, respectively. An analytical model is derived for particles of much smaller dimensions than the incident wavelength and is experimentally verified. A dilution method is applied to verify the plasmonic characteristics of the particles. This study is key for efficient characterization of optical properties of metal oxides, and plasmonic materials in general, from diffuse reflectance measurements.


title: Berthelot's conjecture via homotopy theory

abstract: We use motivic methods to give a quick proof of Berthelot's conjecture stating that the push-forward map in rigid cohomology of the structural sheaf along a smooth and proper map has a canonical structure of overconvergent F-isocrystal on the base.


title: Numerical scheme for the solution of the "bad" Boussinesq equation

abstract: We present a numerical scheme for the solution of the initial-value problem for the ``bad'' Boussinesq equation. The accuracy of the scheme is tested by comparison with exact soliton solutions as well as with recently obtained asymptotic formulas for the solution.


title: GraVITON: Graph based garment warping with attention guided inversion for Virtual-tryon

abstract: Virtual try-on, a rapidly evolving field in computer vision, is transforming e-commerce by improving customer experiences through precise garment warping and seamless integration onto the human body. While existing methods such as TPS and flow address the garment warping but overlook the finer contextual details. In this paper, we introduce a novel graph based warping technique which emphasizes the value of context in garment flow. Our graph based warping module generates warped garment as well as a coarse person image, which is utilised by a simple refinement network to give a coarse virtual tryon image. The proposed work exploits latent diffusion model to generate the final tryon, treating garment transfer as an inpainting task. The diffusion model is conditioned with decoupled cross attention based inversion of visual and textual information. We introduce an occlusion aware warping constraint that generates dense warped garment, without any holes and occlusion. Our method, validated on VITON-HD and Dresscode datasets, showcases substantial state-of-the-art qualitative and quantitative results showing considerable improvement in garment warping, texture preservation, and overall realism.


title: The MAGPI Survey: Massive slow rotator population in place by $z \sim 0.3$

abstract: We use the `Middle Ages Galaxy Properties with Integral field spectroscopy' (MAGPI) survey to investigate whether galaxies have evolved in the distribution of their stellar angular momentum in the past 3-4 Gyr, as probed by the observational proxy for spin, $\lambda_{R}$. We use 2D stellar kinematics to measure $\lambda_{R}$ along with detailed photometric models to estimate galaxy ellipticity. The combination of these measurements quantifies the kinematic classes of `fast rotators' and the rarer `slow rotators', which show no regular rotation in their line-of-sight velocity fields. We compare 51 MAGPI galaxies with $\log_{10} (M_{\star}/\mathrm{M}_\odot) > 10$ to carefully drawn samples of MaNGA galaxies in the local Universe, selected to represent possible descendants of the MAGPI progenitors. The EAGLE simulations are used to identify possible evolutionary pathways between the two samples, explicitly accounting for progenitor bias in our results and the varied evolutionary pathways a galaxy might take between the two epochs. We find that the occurrence of slow rotating galaxies is unchanged between the MAGPI ($z \sim 0.3$) and MaNGA ($z \sim 0$) samples, suggesting the massive slow rotator population was already in place $\sim 4$ Gyr ago and has not accumulated since. There is a hint of the MAGPI sample having an excess of high $\lambda_{R}$ galaxies compared to the MaNGA sample, corresponding to more ordered rotation, but statistically the samples are not significantly different. The large-scale stellar kinematics, as quantified through the $\lambda_{R}$ parameter, of galaxies at $z \sim 0.3$ have already evolved into the diversity of structures seen today in the local Universe.


title: Achieving Stability for Aloha Networks with Multiple Receivers

abstract: Slotted Aloha has been widely adopted in various communication networks. Yet if the transmission probabilities and traffic input rates of transmitters are not properly regulated, their data queues may easily become unstable. For stability analysis of Aloha networks with multiple receivers, the focus of previous studies has been placed on the maximum input rate of each transmitter, below which the network is guaranteed to be stabilized under any given topology. By assuming a fixed and identical transmission probability across the network, however, network stability is found to be unachievable when the input rate exceeds zero. As we will demonstrate in this paper, the key to stabilizing the network lies in proper selection of transmission probabilities according to the traffic input rates and locations of all transmitters and receivers. Specifically, for an Aloha network with multiple capture receivers, by establishing and solving the fixed-point equations of the steady-state probabilities of successful transmissions of Head-of-Line (HOL) packets, the exact service rates of all transmitters' queues are obtained, based on which the operating region of transmission probabilities for achieving stability and the stability region of input rates are further characterized. The results are illustrated in various scenarios of multi-cell and ad-hoc networks. Simulation results validate the analysis and corroborate that the network can be stabilized as long as the traffic input rates are within the stability region, and the transmission probabilities are properly adjusted according to the traffic input rates and network topology.


title: DNCs Require More Planning Steps

abstract: Many recent works use machine learning models to solve various complex algorithmic problems. However, these models attempt to reach a solution without considering the problem's required computational complexity, which can be detrimental to their ability to solve it correctly. In this work we investigate the effect of computational time and memory on generalization of implicit algorithmic solvers. To do so, we focus on the Differentiable Neural Computer (DNC), a general problem solver that also lets us reason directly about its usage of time and memory. In this work, we argue that the number of planning steps the model is allowed to take, which we call "planning budget", is a constraint that can cause the model to generalize poorly and hurt its ability to fully utilize its external memory. We evaluate our method on Graph Shortest Path, Convex Hull, Graph MinCut and Associative Recall, and show how the planning budget can drastically change the behavior of the learned algorithm, in terms of learned time complexity, training time, stability and generalization to inputs larger than those seen during training.


title: Polyadic supersymmetry

abstract: We introduce a polyadic analog of supersymmetry by considering the polyadization procedure (proposed by the author) applied to the toy model of one-dimensional supersymmetric quantum mechanics. The supercharges are generalized to polyadic ones using the $n$-ary sigma matrices defined in earlier work. In this way, polyadic analogs of supercharges and Hamiltonians take the cyclic shift block matrix form, and they can describe multidegenerated quantum states in a way that is different from the $N$-extended and multigraded SQM. While constructing the corresponding supersymmetry as an $n$-ary Lie superalgebra ($n$ is the arity of the initial associative multiplication), we have found new brackets with a reduced arity of $2\leq m<n$ and a related series of $m$-ary superalgebras (which is impossible for binary superalgebras). In the case of even reduced arity $m$ we obtain a tower of higher order (as differential operators) even Hamiltonians, while for $m$ odd we get a tower of higher order odd supercharges, and the corresponding algebra consists of the odd sector only.


title: Fast and Scalable Multi-Kernel Encoder Classifier

abstract: This paper introduces a new kernel-based classifier by viewing kernel matrices as generalized graphs and leveraging recent progress in graph embedding techniques. The proposed method facilitates fast and scalable kernel matrix embedding, and seamlessly integrates multiple kernels to enhance the learning process. Our theoretical analysis offers a population-level characterization of this approach using random variables. Empirically, our method demonstrates superior running time compared to standard approaches such as support vector machines and two-layer neural network, while achieving comparable classification accuracy across various simulated and real datasets.


title: Age of Trust (AoT): A Continuous Verification Framework for Wireless Networks

abstract: Zero Trust is a new security vision for 6G networks that emphasises the philosophy of never trust and always verify. However, there is a fundamental trade-off between the wireless transmission efficiency and the trust level, which is reflected by the verification interval and its adaptation strategy. More importantly, the mathematical framework to characterise the trust level of the adaptive verification strategy is still missing. Inspired by this vision, we propose a concept called age of trust (AoT) to capture the characteristics of the trust level degrading over time, with the definition of the time elapsed since the last verification of the target user's trust plus the initial age, which depends on the trust level evaluated at that verification. The higher the trust level, the lower the initial age. To evaluate the trust level in the long term, the average AoT is used. We then investigate how to find a compromise between average AoT and wireless transmission efficiency with limited resources. In particular, we address the bi-objective optimization (BOO) problem between average AoT and throughput over a single link with arbitrary service process, where the identity of the receiver is constantly verified, and we devise a periodic verification scheme and a Q-learning-based scheme for constant process and random process, respectively. We also tackle the BOO problem in a multiple random access scenario, where a trust-enhanced frame-slotted ALOHA is designed. Finally, the numerical results show that our proposals can achieve a fair compromise between trust level and wireless transmission efficiency, and thus have a wide application prospect in various zero-trust architectures.


title: On the Recoverability of Causal Relations from Temporally Aggregated I.I.D. Data

abstract: We consider the effect of temporal aggregation on instantaneous (non-temporal) causal discovery in general setting. This is motivated by the observation that the true causal time lag is often considerably shorter than the observational interval. This discrepancy leads to high aggregation, causing time-delay causality to vanish and instantaneous dependence to manifest. Although we expect such instantaneous dependence has consistency with the true causal relation in certain sense to make the discovery results meaningful, it remains unclear what type of consistency we need and when will such consistency be satisfied. We proposed functional consistency and conditional independence consistency in formal way correspond functional causal model-based methods and conditional independence-based methods respectively and provide the conditions under which these consistencies will hold. We show theoretically and experimentally that causal discovery results may be seriously distorted by aggregation especially in complete nonlinear case and we also find causal relationship still recoverable from aggregated data if we have partial linearity or appropriate prior. Our findings suggest community should take a cautious and meticulous approach when interpreting causal discovery results from such data and show why and when aggregation will distort the performance of causal discovery methods.


title: Uniform Resolvent Estimates for Subwavelength Resonators: The Minnaert Bubble Case

abstract: Subwavelength resonators are small scaled objects that exhibit contrasting medium properties (eigher in intensity or sign) while compared to the ones of a uniform background. Such contrasts allow them to resonate at specific frequencies. There are two ways to mathematically define these resonances. First, as the frequencies for which the related system of integral equations is not injective. Second, as the frequencies for which the related resolvent operator of the natural Hamiltonian has a pole. In this work, we consider, as the subwavelength resonator, the Minneart bubble. We show that these two mentioned definitions are equivalent. Most importantly, 1. we derive the related resolvent estimates which are uniform in terms of the size/contrast of the resonators. As a by product, we show that the resolvent operators have no resonances in the upper half complex plane while they exhibit two resonances in the lower half plane which converge to the real axis, as the size of the bubble tends to zero. These resonances are related to the Minnaert frequency (which constitutes their dominating real part). 2. we derive the asymptotic estimates of the generated scattered fields which are uniform in terms of the incident frequency and which are valid everywhere in space (i.e. inside or outside the bubble). \end{enumerate} The dominating parts, for both the resolvent operator and the scattered fields, are given by the ones of the point-scatterer supported at the location of the bubble. In particular, these dominant parts are non trivial (not the same as those of the background medium) if and only if the used incident frequency identifies with the Minnaert one.


title: Optical polarimetry study of Lambda-Orionis star-forming region

abstract: We present an optical polarimetric study of a nearby star-forming region, Lambda-Orionis, to map plane-of-the-sky magnetic field geometry to understand the magnetized evolution of the HII region and associated small molecular clouds. We made multi-wavelength polarization observations of 34 bright stars distributed across the region. R-band polarization measurements focused on small molecular clouds BRC 17 and BRC 18 located at the periphery of the HII region are also presented. The magnetic field lines exhibit a large-scale ordered orientation consistent with the Planck sub-mm polarization measurements. The magnetic field lines in both the BRCs are found to be roughly in north-south directions; however, a larger dispersion is noticed in the orientation for BRC 17 compared to BRC 18. Using structure-function analysis, the strength of the plane-of-the-sky component of the magnetic field is estimated as $\sim$28 $\mu$G for BRC 17 and $\sim$40 $\mu$G for BRC 18. The average dust grain size and the mean value of the total-to-selective extinction ratio (R$_{V}$) in the HII region are found to be $\sim$0.51 $\pm$ 0.05 $\mu$m and $\sim$2.9 $\pm$ 0.3, respectively. The distance of the whole HII region is estimated as $\sim$392 $\pm$ 8 pc by combining astrometry information from GAIA EDR3 for YSOs associated with BRCs and confirmed members of central cluster Collinder 69.


title: A simple characterization of Quillen adjunctions

abstract: We observe that an enriched right adjoint functor between model categories which preserves acyclic fibrations and fibrant objects is quite generically a right Quillen functor.


title: Electromechanical response of saddle points in twisted hBN moir\'e superlattices

abstract: In twisted layered materials (t-LMs), an inter-layer rotation can break inversion symmetry and create an interfacial array of staggered out-of-plane polarization due to AB/BA stacking registries. This symmetry breaking can also trigger the formation of edge in-plane polarizations localized along the perimeter of AB/BA regions (i.e., saddle point domains). However, a comprehensive experimental investigation of these features is still lacking. Here, we use piezo force microscopy to probe the electromechanical behavior of twisted hexagonal boron nitride (t-hBN). For a parallel stacking alignment of t-hBN, we reveal very narrow (width ~ 20 nm) saddle point polarizations, which we also measure in the anti-parallel configuration. These localized polarizations can still be found on a multiply-stacked t-hBN structure, determining the formation of a double moir\'e. We also visualize a t-hBN moir\'e superlattice in the topography maps with atomic force microscopy, related to the strain accumulated at the saddle point domains. Our findings imply that polarizations in t-hBN do not only point in the out-of-plane direction, but also show an in-plane component, giving rise to a much more complex 3D polarization field.


title: Local versus global environment: the suppression of star formation in the vicinity of galaxy clusters

abstract: In order to examine where, how and why the quenching of star formation begins in the outskirts of galaxy clusters, we investigate the de-projected radial distribution of a large sample of quenched and star-forming galaxies (SFGs) out to $30R_{500}$ around clusters. We identify the SFG sample using radio continuum emission from the Low-Frequency Array Two-metre Sky Survey. We find that the SFG fraction starts to decrease from the field fraction as far out as $10R_{500}$, well outside the virial radius of the clusters. We investigate how the SFG fraction depends on both large-scale and local environments, using radial distance from a cluster to characterise the former, and distance from 5th nearest neighbour for the latter. The fraction of SFGs in high-density local environments is consistently lower than that found in low-density local environments, indicating that galaxies' immediate surroundings have a significant impact on star formation. However, for high-mass galaxies -- and low mass galaxies to a lesser extent -- high-density local environments appear to act as a protective barrier for those SFGs that survived this pre-processing, shielding them from the external quenching mechanisms of the cluster outskirts. For those galaxies that are not in a dense local environment, the global environment causes the fraction of SFGs to decrease toward the cluster centre in a manner that is independent of galaxy mass. Thus, the fraction of SFGs depends on quite a complex interplay between the galaxies' mass, their local environment, and their more global cluster-centric distance.


title: A Pipelined Memristive Neural Network Analog-to-Digital Converter

abstract: With the advent of high-speed, high-precision, and low-power mixed-signal systems, there is an ever-growing demand for accurate, fast, and energy-efficient analog-to-digital (ADCs) and digital-to-analog converters (DACs). Unfortunately, with the downscaling of CMOS technology, modern ADCs trade off speed, power and accuracy. Recently, memristive neuromorphic architectures of four-bit ADC/DAC have been proposed. Such converters can be trained in real-time using machine learning algorithms, to break through the speedpower-accuracy trade-off while optimizing the conversion performance for different applications. However, scaling such architectures above four bits is challenging. This paper proposes a scalable and modular neural network ADC architecture based on a pipeline of four-bit converters, preserving their inherent advantages in application reconfiguration, mismatch selfcalibration, noise tolerance, and power optimization, while approaching higher resolution and throughput in penalty of latency. SPICE evaluation shows that an 8-bit pipelined ADC achieves 0.18 LSB INL, 0.20 LSB DNL, 7.6 ENOB, and 0.97 fJ/conv FOM. This work presents a significant step towards the realization of large-scale neuromorphic data converters.


title: Nonlinear Model Predictive Control for Enhanced Path Tracking and Autonomous Drifting through Direct Yaw Moment Control and Rear-Wheel-Steering

abstract: Path tracking (PT) controllers capable of replicating race driving techniques, such as drifting beyond the limits of handling, have the potential of enhancing active safety in critical conditions. This paper presents a nonlinear model predictive control (NMPC) approach that integrates multiple actuation methods, namely four-wheel-steering, longitudinal tyre force distribution, and direct yaw moment control, to execute drifting when this is beneficial for PT in emergency scenarios. Simulation results of challenging manoeuvres, based on an experimentally validated vehicle model, highlight the substantial PT performance improvements brought by: i) vehicle operation outside the envelope enforced by the current generation of stability controllers; and ii) the integrated control of multiple actuators.


title: Communication Complexity of Graph Isomorphism, Coloring, and Distance Games

abstract: In quantum information, nonlocal games are particularly useful for differentiating classical, quantum, and non-signalling correlations. An example of differentiation is given by the principle of no-collapse of communication complexity, which is often interpreted as necessary for a feasible physical theory. It is satisfied by quantum correlations but violated by some non-signalling ones. In this work, we investigate this principle in the context of three nonlocal games related to graph theory, starting from the well-known graph isomorphism and graph coloring games, and introducing a new game, the vertex distance game, with a parameter $D\in\mathbb N$, that generalizes the former two to some extent. For these three games, we prove that perfect non-signalling strategies collapse communication complexity under favorable conditions. We also define a refinement of fractional isomorphism of graphs, namely D-fractional isomorphisms, and we show that this characterizes perfect non-signalling strategies for the vertex distance game. Surprisingly, we observe that non-signalling strategies provide a finer distinction for the new game compared to classical and quantum strategies since the parameter D is visible only in the non-signalling setting.


title: Dynamics and non-integrability of the double spring pendulum

abstract: This paper investigates the dynamics and integrability of the double spring pendulum, which has great importance in studying nonlinear dynamics, chaos, and bifurcations. Being a Hamiltonian system with three degrees of freedom, its analysis presents a significant challenge. To gain insight into the system's dynamics, we employ various numerical methods, including Lyapunov exponents spectra, phase-parametric diagrams, and Poincar\'e cross-sections. The novelty of our work lies in the integration of these three numerical methods into one powerful tool. We provide a comprehensive understanding of the system's dynamics by identifying parameter values or initial conditions that lead to hyper-chaotic, chaotic, quasi-periodic, and periodic motion, which is a novel contribution in the context of Hamiltonian systems. In the absence of gravitational potential, the system exhibits $S^1$ symmetry, and the presence of an additional first integral was identified using Lyapunov exponents diagrams. We demonstrate the effective utilisation of Lyapunov exponents as a potential indicator of first integrals and integrable dynamics. The numerical analysis is complemented by an analytical proof regarding the non-integrability of the system. This proof relies on the analysis of properties of the differential Galois group of variational equations along specific solutions of the system. To facilitate this analysis, we utilised a newly developed extension of the Kovacic algorithm specifically designed for fourth-order differential equations. Overall, our study sheds light on the intricate dynamics and integrability of the double spring pendulum, offering new insights and methodologies for further research in this field.


title: Porting the grid-based 3D+3V hybrid-Vlasov kinetic plasma simulation Vlasiator to heterogeneous GPU architectures

abstract: Vlasiator is a space plasma simulation code which models near-Earth ion-kinetic dynamics in three spatial and three velocity dimensions. It is highly parallelized, modeling the Vlasov equation directly through the distribution function, discretized on a Cartesian grid, instead of the more common particle-in-cell approach. Modeling near-Earth space, plasma properties span several orders of magnitude in temperature, density, and magnetic field strength. In order to fit the required six-dimensional grids in memory, Vlasiator utilizes a sparse block-based velocity mesh, where chunks of velocity space are added or deleted based on the advection requirements of the Vlasov solver. In addition, the spatial mesh is adaptively refined through cell-based octree refinement. In this paper, we describe the design choices of porting Vlasiator to heterogeneous CPU/GPU architectures. We detail the memory management, algorithmic changes, and kernel construction as well as our unified codebase approach, resulting in portability to both NVIDIA and AMD hardware (CUDA and HIP languages, respectively). In particular, we showcase a highly parallel block adjustment approach allowing efficient re-ordering of a sparse velocity mesh. We detail pitfalls we have overcome and lay out a plan for optimization to facilitate future exascale simulations using multi-node GPU supercomputing.


title: Can CLIP help CLIP in learning 3D?

abstract: In this study, we explore an alternative approach to enhance contrastive text-image-3D alignment in the absence of textual descriptions for 3D objects. We introduce two unsupervised methods, $I2I$ and $(I2L)^2$, which leverage CLIP knowledge about textual and 2D data to compute the neural perceived similarity between two 3D samples. We employ the proposed methods to mine 3D hard negatives, establishing a multimodal contrastive pipeline with hard negative weighting via a custom loss function. We train on different configurations of the proposed hard negative mining approach, and we evaluate the accuracy of our models in 3D classification and on the cross-modal retrieval benchmark, testing image-to-shape and shape-to-image retrieval. Results demonstrate that our approach, even without explicit text alignment, achieves comparable or superior performance on zero-shot and standard 3D classification, while significantly improving both image-to-shape and shape-to-image retrieval compared to previous methods.


title: Minimum-norm solutions of the non-symmetric semidefinite Procrustes problem

abstract: Given two matrices $X,B\in \mathbb{R}^{n\times m}$ and a set $\mathcal{A}\subseteq \mathbb{R}^{n\times n}$, a Procrustes problem consists in finding a matrix $A \in \mathcal{A}$ such that the Frobenius norm of $AX-B$ is minimized. When $\mathcal{A}$ is the set of the matrices whose symmetric part is positive semidefinite, we obtain the so-called non-symmetric positive semidefinite Procrustes (NSPDSP) problem. The NSPDSP problem arises in the estimation of compliance or stiffness matrix in solid and elastic structures. If $X$ has rank $r$, Baghel et al. (Lin. Alg. Appl., 2022) proposed a three-step semi-analytical approach: (1) construct a reduced NSPDSP problem in dimension $r\times r$, (2) solve the reduced problem by means of a fast gradient method with a linear rate of convergence, and (3) post-process the solution of the reduced problem to construct a solution of the larger original NSPDSP problem. In this paper, we revisit this approach of Baghel et al. and identify an unnecessary assumption used by the authors leading to cases where their algorithm cannot attain a minimum and produces solutions with unbounded norm. In fact, revising the post-processing phase of their semi-analytical approach, we show that the infimum of the NSPDSP problem is always attained, and we show how to compute a minimum-norm solution. We also prove that the symmetric part of the computed solution has minimum rank bounded by $r$, and that the skew-symmetric part has rank bounded by $2r$. Several numerical examples show the efficiency of this algorithm, both in terms of computational speed and of finding optimal minimum-norm solutions.


title: The Deep Latent Space Particle Filter for Real-Time Data Assimilation with Uncertainty Quantification

abstract: In Data Assimilation, observations are fused with simulations to obtain an accurate estimate of the state and parameters for a given physical system. Combining data with a model, however, while accurately estimating uncertainty, is computationally expensive and infeasible to run in real-time for complex systems. Here, we present a novel particle filter methodology, the Deep Latent Space Particle filter or D-LSPF, that uses neural network-based surrogate models to overcome this computational challenge. The D-LSPF enables filtering in the low-dimensional latent space obtained using Wasserstein AEs with modified vision transformer layers for dimensionality reduction and transformers for parameterized latent space time stepping. As we demonstrate on three test cases, including leak localization in multi-phase pipe flow and seabed identification for fully nonlinear water waves, the D-LSPF runs orders of magnitude faster than a high-fidelity particle filter and 3-5 times faster than alternative methods while being up to an order of magnitude more accurate. The D-LSPF thus enables real-time data assimilation with uncertainty quantification for physical systems.


title: Query-Enhanced Adaptive Semantic Path Reasoning for Inductive Knowledge Graph Completion

abstract: Conventional Knowledge graph completion (KGC) methods aim to infer missing information in incomplete Knowledge Graphs (KGs) by leveraging existing information, which struggle to perform effectively in scenarios involving emerging entities. Inductive KGC methods can handle the emerging entities and relations in KGs, offering greater dynamic adaptability. While existing inductive KGC methods have achieved some success, they also face challenges, such as susceptibility to noisy structural information during reasoning and difficulty in capturing long-range dependencies in reasoning paths. To address these challenges, this paper proposes the Query-Enhanced Adaptive Semantic Path Reasoning (QASPR) framework, which simultaneously captures both the structural and semantic information of KGs to enhance the inductive KGC task. Specifically, the proposed QASPR employs a query-dependent masking module to adaptively mask noisy structural information while retaining important information closely related to the targets. Additionally, QASPR introduces a global semantic scoring module that evaluates both the individual contributions and the collective impact of nodes along the reasoning path within KGs. The experimental results demonstrate that QASPR achieves state-of-the-art performance.


title: Nonlinear Model Predictive Control for Preview-Based Traction Control

abstract: This study presents a nonlinear model predictive control (NMPC) formulation for preview-based traction control, which uses the information on the expected tire-road friction coefficient ahead to enhance the wheel slip control performance, in the context of connected vehicles with V2X features. Proof-of-concept experiments on an electric vehicle prototype highlight the real-time capability of the controller, and the wheel slip control performance improvement brought by the tire-road friction coefficient preview. Finally, an experimentally validated simulation model is used in sensitivity analyses, to evaluate the performance benefit of the preview-based controller for different dynamic characteristics (e.g., time constant and pure time delays) of the electric powertrains.


title: Diffusion Distribution Model for Damage Mitigation in Scanning Transmission Electron Microscopy

abstract: Despite the widespread use of Scanning Transmission Electron Microscopy (STEM) for observing the structure of materials at the atomic scale, a detailed understanding of some relevant electron beam damage mechanisms is limited. Recent reports suggest that certain types of damage can be modeled as a diffusion process and that the accumulation effects of this process must be kept low in order to reduce damage. We therefore develop an explicit mathematical formulation of spatiotemporal diffusion processes in STEM that take into account both instrument and sample parameters. Furthermore, our framework can aid the design of Diffusion Controlled Sampling (DCS) strategies using optimally selected probe positions in STEM, that constrain the cumulative diffusion distribution. Numerical simulations highlight the variability of the cumulative diffusion distribution for different experimental STEM configurations. These analytical and numerical frameworks can subsequently be used for careful design of 2- and 4-dimensional STEM experiments where beam damage is minimised.


title: Why Only Text: Empowering Vision-and-Language Navigation with Multi-modal Prompts

abstract: Current Vision-and-Language Navigation (VLN) tasks mainly employ textual instructions to guide agents. However, being inherently abstract, the same textual instruction can be associated with different visual signals, causing severe ambiguity and limiting the transfer of prior knowledge in the vision domain from the user to the agent. To fill this gap, we propose Vision-and-Language Navigation with Multi-modal Prompts (VLN-MP), a novel task augmenting traditional VLN by integrating both natural language and images in instructions. VLN-MP not only maintains backward compatibility by effectively handling text-only prompts but also consistently shows advantages with different quantities and relevance of visual prompts. Possible forms of visual prompts include both exact and similar object images, providing adaptability and versatility in diverse navigation scenarios. To evaluate VLN-MP under a unified framework, we implement a new benchmark that offers: (1) a training-free pipeline to transform textual instructions into multi-modal forms with landmark images; (2) diverse datasets with multi-modal instructions for different downstream tasks; (3) a novel module designed to process various image prompts for seamless integration with state-of-the-art VLN models. Extensive experiments on four VLN benchmarks (R2R, RxR, REVERIE, CVDN) show that incorporating visual prompts significantly boosts navigation performance. While maintaining efficiency with text-only prompts, VLN-MP enables agents to navigate in the pre-explore setting and outperform text-based models, showing its broader applicability.


title: Automatic nonstationary anisotropic Tikhonov regularization through bilevel optimization

abstract: Regularization techniques are necessary to compute meaningful solutions to discrete ill-posed inverse problems. The well-known 2-norm Tikhonov regularization method equipped with a discretization of the gradient operator as regularization operator penalizes large gradient components of the solution to overcome instabilities. However, this method is homogeneous, i.e., it does not take into account the orientation of the regularized solution and therefore tends to smooth the desired structures, textures and discontinuities, which often contain important information. If the local orientation field of the solution is known, a possible way to overcome this issue is to implement local anisotropic regularization by penalizing weighted directional derivatives. In this paper, considering problems that are inherently two-dimensional, we propose to automatically and simultaneously recover the regularized solution and the local orientation parameters (used to define the anisotropic regularization term) by solving a bilevel optimization problem. Specifically, the lower level problem is Tikhonov regularization equipped with local anisotropic regularization, while the objective function of the upper level problem encodes some natural assumptions about the local orientation parameters and the Tikhonov regularization parameter. Application of the proposed algorithm to a variety of inverse problems in imaging (such as denoising, deblurring, tomography and Dix inversion), with both real and synthetic data, shows its effectiveness and robustness.


title: An Open and Reconfigurable User Interface to Manage Complex ROS-based Robotic Systems

abstract: The Robot Operating System (ROS) has significantly gained popularity among robotic engineers and researchers over the past five years, primarily due to its powerful infrastructure for node communication, which enables developers to build modular and large robotic applications. However, ROS presents a steep learning curve and lacks the intuitive usability of vendor-specific robotic Graphical User Interfaces (GUIs). Moreover, its modular and distributed nature complicates the control and monitoring of extensive systems, even for advanced users. To address these challenges, this paper proposes a highly adaptable and reconfigurable web-based GUI for intuitively controlling, monitoring, and configuring complex ROS-based robotic systems. The GUI leverages ROSBridge and roslibjs to ensure seamless communication with ROS systems via topics and services. Designed as a versatile platform, the GUI allows for the selective incorporation of modular features to accommodate diverse robotic systems and applications. An initial set of commonly used features in robotic applications is presented. To demonstrate its reconfigurability, the GUI was customized and tested for four industrial use cases, receiving positive feedback. The project's repository has been made publicly available to support the robotics community and lower the entry barrier for ROS in industrial applications.


title: Novel pre-emptive control solutions for V2X connected electric vehicles

abstract: V2X technologies will become widespread in the next generation of passenger cars, and enable the development of novel vehicle control functionalities. Although a wide literature describes the energy efficiency benefits of V2X connectivity, e.g., in terms of vehicle speed profiling and platooning, there is a gap in the analysis of the potential of vehicle connectivity in enhancing the performance of active safety control systems. To highlight the impact vehicle connectivity could have on future active safety systems, this paper presents two novel control functions for connected vehicles, benefitting from the precise knowledge of the expected path and tire-road friction conditions ahead, as well as the current position of the ego vehicle. These functions, developed within recent and ongoing European projects, are: i) pre-emptive traction control; and ii) pre-emptive braking control.


title: Generative Pre-Trained Diffusion Paradigm for Zero-Shot Time Series Forecasting

abstract: In recent years, generative pre-trained paradigms such as Large Language Models (LLMs) and Large Vision Models (LVMs) have achieved revolutionary advancements and widespread real-world applications. Particularly, the emergence of pre-trained LLMs-based temporal works, compared to previous deep model approaches, has demonstrated superior generalization and robustness, showcasing the potential of generative pre-trained paradigms as foundation models for time series. However, those LLMs-based works mainly focus on cross-modal research, i.e., leveraging the language capabilities of LLMs in time series contexts. Although they have achieved impressive performance, there still exist the issues of concept drift caused by differences in data distribution and inflexibility caused by misalignment of dimensions. To this end, inspired by recent work on LVMs, we reconsider the paradigm of time series modeling. In this paper, we comprehensively explore, for the first time, the effectiveness and superiority of the Generative Pre-trained Diffusion (GPD) paradigm in real-world multivariate time series forecasting (TSF). Specifically, to mitigate performance bias introduced by sophisticated networks, we propose a straightforward MLP diffusion network for unconditional modeling of time series. Then we employ a zero-shot and tuning-free method to predict (generate) future data using historical data as prompts. The GPD paradigm is established on the time series modality, effectively preventing the phenomenon of concept drift, and enabling flexible forecasting of arbitrary lengths. We demonstrate that the GPD paradigm achieves comprehensive performance and generalization comparable to current SOTA LLM-based and deep model paradigms on mainstream benchmarks and various TSF tasks. Extensive experiments validate the potential of the GPD paradigm and its assistance in future related research.


title: Rectifying Reinforcement Learning for Reward Matching

abstract: The Generative Flow Network (GFlowNet) is a probabilistic framework in which an agent learns a stochastic policy and flow functions to sample objects with probability proportional to an unnormalized reward function. GFlowNets share a strong resemblance to reinforcement learning (RL), that typically aims to maximize reward, due to their sequential decision-making processes. Recent works have studied connections between GFlowNets and maximum entropy (MaxEnt) RL, which modifies the standard objective of RL agents by learning an entropy-regularized objective. However, a critical theoretical gap persists: despite the apparent similarities in their sequential decision-making nature, a direct link between GFlowNets and standard RL has yet to be discovered, while bridging this gap could further unlock the potential of both fields. In this paper, we establish a new connection between GFlowNets and policy evaluation for a uniform policy. Surprisingly, we find that the resulting value function for the uniform policy has a close relationship to the flows in GFlowNets. Leveraging these insights, we further propose a novel rectified policy evaluation (RPE) algorithm, which achieves the same reward-matching effect as GFlowNets, offering a new perspective. We compare RPE, MaxEnt RL, and GFlowNets in a number of benchmarks, and show that RPE achieves competitive results compared to previous approaches. This work sheds light on the previously unexplored connection between (non-MaxEnt) RL and GFlowNets, potentially opening new avenues for future research in both fields.


title: SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining

abstract: Large language models (LLMs) have shown impressive capabilities across various tasks. However, training LLMs from scratch requires significant computational power and extensive memory capacity. Recent studies have explored low-rank structures on weights for efficient fine-tuning in terms of parameters and memory, either through low-rank adaptation or factorization. While effective for fine-tuning, low-rank structures are generally less suitable for pretraining because they restrict parameters to a low-dimensional subspace. In this work, we propose to parameterize the weights as a sum of low-rank and sparse matrices for pretraining, which we call SLTrain. The low-rank component is learned via matrix factorization, while for the sparse component, we employ a simple strategy of uniformly selecting the sparsity support at random and learning only the non-zero entries with the fixed support. While being simple, the random fixed-support sparse learning strategy significantly enhances pretraining when combined with low-rank learning. Our results show that SLTrain adds minimal extra parameters and memory costs compared to pretraining with low-rank parameterization, yet achieves substantially better performance, which is comparable to full-rank training. Remarkably, when combined with quantization and per-layer updates, SLTrain can reduce memory requirements by up to 73% when pretraining the LLaMA 7B model.


title: Observation of HI around three satellite galaxies of the M31 with the FAST: Andromeda II, NGC 205, and NGC 185

abstract: With the exceptional sensitivity of the Five-hundred-meter Aperture Spherical radio Telescope (FAST), we conducted observations of the neutral hydrogen (HI) in the Circular Galactical Medium (CGM) of Andromeda's (M31) satellite galaxies, specifically Andromeda II, NGC 205, and NGC 185. Initially, three drift scans were executed for these satellites, with a detection limit of $4\times10^{18}$ cm$^{-2}$ ( approximately $1.88\times10^3 M_{\odot}$ of HI mass), followed by a more in-depth scan of a specific region. We discovered a C-shaped HI arc structure sharing a position and line-of-sight velocity similar to a stellar ring structure around Andromeda II, hinting at a potential connection with Andromeda II. In the context of NGC 205, we identified two mass concentrations in the northeast direction, which could be indicative of tidal streams resulting from the interaction between this galaxy and M31. These new lumps discovered could be very helpful in solving the missing interstellar medium (ISM) problem for NGC 205. Observations regarding NGC 185 are consistent with previous studies, and we did not detect any additional HI material around this galaxy. These observational results enhance our understanding of the evolution of these satellite galaxies and provide insight into their historical interactions with the M31 galaxy.


title: NordIQuEst: the Nordic-Estonian Quantum Computing e-Infrastructure Quest

abstract: This paper presents the Nordic-Estonian Quantum Computing e-Infrastructure Quest - NordIQuEst - an international collaboration of scientific and academic organizations from Denmark, Estonia, Finland, Norway, and Sweden, working together to develop a hybrid High-Performance and Quantum Computing (HPC+QC) infrastructure. The project leverages existing and upcoming classical high-performance computing and quantum computing systems, facilitating the development of interconnected systems. Our effort pioneers a forward-looking architecture for both hardware and software capabilities, representing an early-stage development in hybrid computing infrastructure. Here, we detail the outline of the initiative, summarizing the progress since the project outset, and describing the framework established. Moreover, we identify the crucial challenges encountered, and potential strategies employed to address them.


title: Enhancing the sensitivity of quantum fiber-optical gyroscopes via a non-Gaussian-state probe

abstract: We propose a theoretical scheme to enhance the sensitivity of a quantum fiber-optical gyroscope (QFOG) via a non-Gaussian-state probe based on quadrature measurements of the optical field. The non-Gaussian-state probe utilizes the product state comprising a photon-added coherent state (PACS) with photon excitations and a coherent state CS. We study the sensitivity of the QFOG, and find that it can be significantly enhanced through increasing the photon excitations in the PACS probe. We investigate the influence of photon loss on the performance of QFOG and demonstrate that the PACS probe exhibits robust resistance to photon loss. Furthermore, we compare the performance of the QFOG using the PACS probe against two Gaussian-state probes: the CS probe and the squeezed state (SS) probe and indicate that the PACS probe offers a significant advantage in terms of sensitivity, regardless of photon loss, under the constraint condition of the same total number of input photons. Particularly, it is found that the sensitivity of the PACS probe can be three orders of magnitude higher than that of two Gaussian-state probes for certain values of the measured parameter. The capabilities of the non-Gaussian state probe on enhancing the sensitivity and resisting photon loss could have a wide-ranging impact on future high-performance QFOGs.


title: Projection scheme for a perfect plasticity model with a time-dependent constraint set

abstract: This paper introduces a new numerical scheme for a system that includes evolution equations describing a perfect plasticity model with a time-dependent yield surface. We demonstrate that the solution to the proposed scheme is stable under suitable norms. Moreover, the stability leads to the existence of an exact solution, and we also prove that the solution to the proposed scheme converges strongly to the exact solution under suitable norms.


title: The Qudit ZH Calculus for Arbitrary Finite Fields: Universality and Application

abstract: We propose a generalization of the graphical ZH calculus to qudits of prime-power dimensions $q = p^t$, implementing field arithmetic in arbitrary finite fields. This is an extension of a previous result by Roy which implemented arithmetic of prime-sized fields; and an alternative to a result by de Beaudrap which extended the ZH to implement cyclic ring arithmetic in $\mathbb Z / q\mathbb Z$ rather than field arithmetic in $\mathbb F_q$. We show this generalized ZH calculus to be universal over matrices $\mathbb C^{q^n} \to \mathbb C^{q^m}$ with entries in the ring $\mathbb Z[\omega]$ where $\omega$ is a $p$th root of unity. As an illustration of the necessity of such an extension of ZH for field rather than cyclic ring arithmetic, we offer a graphical description and proof for a quantum algorithm for polynomial interpolation. This algorithm relies on the invertibility of multiplication, and therefore can only be described in a graphical language that implements field, rather than ring, multiplication.


title: Stochastic Thermodynamics of Micromagnetics with Spin Torque

abstract: In this work, we study the stochastic dynamics of micro-magnetics interacting with a spin-current torque. We extend the previously constructed stochastic Landau-Lifshitz equation to the case with spin-current torque, and verify the conditions of detailed balance. Then we construct various thermodynamics quantities such as work and heat, and prove the second law of thermodynamics. Due to the existence of spin-torque and the asymmetry of the kinetic matrix, a novel effect of entropy pumping shows up. As a consequence, the system may behave as a heat engine which constantly transforms heat into magnetic work. Finally, we derive a fluctuation theorem for the joint probability density function of the pumped entropy and the total work, and verify it using numerical simulations.


title: A general design method for ultra-long optical path length multipass matrix cells

abstract: For the first time, we propose a general design method for ultra-long optical path length (OPL) multipass matrix cells (MMCs) based on multi-cycle mode of two-sided field mirrors. The design idea of the dual circulation mode with two-sided field mirrors is elaborated in detail with the example of MMC based on dual Pickett Bradley White cell (PBWC), and the simple design methods of the other three MMCs based on the dual circulation mode of PBWC and Bernstein Herzberg White cell (BHWC) are given. Further, we propose a general design method for ultra-long OPL MMCs with multi-cycle mode by adding cyclic elements. The OPL of the MMCs designed by this method can reach the order of kilometers or even tens of kilometers. The novel MMCs have the advantages of simple structure, strong spot formation regularity, easy expansion, high mirror utilization ratio, high reuse times of spot spatial position, good stability and extremely high ratio of the optical path length to the volume (RLV). In order to evaluate the performance of the new MMCs, an open-path methane gas sensor with the MMC based on triple PBWC was constructed, which was used to continuously measure the methane in the laboratory, and the feasibility, effectiveness and practicability of the new design method were verified. The design method proposed in this paper provides a new idea for the design of multipass cell (MPC), and the new MMCs designed have great potential application value in the field of high-precision trace gas monitoring.


title: Towards an Extensible Model-Based Digital Twin Framework for Space Launch Vehicles

abstract: The concept of Digital Twin (DT) is increasingly applied to systems on different levels of abstraction across domains, to support monitoring, analysis, diagnosis, decision making and automated control. Whilst the interest in applying DT is growing, the definition of DT is unclear, neither is there a clear pathway to develop DT to fully realise its capacities. In this paper, we revise the concept of DT and its categorisation. We propose a DT maturity matrix, based on which we propose a model-based DT development methodology. We also discuss how model-based tools can be used to support the methodology and present our own supporting tool. We report our preliminary findings with a discussion on a case study, in which we use our proposed methodology and our supporting tool to develop an extensible DT platform for the assurance of Electrical and Electronics systems of space launch vehicles.


title: SMCL: Saliency Masked Contrastive Learning for Long-tailed Recognition

abstract: Real-world data often follow a long-tailed distribution with a high imbalance in the number of samples between classes. The problem with training from imbalanced data is that some background features, common to all classes, can be unobserved in classes with scarce samples. As a result, this background correlates to biased predictions into ``major" classes. In this paper, we propose saliency masked contrastive learning, a new method that uses saliency masking and contrastive learning to mitigate the problem and improve the generalizability of a model. Our key idea is to mask the important part of an image using saliency detection and use contrastive learning to move the masked image towards minor classes in the feature space, so that background features present in the masked image are no longer correlated with the original class. Experiment results show that our method achieves state-of-the-art level performance on benchmark long-tailed datasets.


title: FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models

abstract: Recent research in federated large language models (LLMs) has primarily focused on enabling clients to fine-tune their locally deployed homogeneous LLMs collaboratively or on transferring knowledge from server-based LLMs to small language models (SLMs) at downstream clients. However, a significant gap remains in the simultaneous mutual enhancement of both the server's LLM and clients' SLMs. To bridge this gap, we propose FedMKT, a parameter-efficient federated mutual knowledge transfer framework for large and small language models. This framework is designed to adaptively transfer knowledge from the server's LLM to clients' SLMs while concurrently enriching the LLM with clients' unique domain insights. We facilitate token alignment using minimum edit distance (MinED) and then selective mutual knowledge transfer between client-side SLMs and a server-side LLM, aiming to collectively enhance their performance. Through extensive experiments across three distinct scenarios, we evaluate the effectiveness of FedMKT using various public LLMs and SLMs on a range of NLP text generation tasks. Empirical results demonstrate that FedMKT simultaneously boosts the performance of both LLMs and SLMs.


title: Riemannian coordinate descent algorithms on matrix manifolds

abstract: Many machine learning applications are naturally formulated as optimization problems on Riemannian manifolds. The main idea behind Riemannian optimization is to maintain the feasibility of the variables while moving along a descent direction on the manifold. This results in updating all the variables at every iteration. In this work, we provide a general framework for developing computationally efficient coordinate descent (CD) algorithms on matrix manifolds that allows updating only a few variables at every iteration while adhering to the manifold constraint. In particular, we propose CD algorithms for various manifolds such as Stiefel, Grassmann, (generalized) hyperbolic, symplectic, and symmetric positive (semi)definite. While the cost per iteration of the proposed CD algorithms is low, we further develop a more efficient variant via a first-order approximation of the objective function. We analyze their convergence and complexity, and empirically illustrate their efficacy in several applications.


title: Stability for a family of planar systems with nilpotent critical points

abstract: Consider a family of planar polynomial systems $\dot x = y^{2l-1} - x^{2k+1}, \dot y =-x +m y^{2s+1},$ where $l,k,s\in\mathbb{N^*},$ $2\le l \le 2s$ and $m\in\mathbb{R}.$ We study the center-focus problem on its origin which is a monodromic nilpotent critical point. By directly calculating the generalized Lyapunov constants, we find that the origin is always a focus and we complete the classification of its stability. This includes the most difficult case: $s=kl$ and $m=(2k+1)!!/(2kl+1)!_{(2l)}.$ In this case, we prove that the origin is always unstable. Our result extends and completes a previous one.


title: Extracting the partonic structure of colorless exchanges at the Electron Ion Collider

abstract: We investigate the determination of the partonic structure of colorless exchanges in deep inelastic diffractive $ep$ scattering at the Electron Ion Collider, using the standard decomposition into Pomeron and Reggeon contributions. We perform fits to simulated diffractive cross section pseudodata in four variables, including the momentum transfer $t$, to estimate the achievable precision on the Pomeron and Reggeon quark and gluon distributions. We analyze the influence of different cuts in the kinematic variables, beam energy configurations and luminosities, including a `first year' scenario. We conclude that the EIC will be able to constrain the partonic structure of the sub-leading Reggeon exchange with a precision comparable to that of the leading Pomeron exchange.


title: Constrained cosmological simulations of the Local Group using Bayesian hierarchical field-level inference

abstract: We present a novel approach based on Bayesian field-level inference capable of resolving individual galaxies within the Local Group (LG), enabling detailed studies of its structure and formation via posterior simulations. We extend the Bayesian Origin Reconstruction from Galaxies (BORG) algorithm with a multi-resolution approach, allowing us to reach smaller mass scales and apply observational constraints based on LG galaxies. Our updated data model simultaneously accounts for observations of mass tracers within the dark haloes of the Milky Way (MW) and M31, their observed separation and relative velocity, and the quiet surrounding Hubble flow represented through the positions and velocities of galaxies at distances from one to four Mpc. Our approach delivers representative posterior samples of $\Lambda$CDM realisations that are statistically and simultaneously consistent with all these observations, leading to significantly tighter mass constraints than found if the individual datasets are considered separately. In particular, we estimate the virial masses of the MW and M31 to be $\log_{10}(M_{200c}/M_\odot) = 12.07\pm0.08$ and $12.33\pm0.10$, respectively, their sum to be $\log_{10}(\Sigma M_{200c}/M_\odot)= 12.52\pm0.07$, and the enclosed mass within spheres of radius $R$ to be $\log_{10}(M(R)/M_\odot)= 12.71\pm0.06$ and $12.96\pm0.08$ for $R=1$ Mpc and 3 Mpc, respectively. The M31-MW orbit is nearly radial for most of our $\Lambda$CDM LG's, and most lie in a dark matter sheet that aligns approximately with the Supergalactic Plane, even though the surrounding density field was not used explicitly as a constraint. The approximate simulations employed in our inference are accurately reproduced by high-fidelity structure formation simulations, demonstrating the potential for future high-resolution, full-physics $\Lambda$CDM posterior simulations of LG look-alikes.


title: Hybrid Quantum-Classical Neural Network for LAB Color Space Image Classification

abstract: Parameterized quantum circuits (PQCs) are essential in many variational quantum algorithms. Quantum convolutional neural networks (QCNNs), which are structurally similar to classical convolutional neural networks, possess the capability to extract informative features and have shown significant effectiveness in image classification tasks. To achieve higher image classification accuracy and reduce the number of training parameters, modifications to the structure of PQCs or hybrid quantum-classical convolutional neural network (HQCCNN) models are typically employed. The image datasets used in these learning models are usually RGB images. We investigate the effects of different color spaces to explore the potential for reducing the resources required for quantum computation. By utilizing a simple HQCCNN model with existing PQCs, we analyze the performance of each channel in various color space images. Experimental results reveal that two channels consistently exhibit higher classification accuracy in images from different color spaces than the third. Specifically, the L channel of LAB color space images achieves superior classification accuracy when employing a more complex PQC. Additionally, PQCs utilizing controlled rotation X-gates outperform those using controlled selection Z-gates in this classification task.


title: I4VGen: Image as Stepping Stone for Text-to-Video Generation

abstract: Text-to-video generation has lagged behind text-to-image synthesis in quality and diversity due to the complexity of spatio-temporal modeling and limited video-text datasets. This paper presents I4VGen, a training-free and plug-and-play video diffusion inference framework, which enhances text-to-video generation by leveraging robust image techniques. Specifically, following text-to-image-to-video, I4VGen decomposes the text-to-video generation into two stages: anchor image synthesis and anchor image-guided video synthesis. Correspondingly, a well-designed generation-selection pipeline is employed to achieve visually-realistic and semantically-faithful anchor image, and an innovative Noise-Invariant Video Score Distillation Sampling is incorporated to animate the image to a dynamic video, followed by a video regeneration process to refine the video. This inference strategy effectively mitigates the prevalent issue of non-zero terminal signal-to-noise ratio. Extensive evaluations show that I4VGen not only produces videos with higher visual realism and textual fidelity but also integrates seamlessly into existing image-to-video diffusion models, thereby improving overall video quality.


title: Longitudinal Filtering, Sponge Layers, and Equatorial Jet Formation in a General Circulation Model of Gaseous Exoplanets

abstract: General circulation models are a useful tool in understanding the three dimensional structure of hot Jupiter and sub-Neptune atmospheres; however, understanding the validity of the results from these simulations requires an understanding the artificial dissipation required for numerical stability. In this paper, we investigate the impact of the longitudinal filter and vertical ``sponge'' used in the Met Office's {\sc Unified Model} when simulating gaseous exoplanets. We demonstrate that excessive dissipation can result in counter-rotating jets and a catastrophic failure to conserve angular momentum. Once the dissipation is reduced to a level where a super-rotating jet forms, however, the jet and thermal structure are relatively insensitive to the dissipation, except in the nightside gyres where temperatures can vary by $\sim 100\,\mathrm{K}$. We do find, however, that flattening the latitudinal profile of the longitudinal filtering alters the results more than a reduction in the strength of the filtering itself. We also show that even in situations where the temperatures are relatively insensitive to the dissipation, the vertical velocities can still vary with the dissipation, potentially impacting physical processes that depend on the local vertical transport.


title: Optimizing Air-borne Network-in-a-box Deployment for Efficient Remote Coverage

abstract: Among many envisaged drivers for the sixth generation, one is from the United Nations Sustainability Development Goals 2030 to eliminate digital inequality. Remote coverage in sparsely populated areas, difficult terrains, or emergency scenarios requires on-demand access and flexible deployment with minimal capex and opex. In this context, network-in-a-box (NIB) is an exciting solution that packs the whole wireless network into a single portable and re-configurable box to support multiple access technologies such as WiFi/2G/3G/4G/5G etc. In this paper, we propose low-altitude platform stations (LAPS) based NIBs with stratospheric high-altitude platform station (HAPS) as backhaul. Specifically, backhaul employs non-orthogonal multiple access (NOMA) with superposition coding at the transmitting HAPS and successive interference cancellation (SIC) at the receiving NIBs, whereas the access link (AL) employs superposition coding along with the regularized zero-forcing (RZF) precoding at the NIB in order to elevate the computational overhead from the ground users. The required number of airborne NIBs to serve a desired coverage area, their optimal placement, user association, beam optimization, and resource allocation are optimized by maximizing the sum rate of the AL while maintaining the quality of service. Our findings reveal the significance of thorough system planning and communication parameters optimization for enhanced system performance and best coverage under limited resources.


title: Towards Out-of-Distribution Detection in Vocoder Recognition via Latent Feature Reconstruction

abstract: Advancements in synthesized speech have created a growing threat of impersonation, making it crucial to develop deepfake algorithm recognition. One significant aspect is out-of-distribution (OOD) detection, which has gained notable attention due to its important role in deepfake algorithm recognition. However, most of the current approaches for detecting OOD in deepfake algorithm recognition rely on probability-score or classified-distance, which may lead to limitations in the accuracy of the sample at the edge of the threshold. In this study, we propose a reconstruction-based detection approach that employs an autoencoder architecture to compress and reconstruct the acoustic feature extracted from a pre-trained WavLM model. Each acoustic feature belonging to a specific vocoder class is only aptly reconstructed by its corresponding decoder. When none of the decoders can satisfactorily reconstruct a feature, it is classified as an OOD sample. To enhance the distinctiveness of the reconstructed features by each decoder, we incorporate contrastive learning and an auxiliary classifier to further constrain the reconstructed feature. Experiments demonstrate that our proposed approach surpasses baseline systems by a relative margin of 10\% in the evaluation dataset. Ablation studies further validate the effectiveness of both the contrastive constraint and the auxiliary classifier within our proposed approach.


title: On the Limitations of Fractal Dimension as a Measure of Generalization

abstract: Bounding and predicting the generalization gap of overparameterized neural networks remains a central open problem in theoretical machine learning. Neural network optimization trajectories have been proposed to possess fractal structure, leading to bounds and generalization measures based on notions of fractal dimension on these trajectories. Prominently, both the Hausdorff dimension and the persistent homology dimension have been proposed to correlate with generalization gap, thus serving as a measure of generalization. This work performs an extended evaluation of these topological generalization measures. We demonstrate that fractal dimension fails to predict generalization of models trained from poor initializations. We further identify that the $\ell^2$ norm of the final parameter iterate, one of the simplest complexity measures in learning theory, correlates more strongly with the generalization gap than these notions of fractal dimension. Finally, our study reveals the intriguing manifestation of model-wise double descent in persistent homology-based generalization measures. This work lays the ground for a deeper investigation of the causal relationships between fractal geometry, topological data analysis, and neural network optimization.