title: EyeLS: Shadow-Guided Instrument Landing System for Intraocular Target Approaching in Robotic Eye Surgery

abstract: Robotic ophthalmic surgery is an emerging technology to facilitate high-precision interventions such as retina penetration in subretinal injection and removal of floating tissues in retinal detachment depending on the input imaging modalities such as microscopy and intraoperative OCT (iOCT). Although iOCT is explored to locate the needle tip within its range-limited ROI, it is still difficult to coordinate iOCT's motion with the needle, especially at the initial target-approaching stage. Meanwhile, due to 2D perspective projection and thus the loss of depth information, current image-based methods cannot effectively estimate the needle tip's trajectory towards both retinal and floating targets. To address this limitation, we propose to use the shadow positions of the target and the instrument tip to estimate their relative depth position and accordingly optimize the instrument tip's insertion trajectory until the tip approaches targets within iOCT's scanning area. Our method succeeds target approaching on a retina model, and achieves an average depth error of 0.0127 mm and 0.3473 mm for floating and retinal targets respectively in the surgical simulator without damaging the retina.


title: Factorization of derivatives of Bloch mappings through a Hilbert space

abstract: We introduce the concept of vector-valued holomorphic mapping on the complex unit disc whose derivative factors through a Hilbert space and state the main properties of the space formed by such Bloch mappings equipped with a natural norm: linearization, Bloch transposition, surjective and injective Banach ideal property, invariance by M\"obius transformations, Kwapi\'en-type characterization by Bloch domination, and duality.


title: On the orbital decay of the gas giant Kepler-1658b

abstract: The gas giant Kepler-1658b has been inferred to be spiralling into its sub-giant F-type host star Kepler-1658a (KOI-4). The measured rate of change of its orbital period is $\dot{P}_{\rm orb}=-131^{+20}_{-22}\mathrm{ms/yr}$, which can be explained by tidal dissipation in the star if its modified tidal quality factor is as low as $Q^{\,\prime}\approx 2.50\times {10}^{4}$. We explore whether this could plausibly be consistent with theoretical predictions based on applying up-to-date tidal theory in stellar models (varying stellar mass, age, and metallicity) consistent with our newly-derived observational constraints. In most of our models matching the combined constraints on the stellar effective temperature and radius, the dissipation in the star is far too weak, capable of providing $Q^{\,\prime}\gtrsim 10^9$, hence contributing negligibly to orbital evolution. Using only constraints on the stellar radius, efficient tidal dissipation sufficient to explain observations is possible due to inertial waves in the convective envelope during the sub-giant phase, providing $Q^{\,\prime}\sim 10^4$, but this period in the evolution is very short-lived (shorter than $10^2$ yrs in our models). We show that dissipation in the planet is capable of explaining the observed $\dot{P}_\mathrm{orb}$ only if the planet rotates non-synchronously. Tidally-induced pericentre precession is a viable explanation if the periastron argument is near $3\pi/2$ and the quadrupolar Love number is above 0.26. Further observations constraining the stellar and planetary properties in this system have the exciting potential to test tidal theories in stars and planets.


title: Recovering Marcus Theory Rates and Beyond without the Need for Decoherence Corrections: The Mapping Approach to Surface Hopping

abstract: It is well known that fewest-switches surface hopping (FSSH) fails to correctly capture the quadratic scaling of rate constants with diabatic coupling in the weak-coupling limit, as expected from Fermi's golden rule and Marcus theory. To address this deficiency, the most widely used approach is to introduce a `decoherence correction', which removes the inconsistency between the wavefunction coefficients and the active state. Here we investigate the behavior of a new nonadiabatic trajectory method, called the mapping approach to surface hopping (MASH), on systems that exhibit incoherent rate behavior. Unlike FSSH, MASH hops between active surfaces deterministically, and can never have an inconsistency between the wavefunction coefficients and the active state. We show that MASH is not only able to describe rates for intermediate and strong diabatic coupling, but can also accurately reproduce the results of Marcus theory in the golden-rule limit, without the need for a decoherence correction. MASH is therefore a significant improvement over FSSH in the simulation of nonadiabatic reactions.


title: StrategyLLM: Large Language Models as Strategy Generators, Executors, Optimizers, and Evaluators for Problem Solving

abstract: Most existing prompting methods suffer from the issues of generalizability and consistency, as they often rely on instance-specific solutions that may not be applicable to other instances and lack task-level consistency across the selected few-shot examples. To address these limitations, we propose a comprehensive framework, StrategyLLM, allowing LLMs to perform inductive reasoning, deriving general strategies from specific task instances, and deductive reasoning, applying these general strategies to particular task examples, for constructing generalizable and consistent few-shot prompts. It employs four LLM-based agents: strategy generator, executor, optimizer, and evaluator, working together to generate, evaluate, and select promising strategies for a given task. Experimental results demonstrate that StrategyLLM outperforms the competitive baseline CoT-SC that requires human-annotated solutions on 13 datasets across 4 challenging tasks without human involvement, including math reasoning (34.2\% $\rightarrow$ 38.8\%), commonsense reasoning (70.3\% $\rightarrow$ 72.5\%), algorithmic reasoning (73.7\% $\rightarrow$ 85.0\%), and symbolic reasoning (30.0\% $\rightarrow$ 79.2\%). Further analysis reveals that StrategyLLM is applicable to various LLMs and demonstrates advantages across numerous scenarios.


title: Channel Capacity and Bounds In Mixed Gaussian-Impulsive Noise

abstract: Communication systems suffer from the mixed noise consisting of both non-Gaussian impulsive noise (IN) and white Gaussian noise (WGN) in many practical applications. However, there is little literature about the channel capacity under mixed noise. In this paper, we prove the existence of the capacity under p-th moment constraint and show that there are only finite mass points in the capacity-achieving distribution. Moreover, we provide lower and upper capacity bounds with closed forms. It is shown that the lower bounds can degenerate to the well-known Shannon formula under special scenarios. In addition, the capacity for specific modulations and the corresponding lower bounds are discussed. Numerical results reveal that the capacity decreases when the impulsiveness of the mixed noise becomes dominant and the obtained capacity bounds are shown to be very tight.


title: Strength-dependent Transition of Graphite Under Shock Condition Resolved by First Principles

abstract: The shock strength dependent formation of diamond represents one of the most intriguing questions in graphite research. Using ab initio DFT-trained carbon GNN model, we observe a strength-dependent graphite transition under shock. The poor sliding caused by scarce sliding time under high-strength shock forms hexagonal diamond with an orientation of (001)G//(100)HD+[010]G//[010]HD; under low-strength shock, cubic diamond forms after enough sliding time, unveiling the strength-dependent graphite transition. We provide computational evidence of the strength-dependent graphite transition from first principles, clarifying the long-term shock-induced hexagonal formation and structural strength-dependent trend source.


title: SparseSpikformer: A Co-Design Framework for Token and Weight Pruning in Spiking Transformer

abstract: As the third-generation neural network, the Spiking Neural Network (SNN) has the advantages of low power consumption and high energy efficiency, making it suitable for implementation on edge devices. More recently, the most advanced SNN, Spikformer, combines the self-attention module from Transformer with SNN to achieve remarkable performance. However, it adopts larger channel dimensions in MLP layers, leading to an increased number of redundant model parameters. To effectively decrease the computational complexity and weight parameters of the model, we explore the Lottery Ticket Hypothesis (LTH) and discover a very sparse ($\ge$90%) subnetwork that achieves comparable performance to the original network. Furthermore, we also design a lightweight token selector module, which can remove unimportant background information from images based on the average spike firing rate of neurons, selecting only essential foreground image tokens to participate in attention calculation. Based on that, we present SparseSpikformer, a co-design framework aimed at achieving sparsity in Spikformer through token and weight pruning techniques. Experimental results demonstrate that our framework can significantly reduce 90% model parameters and cut down Giga Floating-Point Operations (GFLOPs) by 20% while maintaining the accuracy of the original model.


title: NLP-Based Techniques for Cyber Threat Intelligence

abstract: In the digital era, threat actors employ sophisticated techniques for which, often, digital traces in the form of textual data are available. Cyber Threat Intelligence~(CTI) is related to all the solutions inherent to data collection, processing, and analysis useful to understand a threat actor's targets and attack behavior. Currently, CTI is assuming an always more crucial role in identifying and mitigating threats and enabling proactive defense strategies. In this context, NLP, an artificial intelligence branch, has emerged as a powerful tool for enhancing threat intelligence capabilities. This survey paper provides a comprehensive overview of NLP-based techniques applied in the context of threat intelligence. It begins by describing the foundational definitions and principles of CTI as a major tool for safeguarding digital assets. It then undertakes a thorough examination of NLP-based techniques for CTI data crawling from Web sources, CTI data analysis, Relation Extraction from cybersecurity data, CTI sharing and collaboration, and security threats of CTI. Finally, the challenges and limitations of NLP in threat intelligence are exhaustively examined, including data quality issues and ethical considerations. This survey draws a complete framework and serves as a valuable resource for security professionals and researchers seeking to understand the state-of-the-art NLP-based threat intelligence techniques and their potential impact on cybersecurity.


title: Degradation Estimation Recurrent Neural Network with Local and Non-Local Priors for Compressive Spectral Imaging

abstract: In the Coded Aperture Snapshot Spectral Imaging (CASSI) system, deep unfolding networks (DUNs) have demonstrated excellent performance in recovering 3D hyperspectral images (HSIs) from 2D measurements. However, some noticeable gaps exist between the imaging model used in DUNs and the real CASSI imaging process, such as the sensing error as well as photon and dark current noise, compromising the accuracy of solving the data subproblem and the prior subproblem in DUNs. To address this issue, we propose a Degradation Estimation Network (DEN) to correct the imaging model used in DUNs by simultaneously estimating the sensing error and the noise level, thereby improving the performance of DUNs. Additionally, we propose an efficient Local and Non-local Transformer (LNLT) to solve the prior subproblem, which not only effectively models local and non-local similarities but also reduces the computational cost of the window-based global Multi-head Self-attention (MSA). Furthermore, we transform the DUN into a Recurrent Neural Network (RNN) by sharing parameters of DNNs across stages, which not only allows DNN to be trained more adequately but also significantly reduces the number of parameters. The proposed DERNN-LNLT achieves state-of-the-art (SOTA) performance with fewer parameters on both simulation and real datasets.


title: A high-efficiency programmable modulator for extreme ultraviolet light with nm feature size based on an electronic phase transition

abstract: The absence of efficient light modulators for extreme ultraviolet (EUV) and X-ray photons significantly limits their real-life application, particularly when even slight complexity of the beam patterns is required. Here we report on a novel approach to reversible imprinting of a holographic mask in an electronic Wigner crystal material with a sub-90 nm feature size. The structure is imprinted on a sub-picosecond time-scale using EUV laser pulses and acts as a high-efficiency diffraction grating that deflects EUV or soft X-ray light. The imprinted nanostructure is stable after the removal of the exciting beams at low temperatures but can be easily erased by a single heating beam. Modeling shows that the efficiency of the device can exceed 1%, approaching state-of-the-art etched gratings, but with the benefit of being programmable and tunable over a large range of wavelengths. The observed effect is based on the rapid change of lattice constant upon transition between metastable electronically-ordered phases in a layered transition metal dichalcogenide. The proposed approach is potentially useful for creating tunable light modulators in the EUV and soft X-ray spectral ranges.


title: Wireless Communications in Cavity: A Reconfigurable Boundary Modulation based Approach

abstract: This paper explores the potential wireless communication applications of Reconfigurable Intelligent Surfaces (RIS) in reverberant wave propagation environments. Unlike in free space, we utilize the sensitivity to boundaries of the enclosed electromagnetic (EM) field and the equivalent perturbation of RISs. For the first time, we introduce the framework of reconfigurable boundary modulation in the cavities . We have proposed a robust boundary modulation scheme that exploits the continuity of object motion and the mutation of the codebook switch, which achieves pulse position modulation (PPM) by RIS-generated equivalent pulses for wireless communication in cavities. This approach achieves around 2 Mbps bit rate in the prototype and demonstrates strong resistance to channel's frequency selectivity resulting in an extremely low bit error rate (BER).


title: Correlation-aware active learning for surgery video segmentation

abstract: Semantic segmentation is a complex task that relies heavily on large amounts of annotated image data. However, annotating such data can be time-consuming and resource-intensive, especially in the medical domain. Active Learning (AL) is a popular approach that can help to reduce this burden by iteratively selecting images for annotation to improve the model performance. In the case of video data, it is important to consider the model uncertainty and the temporal nature of the sequences when selecting images for annotation. This work proposes a novel AL strategy for surgery video segmentation, COWAL, COrrelation-aWare Active Learning. Our approach involves projecting images into a latent space that has been fine-tuned using contrastive learning and then selecting a fixed number of representative images from local clusters of video frames. We demonstrate the effectiveness of this approach on two video datasets of surgical instruments and three real-world video datasets. The datasets and code will be made publicly available upon receiving necessary approvals.


title: Optimal subsampling algorithm for the marginal model with large longitudinal data

abstract: Big data is ubiquitous in practices, and it has also led to heavy computation burden. To reduce the calculation cost and ensure the effectiveness of parameter estimators, an optimal subset sampling method is proposed to estimate the parameters in marginal models with massive longitudinal data. The optimal subsampling probabilities are derived, and the corresponding asymptotic properties are established to ensure the consistency and asymptotic normality of the estimator. Extensive simulation studies are carried out to evaluate the performance of the proposed method for continuous, binary and count data and with four different working correlation matrices. A depression data is used to illustrate the proposed method.


title: Comments on "Dynamic Consensus Committee-Based for Secure Data Sharing With Authorized Multi-Receiver Searchable Encryption"

abstract: Recently, Yang et al. introduced an efficient searchable encryption scheme titled "Dynamic Consensus Committee-Based for Secure Data Sharing With Authorized Multi-Receiver Searchable Encryption (DCC-SE)," published in IEEE Transactions on Information Forensics and Security (DOI: 10.1109/TIFS.2023.3305183). According to the authors, DCC-SE meets various security requirements, especially the keyword trapdoor indistinguishability against chosen keyword attacks (KT-IND-CKA). In this letter, however, we reveal a significant vulnerability of DCC-SE: any users involved in the system can execute attacks against KT-IND-CKA security. This flaw potentially results in the unintended disclosure of sensitive keyword information related to the documents. We present a detailed cryptanalysis on DCC-SE. In addition, to address this vulnerability, we discuss the root cause and identify a flaw in the security proof of DCC-SE. Subsequently, we provide a solution that effectively addresses this concern without significantly increasing computational overhead.


title: The quotient spaces of topological groups with a $q$-point

abstract: In this paper, we study the uniformities on the double coset spaces in topological groups. As an implication, the quotient spaces of topological groups with a $q$-point are studied. It mainly shows that: (1) Suppose that $G$ is a topological group with a $q$-point and $H$ is a closed subgroup of $G$; then the quotient space $G/H$ is an open and quasi-perfect preimage of a metrizable space; in particular, $G/H$ is an $M$-space. (2) Suppose that $G$ is a topological group with a strict $q$-point and $H$ is a closed subgroup of $G$; then the quotient space $G/H$ is an open and sequentially perfect preimage of a metrizable space. (3) Suppose that $G$ is a topological group with a strong $q$-point and $H$ is a closed subgroup of $G$; then the quotient space $G/H$ is an open and strongly sequentially perfect preimage of a metrizable space.


title: Self-Supervised Disentanglement by Leveraging Structure in Data Augmentations

abstract: Self-supervised representation learning often uses data augmentations to induce some invariance to "style" attributes of the data. However, with downstream tasks generally unknown at training time, it is difficult to deduce a priori which attributes of the data are indeed "style" and can be safely discarded. To address this, we introduce a more principled approach that seeks to disentangle style features rather than discard them. The key idea is to add multiple style embedding spaces where: (i) each is invariant to all-but-one augmentation; and (ii) joint entropy is maximized. We formalize our structured data-augmentation procedure from a causal latent-variable-model perspective, and prove identifiability of both content and (multiple blocks of) style variables. We empirically demonstrate the benefits of our approach on synthetic datasets and then present promising but limited results on ImageNet.


title: Target-oriented Domain Adaptation for Infrared Image Super-Resolution

abstract: Recent efforts have explored leveraging visible light images to enrich texture details in infrared (IR) super-resolution. However, this direct adaptation approach often becomes a double-edged sword, as it improves texture at the cost of introducing noise and blurring artifacts. To address these challenges, we propose the Target-oriented Domain Adaptation SRGAN (DASRGAN), an innovative framework specifically engineered for robust IR super-resolution model adaptation. DASRGAN operates on the synergy of two key components: 1) Texture-Oriented Adaptation (TOA) to refine texture details meticulously, and 2) Noise-Oriented Adaptation (NOA), dedicated to minimizing noise transfer. Specifically, TOA uniquely integrates a specialized discriminator, incorporating a prior extraction branch, and employs a Sobel-guided adversarial loss to align texture distributions effectively. Concurrently, NOA utilizes a noise adversarial loss to distinctly separate the generative and Gaussian noise pattern distributions during adversarial training. Our extensive experiments confirm DASRGAN's superiority. Comparative analyses against leading methods across multiple benchmarks and upsampling factors reveal that DASRGAN sets new state-of-the-art performance standards. Code are available at \url{https://github.com/yongsongH/DASRGAN}.


title: MAP's not dead yet: Uncovering true language model modes by conditioning away degeneracy

abstract: It has been widely observed that exact or approximate MAP (mode-seeking) decoding from natural language generation (NLG) models consistently leads to degenerate outputs (Stahlberg and Byrne, 2019, Holtzman et al., 2019). This has generally been attributed to either a fundamental inadequacy of modes in models or weaknesses in language modeling. Contrastingly in this work, we emphasize that degenerate modes can even occur in the absence of any model error, due to contamination of the training data. Specifically, we show that mixing even a tiny amount of low-entropy noise with a population text distribution can cause the data distribution's mode to become degenerate, implying that any models trained on it will be as well. As the unconditional mode of NLG models will often be degenerate, we therefore propose to apply MAP decoding to the model's distribution conditional on avoiding specific degeneracies. Using exact-search, we empirically verify that the length-conditional modes of machine translation models and language models are indeed more fluent and topical than their unconditional modes. For the first time, we also share many examples of exact modal sequences from these models, and from several variants of the LLaMA-7B model. Notably, the modes of the LLaMA models are still degenerate, showing that improvements in modeling have not fixed this issue. Because of the cost of exact mode finding algorithms, we develop an approximate mode finding approach, ACBS, which finds sequences that are both high-likelihood and high-quality. We apply this approach to LLaMA-7B, a model which was not trained for instruction following, and find that we are able to elicit reasonable outputs without any finetuning.


title: Growth of orbital resonances around a black hole surrounded by matter

abstract: This work studies the dynamics of geodesic motion within a curved spacetime around a Schwarzschild black hole, perturbed by a gravitational field of a far axisymmetric distribution of mass enclosing the system. This spacetime can serve as a versatile model for a diverse range of astrophysical scenarios and, in particular, for extreme mass ratio inspirals as in our work. We show that the system is non-integrable by employing Poincar\'e surface of section and rotation numbers. By utilising the rotation numbers, the widths of resonances are calculated, which are then used in establishing the relation between the underlying perturbation parameter driving the system from integrability and the quadrupole parameter characterising the perturbed metric. This relation allows us to estimate the phase shift caused by the resonance during an inspiral.


title: Frequency Domain-based Dataset Distillation

abstract: This paper presents FreD, a novel parameterization method for dataset distillation, which utilizes the frequency domain to distill a small-sized synthetic dataset from a large-sized original dataset. Unlike conventional approaches that focus on the spatial domain, FreD employs frequency-based transforms to optimize the frequency representations of each data instance. By leveraging the concentration of spatial domain information on specific frequency components, FreD intelligently selects a subset of frequency dimensions for optimization, leading to a significant reduction in the required budget for synthesizing an instance. Through the selection of frequency dimensions based on the explained variance, FreD demonstrates both theoretical and empirical evidence of its ability to operate efficiently within a limited budget, while better preserving the information of the original dataset compared to conventional parameterization methods. Furthermore, based on the orthogonal compatibility of FreD with existing methods, we confirm that FreD consistently improves the performances of existing distillation methods over the evaluation scenarios with different benchmark datasets. We release the code at https://github.com/sdh0818/FreD.


title: Reinforcement Learning with Model Predictive Control for Highway Ramp Metering

abstract: In the backdrop of an increasingly pressing need for effective urban and highway transportation systems, this work explores the synergy between model-based and learning-based strategies to enhance traffic flow management by use of an innovative approach to the problem of ramp metering control that embeds Reinforcement Learning (RL) techniques within the Model Predictive Control (MPC) framework. The control problem is formulated as an RL task by crafting a suitable stage cost function that is representative of the traffic conditions, variability in the control action, and violations of the constraint on the maximum number of vehicles in queue. An MPC-based RL approach, which leverages the MPC optimal problem as a function approximation for the RL algorithm, is proposed to learn to efficiently control an on-ramp and satisfy its constraints despite uncertainties in the system model and variable demands. Simulations are performed on a benchmark small-scale highway network to compare the proposed methodology against other state-of-the-art control approaches. Results show that, starting from an MPC controller that has an imprecise model and is poorly tuned, the proposed methodology is able to effectively learn to improve the control policy such that congestion in the network is reduced and constraints are satisfied, yielding an improved performance that is superior to the other controllers.


title: Thermal Finite Element Modeling and Simulation of a Squirrel-Cage Induction Machine

abstract: Finite element models of electrical machines allow insights in electrothermal stresses which endanger the insulation system of the machine. This paper presents a thermal finite element model of a 3.7 kW squirrel-cage induction machine. The model resolves the conductors and the surrounding insulation materials in the stator slots. A set of transient thermal scenarios is defined and measured in the machine laboratory. These data are used to assess the finite element model.


title: Unveiling the Fingerprint of Eccentric Binary Black Hole Mergers

abstract: The orbital eccentricity plays a crucial role in shaping the dynamics of binary black hole (BBH) mergers. Remarkably, our recent findings reveal a universal oscillation in essential dynamic quantities: peak luminosity $L_{\text{peak}}$, masses $M_f$, spins $\alpha_f$, and recoil velocity $V_f$ of the final remnant black hole, as the initial eccentricity $e_0$ undergoes variation. In this letter, by leveraging RIT's extensive numerical relativistic simulations of nonspinning eccentric orbital BBH mergers, we not only confirm the universal oscillation in peak amplitudes (including harmonic modes), similar to the oscillations observed in $L_{\text{peak}}$, $M_f$, $\alpha_f$, and $V_f$, but also make the first discovery of a ubiquitous spiral-like internal fine structure that correlates $L_{\text{peak}}$, $M_f$, $\alpha_f$, $V_f$, and peak amplitudes. This distinctive feature, which we term the "fingerprint" of eccentric orbital BBH mergers, carries important implications for unraveling the intricate dynamics and astrophysics associated with eccentric orbital BBH mergers.


title: Ultrafast 3-D Super Resolution Ultrasound using Row-Column Array specific Coherence-based Beamforming and Rolling Acoustic Sub-aperture Processing: In Vitro, In Vivo and Clinical Study

abstract: The row-column addressed array is an emerging probe for ultrafast 3-D ultrasound imaging. It achieves this with far fewer independent electronic channels and a wider field of view than traditional 2-D matrix arrays, of the same channel count, making it a good candidate for clinical translation. However, the image quality of row-column arrays is generally poor, particularly when investigating tissue. Ultrasound localisation microscopy allows for the production of super-resolution images even when the initial image resolution is not high. Unfortunately, the row-column probe can suffer from imaging artefacts that can degrade the quality of super-resolution images as `secondary' lobes from bright microbubbles can be mistaken as microbubble events, particularly when operated using plane wave imaging. These false events move through the image in a physiologically realistic way so can be challenging to remove via tracking, leading to the production of 'false vessels'. Here, a new type of rolling window image reconstruction procedure was developed, which integrated a row-column array-specific coherence-based beamforming technique with acoustic sub-aperture processing for the purposes of reducing `secondary' lobe artefacts, noise and increasing the effective frame rate. Using an {\it{in vitro}} cross tube, it was found that the procedure reduced the percentage of `false' locations from $\sim$26\% to $\sim$15\% compared to traditional orthogonal plane wave compounding. Additionally, it was found that the noise could be reduced by $\sim$7 dB and that the effective frame rate could be increased to over 4000 fps. Subsequently, {\it{in vivo}} ultrasound localisation microscopy was used to produce images non-invasively of a rabbit kidney and a human thyroid.


title: Growth and Characterization of $\beta$-Mn Structured CoZn Thin Films

abstract: Thin films of polycrystalline $\beta$-Mn structure CoZn have been grown on thermally oxidized Si substrates by co-sputtering from elemental targets followed by annealing. A range of films grown with variable Co deposition power and fixed Zn deposition power were produced, so as to vary the proportions of the two elements reaching the substrate, which were annealed post-growth. Whilst all films exhibited a (211) $\beta$-Mn structure CoZn texture in X-ray diffraction, transmission electron microscopy showed that the composition with the highest integrated intensity for that Bragg peak contained large vacancies and was covered by a thick ZnO cap owing to being Co-deficient overall. CoZn films deposited at ratios tuned to give the optimal volume fraction of $\beta$-Mn were continuous, with crystallites up to 200~nm in size, with a much thinner ZnO cap layer. Magnetic measurements show that such optimal CoZn films have a Curie temperature $T_\mathrm{C} \sim 420$~K and saturation magnetization of 120~emu/cm$^3$, properties close to those reported for bulk crystals. The $\beta$-Mn structure is chiral (P4$_{1}$32/P4$_{3}$32 space group) and is known to give rise to a Dzyaloshinkii-Moriya interaction (DMI) that stabilizes room-temperature skyrmions in the bulk. Our thin films are thus a potential materials platform, compatible with planar processing technology, for magnetic skyrmions arising from a bulk DMI.


title: Emergence of a Novel Phase in Population and Community Dynamics Due to Fat-Tailed Environmental Correlations

abstract: Temporal environmental noise (EN) is a prevalent natural phenomenon that controls population and community dynamics, shaping the destiny of biological species and genetic types. Conventional theoretical models often depict EN as a Markovian process with an exponential distribution of correlation times, resulting in two distinct qualitative dynamical categories: quenched (pertaining to short demographic timescales) and annealed (pertaining to long timescales). However, numerous empirical studies demonstrate a fat-tailed decay of correlation times. Here, we study the consequences of power-law correlated EN on the dynamics of isolated and competing populations. We reveal the emergence of a novel intermediate phase that lies between the quenched and annealed regimes. Within this phase, dynamics are primarily driven by rare, yet not exceedingly rare, long periods of almost-steady environmental conditions. For an isolated population, the time to extinction in this phase exhibits a novel scaling with the abundance, and also a non-monotonic dependence on the spectral exponent.


title: Multi-stage Euler-Maruyama methods for backward stochastic differential equations driven by continuous-time Markov chains

abstract: Numerical methods for computing the solutions of Markov backward stochastic differential equations (BSDEs) driven by continuous-time Markov chains (CTMCs) are explored. The main contributions of this paper are as follows: (1) we observe that Euler-Maruyama temporal discretization methods for solving Markov BSDEs driven by CTMCs are equivalent to exponential integrators for solving the associated systems of ordinary differential equations (ODEs); (2) we introduce multi-stage Euler-Maruyama methods for effectively solving "stiff" Markov BSDEs driven by CTMCs; these BSDEs typically arise from the spatial discretization of Markov BSDEs driven by Brownian motion; (3) we propose a multilevel spatial discretization method on sparse grids that efficiently approximates high-dimensional Markov BSDEs driven by Brownian motion with a combination of multiple Markov BSDEs driven by CTMCs on grids with different resolutions. We also illustrate the effectiveness of the presented methods with a number of numerical experiments in which we treat nonlinear BSDEs arising from option pricing problems in finance.


title: A Deep Reinforcement Learning Approach to Efficient Distributed Optimization

abstract: In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a given specific problem. In this paper, we propose a learning-based method to achieve efficient distributed optimization over networked systems. Specifically, a deep reinforcement learning (DRL) framework is developed for adaptive configuration within a parameterized unifying algorithmic form, which incorporates an abundance of decentralized first-order and second-order optimization algorithms. We exploit the local consensus and objective information to represent the regularities of problem instances and trace the solving progress, which constitute the states observed by a DRL agent. The framework is trained using Proximal Policy Optimization (PPO) on a number of practical problem instances of similar structures yet different problem data. Experiments on various smooth and non-smooth classes of objective functions demonstrate that our proposed learning-based method outperforms several state-of-the-art distributed optimization algorithms in terms of convergence speed and solution accuracy.


title: Status of the superweak extension of the standard model and muon g-2

abstract: The super-weak force is a minimal, anomaly-free U(1) extension of the standard model, designed to explain the origin of (i) neutrino masses and mixing matrix elements, (ii) dark matter, (iii) cosmic inflation, (iv) stabilization of the electroweak vacuum and (v) leptogenesis. In this talk we discuss the phenomenological status of the model and provide viable scenarios for the physics of the items in this list.


title: Autoencoder with Group-based Decoder and Multi-task Optimization for Anomalous Sound Detection

abstract: In industry, machine anomalous sound detection (ASD) is in great demand. However, collecting enough abnormal samples is difficult due to the high cost, which boosts the rapid development of unsupervised ASD algorithms. Autoencoder (AE) based methods have been widely used for unsupervised ASD, but suffer from problems including 'shortcut', poor anti-noise ability and sub-optimal quality of features. To address these challenges, we propose a new AE-based framework termed AEGM. Specifically, we first insert an auxiliary classifier into AE to enhance ASD in a multi-task learning manner. Then, we design a group-based decoder structure, accompanied by an adaptive loss function, to endow the model with domain-specific knowledge. Results on the DCASE 2021 Task 2 development set show that our methods achieve a relative improvement of 13.11% and 15.20% respectively in average AUC over the official AE and MobileNetV2 across test sets of seven machines.


title: Quantity versus quality in publication activity: knowledge production at the regional level

abstract: This study contributes to the ongoing debate regarding the balance between quality and quantity in research productivity and publication activity. Using empirical regional knowledge production functions, we establish a significant correlation between R&D spending and research output, specifically publication productivity, while controlling for patenting activity and socioeconomic factors. Our focus is on the dilemma of research quantity versus quality, which is analysed in the context of regional thematic specialization using spatial lags. When designing policies and making forecasts, it is important to consider the quality of research measured by established indicators. In this study, we examine the dual effect of research quality on publication activity. We identify two groups of quality factors: those related to the quality of journals and those related to the impact of publications. On average, these factors have different influences on quantitative measures. The quality of journals shows a negative relationship with quantity, indicating that as journal quality increases, the number of publications decreases. On the other hand, the impact of publications can be approximated by an inverse parabolic shape, with a positive decreasing slope within a common range of values. This duality in the relationship between quality factors and quantitative measures may explain some of the significant variations in conclusions found in the literature. We compare several models that explore factors influencing publication activity using a balanced panel dataset of Russian regions from 2009 to 2021. Additionally, we propose a novel approach using thematic scientometric parameters as a special type of proximity measure between regions in thematic space. Incorporating spatial spillovers in thematic space allows us to account for potential cross-sectional dependence in regional data.


title: Introduction to Field Line Helicity

abstract: Field line helicity measures the net linking of magnetic flux with a single magnetic field line. It offers a finer topological description than the usual global magnetic helicity integral, while still being invariant in an ideal evolution unless there is a flux of helicity through the domain boundary. In this chapter, we explore how to appropriately define field line helicity in different volumes in a way that preserves a meaningful topological interpretation. We also review the time evolution of field line helicity under both boundary motions and magnetic reconnection.

categories: astro-ph.SR astro-ph.HE math-ph math.MP physics.plasm-ph


title: Exploring Links between Conversational Agent Design Challenges and Interdisciplinary Collaboration

abstract: Recent years have seen a steady rise in the popularity and use of Conversational Agents (CA) for different applications, well before the more immediate impact of large language models. This rise has been accompanied by an extensive exploration and documentation of the challenges of designing and creating conversational agents. Focusing on a recent scoping review of the socio-technical challenges of CA creation, this opinion paper calls for an examination of the extent to which interdisciplinary collaboration (IDC) challenges might contribute towards socio-technical CA design challenges. The paper proposes a taxonomy of CA design challenges using IDC as a lens, and proposes practical strategies to overcome them which complement existing design principles. The paper invites future work to empirically verify suggested conceptual links and apply the proposed strategies within the space of CA design to evaluate their effectiveness.


title: Phase retrieval with semi-algebraic and ReLU neural network priors

abstract: The key ingredient to retrieving a signal from its Fourier magnitudes, namely, to solve the phase retrieval problem, is an effective prior on the sought signal. In this paper, we study the phase retrieval problem under the prior that the signal lies in a semi-algebraic set. This is a very general prior as semi-algebraic sets include linear models, sparse models, and ReLU neural network generative models. The latter is the main motivation of this paper, due to the remarkable success of deep generative models in a variety of imaging tasks, including phase retrieval. We prove that almost all signals in R^N can be determined from their Fourier magnitudes, up to a sign, if they lie in a (generic) semi-algebraic set of dimension N/2. The same is true for all signals if the semi-algebraic set is of dimension N/4. We also generalize these results to the problem of signal recovery from the second moment in multi-reference alignment models with multiplicity free representations of compact groups. This general result is then used to derive improved sample complexity bounds for recovering band-limited functions on the sphere from their noisy copies, each acted upon by a random element of SO(3).


title: A* search algorithm for an optimal investment problem in vehicle-sharing systems

abstract: We study an optimal investment problem that arises in the context of the vehicle-sharing system. Given a set of locations to build stations, we need to determine i) the sequence of stations to be built and the number of vehicles to acquire in order to obtain the target state where all stations are built, and ii) the number of vehicles to acquire and their allocation in order to maximize the total profit returned by operating the system when some or all stations are open. The profitability associated with operating open stations, measured over a specific time period, is represented as a linear optimization problem applied to a collection of open stations. With operating capital, the owner of the system can open new stations. This property introduces a set-dependent aspect to the duration required for opening a new station, and the optimal investment problem can be viewed as a variant of the Traveling Salesman Problem (TSP) with set-dependent cost. We propose an A* search algorithm to address this particular variant of the TSP. Computational experiments highlight the benefits of the proposed algorithm in comparison to the widely recognized Dijkstra algorithm and propose future research to explore new possibilities and applications for both exact and approximate A* algorithms.


title: Correlation-guided Query-Dependency Calibration in Video Representation Learning for Temporal Grounding

abstract: Video Temporal Grounding is to identify specific moments or highlights from a video corresponding to textual descriptions. Typical approaches in temporal grounding treat all video clips equally during the encoding process regardless of their semantic relevance with the text query. Therefore, we propose Correlation-Guided DEtection TRansformer(CG-DETR), exploring to provide clues for query-associated video clips within the cross-modal attention. First, we design an adaptive cross-attention with dummy tokens. Dummy tokens conditioned by text query take portions of the attention weights, preventing irrelevant video clips from being represented by the text query. Yet, not all words equally inherit the text query's correlation to video clips. Thus, we further guide the cross-attention map by inferring the fine-grained correlation between video clips and words. We enable this by learning a joint embedding space for high-level concepts, i.e., moment and sentence level, and inferring the clip-word correlation. Lastly, we exploit the moment-specific characteristics and combine them with the context of each video to form a moment-adaptive saliency detector. By exploiting the degrees of text engagement in each video clip, it precisely measures the highlightness of each clip. CG-DETR achieves state-of-the-art results on various benchmarks for temporal grounding.


title: Evaluating Gender Bias in the Translation of Gender-Neutral Languages into English

abstract: Machine Translation (MT) continues to improve in quality and adoption, yet the inadvertent perpetuation of gender bias remains a significant concern. Despite numerous studies into gender bias in translations from gender-neutral languages such as Turkish into more strongly gendered languages like English, there are no benchmarks for evaluating this phenomenon or for assessing mitigation strategies. To address this gap, we introduce GATE X-E, an extension to the GATE (Rarrick et al., 2023) corpus, that consists of human translations from Turkish, Hungarian, Finnish, and Persian into English. Each translation is accompanied by feminine, masculine, and neutral variants for each possible gender interpretation. The dataset, which contains between 1250 and 1850 instances for each of the four language pairs, features natural sentences with a wide range of sentence lengths and domains, challenging translation rewriters on various linguistic phenomena. Additionally, we present an English gender rewriting solution built on GPT-3.5 Turbo and use GATE X-E to evaluate it. We open source our contributions to encourage further research on gender debiasing.


title: On the distance spectral radius, fractional matching and factors of graphs with given minimum degree

abstract: Let $D(G)=(d_{ij})_{n\times n}$ be the distance matrix of a graph $G$ of order $n$. The largest eigenvalue of $D(G)$, denoted by $\mu(G)$, is called the distance spectral radius of $G$. A fractional matching of $G$ is a function $f: E(G)\to [0,1]$ such that for any $v_i\in V(G)$, $\sum_{e\in E_G(v_i)}f(e)\le 1$, where $E_G(v_i)=\{e:e\in E(G) \ \textrm{and}\ e \ \textrm{is incident with} \ v_i\}$. Let $\alpha_f(G)$ denote the fractional matching number of $G$ which is defined as $\alpha_f(G)=\max\{\sum_{e\in E(G)}f(e): f\ \textrm{is a fractional matching of} \ G\}$. In this paper, we establish a sharp upper bound for the distance spectral radius to guarantee $\alpha_f(G)>\frac{n-k}{2}$ in graph $G$ with given minimum degree $\delta$. Let $\{G_1,G_2,G_3,\cdots\}$ be a set of graphs, an $\{G_1,G_2,G_3,\cdots\}$-factor of a graph $G$ is a spanning subgraph of $G$ such that each component of which is isomorphic to one of $\{G_1,G_2,G_3,\cdots\}$. In this paper, we give a sharp upper bound on distance spectral radius of graph $G$ with given minimum degree $\delta$ to ensure that $G$ has a $\{K_2, C_k\}$-factor, where $k\ge3$ is an integer. In addition, we also obtain a sharp upper bound on distance spectral radius for the existence of a $\{K_{1,1},K_{1,2},\cdots,K_{1,k}\}$-factor with $k\ge2$ in a graph $G$ with given minimum degree $\delta$.


title: Disinformation Capabilities of Large Language Models

abstract: Automated disinformation generation is often listed as an important risk associated with large language models (LLMs). The theoretical ability to flood the information space with disinformation content might have dramatic consequences for societies around the world. This paper presents a comprehensive study of the disinformation capabilities of the current generation of LLMs to generate false news articles in the English language. In our study, we evaluated the capabilities of 10 LLMs using 20 disinformation narratives. We evaluated several aspects of the LLMs: how good they are at generating news articles, how strongly they tend to agree or disagree with the disinformation narratives, how often they generate safety warnings, etc. We also evaluated the abilities of detection models to detect these articles as LLM-generated. We conclude that LLMs are able to generate convincing news articles that agree with dangerous disinformation narratives.


title: Approximate solutions to the multiple-choice knapsack problem by multiobjectivization and Chebyshev scalarization

abstract: The method BISSA, proposed by Bednarczuk, Miroforidis, and Pyzel, provides approximate solutions to the multiple-choice knapsack problem. To fathom the optimality gap that is left by BISSA, we present a method that starts from the BISSA solution and it is able to provide a better approximation and in consequence a tighter optimality gap. Like BISSA, the new method is based on the multiobjectivization of the multiple-choice knapsack but instead of the linear scalarization used in BISSA, it makes use of the Chebyshev scalarization. We validate the new method on the same set of problems used to validate BISSA.


title: An MRL-Based Design Solution for RIS-Assisted MU-MIMO Wireless System under Time-Varying Channels

abstract: Utilizing Deep Reinforcement Learning (DRL) for Reconfigurable Intelligent Surface (RIS) assisted wireless communication has been extensively researched. However, existing DRL methods either act as a simple optimizer or only solve problems with concurrent Channel State Information (CSI) represented in the training data set. Consequently, solutions for RIS-assisted wireless communication systems under time-varying environments are relatively unexplored. However, communication problems should be considered with realistic assumptions; for instance, in scenarios where the channel is time-varying, the policy obtained by reinforcement learning should be applicable for situations where CSI is not well represented in the training data set. In this paper, we apply Meta-Reinforcement Learning (MRL) to the joint optimization problem of active beamforming at the Base Station (BS) and phase shift at the RIS, motivated by MRL's ability to extend the DRL concept of solving one Markov Decision Problem (MDP) to multiple MDPs. We provide simulation results to compare the average sum rate of the proposed approach with those of selected forerunners in the literature. Our approach improves the sum rate by more than 60% under time-varying CSI assumption while maintaining the advantages of typical DRL-based solutions. Our study's results emphasize the possibility of utilizing MRL-based designs in RIS-assisted wireless communication systems while considering realistic environment assumptions.


title: Effective water/water contact angle at the base of an impinging jet

abstract: The base of a jet impinging on an ultrapure water bath is studied experimentally. At the impact point, a train of capillary waves develops along the jet. By performing Particle Tracking Velocity measurements, we show that there is a boundary layer separation between the jet and the meniscus. We thus describe the shape of this meniscus with a hydrostatic model. A striking observation is the existence of an effective non-zero water/water contact angle between the jet and the meniscus. The rationalization of this finite contact angle requires a full description of the shape of the interface. By doing an analytical matching between the meniscus and the jet, we show that the capillary waves can be considered as reflected waves present to ensure pressure continuity. It is finally shown that the value of the apparent contact angle is fixed by energy minimization, with an excellent agreement between prediction and experiment for small jets.


title: A Natural Field-like Entanglement Resource in Trapped-Ion Chains

abstract: The electromagnetic trapping of ion chains can be regarded as a process of non-trivial entangled quantum state preparation within Hilbert spaces of the local axial motional modes. To begin uncovering properties of this entanglement resource produced as a byproduct of conventional ion-trap quantum information processing, the quantum continuous-variable formalism is herein utilized to focus on the leading-order entangled ground state of local motional modes in the presence of a quadratic trapping potential. The decay of entanglement between disjoint subsets of local modes is found to exhibit features of entanglement structure and response to partial measurement reminiscent of the free massless scalar field vacuum. With significant fidelities between the two, even for large system sizes, a framework is established for initializing quantum field simulations via "imaging" extended entangled states from natural sources, rather than building correlations through deep circuits of few-body entangling operators. By calculating probabilities in discrete Fock subspaces of the local motional modes, considerations are presented for locally transferring these pre-distributed entanglement resources to the qudits of ion internal energy levels, improving this procedure's anticipated experimental viability.


title: Personalized Video Relighting With an At-Home Light Stage

abstract: In this paper, we develop a personalized video relighting algorithm that produces high-quality and temporally consistent relit videos under any pose, expression, and lighting condition in real-time. Existing relighting algorithms typically rely either on publicly available synthetic data, which yields poor relighting results, or instead on light stage data which is difficult to obtain. We show that by just capturing video of a user watching YouTube videos on a monitor we can train a personalized algorithm capable of performing high-quality relighting under any condition. Our key contribution is a novel neural relighting architecture that effectively separates the intrinsic appearance features - the geometry and reflectance of the face - from the source lighting and then combines them with the target lighting to generate a relit image. This neural network architecture enables smoothing of intrinsic appearance features leading to temporally stable video relighting. Both qualitative and quantitative evaluations show that our architecture improves portrait image relighting quality and temporal consistency over state-of-the-art approaches on both casually captured `Light Stage at Your Desk' (LSYD) and light-stage-captured `One Light At a Time' (OLAT) datasets.


title: Violet: A Vision-Language Model for Arabic Image Captioning with Gemini Decoder

abstract: Although image captioning has a vast array of applications, it has not reached its full potential in languages other than English. Arabic, for instance, although the native language of more than 400 million people, remains largely underrepresented in this area. This is due to the lack of labeled data and powerful Arabic generative models. We alleviate this issue by presenting a novel vision-language model dedicated to Arabic, dubbed \textit{Violet}. Our model is based on a vision encoder and a Gemini text decoder that maintains generation fluency while allowing fusion between the vision and language components. To train our model, we introduce a new method for automatically acquiring data from available English datasets. We also manually prepare a new dataset for evaluation. \textit{Violet} performs sizeably better than our baselines on all of our evaluation datasets. For example, it reaches a CIDEr score of $61.2$ on our manually annotated dataset and achieves an improvement of $13$ points on Flickr8k.


title: Statistical learning by sparse deep neural networks

abstract: We consider a deep neural network estimator based on empirical risk minimization with l_1-regularization. We derive a general bound for its excess risk in regression and classification (including multiclass), and prove that it is adaptively nearly-minimax (up to log-factors) simultaneously across the entire range of various function classes.


title: Sticky Flavors

abstract: The Fr\'echet mean, a generalization to a metric space of the expectation of a random variable in a vector space, can exhibit unexpected behavior for a wide class of random variables. For instance, it can stick to a point (more generally to a closed set) under resampling: sample stickiness. It can stick to a point for topologically nearby distributions: topological stickiness, such as total variation or Wasserstein stickiness. It can stick to a point for slight but arbitrary perturbations: perturbation stickiness. Here, we explore these and various other flavors of stickiness and their relationship in varying scenarios, for instance on CAT($\kappa$) spaces, $\kappa\in \mathbb{R}$. Interestingly, modulation stickiness (faster asymptotic rate than $\sqrt{n}$) and directional stickiness (a generalization of moment stickiness from the literature) allow for the development of new statistical methods building on an asymptotic fluctuation, where, due to stickiness, the mean itself features no asymptotic fluctuation. Also, we rule out sticky flavors on manifolds in scenarios with curvature bounds.


title: Robust discrete-time super-hedging strategies under AIP condition and under price uncertainty

abstract: We solve the problem of super-hedging European or Asian options for discrete-time financial market models where executable prices are uncertain. The risky asset prices are not described by single-valued processes but measurable selections of random sets that allows to consider a large variety of models including bid-ask models with order books, but also models with a delay in the execution of the orders. We provide a numerical procedure to compute the infimum price under a weak no-arbitrage condition, the so-called AIP condition, under which the prices of the non negative European options are non negative. This condition is weaker than the existence of a risk-neutral martingale measure but it is sufficient to numerically solve the super-hedging problem. We illustrate our method by a numerical example.


title: On singular strictly convex solutions to the Monge-Amp\`ere equation

abstract: We show the existence of a strictly convex function $u: B_1 \to \mathbb{R}$ with associated Monge-Amp\`ere measure represented by a function $f$ with $0 < f < 1$ a.e. whose Hessian has a singular part. This extends the work [13] and answers an open question of [14,Sec. 6.2(1)].


title: OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretraining

abstract: Instead of pretraining multilingual language models from scratch, a more efficient method is to adapt existing pretrained language models (PLMs) to new languages via vocabulary extension and continued pretraining. However, this method usually randomly initializes the embeddings of new subwords and introduces substantially more embedding parameters to the model, thus weakening the efficiency. To address these issues, we propose a novel framework: $\textbf{O}$ne $\textbf{F}$or $\textbf{A}$ll ($\textbf{OFA}$), which wisely initializes the embeddings of unseen subwords and thus can adapt a PLM to multiple languages efficiently and effectively. OFA takes advantage of external well-aligned multilingual static word vectors and injects the alignment knowledge into the subword embeddings. In addition, OFA applies matrix factorization and replaces the cumbersome embeddings with two lower-dimensional matrices, which largely reduces the number of parameters. We show OFA accelerates the convergence of continued pretraining, which is environmentally friendly as much fewer carbon footprints are generated. Through extensive experiments, we demonstrate OFA can achieve competitive or better performance than default continued pretraining baselines on a wide range of crosslingual downstream tasks. We make our code and models publicly available.


title: Controlling the Output of a Generative Model by Latent Feature Vector Shifting

abstract: State-of-the-art generative models (e.g. StyleGAN3 \cite{karras2021alias}) often generate photorealistic images based on vectors sampled from their latent space. However, the ability to control the output is limited. Here we present our novel method for latent vector shifting for controlled output image modification utilizing semantic features of the generated images. In our approach we use a pre-trained model of StyleGAN3 that generates images of realistic human faces in relatively high resolution. We complement the generative model with a convolutional neural network classifier, namely ResNet34, trained to classify the generated images with binary facial features from the CelebA dataset. Our latent feature shifter is a neural network model with a task to shift the latent vectors of a generative model into a specified feature direction. We have trained latent feature shifter for multiple facial features, and outperformed our baseline method in the number of generated images with the desired feature. To train our latent feature shifter neural network, we have designed a dataset of pairs of latent vectors with and without a certain feature. Based on the evaluation, we conclude that our latent feature shifter approach was successful in the controlled generation of the StyleGAN3 generator.


title: Data Augmentations in Deep Weight Spaces

abstract: Learning in weight spaces, where neural networks process the weights of other deep neural networks, has emerged as a promising research direction with applications in various fields, from analyzing and editing neural fields and implicit neural representations, to network pruning and quantization. Recent works designed architectures for effective learning in that space, which takes into account its unique, permutation-equivariant, structure. Unfortunately, so far these architectures suffer from severe overfitting and were shown to benefit from large datasets. This poses a significant challenge because generating data for this learning setup is laborious and time-consuming since each data sample is a full set of network weights that has to be trained. In this paper, we address this difficulty by investigating data augmentations for weight spaces, a set of techniques that enable generating new data examples on the fly without having to train additional input weight space elements. We first review several recently proposed data augmentation schemes %that were proposed recently and divide them into categories. We then introduce a novel augmentation scheme based on the Mixup method. We evaluate the performance of these techniques on existing benchmarks as well as new benchmarks we generate, which can be valuable for future studies.


title: Real-Time Performance of Industrial IoT Communication Technologies: A Review

abstract: With the growing need for automation and the ongoing merge of OT and IT, industrial networks have to transport a high amount of heterogeneous data with mixed criticality such as control traffic, sensor data, and configuration messages. Current advances in IT technologies furthermore enable a new set of automation scenarios under the roof of Industry 4.0 and IIoT where industrial networks now have to meet new requirements in flexibility and reliability. The necessary real-time guarantees will place significant demands on the networks. In this paper, we identify IIoT use cases and infer real-time requirements along several axes before bridging the gap between real-time network technologies and the identified scenarios. We review real-time networking technologies and present peer-reviewed works from the past 5 years for industrial environments. We investigate how these can be applied to controllers, systems, and embedded devices. Finally, we discuss open challenges for real-time communication technologies to enable the identified scenarios. The review shows academic interest in the field of real-time communication technologies but also highlights a lack of a fixed set of standards important for trust in safety and reliability, especially where wireless technologies are concerned.


title: Unravelling Interaction and Temperature Contributions in Unpolarized Trapped Fermionic Atoms in the BCS Regime

abstract: In the BCS limit density profiles for unpolarized trapped fermionic clouds of atoms are largely featureless. Therefore, it is a delicate task to analyze them in order to quantify their respective interaction and temperature contributions. Temperature measurements have so far been mostly considered in an indirect way, where one sweeps isentropically from the BCS to the BEC limit. Instead we suggest here a direct thermometry, which relies on measuring the column density and comparing the obtained data with a Hartree-Bogoliubov mean-field theory combined with a local density approximation. In case of an attractive interaction between two-components of $^{6}$Li atoms trapped in a tri-axial harmonic confinement we show that minimizing the error within such an experiment-theory collaboration turns out to be a reasonable criterion for analyzing in detail measured densities and, thus, for ultimately determining the sample temperatures. The findings are discussed in view of various possible sources of errors.


title: A Formalization of Finite Group Theory: Part III

abstract: This is the third and final installment of an exposition of an ACL2 formalization of finite group theory. Part I covers groups and subgroups, cosets, normal subgroups, and quotient groups. Part II extends the theory in the developmnent of group homomorphisms and direct products, which are applied in a proof of the Fundamental Theorem of Finite Abelian Groups. The central topics of the present paper are the symmetric groups and the Sylow theorems, which pertain to subgroups of prime power order. Since these theorems are based on the conjugation of subgroups, an example of a group action on a set, their presentation is preceded by a comprehensive treatment of group actions. Our final result is mainly an application of the Sylow theorems: after showing that the alternating group of order 60 is simple (i.e., has no proper normal subgroup), we prove that no group of non-prime order less than 60 is simple. The combined content of the groups directory is a close approximation to that of an advanced undergraduate course taught by the author in 1976.


title: A Case Study in Analytic Protocol Analysis in ACL2

abstract: When verifying computer systems we sometimes want to study their asymptotic behaviors, i.e., how they behave in the long run. In such cases, we need real analysis, the area of mathematics that deals with limits and the foundations of calculus. In a prior work, we used real analysis in ACL2s to study the asymptotic behavior of the RTO computation, commonly used in congestion control algorithms across the Internet. One key component in our RTO computation analysis was proving in ACL2s that for all alpha in [0, 1), the limit as n approaches infinity of alpha raised to n is zero. Whereas the most obvious proof strategy involves the logarithm, whose codomain includes irrationals, by default ACL2 only supports rationals, which forced us to take a non-standard approach. In this paper, we explore different approaches to proving the above result in ACL2(r) and ACL2s, from the perspective of a relatively new user to each. We also contextualize the theorem by showing how it allowed us to prove important asymptotic properties of the RTO computation. Finally, we discuss tradeoffs between the various proof strategies and directions for future research.


title: Advances in ACL2 Proof Debugging Tools

abstract: The experience of an ACL2 user generally includes many failed proof attempts. A key to successful use of the ACL2 prover is the effective use of tools to debug those failures. We focus on changes made after ACL2 Version 8.5: the improved break-rewrite utility and the new utility, with-brr-data.


title: Using Counterexample Generation and Theory Exploration to Suggest Missing Hypotheses

abstract: Newcomers to ACL2 are sometimes surprised that ACL2 rejects formulas that they believe should be theorems, such as (REVERSE (REVERSE X)) = X. Experienced ACL2 users will recognize that the theorem only holds for intended values of X, and given ACL2's total logic, there are many counterexamples for which this formula is simply not true. Counterexample generation (cgen) is a technique that helps by giving the user a number of counterexamples (and also witnesses) to the formula, e.g., letting the user know that the intended theorem is false when X is equal to 10. In this paper we describe a tool called DrLA that goes further by suggesting additional hypotheses that will make the theorem true. In this case, for example, DrLA may suggest that X needs to be either a TRUE-LIST or a STRING. The suggestions are discovered using the ideas of theory exploration and subsumption from automated theorem proving.


title: Formal Verification of Zero-Knowledge Circuits

abstract: Zero-knowledge circuits are sets of equality constraints over arithmetic expressions interpreted in a prime field; they are used to encode computations in cryptographic zero-knowledge proofs. We make the following contributions to the problem of ensuring that a circuit correctly encodes a computation: a formal framework for circuit correctness; an ACL2 library for prime fields; an ACL2 model of the existing R1CS (Rank-1 Constraint Systems) formalism to represent circuits, along with ACL2 and Axe tools to verify circuits of this form; a novel PFCS (Prime Field Constraint Systems) formalism to represent hierarchically structured circuits, along with an ACL2 model of it and ACL2 tools to verify circuits of this form in a compositional and scalable way; verification of circuits, ranging from simple to complex; and discovery of bugs and optimizations in existing zero-knowledge systems.


title: Verification of GossipSub in ACL2s

abstract: GossipSub is a popular new peer-to-peer network protocol designed to disseminate messages quickly and efficiently by allowing peers to forward the full content of messages only to a dynamically selected subset of their neighboring peers (mesh neighbors) while gossiping about messages they have seen with the rest. Peers decide which of their neighbors to graft or prune from their mesh locally and periodically using a score for each neighbor. Scores are calculated using a score function that depends on mesh-specific parameters, weights and counters relating to a peer's performance in the network. Since a GossipSub network's performance ultimately depends on the performance of its peers, an important question arises: Is the score calculation mechanism effective in weeding out non-performing or even intentionally misbehaving peers from meshes? We answered this question in the negative in our companion paper by reasoning about GossipSub using our formal, official and executable ACL2s model. Based on our findings, we synthesized and simulated attacks against GossipSub which were confirmed by the developers of GossipSub, FileCoin, and Eth2.0, and publicly disclosed in MITRE CVE-2022-47547. In this paper, we present a detailed description of our model. We discuss design decisions, security properties of GossipSub, reasoning about the security properties in context of our model, attack generation and lessons we learnt when writing it.


title: Proving Calculational Proofs Correct

abstract: Teaching proofs is a crucial component of any undergraduate-level program that covers formal reasoning. We have developed a calculational reasoning format and refined it over several years of teaching a freshman-level course, "Logic and Computation", to thousands of undergraduate students. In our companion paper, we presented our calculational proof format, gave an overview of the calculational proof checker (CPC) tool that we developed to help users write and validate proofs, described some of the technical and implementation details of CPC and provided several publicly available proofs written using our format. In this paper, we dive deeper into the implementation details of CPC, highlighting how proof validation works, which helps us argue that our proof checking process is sound.


title: ACL2 Proofs of Nonlinear Inequalities with Imandra

abstract: We present a proof-producing integration of ACL2 and Imandra for proving nonlinear inequalities. This leverages a new Imandra interface exposing its nonlinear decision procedures. The reasoning takes place over the reals, but the proofs produced are valid over the rationals and may be run in both ACL2 and ACL2(r). The ACL2 proofs Imandra constructs are extracted from Positivstellensatz refutations, a real algebraic analogue of the Nullstellensatz, and are found using convex optimization.


title: Verification of a Rust Implementation of Knuth's Dancing Links using ACL2

abstract: Dancing Links connotes an optimization to a circular doubly-linked list data structure implementation which provides for fast list element removal and restoration. The Dancing Links optimization is used primarily in fast algorithms to find exact covers, and has been popularized by Knuth in Volume 4B of his seminal series The Art of Computer Programming. We describe an implementation of the Dancing Links optimization in the Rust programming language, as well as its formal verification using the ACL2 theorem prover. Rust has garnered significant endorsement in the past few years as a modern, memory-safe successor to C/C++ at companies such as Amazon, Google, and Microsoft, and is being integrated into both the Linux and Windows operating system kernels. Our interest in Rust stems from its potential as a hardware/software co-assurance language, with application to critical systems. We have crafted a Rust subset, inspired by Russinoff's Restricted Algorithmic C (RAC), which we have imaginatively named Restricted Algorithmic Rust, or RAR. In previous work, we described our initial implementation of a RAR toolchain, wherein we simply transpile the RAR source into RAC. By so doing, we leverage a number of existing hardware/software co-assurance tools with a minimum investment of time and effort. In this paper, we describe the RAR Rust subset, describe our improved prototype RAR toolchain, and detail the design and verification of a circular doubly-linked list data structure employing the Dancing Links optimization in RAR, with full proofs of functional correctness accomplished using the ACL2 theorem prover.


title: Toulouse Hyperspectral Data Set: a benchmark data set to assess semi-supervised spectral representation learning and pixel-wise classification techniques

abstract: Airborne hyperspectral images can be used to map the land cover in large urban areas, thanks to their very high spatial and spectral resolutions on a wide spectral domain. While the spectral dimension of hyperspectral images is highly informative of the chemical composition of the land surface, the use of state-of-the-art machine learning algorithms to map the land cover has been dramatically limited by the availability of training data. To cope with the scarcity of annotations, semi-supervised and self-supervised techniques have lately raised a lot of interest in the community. Yet, the publicly available hyperspectral data sets commonly used to benchmark machine learning models are not totally suited to evaluate their generalization performances due to one or several of the following properties: a limited geographical coverage (which does not reflect the spectral diversity in metropolitan areas), a small number of land cover classes and a lack of appropriate standard train / test splits for semi-supervised and self-supervised learning. Therefore, we release in this paper the Toulouse Hyperspectral Data Set that stands out from other data sets in the above-mentioned respects in order to meet key issues in spectral representation learning and classification over large-scale hyperspectral images with very few labeled pixels. Besides, we discuss and experiment self-supervised techniques for spectral representation learning, including the Masked Autoencoder, and establish a baseline for pixel-wise classification achieving 85% overall accuracy and 77% F1 score. The Toulouse Hyperspectral Data Set and our code are publicly available at https://www.toulouse-hyperspectral-data-set.com and https://www.github.com/Romain3Ch216/tlse-experiments, respectively.


title: Systematic study of the low-lying electric dipole strength in Sn isotopes and its astrophysical implications

abstract: The $\gamma$-ray strength functions (GSF) and nuclear level densities (NLD) below the neutron threshold have been extracted for $^{111-113,116-122,124}$Sn from particle-$\gamma$ coincidence data with the Oslo method. The evolution of bulk properties of the low-lying electric dipole response has been investigated on the basis of the Oslo GSF data and results of a recent systematic study of electric and magnetic dipole strengths in even-even Sn isotopes with relativistic Coulomb excitation. The obtained GSFs reveal a resonance-like peak on top of the tail of the isovector giant dipole resonance, centered at $\approx$8 MeV and exhausting $\approx$2\% of the classical Thomas-Reiche-Kuhn (TRK) sum. In contrast to predictions of the relativistic quasiparticle random-phase and time-blocking approximation calculations (RQRPA and RQTBA), no monotonous increase in the total low-lying $E1$ strength was observed in the experimental data from $^{111}$Sn to $^{124}$Sn, demonstrating rather similar strength distributions in these nuclei. The Oslo GSFs and NLDs were further used as inputs to constrain the cross sections and Maxwellian-averaged cross sections of $(n,\gamma)$ reactions in the Sn isotopic chain using TALYS. The obtained results agree well with other available experimental data and the recommended values from the JINA REACLIB, BRUSLIB, and KADoNiS libraries. Despite relatively small exhausted fractions of the TRK sum rule, the low-lying electric dipole strength makes a noticeable impact on the radiative neutron-capture cross sections in stable Sn isotopes. Moreover, the experimental Oslo inputs for the $^{121,123}$Sn$(n,\gamma)$$^{122,124}$Sn reactions were found to affect the production of Sb in the astrophysical $i$-process, providing new constraints on the uncertainties of the resulting chemical abundances from multi-zone low-metallicity Asymptotic Giant Branch stellar models.


title: Nuclear level densities and $\gamma-$ray strength functions of $^{111,112,113}$Sn isotopes studied with the Oslo method

abstract: The $^{111,112,113}$Sn isotopes have been studied with ($p,d \gamma$), ($p,p^{\prime} \gamma$), and ($d,p \gamma$) reactions to extract the nuclear level densities (NLDs) and $\gamma$-ray strength functions (GSFs) of these nuclei below the neutron separation energy by means of the Oslo method. The experimental NLDs for all three nuclei demonstrate a trend compatible with the constant-temperature model below the neutron separation energy while also being in good agreement with the NLDs of neighboring Sn isotopes, obtained previously with the Oslo-type and neutron evaporation experiments. The extracted microcanonical entropies yield $\approx 1.5$ $k_B$ entropy of a valence neutron in both $^{111}$Sn and $^{113}$Sn. Moreover, the deduced microcanonical temperatures indeed suggest a clear constant-temperature behavior above $\approx$ 3 MeV in $^{111,113}$Sn and above $\approx$ 4.5 MeV in $^{112}$Sn. We observe signatures for the first broken neutron pairs between 2 and 4 MeV in all three nuclei. The GSFs obtained with the Oslo method are found to be in good agreement below the neutron threshold with the strengths of $^{112,114}$Sn extracted in the ($p,p^{\prime}$) Coulomb excitation experiments.


title: A Formalization of Finite Group Theory: Part II

abstract: This is the second installment of an exposition of an ACL2 formalization of finite group theory. The first, which was presented at the 2022 ACL2 workshop, covered groups and subgroups, cosets, normal subgroups, and quotient groups, culminating in a proof of Cauchy's Theorem: If the order of a group G is divisible by a prime p, then G has an element of order p. This sequel addresses homomorphisms, direct products, and the Fundamental Theorem of Finite Abelian Groups: Every finite abelian group is isomorphic to the direct product of a list of cyclic p-groups, the orders of which are unique up to permutation. This theorem is a suitable application of ACL2 because of its extensive reliance on recursion and induction as well as the constructive nature of the factorization. The proof of uniqueness is especially challenging, requiring the formalization of vague intuition that is commonly taken as self-evident.


title: Gigahertz-rate-switchable wavefront shaping through integration of metasurfaces with photonic integrated circuit

abstract: Achieving spatiotemporal control of light at high-speeds presents immense possibilities for various applications in communication, computation, metrology, and sensing. The integration of subwavelength metasurfaces and optical waveguides offers a promising approach to manipulate light across multiple degrees of freedom at high-speed in compact photonic integrated circuit (PICs) devices. Here, we demonstrate a gigahertz-rate-switchable wavefront shaping by integrating metasurface, lithium niobite on insulator (LNOI) photonic waveguide and electrodes within a PIC device. As proofs of concept, we showcase the generation of a focus beam with reconfigurable arbitrary polarizations, switchable focusing with lateral focal positions and focal length, orbital angular momentum light beams (OAMs) as well as Bessel beams. Our measurements indicate modulation speeds of up to gigahertz rate. This integrated platform offers a versatile and efficient means of controlling light field at high-speed within a compact system, paving the way for potential applications in optical communication, computation, sensing, and imaging.


title: Color Fault-Tolerant Spanners

abstract: We initiate the study of spanners in arbitrarily vertex- or edge-colored graphs (with no "legality" restrictions), that are resilient to failures of entire color classes. When a color fails, all vertices/edges of that color crash. An $f$-color fault-tolerant ($f$-CFT) $t$-spanner of an $n$-vertex colored graph $G$ is a subgraph $H$ that preserves distances up to factor $t$, even in the presence of at most $f$ color faults. This notion generalizes the well-studied $f$-vertex/edge fault-tolerant ($f$-V/EFT) spanners. The size of an $f$-V/EFT spanner crucially depends on the number $f$ of vertex/edge faults to be tolerated. In the colored variants, even a single color fault can correspond to an unbounded number of vertex/edge faults. The key conceptual contribution of this work is in showing that the size (number of edges) required by an $f$-CFT spanner is in fact comparable to its uncolored counterpart, with no dependency on the size of color classes. We provide optimal bounds on the size required by $f$-CFT spanners, revealing an interesting phenomenon: while (individual) edge faults are "easier" than vertex faults in terms of spanner size, edge-color faults are "harder" than vertex-color faults. Our upper bounds are based on a generalization of the blocking set technique of [Bodwin and Patel, PODC 2019] for analyzing the (exponential-time) greedy algorithm for FT spanners. We complement them by providing efficient constructions of CFT spanners with similar size guarantees, based on the algorithm of [Dinitz and Robelle, PODC 2020].


title: Origin of an Orbiting Star Around the Galactic Supermassive Black Hole

abstract: The tremendous tidal force that is linked to the supermassive black hole (SMBH) at the center of our galaxy is expected to strongly subdue star formation in its vicinity. Stars within 1" from the SMBH thus likely formed further from the SMBH and migrated to their current positions. In this study, spectroscopic observations of the star S0-6/S10, one of the closest (projected distance from the SMBH of about 0.3") late-type stars were conducted. Using metal absorption lines in the spectra of S0-6, the radial velocity of S0-6 from 2014 to 2021 was measured, and a marginal acceleration was detected, which indicated that S0-6 is close to the SMBH. The S0-6 spectra were employed to determine its stellar parameters including temperature, chemical abundances ([M/H], [Fe/H], [alpha/Fe], [Ca/Fe], [Mg/Fe], [Ti/Fe]), and age. As suggested by the results of this study, S0-6 is very old (> ~10 Gyr) and has an origin different from that of stars born in the central pc region.


title: One-Shot Federated Learning with Classifier-Guided Diffusion Models

abstract: One-shot federated learning (OSFL) has gained attention in recent years due to its low communication cost. However, most of the existing methods require auxiliary datasets or training generators, which hinders their practicality in real-world scenarios. In this paper, we explore the novel opportunities that diffusion models bring to OSFL and propose FedCADO, utilizing guidance from client classifiers to generate data that complies with clients' distributions and subsequently training the aggregated model on the server. Specifically, our method involves targeted optimizations in two aspects. On one hand, we conditionally edit the randomly sampled initial noises, embedding them with specified semantics and distributions, resulting in a significant improvement in both the quality and stability of generation. On the other hand, we employ the BN statistics from the classifiers to provide detailed guidance during generation. These tailored optimizations enable us to limitlessly generate datasets, which closely resemble the distribution and quality of the original client dataset. Our method effectively handles the heterogeneous client models and the problems of non-IID features or labels. In terms of privacy protection, our method avoids training any generator or transferring any auxiliary information on clients, eliminating any additional privacy leakage risks. Leveraging the extensive knowledge stored in the pre-trained diffusion model, the synthetic datasets can assist us in surpassing the knowledge limitations of the client samples, resulting in aggregation models that even outperform the performance ceiling of centralized training in some cases, which is convincingly demonstrated in the sufficient quantification and visualization experiments conducted on three large-scale multi-domain image datasets.


title: A short note on super-hedging an arbitrary number of European options with integer-valued strategies

abstract: The usual theory of asset pricing in finance assumes that the financial strategies, i.e. the quantity of risky assets to invest, are real-valued so that they are not integer-valued in general, see the Black and Scholes model for instance. This is clearly contrary to what it is possible to do in the real world. Surprisingly, it seems that there is no many contributions in that direction in the literature, except for a finite number of states. In this paper, for arbitrary {\Omega}, we show that, in discrete-time, it is possible to evaluate the minimal super-hedging price when we restrict ourselves to integer-valued strategies. To do so, we only consider terminal claims that are continuous piecewise affine functions of the underlying asset. We formulate a dynamic programming principle that can be directly implemented on an historical data and which also provides the optimal integer-valued strategy. The problem with general payoffs remains open but should be solved with the same approach.


title: Multilevel Monte Carlo methods for the Dean-Kawasaki equation from Fluctuating Hydrodynamics

abstract: Stochastic PDEs of Fluctuating Hydrodynamics are a powerful tool for the description of fluctuations in many-particle systems. In this paper, we develop and analyze a Multilevel Monte Carlo (MLMC) scheme for the Dean--Kawasaki equation, a pivotal representative of this class of SPDEs. We prove analytically and demonstrate numerically that our MLMC scheme provides a significant reduction in computational cost (with respect to a standard Monte Carlo method) in the simulation of the Dean--Kawasaki equation. Specifically, we link this reduction in cost to having a sufficiently large average particle density, and show that sizeable cost reductions can be obtained even when we have solutions with regions of low density. Numerical simulations are provided in the two-dimensional case, confirming our theoretical predictions. Our results are formulated entirely in terms of the law of distributions rather than in terms of strong spatial norms: this crucially allows for MLMC speed-ups altogether despite the Dean--Kawasaki equation being highly singular.


title: A new shift operator-based polynomial method in additive combinatorics

abstract: We introduce a new form of the polynomial method based on what we call "shift operators," which we use to give efficient and intuitive new proofs of results previously shown using a wide range of polynomial methods, including Alon's Combinatorial Nullstellensatz and the Croot-Lev-Pach method. We end by discussing some potential new directions in which the tools introduced here may be fruitfully applied.


title: Human-in-the-loop: Towards Label Embeddings for Measuring Classification Difficulty

abstract: Uncertainty in machine learning models is a timely and vast field of research. In supervised learning, uncertainty can already occur in the first stage of the training process, the annotation phase. This scenario is particularly evident when some instances cannot be definitively classified. In other words, there is inevitable ambiguity in the annotation step and hence, not necessarily a "ground truth" associated with each instance. The main idea of this work is to drop the assumption of a ground truth label and instead embed the annotations into a multidimensional space. This embedding is derived from the empirical distribution of annotations in a Bayesian setup, modeled via a Dirichlet-Multinomial framework. We estimate the model parameters and posteriors using a stochastic Expectation Maximization algorithm with Markov Chain Monte Carlo steps. The methods developed in this paper readily extend to various situations where multiple annotators independently label instances. To showcase the generality of the proposed approach, we apply our approach to three benchmark datasets for image classification and Natural Language Inference. Besides the embeddings, we can investigate the resulting correlation matrices, which reflect the semantic similarities of the original classes very well for all three exemplary datasets.


title: The Monogenicity of Power-Compositional Characteristic Polynomials

abstract: Let $f(x)\in {\mathbb Z}[x]$ be monic of degree $N\ge 2$. Suppose that $f(x)$ is monogenic, and that $f(x)$ is the characteristic polynomial of the $N$th order linear recurrence sequence $\Upsilon_f:=(U_n)_{n\ge 0}$ with initial conditions \[U_0=U_1=\cdots =U_{N-2}=0 \quad \mbox{and} \quad U_{N-1}=1.\] Let $p$ be a prime such that $f(x)$ is irreducible over ${\mathbb F}_p$ and $f(x^p)$ is irreducible over ${\mathbb Q}$. We prove that $f(x^p)$ is monogenic if and only if $\pi(p^2)\ne \pi(p)$, where $\pi(m)$ denotes the period of $\Upsilon_f$ modulo $m$. These results extend previous work of the author, and provide a new and simple test for the monogenicity of $f(x^p)$. We also provide some infinite families of such polynomials. This article extends previous work of the author.


title: Aerial IRS with Robotic Anchoring Capabilities: A Novel Way for Adaptive Coverage Enhancement

abstract: It is widely accepted that integrating intelligent reflecting surfaces (IRSs) with unmanned aerial vehicles (UAV) or drones can assist wireless networks in improving network coverage and end user Quality of Service (QoS). However, the critical constrain of drones is their very limited hovering/flying time. In this paper we propose the concept of robotic aerial IRSs (RA-IRSs), which are in essence drones that in addition to IRS embed an anchoring mechanism that allows them to grasp in an energy neutral manner at tall urban landforms such as lampposts. By doing so, RA-IRSs can completely eliminate the flying/hovering energy consumption and can offer service for multiple hours or even days (something not possible with UAV-mounted IRSs). Using that property we show how RA-IRS can increase network performance by changing their anchoring location to follow the spatio-temporal traffic demand. The proposed methodology, developed through Integer Linear Programming (ILP) formulations offers a significant Signal-to-Noise (SNR) gain in highly heterogeneous regions in terms of traffic demand compared to fixed IRS; hence, addressing urban coverage discrepancies effectively. Numerical simulations validate the superiority of RA-IRSs over fixed terrestrial IRSs in terms of traffic serviceability, sustaining more than 2 times the traffic demand in areas experiencing high heterogeneity, emphasizing their adaptability in improving coverage and QoS in complex urban terrains.


title: Llamas Know What GPTs Don't Show: Surrogate Models for Confidence Estimation

abstract: To maintain user trust, large language models (LLMs) should signal low confidence on examples where they are incorrect, instead of misleading the user. The standard approach of estimating confidence is to use the softmax probabilities of these models, but as of November 2023, state-of-the-art LLMs such as GPT-4 and Claude-v1.3 do not provide access to these probabilities. We first study eliciting confidence linguistically -- asking an LLM for its confidence in its answer -- which performs reasonably (80.5% AUC on GPT-4 averaged across 12 question-answering datasets -- 7% above a random baseline) but leaves room for improvement. We then explore using a surrogate confidence model -- using a model where we do have probabilities to evaluate the original model's confidence in a given question. Surprisingly, even though these probabilities come from a different and often weaker model, this method leads to higher AUC than linguistic confidences on 9 out of 12 datasets. Our best method composing linguistic confidences and surrogate model probabilities gives state-of-the-art confidence estimates on all 12 datasets (84.6% average AUC on GPT-4).


title: Multi-objective Non-intrusive Hearing-aid Speech Assessment Model

abstract: Without the need for a clean reference, non-intrusive speech assessment methods have caught great attention for objective evaluations. While deep learning models have been used to develop non-intrusive speech assessment methods with promising results, there is limited research on hearing-impaired subjects. This study proposes a multi-objective non-intrusive hearing-aid speech assessment model, called HASA-Net Large, which predicts speech quality and intelligibility scores based on input speech signals and specified hearing-loss patterns. Our experiments showed the utilization of pre-trained SSL models leads to a significant boost in speech quality and intelligibility predictions compared to using spectrograms as input. Additionally, we examined three distinct fine-tuning approaches that resulted in further performance improvements. Furthermore, we demonstrated that incorporating SSL models resulted in greater transferability to OOD dataset. Finally, this study introduces HASA-Net Large, which is a non-invasive approach for evaluating speech quality and intelligibility. HASA-Net Large utilizes raw waveforms and hearing-loss patterns to accurately predict speech quality and intelligibility levels for individuals with normal and impaired hearing and demonstrates superior prediction performance and transferability.


title: Voice App Developer Experiences with Alexa and Google Assistant: Juggling Risks, Liability, and Security

abstract: Voice applications (voice apps) are a key element in Voice Assistant ecosystems such as Amazon Alexa and Google Assistant, as they provide assistants with a wide range of capabilities that users can invoke with a voice command. Most voice apps, however, are developed by third parties - i.e., not by Amazon/Google - and they are included in the ecosystem through marketplaces akin to smartphone app stores but with crucial differences, e.g., the voice app code is not hosted by the marketplace and is not run on the local device. Previous research has studied the security and privacy issues of voice apps in the wild, finding evidence of bad practices by voice app developers. However, developers' perspectives are yet to be explored. In this paper, we report a qualitative study of the experiences of voice app developers and the challenges they face. Our findings suggest that: 1) developers face several risks due to liability pushed on to them by the more powerful voice assistant platforms, which are linked to negative privacy and security outcomes on voice assistant platforms; and 2) there are key issues around monetization, privacy, design, and testing rooted in problems with the voice app certification process. We discuss the implications of our results for voice app developers, platforms, regulators, and research on voice app development and certification.


title: Motion Control of Two Mobile Robots under Allowable Collisions

abstract: This letter investigates the motion control problem of two mobile robots under allowable collisions. Here, the allowable collisions mean that the collisions do not damage the mobile robots. The occurrence of the collisions is discussed and the effects of the collisions on the mobile robots are analyzed to develop a hybrid model of each mobile robot under allowable collisions. Based on the effects of the collisions, we show the necessity of redesigning the motion control strategy for mobile robots. Furthermore, impulsive control techniques are applied to redesign the motion control strategy to guarantee the task accomplishment for each mobile robot. Finally, an example is used to illustrate the redesigned motion control strategy.