title: IPDnet: A Universal Direct-Path IPD Estimation Network for Sound Source Localization

abstract: Extracting direct-path spatial feature is crucial for sound source localization in adverse acoustic environments. This paper proposes the IPDnet, a neural network that estimates direct-path inter-channel phase difference (DP-IPD) of sound sources from microphone array signals. The estimated DP-IPD can be easily translated to source location based on the known microphone array geometry. First, a full-band and narrow-band fusion network is proposed for DP-IPD estimation, in which alternating narrow-band and full-band layers are responsible for estimating the rough DP-IPD information in one frequency band and capturing the frequency correlations of DP-IPD, respectively. Second, a new multi-track DP-IPD learning target is proposed for the localization of flexible number of sound sources. Third, the IPDnet is extend to handling variable microphone arrays, once trained which is able to process arbitrary microphone arrays with different number of channels and array topology. Experiments of multiple-moving-speaker localization are conducted on both simulated and real-world data, which show that the proposed full-band and narrow-band fusion network and the proposed multi-track DP-IPD learning target together achieves excellent sound source localization performance. Moreover, the proposed variable-array model generalizes well to unseen microphone arrays.


title: DTMamba : Dual Twin Mamba for Time Series Forecasting

abstract: We utilized the Mamba model for time series data prediction tasks, and the experimental results indicate that our model performs well.


title: Efficient Real-world Image Super-Resolution Via Adaptive Directional Gradient Convolution

abstract: Real-SR endeavors to produce high-resolution images with rich details while mitigating the impact of multiple degradation factors. Although existing methods have achieved impressive achievements in detail recovery, they still fall short when addressing regions with complex gradient arrangements due to the intensity-based linear weighting feature extraction manner. Moreover, the stochastic artifacts introduced by degradation cues during the imaging process in real LR increase the disorder of the overall image details, further complicating the perception of intrinsic gradient arrangement. To address these challenges, we innovatively introduce kernel-wise differential operations within the convolutional kernel and develop several learnable directional gradient convolutions. These convolutions are integrated in parallel with a novel linear weighting mechanism to form an Adaptive Directional Gradient Convolution (DGConv), which adaptively weights and fuses the basic directional gradients to improve the gradient arrangement perception capability for both regular and irregular textures. Coupled with DGConv, we further devise a novel equivalent parameter fusion method for DGConv that maintains its rich representational capabilities while keeping computational costs consistent with a single Vanilla Convolution (VConv), enabling DGConv to improve the performance of existing super-resolution networks without incurring additional computational expenses. To better leverage the superiority of DGConv, we further develop an Adaptive Information Interaction Block (AIIBlock) to adeptly balance the enhancement of texture and contrast while meticulously investigating the interdependencies, culminating in the creation of a DGPNet for Real-SR through simple stacking. Comparative results with 15 SOTA methods across three public datasets underscore the effectiveness and efficiency of our proposed approach.


title: Demystifying the Hypercomplex: Inductive Biases in Hypercomplex Deep Learning

abstract: Hypercomplex algebras have recently been gaining prominence in the field of deep learning owing to the advantages of their division algebras over real vector spaces and their superior results when dealing with multidimensional signals in real-world 3D and 4D paradigms. This paper provides a foundational framework that serves as a roadmap for understanding why hypercomplex deep learning methods are so successful and how their potential can be exploited. Such a theoretical framework is described in terms of inductive bias, i.e., a collection of assumptions, properties, and constraints that are built into training algorithms to guide their learning process toward more efficient and accurate solutions. We show that it is possible to derive specific inductive biases in the hypercomplex domains, which extend complex numbers to encompass diverse numbers and data structures. These biases prove effective in managing the distinctive properties of these domains, as well as the complex structures of multidimensional and multimodal signals. This novel perspective for hypercomplex deep learning promises to both demystify this class of methods and clarify their potential, under a unifying framework, and in this way promotes hypercomplex models as viable alternatives to traditional real-valued deep learning for multidimensional signal processing.


title: Second-Order Dissociation and Transition of Heavy Quarkonia in the Quark-Gluon Plasma

abstract: We revisit the dissociation of heavy quarkonia by thermal partons at the next-to-leading order (NLO, also known as inelastic parton scattering dissociation) in the Quark-Gluon Plasma (QGP). Utilizing the chromo-electric dipole coupling from QCD multipole expansion as an effective Hamiltonian, this has been conducted in the approach of second-order quantum mechanical perturbation theory, which allows us to systematically incorporate the bound state wave functions. Employing the quarkonium wave functions and binding energies obtained from an in-medium potential model, we then numerically evaluate the dissociation cross sections and rates for various charmonia and bottomonia, where the infrared and collinear divergences are regularized by the thermal masses of medium partons. We demonstrate that distinct from the leading order (LO, also known as gluo-dissociation) counterparts peaking at relatively low gluon energy and falling off thereafter, the NLO cross sections first grow and then nearly saturate as the incident parton energy increases, as a result of the outgoing parton carrying away the excess energy. The resulting NLO dissociation rates increase with temperature and take over from the LO counterparts toward high temperatures, similar to pertinent findings from previous studies. We also evaluate the in-medium second-order transition between different bound states, which may contribute to the total thermal decay widths of heavy quarkonia in the QGP.


title: Selective Randomization Inference for Adaptive Experiments

abstract: Adaptive experiments use preliminary analyses of the data to inform further course of action and are commonly used in many disciplines including medical and social sciences. Because the null hypothesis and experimental design are not pre-specified, it has long been recognized that statistical inference for adaptive experiments is not straightforward. Most existing methods only apply to specific adaptive designs and rely on strong assumptions. In this work, we propose selective randomization inference as a general framework for analyzing adaptive experiments. In a nutshell, our approach applies conditional post-selection inference to randomization tests. By using directed acyclic graphs to describe the data generating process, we derive a selective randomization p-value that controls the selective type-I error without requiring independent and identically distributed data or any other modelling assumptions. We show how rejection sampling and Markov Chain Monte Carlo can be used to compute the selective randomization p-values and construct confidence intervals for a homogeneous treatment effect. To mitigate the risk of disconnected confidence intervals, we propose the use of hold-out units. Lastly, we demonstrate our method and compare it with other randomization tests using synthetic and real-world data.


title: TD-NeRF: Novel Truncated Depth Prior for Joint Camera Pose and Neural Radiance Field Optimization

abstract: The reliance on accurate camera poses is a significant barrier to the widespread deployment of Neural Radiance Fields (NeRF) models for 3D reconstruction and SLAM tasks. The existing method introduces monocular depth priors to jointly optimize the camera poses and NeRF, which fails to fully exploit the depth priors and neglects the impact of their inherent noise. In this paper, we propose Truncated Depth NeRF (TD-NeRF), a novel approach that enables training NeRF from unknown camera poses - by jointly optimizing learnable parameters of the radiance field and camera poses. Our approach explicitly utilizes monocular depth priors through three key advancements: 1) we propose a novel depth-based ray sampling strategy based on the truncated normal distribution, which improves the convergence speed and accuracy of pose estimation; 2) to circumvent local minima and refine depth geometry, we introduce a coarse-to-fine training strategy that progressively improves the depth precision; 3) we propose a more robust inter-frame point constraint that enhances robustness against depth noise during training. The experimental results on three datasets demonstrate that TD-NeRF achieves superior performance in the joint optimization of camera pose and NeRF, surpassing prior works, and generates more accurate depth geometry. The implementation of our method has been released at https://github.com/nubot-nudt/TD-NeRF.


title: Systematic Search and Study of Short-Timescale Flare Structures in BL Lac object Gamma-ray Emission

abstract: We present here the first systematic search of short timescale $\gamma$-ray flares from 29 high Galactic latitude BL Lac objects over 14 years of Fermi Large Area Telescope data. Using a combined Bayesian Blocks and HOP algorithm, we identified seven high-quality orbital timescale flare segments from three sources and quantified 24 short-timescale flare structures. We then performed a comprehensive analysis of flare symmetry, power spectral density (PSD) of variability, and flux-photon index relation. The main results are as follows: (1) The flare symmetry parameter $A$ shows a "U-shaped" distribution. Short timescale flares are symmetric while long timescale flares are asymmetric. The number of fast-rise slow-decay and slow-rise fast-decay type flares are equal. No correlation is found between $A$ and peak/integral flux. No parameter evolution is seen between consecutive flares either. The observations support a scenario where longer timescale flares originate from superposition of short, symmetric sub-hour flares. (2) PSD from yearly to hourly timescales is modeled using the CARMA process. At lower frequencies, the PSD follows the typical broken power-law form. The high-frequency region of the PSD exhibits a continuous power-law shape, indicating that $\gamma$-ray variability originates from a single physical process across all probed timescales. (3) The flux-photon index distribution shows a pattern of "harder-when-brighter" or "softer-when-brighter," but becomes flat above a certain critical flux, with $\Gamma$ $\approx$ 2. This behavior cannot be simply explained by a two-component or blazar sequence model, and we speculate it may be related to complex interplay between electron acceleration and cooling.


title: A framework of text-dependent speaker verification for chinese numerical string corpus

abstract: The Chinese numerical string corpus, serves as a valuable resource for speaker verification, particularly in financial transactions. Researches indicate that in short speech scenarios, text-dependent speaker verification (TD-SV) consistently outperforms text-independent speaker verification (TI-SV). However, TD-SV potentially includes the validation of text information, that can be negatively impacted by reading rhythms and pauses. To address this problem, we propose an end-to-end speaker verification system that enhances TD-SV by decoupling speaker and text information. Our system consists of a text embedding extractor, a speaker embedding extractor and a fusion module. In the text embedding extractor, we employ an enhanced Transformer and introduce a triple loss including text classification loss, connectionist temporal classification (CTC) loss and decoder loss; while in the speaker embedding extractor, we create a multi-scale pooling method by combining sliding window attentive statistics pooling (SWASP) with attentive statistics pooling (ASP). To mitigate the scarcity of data, we have recorded a publicly available Chinese numerical corpus named SHALCAS22A (hereinafter called SHAL), which can be accessed on Open-SLR. Moreover, we employ data augmentation techniques using Tacotron2 and HiFi-GAN. Our method achieves an equal error rate (EER) performance improvement of 49.2% on Hi-Mia and 75.0% on SHAL, respectively.


title: Lasso Ridge based XGBoost and Deep_LSTM Help Tennis Players Perform better

abstract: Understanding the dynamics of momentum and game fluctuation in tennis matches is cru-cial for predicting match outcomes and enhancing player performance. In this study, we present a comprehensive analysis of these factors using a dataset from the 2023 Wimbledon final. Ini-tially, we develop a sliding-window-based scoring model to assess player performance, ac-counting for the influence of serving dominance through a serve decay factor. Additionally, we introduce a novel approach, Lasso-Ridge-based XGBoost, to quantify momentum effects, lev-eraging the predictive power of XGBoost while mitigating overfitting through regularization. Through experimentation, we achieve an accuracy of 94% in predicting match outcomes, iden-tifying key factors influencing winning rates. Subsequently, we propose a Derivative of the winning rate algorithm to quantify game fluctuation, employing an LSTM_Deep model to pre-dict fluctuation scores. Our model effectively captures temporal correlations in momentum fea-tures, yielding mean squared errors ranging from 0.036 to 0.064. Furthermore, we explore me-ta-learning using MAML to transfer our model to predict outcomes in ping-pong matches, though results indicate a comparative performance decline. Our findings provide valuable in-sights into momentum dynamics and game fluctuation, offering implications for sports analytics and player training strategies.


title: Global Motion Understanding in Large-Scale Video Object Segmentation

abstract: In this paper, we show that transferring knowledge from other domains of video understanding combined with large-scale learning can improve robustness of Video Object Segmentation (VOS) under complex circumstances. Namely, we focus on integrating scene global motion knowledge to improve large-scale semi-supervised Video Object Segmentation. Prior works on VOS mostly rely on direct comparison of semantic and contextual features to perform dense matching between current and past frames, passing over actual motion structure. On the other hand, Optical Flow Estimation task aims to approximate the scene motion field, exposing global motion patterns which are typically undiscoverable during all pairs similarity search. We present WarpFormer, an architecture for semi-supervised Video Object Segmentation that exploits existing knowledge in motion understanding to conduct smoother propagation and more accurate matching. Our framework employs a generic pretrained Optical Flow Estimation network whose prediction is used to warp both past frames and instance segmentation masks to the current frame domain. Consequently, warped segmentation masks are refined and fused together aiming to inpaint occluded regions and eliminate artifacts caused by flow field imperfects. Additionally, we employ novel large-scale MOSE 2023 dataset to train model on various complex scenarios. Our method demonstrates strong performance on DAVIS 2016/2017 validation (93.0% and 85.9%), DAVIS 2017 test-dev (80.6%) and YouTube-VOS 2019 validation (83.8%) that is competitive with alternative state-of-the-art methods while using much simpler memory mechanism and instance understanding logic.


title: Large deviations in statistics of the local time and occupation time for a run and tumble particle

abstract: We investigate the statistics of the local time $\mathcal{T} = \int_0^T \delta(x(t)) dt$ that a run and tumble particle (RTP) $x(t)$ in one dimension spends at the origin, with or without an external drift. By relating the local time to the number of times the RTP crosses the origin, we find that the local time distribution $P(\mathcal{T})$ satisfies the large deviation principle $P(\mathcal{T}) \sim \, e^{-T \, I(\mathcal{T} / T)} $ in the large observation time limit $T \to \infty$. Remarkably, we find that in presence of drift the rate function $I(\rho)$ is nonanalytic: We interpret its singularity as dynamical phase transitions of first order. We then extend these results by studying the statistics of the amount of time $\mathcal{R}$ that the RTP spends inside a finite interval (i.e., the occupation time), with qualitatively similar results. In particular, this yields the long-time decay rate of the probability $P(\mathcal{R} = T)$ that the particle does not exit the interval up to time $T$. We find that the conditional endpoint distribution exhibits an interesting change of behavior from unimodal to bimodal as a function of the size of the interval. To study the occupation time statistics, we extend the Donsker-Varadhan large-deviation formalism to the case of RTPs, for general dynamical observables and possibly in the presence of an external potential.


title: A Performance Analysis Modeling Framework for Extended Reality Applications in Edge-Assisted Wireless Networks

abstract: Extended reality (XR) is at the center of attraction in the research community due to the emergence of augmented, mixed, and virtual reality applications. The performance of such applications needs to be uptight to maintain the requirements of latency, energy consumption, and freshness of data. Therefore, a comprehensive performance analysis model is required to assess the effectiveness of an XR application but is challenging to design due to the dependence of the performance metrics on several difficult-to-model parameters, such as computing resources and hardware utilization of XR and edge devices, which are controlled by both their operating systems and the application itself. Moreover, the heterogeneity in devices and wireless access networks brings additional challenges in modeling. In this paper, we propose a novel modeling framework for performance analysis of XR applications considering edge-assisted wireless networks and validate the model with experimental data collected from testbeds designed specifically for XR applications. In addition, we present the challenges associated with performance analysis modeling and present methods to overcome them in detail. Finally, the performance evaluation shows that the proposed analytical model can analyze XR applications' performance with high accuracy compared to the state-of-the-art analytical models.


title: Towards an Accessible and Rapidly Trainable Rhythm Sequencer Using a Generative Stacked Autoencoder

abstract: Neural networks and deep learning are often deployed for the sake of the most comprehensive music generation with as little involvement as possible from the human musician. Implementations in aid of, or being a tool for, music practitioners are sparse. This paper proposes the integration of generative stacked autoencoder structures for rhythm generation, within a conventional melodic step-sequencer. It further aims to work towards its implementation being accessible to the average electronic music practitioner. Several model architectures have been trained and tested for their creative potential. While the currently implementations do display limitations, they do represent viable creative solutions for music practitioners.


title: A Turkish Educational Crossword Puzzle Generator

abstract: This paper introduces the first Turkish crossword puzzle generator designed to leverage the capabilities of large language models (LLMs) for educational purposes. In this work, we introduced two specially created datasets: one with over 180,000 unique answer-clue pairs for generating relevant clues from the given answer, and another with over 35,000 samples containing text, answer, category, and clue data, aimed at producing clues for specific texts and keywords within certain categories. Beyond entertainment, this generator emerges as an interactive educational tool that enhances memory, vocabulary, and problem-solving skills. It's a notable step in AI-enhanced education, merging game-like engagement with learning for Turkish and setting new standards for interactive, intelligent learning tools in Turkish.


title: Dark Matter Physics in General NMSSM

abstract: In the General Next-to-Minimal Supersymmetric Standard Model (GNMSSM), singlet particles may form a secluded sector of dark matter (DM), in which Singlino-like DM could achieve the observed relic abundance through various channels such as $\tilde{\chi}_1^0 \tilde{\chi}_1^0 \to h_s h_s, A_s A_s, h_s A_s$, where $h_s$ and $A_s$ represent singlet-dominated CP-even and CP-odd Higgs bosons. We provide analytical formulas for both the spin-independent and spin-dependent cross sections of Singlino DM scattering with nucleons, illustrating their dependence on the model's parameters in a clear manner. We also present analytic expressions for the annihilation cross sections of these three important channels. Based on these preparations, we conducted Bayesian analyses of the GNMSSM and concluded that the theory significantly favored Singlino-dominated DM over Bino-like DM across a much broader range of parameters. The combined results from our numerical analyses and the formulas distinctly highlight crucial aspects of DM physics within the GNMSSM.


title: Robust Online Convex Optimization for Disturbance Rejection

abstract: Online convex optimization (OCO) is a powerful tool for learning sequential data, making it ideal for high precision control applications where the disturbances are arbitrary and unknown in advance. However, the ability of OCO-based controllers to accurately learn the disturbance while maintaining closed-loop stability relies on having an accurate model of the plant. This paper studies the performance of OCO-based controllers for linear time-invariant (LTI) systems subject to disturbance and model uncertainty. The model uncertainty can cause the closed-loop to become unstable. We provide a sufficient condition for robust stability based on the small gain theorem. This condition is easily incorporated as an on-line constraint in the OCO controller. Finally, we verify via numerical simulations that imposing the robust stability condition on the OCO controller ensures closed-loop stability.


title: Conformal Online Auction Design

abstract: This paper proposes the conformal online auction design (COAD), a novel mechanism for maximizing revenue in online auctions by quantifying the uncertainty in bidders' values without relying on assumptions about value distributions. COAD incorporates both the bidder and item features and leverages historical data to provide an incentive-compatible mechanism for online auctions. Unlike traditional methods for online auctions, COAD employs a distribution-free, prediction interval-based approach using conformal prediction techniques. This novel approach ensures that the expected revenue from our mechanism can achieve at least a constant fraction of the revenue generated by the optimal mechanism. Additionally, COAD admits the use of a broad array of modern machine-learning methods, including random forests, kernel methods, and deep neural nets, for predicting bidders' values. It ensures revenue performance under any finite sample of historical data. Moreover, COAD introduces bidder-specific reserve prices based on the lower confidence bounds of bidders' valuations, which is different from the uniform reserve prices commonly used in the literature. We validate our theoretical predictions through extensive simulations and a real-data application. All code for using COAD and reproducing results is made available on GitHub.


title: Hubble tension tomography: BAO vs SnIa distance tension

abstract: We investigate the redshift dependence of the Hubble tension by comparing the luminosity distances obtained using an up-to-date BAO dataset (including the latest DESI data) calibrated with the CMB-inferred sound horizon, and the Pantheon+ SnIa distances calibrated with Cepheids. Using a redshift tomography method, we find: 1) The BAO-inferred distances are discrepant with the Pantheon+ SnIa distances across all redshift bins considered, with the discrepancy level varying with redshift. 2) The distance discrepancy is more pronounced at lower redshifts ($z \in [0.1,0.8]$) compared to higher redshifts ($z\in [0.8,2.3]$). The consistency of $\Lambda$CDM best fit parameters obtained in high and low redshift bins of both BAO and SnIa samples is investigated and we confirm that the tension reduces at high redshifts. Also a mild tension between the redshift bins is identified at higher redshifts for both the BAO and Pantheon+ data with respect to the best fit value of $H_0$ in agreement with previous studies which find hints for an 'evolution' of $H_0$ in the context of $\Lambda$CDM. These results confirm that the low redshift BAO and SnIa distances can only become consistent through a re-evaluation of the distance calibration methods. An $H(z)$ expansion rate deformation alone is insufficient to resolve the tension. Our findings also hint at a possible deviation of the expansion rate from the Planck18/$\Lambda$CDM model at high redshifts $z\gtrsim 2$. We show that such a deformation is well described by a high redshift transition of $H(z)$ like the one expressed by $\Lambda_s$CDM even though this alone cannot fully resolve the Hubble tension due to its tension with intermediate/low $z$ BAO data.


title: Low-Complexity OTFS-Based Over-the-Air Computation Design for Time-Varying Channels

abstract: This paper investigates over-the-air computation (AirComp) over multiple-access time-varying channels, where devices with high mobility transmit their sensing data to a fusion center (FC) for averaging. To combat the Doppler shift induced by time-varying channels, each device adopts orthogonal time frequency space (OTFS) modulation. Our objective is minimizing the mean squared error (MSE) for the target function estimation. Due to the multipath time-varying channels, the OTFS-based AirComp not only suffers from noise but also interference. Specifically, we propose three schemes, namely S1, S2, and S3, for the target function estimation. S1 directly estimates the target function under the impacts of noise and interference. S2 mitigates the interference by introducing a zero padding-assisted OTFS. In S3, we propose an iterative algorithm to estimate the function in a matrix form. In the numerical results, we evaluate the performance of S1, S2, and S3 from the perspectives of MSE and computational complexity, and compare them with benchmarks. Specifically, compared to benchmarks, S3 outperforms them with a significantly lower MSE but incurs a higher computational complexity. In contrast, S2 demonstrates a reduction in both MSE and computational complexity. Lastly, S1 shows superior error performance at small SNR and reduced computational complexity.


title: Multi-agent Traffic Prediction via Denoised Endpoint Distribution

abstract: The exploration of high-speed movement by robots or road traffic agents is crucial for autonomous driving and navigation. Trajectory prediction at high speeds requires considering historical features and interactions with surrounding entities, a complexity not as pronounced in lower-speed environments. Prior methods have assessed the spatio-temporal dynamics of agents but often neglected intrinsic intent and uncertainty, thereby limiting their effectiveness. We present the Denoised Endpoint Distribution model for trajectory prediction, which distinctively models agents' spatio-temporal features alongside their intrinsic intentions and uncertainties. By employing Diffusion and Transformer models to focus on agent endpoints rather than entire trajectories, our approach significantly reduces model complexity and enhances performance through endpoint information. Our experiments on open datasets, coupled with comparison and ablation studies, demonstrate our model's efficacy and the importance of its components. This approach advances trajectory prediction in high-speed scenarios and lays groundwork for future developments.


title: Efficient Quantum Simulation Algorithms in the Path Integral Formulation

abstract: We provide a new paradigm for quantum simulation that is based on path integration that allows quantum speedups to be observed for problems that are more naturally expressed using the path integral formalism rather than the conventional sparse Hamiltonian formalism. We provide two novel quantum algorithms based on Hamiltonian versions of the path integral formulation and another for Lagrangians of the form $\frac{m}{2}\dot{x}^2 - V(x)$. This Lagrangian path integral algorithm is based on a new rigorous derivation of a discrete version of the Lagrangian path integral. Our first Hamiltonian path integral method breaks up the paths into short timesteps. It is efficient under appropriate sparsity assumptions and requires a number of queries to oracles that give the eigenvalues and overlaps between the eigenvectors of the Hamiltonian terms that scales as $t^{o(1)}/\epsilon^{o(1)}$ for simulation time $t$ and error $\epsilon$. The second approach uses long-time path integrals for near-adiabatic systems and has query complexity that scales as $O(1/\sqrt{\epsilon})$ if the energy eigenvalue gaps and simulation time is sufficiently long. Finally, we show that our Lagrangian simulation algorithm requires a number of queries to an oracle that computes the discrete Lagrangian that scales, in the continuum limit, as $\widetilde{O}(t^2/\epsilon)$ if $V(x)$ is bounded and finite and the wave function obeys appropriate position and momentum cutoffs. This shows that Lagrangian dynamics can be efficiently simulated on quantum computers and opens up the possibility for quantum field theories for which the Hamiltonian is unknown to be efficiently simulated on quantum computers.


title: Optimal Multilayered Motion Planning for Multiple Differential Drive Mobile Robots with Hierarchical Prioritization (OM-MP)

abstract: We present a novel framework for addressing the challenges of multi-Agent planning and formation control within intricate and dynamic environments. This framework transforms the Multi-Agent Path Finding (MAPF) problem into a Multi-Agent Trajectory Planning (MATP) problem. Unlike traditional MAPF solutions, our multilayer optimization scheme consists of a global planner optimization solver, which is dedicated to determining concise global paths for each individual robot, and a local planner with an embedded optimization solver aimed at ensuring the feasibility of local robot trajectories. By implementing a hierarchical prioritization strategy, we enhance robots' efficiency and approximate the global optimal solution. Specifically, within the global planner, we employ the Augmented Graph Search (AGS) algorithm, which significantly improves the speed of solutions. Meanwhile, within the local planner optimization solver, we utilize Control Barrier functions (CBFs) and introduced an oblique cylindrical obstacle bounding box based on the time axis for obstacle avoidance and construct a single-robot locally aware-communication circle to ensure the simplicity, speed, and accuracy of locally optimized solutions. Additionally, we integrate the weight and priority of path traces to prevent deadlocks in limiting scenarios. Compared to the other state-of-the-art methods, including CBS, ECBS and other derivative algorithms, our proposed method demonstrates superior performance in terms of capacity, flexible scalability and overall task optimality in theory, as validated through simulations and experiments.


title: Semantic Guided Large Scale Factor Remote Sensing Image Super-resolution with Generative Diffusion Prior

abstract: Remote sensing images captured by different platforms exhibit significant disparities in spatial resolution. Large scale factor super-resolution (SR) algorithms are vital for maximizing the utilization of low-resolution (LR) satellite data captured from orbit. However, existing methods confront challenges in recovering SR images with clear textures and correct ground objects. We introduce a novel framework, the Semantic Guided Diffusion Model (SGDM), designed for large scale factor remote sensing image super-resolution. The framework exploits a pre-trained generative model as a prior to generate perceptually plausible SR images. We further enhance the reconstruction by incorporating vector maps, which carry structural and semantic cues. Moreover, pixel-level inconsistencies in paired remote sensing images, stemming from sensor-specific imaging characteristics, may hinder the convergence of the model and diversity in generated results. To address this problem, we propose to extract the sensor-specific imaging characteristics and model the distribution of them, allowing diverse SR images generation based on imaging characteristics provided by reference images or sampled from the imaging characteristic probability distributions. To validate and evaluate our approach, we create the Cross-Modal Super-Resolution Dataset (CMSRD). Qualitative and quantitative experiments on CMSRD showcase the superiority and broad applicability of our method. Experimental results on downstream vision tasks also demonstrate the utilitarian of the generated SR images. The dataset and code will be publicly available at https://github.com/wwangcece/SGDM


title: Predictive Modeling in the Reservoir Kernel Motif Space

abstract: This work proposes a time series prediction method based on the kernel view of linear reservoirs. In particular, the time series motifs of the reservoir kernel are used as representational basis on which general readouts are constructed. We provide a geometric interpretation of our approach shedding light on how our approach is related to the core reservoir models and in what way the two approaches differ. Empirical experiments then compare predictive performances of our suggested model with those of recent state-of-art transformer based models, as well as the established recurrent network model - LSTM. The experiments are performed on both univariate and multivariate time series and with a variety of prediction horizons. Rather surprisingly we show that even when linear readout is employed, our method has the capacity to outperform transformer models on univariate time series and attain competitive results on multivariate benchmark datasets. We conclude that simple models with easily controllable capacity but capturing enough memory and subsequence structure can outperform potentially over-complicated deep learning models. This does not mean that reservoir motif based models are preferable to other more complex alternatives - rather, when introducing a new complex time series model one should employ as a sanity check simple, but potentially powerful alternatives/baselines such as reservoir models or the models introduced here.


title: Retrieval Enhanced Zero-Shot Video Captioning

abstract: Despite the significant progress of fully-supervised video captioning, zero-shot methods remain much less explored. In this paper, we propose to take advantage of existing pre-trained large-scale vision and language models to directly generate captions with test time adaptation. Specifically, we bridge video and text using three key models: a general video understanding model XCLIP, a general image understanding model CLIP, and a text generation model GPT-2, due to their source-code availability. The main challenge is how to enable the text generation model to be sufficiently aware of the content in a given video so as to generate corresponding captions. To address this problem, we propose using learnable tokens as a communication medium between frozen GPT-2 and frozen XCLIP as well as frozen CLIP. Differing from the conventional way to train these tokens with training data, we update these tokens with pseudo-targets of the inference data under several carefully crafted loss functions which enable the tokens to absorb video information catered for GPT-2. This procedure can be done in just a few iterations (we use 16 iterations in the experiments) and does not require ground truth data. Extensive experimental results on three widely used datasets, MSR-VTT, MSVD, and VATEX, show 4% to 20% improvements in terms of the main metric CIDEr compared to the existing state-of-the-art methods.


title: Unsupervised Density Neural Representation for CT Metal Artifact Reduction

abstract: Emerging unsupervised reconstruction techniques based on implicit neural representation (INR), such as NeRP, CoIL, and SCOPE, have shown unique capabilities in CT linear inverse imaging. In this work, we propose a novel unsupervised density neural representation (Diner) to tackle the challenging problem of CT metal artifacts when scanned objects contain metals. The drastic variation of linear attenuation coefficients (LACs) of metals over X-ray spectra leads to a nonlinear beam hardening effect (BHE) in CT measurements. Recovering CT images from metal-affected measurements therefore poses a complicated nonlinear inverse problem. Existing metal artifact reduction (MAR) techniques mostly formulate the MAR as an image inpainting task, which ignores the energy-induced BHE and produces suboptimal performance. Instead, our Diner introduces an energy-dependent polychromatic CT forward model to the INR framework, addressing the nonlinear nature of the MAR problem. Specifically, we decompose the energy-dependent LACs into energy-independent densities and energy-dependent mass attenuation coefficients (MACs) by fully considering the physical model of X-ray absorption. Using the densities as pivot variables and the MACs as known prior knowledge, the LACs can be accurately reconstructed from the raw measurements. Technically, we represent the unknown density map as an implicit function of coordinates. Combined with a novel differentiable forward model simulating the physical acquisition from the densities to the measurements, our Diner optimizes a multi-layer perception network to approximate the implicit function by minimizing predicted errors between the estimated and real measurements. Experimental results on simulated and real datasets confirm the superiority of our unsupervised Diner against popular supervised techniques in MAR performance and robustness.


title: Method of Successive Approximations for Stochastic Optimal Control: Contractivity and Convergence

abstract: The Method of Successive Approximations (MSA) is a fixed-point iterative method used to solve stochastic optimal control problems. It is an indirect method based on the conditions derived from the Stochastic Maximum Principle (SMP), an extension of the Pontryagin Maximum Principle (PMP) to stochastic control problems. In this study, we investigate the contractivity and the convergence of MSA for a specific and interesting class of stochastic dynamical systems (when the drift coefficient is one-sided-Lipschitz with a negative constant and the diffusion coefficient is Lipschitz continuous). Our analysis unfolds in three key steps: firstly, we prove the stability of the state process with respect to the control process. Secondly, we establish the stability of the adjoint process. Finally, we present rigorous evidence to prove the contractivity and then the convergence of MSA. This study contributes to enhancing the understanding of MSA's applicability and effectiveness in addressing stochastic optimal control problems.


title: Using non-Gaussian quantum states for detection of a given phase shift

abstract: Injecting a non-Gaussian (Fock or Shr\"odinger cat) quantum state into the dark port of a two-arm interferometer and a strong classical light into the bright one, it is possible, in principle, to detect a given phase shift unambiguously using the orthogonality between the original and displaced in the interferometer non-Gaussian states. The optical losses degrade the sensitivity, introducing the finite "false positive" and "false negative" detection errors. However, using the state-of-art photodetectors, it is still possible to obtain better detection fidelity than in the case of Gaussian quantum states.


title: Neuromorphic Vision Data Coding: Classifying and Reviewing

abstract: In recent years, visual sensors have been quickly improving towards mimicking the visual information acquisition process of human brain, by responding to illumination changes as they occur in time rather than at fixed time intervals. In this context, the so-called neuromorphic vision sensors depart from the conventional frame-based image sensors by adopting a paradigm shift in the way visual information is acquired. This new way of visual information acquisition enables faster and asynchronous per-pixel responses/recordings driven by the scene dynamics with a very high dynamic range and low power consumption. However, the huge amount of data outputted by the emerging neuromorphic vision sensors critically demands highly efficient coding solutions in order applications may take full advantage of these new, attractive sensors' capabilities. For this reason, considerable research efforts have been invested in recent years towards developing increasingly efficient neuromorphic vision data coding (NVDC) solutions. In this context, the main objective of this paper is to provide a comprehensive overview of NVDC solutions in the literature, guided by a novel classification taxonomy, which allows better organizing this emerging field. In this way, more solid conclusions can be drawn about the current NVDC status quo, thus allowing to better drive future research and standardization developments in this emerging technical area.


title: A note on Kronecker's approximation theorem

abstract: We improve on Gonek-Montgomery's quantitative version of Kronecker's approximation theorem.


title: Length-Aware Multi-Kernel Transformer for Long Document Classification

abstract: Lengthy documents pose a unique challenge to neural language models due to substantial memory consumption. While existing state-of-the-art (SOTA) models segment long texts into equal-length snippets (e.g., 128 tokens per snippet) or deploy sparse attention networks, these methods have new challenges of context fragmentation and generalizability due to sentence boundaries and varying text lengths. For example, our empirical analysis has shown that SOTA models consistently overfit one set of lengthy documents (e.g., 2000 tokens) while performing worse on texts with other lengths (e.g., 1000 or 4000). In this study, we propose a Length-Aware Multi-Kernel Transformer (LAMKIT) to address the new challenges for the long document classification. LAMKIT encodes lengthy documents by diverse transformer-based kernels for bridging context boundaries and vectorizes text length by the kernels to promote model robustness over varying document lengths. Experiments on five standard benchmarks from health and law domains show LAMKIT outperforms SOTA models up to an absolute 10.9% improvement. We conduct extensive ablation analyses to examine model robustness and effectiveness over varying document lengths.


title: Introduction to Lorentzian and Flat Affine Geometry of $\mathsf{GL}(2,\mathbb{R})$

abstract: The goal of this paper is to study the geometry of the connected unit component of the real general linear Lie group $4$ dimensional $G_0$ as a Lorentzian and flat affine manifold. As the group $G_0$ is naturally equipped with a bi-invariant Hessian metric $k^+$, relative to a bi-invariant flat affine structure $\nabla$, we examine both structures and the relationships between them. Both structures are defined using the Lie algebra $\mathfrak{g}$, the first one through the trace $k(u,v):=\mathrm{trace}(u\circ v)$ and the second by the composition $\nabla_{u^+}v^+:=(u\circ v)^+$, where $u,v\in\mathfrak{g}$. The curvatures, tidal force, and Jacobi vector fields of $(G_0, k^+)$ are determined in Section 1. Section 2 discusses the causal structure of $k^+$, while Section 3 focuses on the developed map relative to $\nabla$ in the sense of C. Ehresmann.


title: LUCID: A Framework for Reducing False Positives and Inconsistencies Among Container Scanning Tools

abstract: Containerization has emerged as a revolutionary technology in the software development and deployment industry. Containers offer a portable and lightweight solution that allows for packaging applications and their dependencies systematically and efficiently. In addition, containers offer faster deployment and near-native performance with isolation and security drawbacks compared to Virtual Machines. To address the security issues, scanning tools that scan containers for preexisting vulnerabilities have been developed, but they suffer from false positives. Moreover, using different scanning tools to scan the same container provides different results, which leads to inconsistencies and confusion. Limited work has been done to address these issues. This paper provides a fully functional and extensible framework named LUCID that can reduce false positives and inconsistencies provided by multiple scanning tools. We use a database-centric approach and perform query-based analysis, to pinpoint the causes for inconsistencies. Our results show that our framework can reduce inconsistencies by 70%. The framework has been tested on both Intel64/AMD64 and ARM architecture. We also create a Dynamic Classification component that can successfully classify and predict the different severity levels with an accuracy of 84%. We believe this paper will raise awareness regarding security in container technologies and enable container scanning companies to improve their tool to provide better and more consistent results.


title: A computational model for the evolution of learning physical micro-contents in peer instruction methodology

abstract: One of the most important active methodologies for physics learning developed in recent years is peer instruction. Its technique has allowed, among other things, to monitor students' conceptual learning. In this sense, \textcite{PhysRevSTPER.6.020105} has proposed a model that seeks to understand the dynamics of this methodology. However, her model is very phenomenological and overlooks fundamental aspects such as the cognitive process that students follow during interaction with their peers, the role of the instructor, the connection between content and student characteristics, and long-term learning. The objective of this thesis was to develop a computational model based on neurocognitive principles that aimed to address the shortcomings found in Nitta's work. The model was formulated, simulated, and validated based on several field studies on the learning of one-dimensional graphical interpretation and the falling of bodies among science and engineering students in Bogot\'a, Colombia


title: Graph $p$-Laplacian eigenpairs as saddle points of a family of spectral energy functions

abstract: We address the problem of computing the graph $p$-Laplacian eigenpairs for $p\in (2,\infty)$. We propose a reformulation of the graph $p$-Laplacian eigenvalue problem in terms of a constrained weighted Laplacian eigenvalue problem and discuss theoretical and computational advantages. We provide a correspondence between $p$-Laplacian eigenpairs and linear eigenpair of a constrained generalized weighted Laplacian eigenvalue problem. As a result, we can assign an index to any $p$-Laplacian eigenpair that matches the Morse index of the $p$-Rayleigh quotient evaluated at the eigenfunction. In the second part of the paper we introduce a class of spectral energy functions that depend on edge and node weights. We prove that differentiable saddle points of the $k$-th energy function correspond to $p$-Laplacian eigenpairs having index equal to $k$. Moreover, the first energy function is proved to possess a unique saddle point which corresponds to the unique first $p$-Laplacian eigenpair. Finally we develop novel gradient-based numerical methods suited to compute $p$-Laplacian eigenpairs for any $p\in(2,\infty)$ and present some experiments.


title: On the Reliability and Security of Ambient Backscatter Uplink NOMA Networks

abstract: A fundamental objective of the forthcoming sixth-generation wireless networks is to concurrently serve a vast array of devices many of which, such as Internet-of-Things (IoT) sensors, are projected to have low power requirements or even operate in a battery-free manner. To achieve this goal, non-orthogonal multiple access (NOMA) and ambient backscatter communications (AmBC) are regarded as two pivotal and promising technologies. In this work, we present a novel analytical framework for studying the reliability and security of uplink NOMA-based AmBC systems. Specifically, closed-form analytical expressions for both NOMA-users' and IoT backscatter device's (BD's) outage probabilities (OPs) are derived for both cases of perfect and imperfect successive interference cancellation (SIC). In addition, assuming that one NOMA-user transmits an artificial noise in order to enhance system's security, the physical layer security (PLS) of the system is investigated by extracting analytical expressions for NOMA-users' and BD's intercept probabilities (IPs). To gain insightful understandings, an asymptotic analysis is carried out by focusing on the high signal-to-noise (SNR) regime, which reveals that NOMA-users and BDs face outage floors in the high SNR regime as well as that IPs reach constant values at high SNR. Additionally, practical insights regarding how different system parameters affect these OP floors and IP constant values are extracted. Numerical results verify the accuracy of othe developed theoretical framework, offer performance comparisons between the presented NOMA-based AmBC system and a conventional orthogonal multiple access-based AmBC system, and reveal the impact of different system parameters on the reliability and security of NOMA-based AmBC networks.


title: Mixed quantum-classical modeling of exciton-phonon scattering in solids: Application to optical linewidths of monolayer MoS2

abstract: We present a mixed quantum-classical framework for the microscopic and non-Markovian modeling of exciton-phonon scattering in solid-state materials, and apply it to calculate the optical linewidths of monolayer MoS2. Within this framework, we combine reciprocal-space mixed quantum-classical dynamics with models for the quasiparticle band structure as well as the electron-hole and carrier-phonon interactions, parametrized against ab initio calculations, although noting that a direct interfacing with ab initio calculations is straightforward in principle. We introduce various parameters for truncating the Brillouin zone to select regions of interest. Variations of these parameters allow us to determine linewidths in the limit of asymptotic material sizes. Obtained asymptotic linewidths are found to agree favorably with experimental measurements across a range of temperatures. As such, our framework establishes itself as a promising route towards unraveling the non-Markovian and microscopic principles governing the nonadiabatic dynamics of solids.

categories: cond-mat.mtrl-sci cond-mat.mes-hall physics.chem-ph quant-ph


title: Numerical Analysis of Finite Dimensional Approximations in Finite Temperature DFT

abstract: In this paper, we study numerical approximations of the ground states in finite temperature density functional theory. We formulate the problem with respect to the density matrices and justify the convergence of the finite dimensional approximations. Moreover, we provide an optimal a priori error estimate under some mild assumptions and present some numerical experiments to support the theory.


title: Memory-Maze: Scenario Driven Benchmark and Visual Language Navigation Model for Guiding Blind People

abstract: Visual Language Navigation (VLN) powered navigation robots have the potential to guide blind people by understanding and executing route instructions provided by sighted passersby. This capability allows robots to operate in environments that are often unknown a priori. Existing VLN models are insufficient for the scenario of navigation guidance for blind people, as they need to understand routes described from human memory, which frequently contain stutters, errors, and omission of details as opposed to those obtained by thinking out loud, such as in the Room-to-Room dataset. However, currently, there is no benchmark that simulates instructions that were obtained from human memory in environments where blind people navigate. To this end, we present our benchmark, Memory-Maze, which simulates the scenario of seeking route instructions for guiding blind people. Our benchmark contains a maze-like structured virtual environment and novel route instruction data from human memory. To collect natural language instructions, we conducted two studies from sighted passersby onsite and annotators online. Our analysis demonstrates that instructions data collected onsite were more lengthy and contained more varied wording. Alongside our benchmark, we propose a VLN model better equipped to handle the scenario. Our proposed VLN model uses Large Language Models (LLM) to parse instructions and generate Python codes for robot control. We further show that the existing state-of-the-art model performed suboptimally on our benchmark. In contrast, our proposed method outperformed the state-of-the-art model by a fair margin. We found that future research should exercise caution when considering VLN technology for practical applications, as real-world scenarios have different characteristics than ones collected in traditional settings.


title: LLMs and the Future of Chip Design: Unveiling Security Risks and Building Trust

abstract: Chip design is about to be revolutionized by the integration of large language, multimodal, and circuit models (collectively LxMs). While exploring this exciting frontier with tremendous potential, the community must also carefully consider the related security risks and the need for building trust into using LxMs for chip design. First, we review the recent surge of using LxMs for chip design in general. We cover state-of-the-art works for the automation of hardware description language code generation and for scripting and guidance of essential but cumbersome tasks for electronic design automation tools, e.g., design-space exploration, tuning, or designer training. Second, we raise and provide initial answers to novel research questions on critical issues for security and trustworthiness of LxM-powered chip design from both the attack and defense perspectives.


title: Semigroups of self-similar actions and higher rank Baumslag-Solitar semigroups

abstract: In this paper, we initiate the study of higher rank Baumslag-Solitar semigroups and their related C*-algebras. We focus on two extreme, but interesting, classes - one is related to products of odometers and the other is related to Furstenberg's $\times p,, \times q$ conjecture. For the former class, whose C*-algebras are studied by H. Li and the second author, we here characterize the factoriality of the associated von Neumann algebras and further determine their types; for the latter, we obtain their canonical Cartan subalgebras. In the rank 1 case, we study a more general setting which encompasses (single-vertex) generalized Baumslag-Solitar semigroups. One of our main tools is from self-similar higher rank graphs and their C*-algebras.


title: An overdetermined Neumann Problem with a Nonlinearity

abstract: In this paper, we prove the existence of a family of non trivial compact subdomains $\O$ in the manifold $\mathcal{M}=\R^N\times \R/2\pi\Z$ for which the overdetermined Neumann boundary value problem \begin{align}\label{Neumann1} \left \{ \begin{aligned} -\D w&=\mu |w|^{p-2}w && \qquad \text{in $ \Omega$,} \frac{\partial w}{\partial\eta} &=0 &&\qquad \text{on $\partial \Omega,$} w&=c\ne 0 &&\qquad \text{on $\partial \Omega$,} \end{aligned} \right. \end{align} admits solutions for some $\mu > 0$ and $2<p<2^{*}=\frac{2N}{N-2}$ if $N\geq 3$ or $p>2$ if $N=2$. The domains we construct have nonconstant principal curvature, and therefore are not isoparametric nor homogeneous. By this, we establish a non-linear analogue of a recent result obtained by Fall, Weth and the first named author in \cite{Fall-MinlendI-Weth4}, where the overdetermined Neumann eigenvalue problem for the Laplacian was considered.


title: Theory for electron and hole fine structure and Land\'e g-factors in lead chalcogenide nanowires

abstract: Using the atomistic tight-binding method in combination with symmetry analysis and extended effective mass theory we derive a phenomenological model for the fine structure of the ground electron and hole states in $[111]$-grown PbX, X=S,Se hexagonal and cylindrical nanowires. Projection of the tight-binding states to the basis of valley states enables the explicit parametrization of the valley mixing Hamiltonian, which is essential to obtain correct combinations of the valley states for electron (hole) ground levels analytically. The effective Hamiltonian of valley mixing allows to convert the intravalley components of the $g$-factors tensors to the Zeeman splittings of electron and hole levels in nanowires.Tensors of the intravalley electron (hole) Land\'e $g$-factors, parameters of the valley mixing Hamiltonian as well as the valley and anisotropic splitting energies and velocity matrix elements are also calculated.


title: LogoMotion: Visually Grounded Code Generation for Content-Aware Animation

abstract: Animated logos are a compelling and ubiquitous way individuals and brands represent themselves online. Manually authoring these logos can require significant artistic skill and effort. To help novice designers animate logos, design tools currently offer templates and animation presets. However, these solutions can be limited in their expressive range. Large language models have the potential to help novice designers create animated logos by generating animation code that is tailored to their content. In this paper, we introduce LogoMotion, an LLM-based system that takes in a layered document and generates animated logos through visually-grounded program synthesis. We introduce techniques to create an HTML representation of a canvas, identify primary and secondary elements, synthesize animation code, and visually debug animation errors. When compared with an industry standard tool, we find that LogoMotion produces animations that are more content-aware and are on par in terms of quality. We conclude with a discussion of the implications of LLM-generated animation for motion design.


title: Unveiling the Structure of Hidden-Bottom Strange Pentaquarks via Magnetic Moments

abstract: Motivated by the discovery of hidden-charm strange pentaquarks, we conduct a systematic study of the magnetic moments of the hidden-bottom strange pentaquarks in molecular picture. We calculate magnetic moments of hidden-bottom strange pentaquarks with strangeness-1 and 2. Magnetic moment gives valuable information about the inner structure and shape of the hadron. The obtained results may be helpful to determine the inner structure of these new yet hypothetical states.


title: Learning Flame Evolution Operator under Hybrid Darrieus Landau and Diffusive Thermal Instability

abstract: Recent advancements in the integration of artificial intelligence (AI) and machine learning (ML) with physical sciences have led to significant progress in addressing complex phenomena governed by nonlinear partial differential equations (PDE). This paper explores the application of novel operator learning methodologies to unravel the intricate dynamics of flame instability, particularly focusing on hybrid instabilities arising from the coexistence of Darrieus-Landau (DL) and Diffusive-Thermal (DT) mechanisms. Training datasets encompass a wide range of parameter configurations, enabling the learning of parametric solution advancement operators using techniques such as parametric Fourier Neural Operator (pFNO), and parametric convolutional neural networks (pCNN). Results demonstrate the efficacy of these methods in accurately predicting short-term and long-term flame evolution across diverse parameter regimes, capturing the characteristic behaviors of pure and blended instabilities. Comparative analyses reveal pFNO as the most accurate model for learning short-term solutions, while all models exhibit robust performance in capturing the nuanced dynamics of flame evolution. This research contributes to the development of robust modeling frameworks for understanding and controlling complex physical processes governed by nonlinear PDE.


title: Catastrophe Insurance: An Adaptive Robust Optimization Approach

abstract: The escalating frequency and severity of natural disasters, exacerbated by climate change, underscore the critical role of insurance in facilitating recovery and promoting investments in risk reduction. This work introduces a novel Adaptive Robust Optimization (ARO) framework tailored for the calculation of catastrophe insurance premiums, with a case study applied to the United States National Flood Insurance Program (NFIP). To the best of our knowledge, it is the first time an ARO approach has been applied to for disaster insurance pricing. Our methodology is designed to protect against both historical and emerging risks, the latter predicted by machine learning models, thus directly incorporating amplified risks induced by climate change. Using the US flood insurance data as a case study, optimization models demonstrate effectiveness in covering losses and produce surpluses, with a smooth balance transition through parameter fine-tuning. Among tested optimization models, results show ARO models with conservative parameter values achieving low number of insolvent states with the least insurance premium charged. Overall, optimization frameworks offer versatility and generalizability, making it adaptable to a variety of natural disaster scenarios, such as wildfires, droughts, etc. This work not only advances the field of insurance premium modeling but also serves as a vital tool for policymakers and stakeholders in building resilience to the growing risks of natural catastrophes.


title: Fitting to magnetic forces improves the reliability of magnetic Moment Tensor Potentials

abstract: We propose a novel method for fitting machine-learning interatomic potentials with magnetic degrees of freedom, namely, magnetic Moment Tensor Potentials (mMTP). The main feature of the methodology consists in fitting mMTP to magnetic forces (negative derivatives of energies with respect to magnetic moments) derived from spin-polarized density functional theory calculations. We test our method on the bcc Fe-Al system with different composition. Specifically, we calculate formation energies, equilibrium lattice parameter, and total cell magnetization. Our findings demonstrate a precise match between values calculated with mMTP and those obtained by DFT at zero temperature. Additionally, using molecular dynamics, we estimate the finite temperature lattice parameter and capture the cell expansion as was previously revealed in experiment. We demonstrate that mMTPs fitted to magnetic forces, increase the relaxation reliability, which is the percent of successfully relaxed structures (i.e. with almost zero forces, stresses, and magnetic moments after the optimization of geometry). Eventually, we show that the proposed methodology can provide an accurate and reliable mMTP with reduced number of computationally complex spin-polarized density functional theory calculations.


title: Decoding Cognitive Health Using Machine Learning: A Comprehensive Evaluation for Diagnosis of Significant Memory Concern

abstract: The timely identification of significant memory concern (SMC) is crucial for proactive cognitive health management, especially in an aging population. Detecting SMC early enables timely intervention and personalized care, potentially slowing cognitive disorder progression. This study presents a state-of-the-art review followed by a comprehensive evaluation of machine learning models within the randomized neural networks (RNNs) and hyperplane-based classifiers (HbCs) family to investigate SMC diagnosis thoroughly. Utilizing the Alzheimer's Disease Neuroimaging Initiative 2 (ADNI2) dataset, 111 individuals with SMC and 111 healthy older adults are analyzed based on T1W magnetic resonance imaging (MRI) scans, extracting rich features. This analysis is based on baseline structural MRI (sMRI) scans, extracting rich features from gray matter (GM), white matter (WM), Jacobian determinant (JD), and cortical thickness (CT) measurements. In RNNs, deep random vector functional link (dRVFL) and ensemble dRVFL (edRVFL) emerge as the best classifiers in terms of performance metrics in the identification of SMC. In HbCs, Kernelized pinball general twin support vector machine (Pin-GTSVM-K) excels in CT and WM features, whereas Linear Pin-GTSVM (Pin-GTSVM-L) and Linear intuitionistic fuzzy TSVM (IFTSVM-L) performs well in the JD and GM features sets, respectively. This comprehensive evaluation emphasizes the critical role of feature selection and model choice in attaining an effective classifier for SMC diagnosis. The inclusion of statistical analyses further reinforces the credibility of the results, affirming the rigor of this analysis. The performance measures exhibit the suitability of this framework in aiding researchers with the automated and accurate assessment of SMC. The source codes of the algorithms and datasets used in this study are available at https://github.com/mtanveer1/SMC.


title: Colocation of skill related suppliers -- Revisiting coagglomeration using firm-to-firm network data

abstract: Strong local clusters help firms compete on global markets. One explanation for this is that firms benefit from locating close to their suppliers and customers. However, the emergence of global supply chains shows that physical proximity is not necessarily a prerequisite to successfully manage customer-supplier relations anymore. This raises the question when firms need to colocate in value chains and when they can coordinate over longer distances. We hypothesize that one important aspect is the extent to which supply chain partners exchange not just goods but also know-how. To test this, we build on an expanding literature that studies the drivers of industrial coagglomeration to analyze when supply chain connections lead firms to colocation. We exploit detailed micro-data for the Hungarian economy between 2015 and 2017, linking firm registries, employer-employee matched data and firm-to-firm transaction data from value-added tax records. This allows us to observe colocation, labor flows and value chain connections at the level of firms, as well as construct aggregated coagglomeration patterns, skill relatedness and input-output connections between pairs of industries. We show that supply chains are more likely to support coagglomeration when the industries involved are also skill related. That is, input-output and labor market channels reinforce each other, but supplier connections only matter for colocation when industries have similar labor requirements, suggesting that they employ similar types of know-how. We corroborate this finding by analyzing the interactions between firms, showing that supplier relations are more geographically constrained between companies that operate in skill related industries.


title: Selecting focused digital cohorts from social media using the metric backbone of biomedical knowledge graphs

abstract: The abundance of social media data allows researchers to construct large digital cohorts to study the interplay between human behavior and medical treatment. Identifying the users most relevant to a specific health problem is, however, a challenge in that social media sites vary in the generality of their discourse. While X (formerly Twitter), Instagram, and Facebook cater to wide ranging topics, Reddit subgroups and dedicated patient advocacy forums trade in much more specific, biomedically-relevant discourse. To hone in on relevant users anywhere, we have developed a general framework and applied it to epilepsy discourse in social media as a test case. We analyzed the text from posts by users who mention epilepsy drugs in the general-purpose social media sites X and Instagram, the epilepsy-focused Reddit subgroup (r/Epilepsy), and the Epilepsy Foundation of America (EFA) forums. We curated a medical terms dictionary and used it to generate a knowledge graph (KG) for each online community. For each KG, we computed the metric backbone--the smallest subgraph that preserves all shortest paths in the network. By comparing the subset of users who contribute to the backbone to the subset who do not, we found that epilepsy-focused social media users contribute to the KG backbone in much higher proportion than do general-purpose social media users. Furthermore, using human annotation of Instagram posts, we demonstrated that users who do not contribute to the backbone are more than twice as likely to use dictionary terms in a manner inconsistent with their biomedical meaning. For biomedical research applications, our backbone-based approach thus has several benefits over simple engagement-based approaches: It can retain low-engagement users who nonetheless contribute meaningful biomedical insights. It can filter out very vocal users who contribute no relevant content.


title: A topology on the Fremlin tensor product of locally convex-solid vector lattices

abstract: Suppose E and F are locally convex-solid vector lattices. Although we have a suitable vector lattice structure for the tensor product E and F (known as the Fremlin tensor product and denoted by E\otimesF), there is a lack of topological structure on E\otimes F, in general. In this note, we consider a topological attitude on E\otimes F that makes it into a locally convex-solid vector lattice, as well.


title: Acceleration of electrons and ions by an "almost" astrophysical shock in the heliosphere

abstract: Collisionless shock waves, ubiquitous in the universe, are crucial for particle acceleration in various astrophysical systems. Currently, the heliosphere is the only natural environment available for their in situ study. In this work, we showcase the collective acceleration of electrons and ions by one of the fastest in situ shocks ever recorded, observed by the pioneering Parker Solar Probe at only 34.5 million kilometers from the Sun. Our analysis of this unprecedented, near-parallel shock shows electron acceleration up to 6 MeV amidst intense multi-scale electromagnetic wave emissions. We also present evidence of a variable shock structure capable of injecting and accelerating ions from the solar wind to high energies through a self-consistent process. The exceptional capability of the probe's instruments to measure electromagnetic fields in a shock traveling at 1% the speed of light has enabled us, for the first time, to confirm that the structure of a strong heliospheric shock aligns with theoretical models of strong shocks observed in astrophysical environments. This alignment offers viable avenues for understanding astrophysical shock processes and the acceleration of charged particles.

categories: physics.space-ph astro-ph.HE astro-ph.SR physics.plasm-ph


title: Data-driven discovery of a model equation describing self-oscillations of direct current discharge

abstract: Data-driven techniques developed in recent years for the discovery of equations describing complex physical phenomena open unique opportunities for plasma physics. These methods allow getting insights into the processes difficult for analytical description. Since gas discharges can be represented as complex electrical circuits consisting of impedances and capacitances, it looks natural to use the data-driven techniques to study their complex dynamics. In the present paper, the sparse identification of nonlinear dynamics (SINDy) method is applied to analyze the self-oscillations of direct current discharge in argon. It is obtained that the third order polynomials describe best the oscillations of the discharge voltage and current. They allow an accurate capturing of the oscillations amplitudes as well as the harmonics of these oscillations. To understand the physical meaning of each term, an analytical model is presented which describes the discharge self-oscillations.


title: Integrating Emotional and Linguistic Models for Ethical Compliance in Large Language Models

abstract: This research develops advanced methodologies for Large Language Models (LLMs) to better manage linguistic behaviors related to emotions and ethics. We introduce DIKE, an adversarial framework that enhances the LLMs' ability to internalize and reflect global human values, adapting to varied cultural contexts to promote transparency and trust among users. The methodology involves detailed modeling of emotions, classification of linguistic behaviors, and implementation of ethical guardrails. Our innovative approaches include mapping emotions and behaviors using self-supervised learning techniques, refining these guardrails through adversarial reviews, and systematically adjusting outputs to ensure ethical alignment. This framework establishes a robust foundation for AI systems to operate with ethical integrity and cultural sensitivity, paving the way for more responsible and context-aware AI interactions.


title: A Potential Model Study of the Nucleon's Charge and Mass Radius

abstract: We study the charge and mass distributions within a nucleon and compute the associated squared radii based on a potential model approach. Different constituent quark configurations such as $\Delta$, $Y$, and quark-diquark are considered and compared, with model parameters calibrated by experimental measurements of the proton and neutron charge radius. The results suggest that while the charge radius is dictated by quark dynamics, the mass radius is strongly influenced by nonperturbative QCD contributions to a nucleon's mass that are not sensitive to the constituent quarks. As a result, the mass radius could become substantially different from the charge radius. The obtained nucleon mass distributions of different configurations are further used for simulations of the initial conditions in heavy ion collisions. The computed eccentricities $\varepsilon_2$ and $\varepsilon_3$ are found to demonstrate a considerable sensitivity to the input nucleon profiles, especially to the mass radius in the peripheral region as well as for systems with fewer participants.


title: A novel instability in an elastoviscoplastic fluid flow

abstract: Motivated by the recent demonstration of drastically different turbulent flow dynamics of an EVP fluid by Abdelgawad et al. (Nat. Phys., 2023, 1-5.), we analyse the linear stability of the sliding Couette flow of an EVP fluid. After yielding, the EVP fluid behaves as an Upper Convected Maxwell (UCM) fluid. In the creeping-flow limit, in the absence of yield stress, two discrete linearly stable Gorodtsov and Leonov (GL) modes exist for an arbitrarily high value of the Weissenberg number. As yield stress effects, i.e., Bingham number increases, the GL modes become unstable, leading to the novel instability. Analysis reveals that these modes originate near the boundaries due to the `extra normal stress' arising from the interplay between yield stress and elasticity. The extra normal stress is an inherent feature of an EVP fluid. Thus, the predicted novel instability is expected to be present in wall-bounded flows.


title: Host-Based Allocators for Device Memory

abstract: Memory allocation is a fairly mature field of computer science. However, we challenge a prevailing assumption in the literature over the last 50 years which, if reconsidered, necessitates a fundamental reevaluation of many classical memory management algorithms. We pose a model where the allocation algorithm runs on host memory but allocates device memory and so incur the following constraint: the allocator can't read the memory it is allocating. This means we are unable to use boundary tags, which is a concept that has been ubiquitous in nearly every allocation algorithm. In this paper, we propose alternate algorithms to work around this constraint, and discuss in general the implications of this system model.


title: Pseudocentralizers and the Chermak Delgado Measure of the Mod $p^{n}$ Heisenberg Group

abstract: In this paper we compute the Chermak-Delgado measure of the mod $p^{n}$ Heisenberg Group for any prime $p$. To achieve this we introduce the notion of the pseudocentralizer and prove various results about it.


title: T-curator: a trust based curation tool for LOD logs

abstract: Nowadays, companies are racing towards Linked Open Data (LOD) to improve their added value, but they are ignoring their SPARQL query logs. If well curated, these logs can present an asset for decision makers. A naive and straightforward use of these logs is too risky because their provenance and quality are highly questionable. Users of these logs in a trusted way have to be assisted by providing them with in-depth knowledge of the whole LOD environment and tools to curate these logs. In this paper, we propose an interactive and intuitive trust based tool that can be used to curate these LOD logs before exploiting them. This tool is proposed to support our approach proposed in our previous work Lanasri et al. [2020].


title: Commutation relations for two-sided radial SLE

abstract: We study the commutation relation for 2-radial SLE in the unit disc starting from two boundary points. We follow the framework introduced by Dub\'{e}dat. Under an additional requirement of the interchangeability of the two curves, we classify all locally commuting 2-radial SLE$_\kappa$ for $\kappa\in (0,4]$: it is either a two-sided radial SLE$_\kappa$ with spiral of constant spiraling rate or a chordal SLE$_\kappa$ weighted by a power of the conformal radius of its complement. Namely, for fixed $\kappa$ and starting points, we have exactly two one-parameter continuous families of locally commuting 2-radial SLE. Two-sided radial SLE with spiral is a generalization of two-sided radial SLE (without spiral) which satisfies the resampling property. We define it by weighting two independent radial SLEs by a two-time parameter martingale. However, unlike in the chordal case, the resampling property does not uniquely determine the pair due to the additional degree of freedom in the spiraling rate. We also discuss the semiclassical limit of the commutation relation as $\kappa \to 0$.


title: Data-Efficient and Robust Task Selection for Meta-Learning

abstract: Meta-learning methods typically learn tasks under the assumption that all tasks are equally important. However, this assumption is often not valid. In real-world applications, tasks can vary both in their importance during different training stages and in whether they contain noisy labeled data or not, making a uniform approach suboptimal. To address these issues, we propose the Data-Efficient and Robust Task Selection (DERTS) algorithm, which can be incorporated into both gradient and metric-based meta-learning algorithms. DERTS selects weighted subsets of tasks from task pools by minimizing the approximation error of the full gradient of task pools in the meta-training stage. The selected tasks are efficient for rapid training and robust towards noisy label scenarios. Unlike existing algorithms, DERTS does not require any architecture modification for training and can handle noisy label data in both the support and query sets. Analysis of DERTS shows that the algorithm follows similar training dynamics as learning on the full task pools. Experiments show that DERTS outperforms existing sampling strategies for meta-learning on both gradient-based and metric-based meta-learning algorithms in limited data budget and noisy task settings.


title: Counting steps for re-stabilization in a labor matching market

abstract: We study a one-to-one labor matching market. If a worker considers resigning from her current job to obtain a better one, how long does it take for this worker to actually get it? We present an algorithm that models this situation as a re-stabilization process involving a vacancy chain. Each step of the algorithm is a link of such a chain. We show that the length of this vacancy chain, which can be interpreted as the time the worker has to wait for her new job, is intimately connected with the lattice structure of the set of stable matchings of the market. Namely, this length can be computed by considering the cardinalities of cycles in preferences derived from the initial and final stable matchings involved.


title: Optimised stellarators with a positive radial electric field

abstract: We draw attention to an interesting possibility in the design and operation of stellarator fusion reactors, which has hitherto been considered unrealistic under burning-plasma conditions. Thanks to recent advances in stellarator optimisation theory, it appears possible to create a positive (outward-pointing) radial electric field in the plasma core by carefully tailoring the geometry of the magnetic field. This electric field is likely to expel highly charged impurities from the centre of the plasma through neoclassical transport and thus eliminate, or at least mitigate, a long-standing problem in stellarator physics. Further out, the electric field is expected to suddenly change sign from positive to negative, thus creating a region of strongly sheared flow, which could locally suppress turbulent transport and enhance overall energy confinement.


title: An enhanced basis for producing Bezier-like curves

abstract: This study aims on proposing a new structure for constructing Bernstein-like bases. The structure uses an auxiliary function and a shape parameter to construct a new family of bases from any family of blending functions. The new family of bases inherit almost all algebraic and geometric properties of the initial blending functions. The corresponding curves have the freedom to travel from the curve constructed from the initial blending functions to the line segment joining the first and last control points. The new bases have the monotonicity preservation property and the shape of the curve could be adjusted by changing the parameter.


title: Auditing an Automatic Grading Model with deep Reinforcement Learning

abstract: We explore the use of deep reinforcement learning to audit an automatic short answer grading (ASAG) model. Automatic grading may decrease the time burden of rating open-ended items for educators, but a lack of robust evaluation methods for these models can result in uncertainty of their quality. Current state-of-the-art ASAG models are configured to match human ratings from a training set, and researchers typically assess their quality with accuracy metrics that signify agreement between model and human scores. In this paper, we show that a high level of agreement to human ratings does not give sufficient evidence that an ASAG model is infallible. We train a reinforcement learning agent to revise student responses with the objective of achieving a high rating from an automatic grading model in the least number of revisions. By analyzing the agent's revised responses that achieve a high grade from the ASAG model but would not be considered a high scoring responses according to a scoring rubric, we discover ways in which the automated grader can be exploited, exposing shortcomings in the grading model.


title: Towards Context-Aware Modeling of Situation Awareness in Conditionally Automated Driving

abstract: Maintaining adequate situation awareness (SA) is crucial for the safe operation of conditionally automated vehicles (AVs), which requires drivers to regain control during takeover (TOR) events. This study developed a predictive model for real-time assessment of driver SA using multimodal data (e.g., galvanic skin response, heart rate and eye tracking data, and driver characteristics) collected in a simulated driving environment. Sixty-seven participants experienced automated driving scenarios with TORs, with conditions varying in risk perception and the presence of automation errors. A LightGBM (Light Gradient Boosting Machine) model trained on the top 12 predictors identified by SHAP (SHapley Additive exPlanations) achieved promising performance with RMSE=0.89, MAE=0.71, and Corr=0.78. These findings have implications towards context-aware modeling of SA in conditionally automated driving, paving the way for safer and more seamless driver-AV interactions.


title: SonifyAR: Context-Aware Sound Generation in Augmented Reality

abstract: Sound plays a crucial role in enhancing user experience and immersiveness in Augmented Reality (AR). However, current platforms lack support for AR sound authoring due to limited interaction types, challenges in collecting and specifying context information, and difficulty in acquiring matching sound assets. We present SonifyAR, an LLM-based AR sound authoring system that generates context-aware sound effects for AR experiences. SonifyAR expands the current design space of AR sound and implements a Programming by Demonstration (PbD) pipeline to automatically collect contextual information of AR events, including virtual content semantics and real world context. This context information is then processed by a large language model to acquire sound effects with Recommendation, Retrieval, Generation, and Transfer methods. To evaluate the usability and performance of our system, we conducted a user study with eight participants and created five example applications, including an AR-based science experiment, an improving case for AR headset safety, and an assisting example for low vision AR users.


title: MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling

abstract: The importance of computational modeling of mobile user interfaces (UIs) is undeniable. However, these require a high-quality UI dataset. Existing datasets are often outdated, collected years ago, and are frequently noisy with mismatches in their visual representation. This presents challenges in modeling UI understanding in the wild. This paper introduces a novel approach to automatically mine UI data from Android apps, leveraging Large Language Models (LLMs) to mimic human-like exploration. To ensure dataset quality, we employ the best practices in UI noise filtering and incorporate human annotation as a final validation step. Our results demonstrate the effectiveness of LLMs-enhanced app exploration in mining more meaningful UIs, resulting in a large dataset MUD of 18k human-annotated UIs from 3.3k apps. We highlight the usefulness of MUD in two common UI modeling tasks: element detection and UI retrieval, showcasing its potential to establish a foundation for future research into high-quality, modern UIs.


title: Modulus of continuity of Kerov transition measure for continual Young diagrams

abstract: The transition measure is a foundational concept introduced by Sergey Kerov to represent the shape of a Young diagram as a centered probability measure on the real line. Over a period of decades the transition measure turned out to be an invaluable tool for many problems of the asymptotic representation theory of the symmetric groups. Kerov also showed how to expand this notion for a wider class of continual diagrams so that the transition measure provides a homeomorphism between a subclass of continual diagrams (having a specific support) and a class of centered probability measures with a support contained in a specific interval. We quantify the modulus of continuity of this homeomorphism. More specifically, we study the dependence of the cumulative distribution function of Kerov transition measure on the profile of a diagram at the locations where the profile is not too steep.


title: Belyi Function Decompositions for The Icosahedron of Genus 4

abstract: The icosahedron $I_4$ of genus 4 is a dessin d'enfant embedded in Bring's curve $\mathcal{B}$. The dessin $I_4$ is related in some sense to a regular icosahedron $I_0$ embedded in the complex Riemann sphere. In particular, decompositions of Belyi functions $\beta_{I_0}: \mathbb{CP}^1 \rightarrow \mathbb{CP}^1$ and $\beta_{I_4}: \mathcal{B} \rightarrow \mathbb{CP}^1$ for $I_0$ and $I_4$ have the same lattice. The diagram of $\beta_{I_0}$ decompositions is already known. In the present paper we find $\beta_{I_4}$ decompositions. Note that $\beta_{I_0}$ decomposes into rational functions on $\mathbb{C}P^1$, while in case of $\beta_{I_4}$ we deal with maps between different algebraic curves.


title: On the Correspondence Between Integer Sequences and Vacillating Tableaux

abstract: A fundamental identity in the representation theory of the partition algebra is $n^k = \sum_{\lambda} f^\lambda m_k^\lambda$ for $n \geq 2k$, where $\lambda$ ranges over integer partitions of $n$, $f^\lambda$ is the number of standard Young tableaux of shape $\lambda$, and $m_k^\lambda$ is the number of vacillating tableaux of shape $\lambda$ and length $2k$. Using a combination of RSK insertion and jeu de taquin, Halverson and Lewandowski constructed a bijection $DI_n^k$ that maps each integer sequence in $[n]^k$ to a pair of tableaux of the same shape, where one is a standard Young tableau and the other is a vacillating tableau. In this paper, we study the fine properties of Halverson and Lewandowski's bijection and explore the correspondence between integer sequences and the vacillating tableaux via the map $DI_n^k$ for general integers $n$ and $k$. In particular, we characterize the integer sequences $\boldsymbol{i}$ whose corresponding shape, $\lambda$, in the image $DI_n^k(\boldsymbol{i})$, satisfies $\lambda_1 = n$ or $\lambda_1 = n-k$.


title: The Road to Compliance: Executive Federal Agencies and the NIST Risk Management Framework

abstract: This informative report provides a comprehensive analysis of how executive federal report agencies implement the National Institute of Standards and Technology's (NIST) Risk Management Framework (RMF) to achieve cybersecurity compliance. By exploring the concept and evolution of the RMF, the report delves into the framework's importance for enhancing cybersecurity measures within federal agencies, addressing the challenges these agencies face in the digital landscape. Through a methodical literature review, the report examines theoretical foundations, implementation strategies, and the critical role of continuous monitoring and automation in RMF processes, drawing from key sources like Ross (2014), Lubell (2020), Barrett et al. (2021), and Pillitteri et al. (2021, 2022), among others. Employing a detailed methodology for data collection and analysis, the report presents findings on the successes and challenges of RMF implementation, highlighting the impact of automation and continuous monitoring in bolstering cybersecurity postures. Case studies offer in-depth insights into the experiences of specific agencies, providing lessons learned and best practices. The report concludes with strategic recommendations for overcoming implementation challenges and suggests future directions for enhancing RMF research and practice. This investigation underscores the RMF's critical role in establishing robust cybersecurity compliance across executive federal agencies, offering valuable recommendations for policymakers, cybersecurity professionals, and governmental bodies.


title: \'Etale motives of geometric origin

abstract: Over qcqs finite-dimensional schemes, we prove that \'etale motives of geometric origin can be characterised by a constructibility property which is purely categorical, giving a full answer to the question "Do all constructible \'etale motives come from geometry?" which dates back to Cisinski and D\'eglise's work. We also show that they afford the continuity property and satisfy h-descent and Milnor excision.


title: Multi-Relational Structural Entropy

abstract: Structural Entropy (SE) measures the structural information contained in a graph. Minimizing or maximizing SE helps to reveal or obscure the intrinsic structural patterns underlying graphs in an interpretable manner, finding applications in various tasks driven by networked data. However, SE ignores the heterogeneity inherent in the graph relations, which is ubiquitous in modern networks. In this work, we extend SE to consider heterogeneous relations and propose the first metric for multi-relational graph structural information, namely, Multi-relational Structural Entropy (MrSE). To this end, we first cast SE through the novel lens of the stationary distribution from random surfing, which readily extends to multi-relational networks by considering the choices of both nodes and relation types simultaneously at each step. The resulting MrSE is then optimized by a new greedy algorithm to reveal the essential structures within a multi-relational network. Experimental results highlight that the proposed MrSE offers a more insightful interpretation of the structure of multi-relational graphs compared to SE. Additionally, it enhances the performance of two tasks that involve real-world multi-relational graphs, including node clustering and social event detection.


title: Diffusion models as probabilistic neural operators for recovering unobserved states of dynamical systems

abstract: This paper explores the efficacy of diffusion-based generative models as neural operators for partial differential equations (PDEs). Neural operators are neural networks that learn a mapping from the parameter space to the solution space of PDEs from data, and they can also solve the inverse problem of estimating the parameter from the solution. Diffusion models excel in many domains, but their potential as neural operators has not been thoroughly explored. In this work, we show that diffusion-based generative models exhibit many properties favourable for neural operators, and they can effectively generate the solution of a PDE conditionally on the parameter or recover the unobserved parts of the system. We propose to train a single model adaptable to multiple tasks, by alternating between the tasks during training. In our experiments with multiple realistic dynamical systems, diffusion models outperform other neural operators. Furthermore, we demonstrate how the probabilistic diffusion model can elegantly deal with systems which are only partially identifiable, by producing samples corresponding to the different possible solutions.


title: Interpretable global minima of deep ReLU neural networks on sequentially separable data

abstract: We explicitly construct zero loss neural network classifiers. We write the weight matrices and bias vectors in terms of cumulative parameters, which determine truncation maps acting recursively on input space. The configurations for the training data considered are (i) sufficiently small, well separated clusters corresponding to each class, and (ii) equivalence classes which are sequentially linearly separable. In the best case, for $Q$ classes of data in $\mathbb{R}^M$, global minimizers can be described with $Q(M+2)$ parameters.

categories: cs.LG cs.AI math-ph math.MP math.OC stat.ML


title: Do Pretrained Contextual Language Models Distinguish between Hebrew Homograph Analyses?

abstract: Semitic morphologically-rich languages (MRLs) are characterized by extreme word ambiguity. Because most vowels are omitted in standard texts, many of the words are homographs with multiple possible analyses, each with a different pronunciation and different morphosyntactic properties. This ambiguity goes beyond word-sense disambiguation (WSD), and may include token segmentation into multiple word units. Previous research on MRLs claimed that standardly trained pre-trained language models (PLMs) based on word-pieces may not sufficiently capture the internal structure of such tokens in order to distinguish between these analyses. Taking Hebrew as a case study, we investigate the extent to which Hebrew homographs can be disambiguated and analyzed using PLMs. We evaluate all existing models for contextualized Hebrew embeddings on a novel Hebrew homograph challenge sets that we deliver. Our empirical results demonstrate that contemporary Hebrew contextualized embeddings outperform non-contextualized embeddings; and that they are most effective for disambiguating segmentation and morphosyntactic features, less so regarding pure word-sense disambiguation. We show that these embeddings are more effective when the number of word-piece splits is limited, and they are more effective for 2-way and 3-way ambiguities than for 4-way ambiguity. We show that the embeddings are equally effective for homographs of both balanced and skewed distributions, whether calculated as masked or unmasked tokens. Finally, we show that these embeddings are as effective for homograph disambiguation with extensive supervised training as with a few-shot setup.


title: Analysis of Decentralized Stochastic Successive Convex Approximation for composite non-convex problems

abstract: This work considers the decentralized successive convex approximation (SCA) method for minimizing stochastic non-convex objectives subject to convex constraints, along with possibly non-smooth convex regularizers. Although SCA has been widely applied in decentralized settings, its stochastic first order (SFO) complexity is unknown, and it is thought to be slower than the centralized momentum-enhanced SCA variants. In this work, we advance the state-of-the-art for SCA methods by proposing an accelerated variant, namely the \textbf{D}ecentralized \textbf{M}omentum-based \textbf{S}tochastic \textbf{SCA} (\textbf{D-MSSCA}) and analyze its SFO complexity. The proposed algorithm entails creating a stochastic surrogate of the objective at every iteration, which is minimized at each node separately. Remarkably, the D-MSSCA achieves an SFO complexity of $\mathcal{O}(\epsilon^{-3/2})$ to reach an $\epsilon$-stationary point, which is at par with the SFO complexity lower bound for unconstrained stochastic non-convex optimization in centralized setting.