title: Automatic Fused Multimodal Deep Learning for Plant Identification

abstract: Plant classification is vital for ecological conservation and agricultural productivity, enhancing our understanding of plant growth dynamics and aiding species preservation. The advent of deep learning (DL) techniques has revolutionized this field by enabling autonomous feature extraction, significantly reducing the dependence on manual expertise. However, conventional DL models often rely solely on single data sources, failing to capture the full biological diversity of plant species comprehensively. Recent research has turned to multimodal learning to overcome this limitation by integrating multiple data types, which enriches the representation of plant characteristics. This shift introduces the challenge of determining the optimal point for modality fusion. In this paper, we introduce a pioneering multimodal DL-based approach for plant classification with automatic modality fusion. Utilizing the multimodal fusion architecture search, our method integrates images from multiple plant organs-flowers, leaves, fruits, and stems-into a cohesive model. Our method achieves 83.48% accuracy on 956 classes of the PlantCLEF2015 dataset, surpassing state-of-the-art methods. It outperforms late fusion by 11.07% and is more robust to missing modalities. We validate our model against established benchmarks using standard performance metrics and McNemar's test, further underscoring its superiority.


title: Corps: A Core Calculus of Hierarchical Choreographic Programming

abstract: Functional choreographic programming suggests a new propositions-as-types paradigm might be possible. In this new paradigm, communication is not modeled linearly; instead, ownership of a piece of data is modeled as a modality, and communication changes that modality. However, we must find an appropriate modal logic for the other side of the propositions-as-types correspondence. This paper argues for doxastic logics, or logics of belief. In particular, authorization logics -- doxastic logics with explicit communication -- appear to represent hierarchical choreographic programming. This paper introduces hierarchical choreographic programming and presents Corps, a language for hierarchical choreographic programming with a propositions-as-types interpretation in authorization logic.


title: Differentially Private Tabular Data Synthesis using Large Language Models

abstract: Synthetic tabular data generation with differential privacy is a crucial problem to enable data sharing with formal privacy. Despite a rich history of methodological research and development, developing differentially private tabular data generators that can provide realistic synthetic datasets remains challenging. This paper introduces DP-LLMTGen -- a novel framework for differentially private tabular data synthesis that leverages pretrained large language models (LLMs). DP-LLMTGen models sensitive datasets using a two-stage fine-tuning procedure with a novel loss function specifically designed for tabular data. Subsequently, it generates synthetic data through sampling the fine-tuned LLMs. Our empirical evaluation demonstrates that DP-LLMTGen outperforms a variety of existing mechanisms across multiple datasets and privacy settings. Additionally, we conduct an ablation study and several experimental analyses to deepen our understanding of LLMs in addressing this important problem. Finally, we highlight the controllable generation ability of DP-LLMTGen through a fairness-constrained generation setting.


title: High-redshift quasars at $z \geq 3$: radio variability and MPS/GPS candidates

abstract: We present a study of the radio variability of bright, $S_{1.4}\geq100$ mJy, high-redshift quasars at $z\geq3$ on timescales up to 30-40 years. The study involved simultaneous RATAN-600 measurements at frequencies of 2.3, 4.7, 8.2, 11.2, and 22.3 GHz in 2017-2020. In addition, data from the literature were used. We have found that the variability index, $V_S$, which quantifies the normalized difference between the maximum and minimum flux density while accounting for measurement uncertainties, ranges from 0.02 to 0.96 for the quasars. Approximately half of the objects in the sample exhibit a variability index within the range of 0.25 to 0.50, comparable to that observed in blazars at lower redshifts. The distribution of $V_S$ at 22.3 GHz is significantly different from that at 2.3-11.2 GHz, which may be attributed to the fact that a compact AGN core dominates at the source's rest frame frequencies greater than 45 GHz, leading to higher variability indices obtained at 22.3 GHz (the $V_S$ distribution peaks around 0.4) compared to the lower frequencies (the $V_S$ distribution at 2.3 and 4.7 GHz peaks around 0.1-0.2). Several source groups with distinctive variability characteristics were found using cluster analysis of quasars. We propose 7 new candidates for gigahertz peaked-spectrum (GPS) sources and 5 new megahertz peaked-spectrum (MPS) sources based on their spectrum shape and variability features. Only 6 out of 23 sources previously reported as GPS demonstrate a low variability level typical of classical GPS sources ($V_{S} < 0.25$) at 4.7-22.3 GHz. When excluding the highly variable peaked-spectrum blazars, we expect no more than 20% of the sources in the sample to be GPS candidates and no more than 10% to be MPS candidates.


title: Block Sizes in the Block Sets Conjecture

abstract: A set $X$ is called Euclidean Ramsey if, for any $k$ and sufficiently large $n$, every $k$-colouring of $\mathbb{R}^n$ contains a monochromatic congruent copy of $X$. This notion was introduced by Erd\H{o}s, Graham, Montgomery, Rothschild, Spencer and Straus. They asked if a set is Ramsey if and only if it is spherical, meaning that it lies on the surface of a sphere. It is not too difficult to show that if a set is not spherical then it is not Euclidean Ramsey either, but the converse is very much open despite extensive research over the years. On the other hand, the block sets conjecture is a purely combinatorial, Hales-Jewett type of statement, concerning `blocks in large products', introduced by Leader, Russell and Walters. If true, the block sets conjecture would imply that every transitive set (a set whose symmetry group acts transitively) is Euclidean Ramsey. As for the question above, the block sets conjecture remains very elusive, being known only in a few cases. In this paper we show that the sizes of the blocks in the block sets conjecture cannot be bounded, even for templates over the alphabet of size $3$. We also show that for the first non-trivial template, namely $123$, the blocks may be taken to be of size $2$ (for any number of colours). This is best possible; all previous bounds were `tower-type' large.


title: MLIP: Efficient Multi-Perspective Language-Image Pretraining with Exhaustive Data Utilization

abstract: Contrastive Language-Image Pretraining (CLIP) has achieved remarkable success, leading to rapid advancements in multimodal studies. However, CLIP faces a notable challenge in terms of inefficient data utilization. It relies on a single contrastive supervision for each image-text pair during representation learning, disregarding a substantial amount of valuable information that could offer richer supervision. Additionally, the retention of non-informative tokens leads to increased computational demands and time costs, particularly in CLIP's ViT image encoder. To address these issues, we propose Multi-Perspective Language-Image Pretraining (MLIP). In MLIP, we leverage the frequency transform's sensitivity to both high and low-frequency variations, which complements the spatial domain's sensitivity limited to low-frequency variations only. By incorporating frequency transforms and token-level alignment, we expand CILP's single supervision into multi-domain and multi-level supervision, enabling a more thorough exploration of informative image features. Additionally, we introduce a token merging method guided by comprehensive semantics from the frequency and spatial domains. This allows us to merge tokens to multi-granularity tokens with a controllable compression rate to accelerate CLIP. Extensive experiments validate the effectiveness of our design.


title: Hardness of Learning Neural Networks under the Manifold Hypothesis

abstract: The manifold hypothesis presumes that high-dimensional data lies on or near a low-dimensional manifold. While the utility of encoding geometric structure has been demonstrated empirically, rigorous analysis of its impact on the learnability of neural networks is largely missing. Several recent results have established hardness results for learning feedforward and equivariant neural networks under i.i.d. Gaussian or uniform Boolean data distributions. In this paper, we investigate the hardness of learning under the manifold hypothesis. We ask which minimal assumptions on the curvature and regularity of the manifold, if any, render the learning problem efficiently learnable. We prove that learning is hard under input manifolds of bounded curvature by extending proofs of hardness in the SQ and cryptographic settings for Boolean data inputs to the geometric setting. On the other hand, we show that additional assumptions on the volume of the data manifold alleviate these fundamental limitations and guarantee learnability via a simple interpolation argument. Notable instances of this regime are manifolds which can be reliably reconstructed via manifold learning. Looking forward, we comment on and empirically explore intermediate regimes of manifolds, which have heterogeneous features commonly found in real world data.


title: Understanding Preference Fine-Tuning Through the Lens of Coverage

abstract: Learning from human preference data has emerged as the dominant paradigm for fine-tuning large language models (LLMs). The two most common families of techniques -- online reinforcement learning (RL) such as Proximal Policy Optimization (PPO) and offline contrastive methods such as Direct Preference Optimization (DPO) -- were positioned as equivalent in prior work due to the fact that both have to start from the same offline preference dataset. To further expand our theoretical understanding of the similarities and differences between online and offline techniques for preference fine-tuning, we conduct a rigorous analysis through the lens of dataset coverage, a concept that captures how the training data covers the test distribution and is widely used in RL. We prove that a global coverage condition is both necessary and sufficient for offline contrastive methods to converge to the optimal policy, but a weaker partial coverage condition suffices for online RL methods. This separation provides one explanation of why online RL methods can perform better than offline methods, especially when the offline preference data is not diverse enough. Finally, motivated by our preceding theoretical observations, we derive a hybrid preference optimization (HyPO) algorithm that uses offline data for contrastive-based preference optimization and online data for KL regularization. Theoretically and empirically, we demonstrate that HyPO is more performant than its pure offline counterpart DPO, while still preserving its computation and memory efficiency.


title: PreMevE-MEO: Predicting Ultra-relativistic Electrons Using Observations from GPS Satellites

abstract: Ultra-relativistic electrons with energies greater than or equal to two megaelectron-volt (MeV) pose a major radiation threat to spaceborne electronics, and thus specifying those highly energetic electrons has a significant meaning to space weather communities. Here we report the latest progress in developing our predictive model for MeV electrons in the outer radiation belt. The new version, primarily driven by electron measurements made along medium-Earth-orbits (MEO), is called PREdictive MEV Electron (PreMevE)-MEO model that nowcasts ultra-relativistic electron flux distributions across the whole outer belt. Model inputs include above 2 MeV electron fluxes observed in MEOs by a fleet of GPS satellites as well as electrons measured by one Los Alamos satellite in the geosynchronous orbit. We developed an innovative Sparse Multi-Inputs Latent Ensemble NETwork (SmileNet) which combines convolutional neural networks with transformers, and we used long-term in-situ electron data from NASA's Van Allen Probes mission to train, validate, optimize, and test the model.It is shown that PreMevE-MEO can provide hourly nowcasts with high model performance efficiency and high correlation with observations.This prototype PreMevE-MEO model demonstrates the feasibility of making high-fidelity predictions driven by observations from longstanding space infrastructure in MEO, thus has great potential of growing into an invaluable space weather operational warning tool.


title: Using Convolutional Neural Networks to detect Edge Localized Modes in DIII-D from Doppler Backscattering measurements

abstract: In H-mode tokamak plasmas, the plasma is sometimes ejected beyond the edge transport barrier. These events are known as edge localized modes (ELMs). ELMs cause a loss of energy and damage the vessel walls. Understanding the physics of ELMs and by extension, how to detect and mitigate them, is an important challenge. In this paper, we focus on two diagnostic methods $\unicode{x2013}$ D-alpha spectroscopy and Doppler backscattering (DBS). The former detects ELMs by measuring Balmer alpha emission while the latter uses microwave radiation to probe the plasma. DBS has the advantage of having higher temporal resolution and robustness to damage. These advantages of DBS diagnostics may be beneficial for future operational tokamaks and thus data processing techniques for DBS should be developed in preparation. In sight of this, we explore the training of neural networks to detect ELMs from DBS data, using D-alpha data as the ground truth. With shots found in the DIII-D database, the model is trained to classify each time step based on the occurrence of an ELM event. The results are promising. When tested on shots similar to those used for training, the model is capable of consistently achieving a high f1-score of 0.93. This score is a performance metric for imbalanced datasets that ranges between 0 and 1. We evaluate the performance of our neural network on a variety of ELMs $\unicode{x2013}$ grasssy, suppressed, and wide pedestal $\unicode{x2013}$ finding broad applicability. Beyond ELMs, our work demonstrates the wider feasibility of applying neural networks to data from DBS diagnostics.


title: AIFS - ECMWF's data-driven forecasting system

abstract: Machine learning-based weather forecasting models have quickly emerged as a promising methodology for accurate medium-range global weather forecasting. Here, we introduce the Artificial Intelligence Forecasting System (AIFS), a data driven forecast model developed by the European Centre for Medium-Range Weather Forecasts (ECMWF). AIFS is based on a graph neural network (GNN) encoder and decoder, and a sliding window transformer processor, and is trained on ECMWF's ERA5 re-analysis and ECMWF's operational numerical weather prediction (NWP) analyses. It has a flexible and modular design and supports several levels of parallelism to enable training on high-resolution input data. AIFS forecast skill is assessed by comparing its forecasts to NWP analyses and direct observational data. We show that AIFS produces highly skilled forecasts for upper-air variables, surface weather parameters and tropical cyclone tracks. AIFS is run four times daily alongside ECMWF's physics-based NWP model and forecasts are available to the public under ECMWF's open data policy.


title: A Matrix Model Proposal for Quantum Gravity and the Quantum Mechanics of Black Holes

abstract: We propose a quantum mechanical theory of quantum spaces described by large $N$ noncommutative geometry as a model for quantum gravity. The theory admits fuzzy sphere as static solution. Over the fuzzy geometry, the quantum mechanics of the fermions is given by a sum of oscillators with equal frequency. The energy state where exactly half of the Fermi sea is filled contains the maximal amount of degeneracy. This state of the fuzzy sphere obeys the mass-radius relation of a Schwarzschild black hole if the fuzzy sphere is identified with the black hole horizon. Moreover the set of states in the Fermi sea gives precisely the Bekenstein-Hawking entropy. We thus propose that quantum black holes are described by fuzzy spheres with a half-filled Fermi sea in our theory. We also consider a system of two fuzzy spheres by embedding them as blocks in the matrix quantum mechanics. When the distance $r$ between the two fuzzy spheres is small, the total energy of the system can be computed using perturbation theory. We show that in the leading order of large $N$ limit, the interaction energy depends on the product of the black holes masses and the Newton constant exactly as in Newton gravity. To extract the correct $r$ dependence in the long range, a resummation of all the large $N$ corrections is needed. We outline how Newton gravity for static sources may be reproduced in the long distance limit. We also show that the interaction energy is generally finite in the short distance limit, suggesting that the black hole singularity in general relativity is removed in our quantum description of black hole.


title: RaDe-GS: Rasterizing Depth in Gaussian Splatting

abstract: Gaussian Splatting (GS) has proven to be highly effective in novel view synthesis, achieving high-quality and real-time rendering. However, its potential for reconstructing detailed 3D shapes has not been fully explored. Existing methods often suffer from limited shape accuracy due to the discrete and unstructured nature of Gaussian splats, which complicates the shape extraction. While recent techniques like 2D GS have attempted to improve shape reconstruction, they often reformulate the Gaussian primitives in ways that reduce both rendering quality and computational efficiency. To address these problems, our work introduces a rasterized approach to render the depth maps and surface normal maps of general 3D Gaussian splats. Our method not only significantly enhances shape reconstruction accuracy but also maintains the computational efficiency intrinsic to Gaussian Splatting. It achieves a Chamfer distance error comparable to NeuraLangelo on the DTU dataset and maintains similar computational efficiency as the original 3D GS methods. Our method is a significant advancement in Gaussian Splatting and can be directly integrated into existing Gaussian Splatting-based methods.


title: Understanding Token Probability Encoding in Output Embeddings

abstract: In this paper, we investigate the output token probability information in the output embedding of language models. We provide an approximate common log-linear encoding of output token probabilities within the output embedding vectors and demonstrate that it is accurate and sparse when the output space is large and output logits are concentrated. Based on such findings, we edit the encoding in output embedding to modify the output probability distribution accurately. Moreover, the sparsity we find in output probability encoding suggests that a large number of dimensions in the output embedding do not contribute to causal language modeling. Therefore, we attempt to delete the output-unrelated dimensions and find more than 30% of the dimensions can be deleted without significant movement in output distribution and degeneration on sequence generation. Additionally, in training dynamics, we use such encoding as a probe and find that the output embeddings capture token frequency information in early steps, even before an obvious convergence starts.


title: Tomographic Reconstruction and Regularisation with Search Space Expansion and Total Variation

abstract: The use of ray projections to reconstruct images is a common technique in medical imaging. Dealing with incomplete data is particularly important when a patient is vulnerable to potentially damaging radiation or is unable to cope with the long scanning time. This paper utilises the reformulation of the problem into an optimisation tasks, followed by using a swarm-based reconstruction from highly undersampled data where particles move in image space in an attempt to minimise the reconstruction error. The process is prone to noise and, in addition to the recently introduced search space expansion technique, a further smoothing process, total variation regularisation, is adapted and investigated. The proposed method is shown to produce lower reproduction errors compared to standard tomographic reconstruction toolbox algorithms as well as one of the leading high-dimensional optimisers on the clinically important Shepp-Logan phantom.


title: Verification of entangled states under noisy measurements

abstract: Entanglement plays an indispensable role in numerous quantum information and quantum computation tasks, underscoring the need for efficiently verifying entangled states. In recent years, quantum state verification has received increasing attention, yet the challenge of addressing noise effects in implementing this approach remains unsolved. In this work, we provide a systematic assessment of the performance of quantum state verification protocols in the presence of measurement noise. Based on the analysis, a necessary and sufficient condition is provided to uniquely identify the target state under noisy measurements. Moreover, we propose a symmetric hypothesis testing verification algorithm with noisy measurements. Subsequently, using a noisy nonadaptive verification strategy of GHZ and stabilizer states, the noise effects on the verification efficiency are illustrated. From both analytical and numerical perspectives, we demonstrate that the noisy verification protocol exhibits a negative quadratic relationship between the sample complexity and the infidelity. Our method can be easily applied to real experimental settings, thereby demonstrating its promising prospects.


title: Inverse design of photonic surfaces on Inconel via multi-fidelity machine learning ensemble framework and high throughput femtosecond laser processing

abstract: We demonstrate a multi-fidelity (MF) machine learning ensemble framework for the inverse design of photonic surfaces, trained on a dataset of 11,759 samples that we fabricate using high throughput femtosecond laser processing. The MF ensemble combines an initial low fidelity model for generating design solutions, with a high fidelity model that refines these solutions through local optimization. The combined MF ensemble can generate multiple disparate sets of laser-processing parameters that can each produce the same target input spectral emissivity with high accuracy (root mean squared errors < 2%). SHapley Additive exPlanations analysis shows transparent model interpretability of the complex relationship between laser parameters and spectral emissivity. Finally, the MF ensemble is experimentally validated by fabricating and evaluating photonic surface designs that it generates for improved efficiency energy harvesting devices. Our approach provides a powerful tool for advancing the inverse design of photonic surfaces in energy harvesting applications.


title: Signatures of spinon dynamics and phase structure of dipolar-octupolar quantum spin ices in two-dimensional coherent spectroscopy

abstract: We study how sharp signatures of fractionalization emerge in nonlinear spectroscopy experiments on spin liquids with separated energy scales. Our model is that of dipolar-octupolar rare earth pyrochlore materials, prime candidates for realising quantum spin ice. This family of three dimensional quantum spin liquids exhibits fractionalization of spin degrees of freedom into spinons charged under an emergent $U(1)$ gauge field. We show that the technique of two dimensional coherent spectroscopy (2DCS) can identify clear signatures of fractionalised spinon dynamics in dipolar-octupolar quantum spin ices. However, at intermediate temperatures, spinon dynamics are heavily constrained in the presence of an incoherent spin background, leading to a broad 2DCS response. At lower temperatures, a sharp signal emerges as the system enters a coherent spin liquid state. This lower temperature signal can in turn distinguish between zero-flux and $\pi$-flux forms of quantum spin ice.


title: Solvability of the moisture transport model for porous materials

abstract: We consider an initial and boundary value problem invoked from the mathematical model for moisture transport in porous materials. Because of the difficulty appearing in the boundary condition, we have changed it and obtain the nonlinear parabolic equation with the nonlinear boundary condition in the one-dimensional interval. The main result of this paper is to prove existence and uniqueness of solutions to the problem by applying the standard fixed point theorem argument.


title: Report on some papers related to the function $\mathop{\mathcal R }(s)$ found by Siegel in Riemann's posthumous papers

abstract: In a letter to Weierstrass Riemann asserted that the number $N_0(T)$ of zeros of $\zeta(s)$ on the critical line to height $T$ is approximately equal to the total number of zeros to this height $N(T)$. Siegel studied some posthumous papers of Riemann trying to find a proof of this. He found a function $\mathop{\mathcal R }(s)$ whose zeros are related to the zeros of the function $\zeta(s)$. Siegel concluded that Riemann's papers contained no ideas for a proof of his assertion, connected the position of the zeros of $\mathop{\mathcal R }(s)$ with the position of the zeros of $\zeta(s)$ and asked about the position of the zeros of $\mathop{\mathcal R }(s)$. This paper is a summary of several papers that we will soon upload to arXiv, in which we try to answer Siegel's question about the position of the zeros of $\mathop{\mathcal R }(s)$. The articles contain also improvements on Siegel's results and also other possible ways to prove Riemann's assertion, but without achieving this goal.


title: New limits on warm inflation from pulsar timing arrays

abstract: In this paper, we investigate scalar-induced gravitational waves (GWs) generated in the post-inflationary universe to infer new limits on warm inflation. We specifically examine the evolution of primordial GWs produced by scalar perturbations produced during the radiation-dominated epoch. For this purpose, we assume a weak regime of warm inflation under the slow-roll approximation, with a dissipation coefficient linearly dependent on the temperature of the radiation bath. We then derive analytical expressions for the curvature power spectrum and the scalar index, in the cases of chaotic and exponential potentials of the inflationary field. Subsequently, we compare the theoretical predictions regarding the relic energy density of GWs with the stochastic GW background signal recently detected by the NANOGrav collaboration through the use of pulsar timing array measurements. In so doing, we obtain numerical constraints on the free parameters of the inflationary models under study. Finally, we conduct a model selection analysis through the Bayesian inference method to measure the statistical performance of the different theoretical scenarios.


title: DreamPhysics: Learning Physical Properties of Dynamic 3D Gaussians with Video Diffusion Priors

abstract: Dynamic 3D interaction has witnessed great interest in recent works, while creating such 4D content remains challenging. One solution is to animate 3D scenes with physics-based simulation, and the other is to learn the deformation of static 3D objects with the distillation of video generative models. The former one requires assigning precise physical properties to the target object, otherwise the simulated results would become unnatural. The latter tends to formulate the video with minor motions and discontinuous frames, due to the absence of physical constraints in deformation learning. We think that video generative models are trained with real-world captured data, capable of judging physical phenomenon in simulation environments. To this end, we propose DreamPhysics in this work, which estimates physical properties of 3D Gaussian Splatting with video diffusion priors. DreamPhysics supports both image- and text-conditioned guidance, optimizing physical parameters via score distillation sampling with frame interpolation and log gradient. Based on a material point method simulator with proper physical parameters, our method can generate 4D content with realistic motions. Experimental results demonstrate that, by distilling the prior knowledge of video diffusion models, inaccurate physical properties can be gradually refined for high-quality simulation. Codes are released at: https://github.com/tyhuang0428/DreamPhysics.


title: Finding Optimally Robust Data Mixtures via Concave Maximization

abstract: Training on mixtures of data distributions is now common in many modern machine learning pipelines, useful for performing well on several downstream tasks. Group distributionally robust optimization (group DRO) is one popular way to learn mixture weights for training a specific model class, but group DRO methods suffer for non-linear models due to non-convex loss functions and when the models are non-parametric. We address these challenges by proposing to solve a more general DRO problem, giving a method we call MixMax. MixMax selects mixture weights by maximizing a particular concave objective with entropic mirror ascent, and, crucially, we prove that optimally fitting this mixture distribution over the set of bounded predictors returns a group DRO optimal model. Experimentally, we tested MixMax on a sequence modeling task with transformers and on a variety of non-parametric learning problems. In all instances MixMax matched or outperformed the standard data mixing and group DRO baselines, and in particular, MixMax improved the performance of XGBoost over the only baseline, data balancing, for variations of the ACSIncome and CelebA annotations datasets.


title: Stochastic Newton Proximal Extragradient Method

abstract: Stochastic second-order methods achieve fast local convergence in strongly convex optimization by using noisy Hessian estimates to precondition the gradient. However, these methods typically reach superlinear convergence only when the stochastic Hessian noise diminishes, increasing per-iteration costs over time. Recent work in [arXiv:2204.09266] addressed this with a Hessian averaging scheme that achieves superlinear convergence without higher per-iteration costs. Nonetheless, the method has slow global convergence, requiring up to $\tilde{O}(\kappa^2)$ iterations to reach the superlinear rate of $\tilde{O}((1/t)^{t/2})$, where $\kappa$ is the problem's condition number. In this paper, we propose a novel stochastic Newton proximal extragradient method that improves these bounds, achieving a faster global linear rate and reaching the same fast superlinear rate in $\tilde{O}(\kappa)$ iterations. We accomplish this by extending the Hybrid Proximal Extragradient (HPE) framework, achieving fast global and local convergence rates for strongly convex functions with access to a noisy Hessian oracle.


title: Non-splitting Eulerian-Lagrangian WENO schemes for two-dimensional nonlinear convection-diffusion equations

abstract: In this paper, we develop high-order, conservative, non-splitting Eulerian-Lagrangian (EL) Runge-Kutta (RK) finite volume (FV) weighted essentially non-oscillatory (WENO) schemes for convection-diffusion equations. The proposed EL-RK-FV-WENO scheme defines modified characteristic lines and evolves the solution along them, significantly relaxing the time-step constraint for the convection term. The main algorithm design challenge arises from the complexity of constructing accurate and robust reconstructions on dynamically varying Lagrangian meshes. This reconstruction process is needed for flux evaluations on time-dependent upstream quadrilaterals and time integrations along moving characteristics. To address this, we propose a strategy that utilizes a WENO reconstruction on a fixed Eulerian mesh for spatial reconstruction, and updates intermediate solutions on the Eulerian background mesh for implicit-explicit RK temporal integration. This strategy leverages efficient reconstruction and remapping algorithms to manage the complexities of polynomial reconstructions on time-dependent quadrilaterals, while ensuring local mass conservation. The proposed scheme ensures mass conservation due to the flux-form semi-discretization and the mass-conservative reconstruction on both background and upstream cells. Extensive numerical tests have been performed to verify the effectiveness of the proposed scheme.


title: Towards Automating the Retrospective Generation of BIM Models: A Unified Framework for 3D Semantic Reconstruction of the Built Environment

abstract: The adoption of Building Information Modeling (BIM) is beneficial in construction projects. However, it faces challenges due to the lack of a unified and scalable framework for converting 3D model details into BIM. This paper introduces SRBIM, a unified semantic reconstruction architecture for BIM generation. Our approach's effectiveness is demonstrated through extensive qualitative and quantitative evaluations, establishing a new paradigm for automated BIM modeling.


title: Learning from Streaming Data when Users Choose

abstract: In digital markets comprised of many competing services, each user chooses between multiple service providers according to their preferences, and the chosen service makes use of the user data to incrementally improve its model. The service providers' models influence which service the user will choose at the next time step, and the user's choice, in return, influences the model update, leading to a feedback loop. In this paper, we formalize the above dynamics and develop a simple and efficient decentralized algorithm to locally minimize the overall user loss. Theoretically, we show that our algorithm asymptotically converges to stationary points of of the overall loss almost surely. We also experimentally demonstrate the utility of our algorithm with real world data.


title: Spectroscopy and modeling of $^{171}$Yb Rydberg states for high-fidelity two-qubit gates

abstract: We present multichannel quantum defect (MQDT) models for highly excited $^{174}$Yb and $^{171}$Yb Rydberg states with $L \leq 2$. The models are developed using a combination of existing literature data and new, high-precision laser and microwave spectroscopy in an atomic beam, and validated by detailed comparison with experimentally measured Stark shifts and magnetic moments. We then use these models to compute interaction potentials between two Yb atoms, and find excellent agreement with direct measurements in an optical tweezer array. From the computed interaction potential, we identify an anomalous F\"orster resonance that likely degraded the fidelity of previous entangling gates in $^{171}$Yb using $F=3/2$ Rydberg states. We then identify a more suitable $F=1/2$ state, and achieve a state-of-the-art controlled-Z gate fidelity of $\mathcal{F}=0.994(1)$, with the remaining error fully explained by known sources. This work establishes a solid foundation for the continued development quantum computing, simulation and entanglement-enhanced metrology with Yb neutral atom arrays.


title: Influence of spectra sewing on XCT measurement

abstract: The paper presents an analysis of the possible spectra manipulation and its consequence for the specific application of XCT. The focus was on the modification of the registered spectra dominantly by the sewing/stitching method. A model spectrum was created to analyse the possible behaviour of the spectral components when specifically arranged. The model and processing of real experimental data revealed that careful spectral sewing can be a very useful procedure and typically leads to improvement of the results obtained with the XCT technique. The results recommended also cautiousness in the choice of the applied modification and scale. In some cases gain or spectral enhancement of a part of the spectrum can be considered also as a sort of sewing, and improve the XCT results.


title: Online Optimization Perspective on First-Order and Zero-Order Decentralized Nonsmooth Nonconvex Stochastic Optimization

abstract: We investigate the finite-time analysis of finding ($\delta,\epsilon$)-stationary points for nonsmooth nonconvex objectives in decentralized stochastic optimization. A set of agents aim at minimizing a global function using only their local information by interacting over a network. We present a novel algorithm, called Multi Epoch Decentralized Online Learning (ME-DOL), for which we establish the sample complexity in various settings. First, using a recently proposed online-to-nonconvex technique, we show that our algorithm recovers the optimal convergence rate of smooth nonconvex objectives. We then extend our analysis to the nonsmooth setting, building on properties of randomized smoothing and Goldstein-subdifferential sets. We establish the sample complexity of $O(\delta^{-1}\epsilon^{-3})$, which to the best of our knowledge is the first finite-time guarantee for decentralized nonsmooth nonconvex stochastic optimization in the first-order setting (without weak-convexity), matching its optimal centralized counterpart. We further prove the same rate for the zero-order oracle setting without using variance reduction.


title: Experimental comparison of 5G SDR platforms: srsRAN x OpenAirInterface

abstract: A Software-Defined Radio (SDR) platform is a communication system that implements as software functions that are typically implemented in dedicated hardware. One of its main advantages is the flexibility to test and deploy radio communication networks in a fast and cheap way. In the context of the Fifth Generation (5G) of wireless cellular networks, there are open source SDR platforms available online. Two of the most popular SDR platforms are srsRAN and OpenAirInterface. This paper presents these two platforms, the characteristics of the networks created by them, the possibilities of changes in their interfaces and configurations, and also their limits. Moreover, in this paper, we also evaluate and compare both platforms in an experimental setup deployed in a laboratory.


title: Differentiable Task Graph Learning: Procedural Activity Representation and Online Mistake Detection from Egocentric Videos

abstract: Procedural activities are sequences of key-steps aimed at achieving specific goals. They are crucial to build intelligent agents able to assist users effectively. In this context, task graphs have emerged as a human-understandable representation of procedural activities, encoding a partial ordering over the key-steps. While previous works generally relied on hand-crafted procedures to extract task graphs from videos, in this paper, we propose an approach based on direct maximum likelihood optimization of edges' weights, which allows gradient-based learning of task graphs and can be naturally plugged into neural network architectures. Experiments on the CaptainCook4D dataset demonstrate the ability of our approach to predict accurate task graphs from the observation of action sequences, with an improvement of +16.7% over previous approaches. Owing to the differentiability of the proposed framework, we also introduce a feature-based approach, aiming to predict task graphs from key-step textual or video embeddings, for which we observe emerging video understanding abilities. Task graphs learned with our approach are also shown to significantly enhance online mistake detection in procedural egocentric videos, achieving notable gains of +19.8% and +7.5% on the Assembly101 and EPIC-Tent datasets. Code for replicating experiments is available at https://github.com/fpv-iplab/Differentiable-Task-Graph-Learning.


title: Optimized effective potential forces with the plane-wave and pseudopotential method

abstract: The optimized effective potential (OEP) approach has so far mainly been used in benchmark studies and for the evaluation of band gaps. In this work, we extend the application of the OEP by determining the analytical ionic forces within the plane-wave and pseudopotential framework. It is first shown that, due to the constrained optimization inherent to the OEP approach, an extra term needs to be added to the standard Hellmann-Feynman expression for the forces, whenever nonlocal pseudopotentials are employed. Computing this term for functionals based on Hartree-Fock and the hybrid PBE0 functional yields forces with excellent numerical accuracy. Furthermore, results for equilibrium geometries and vibrational frequencies on a set of molecules and solids confirm that the local exchange OEP is able to reproduce results obtained with the nonlocal exchange potential. Our work opens up the possibility to study lattice dynamics using advanced orbital functionals for describing exchange and correlation effects.


title: Near-Field Beam Tracking with Extremely Large Dynamic Metasurface Antennas

abstract: The interplay between large antenna apertures and high frequencies in future generations of wireless networks will give rise to near-field communications. In this paper, we focus on the hybrid analog and digital beamforming architecture of dynamic metasurface antennas, which constitutes a recent prominent enabler of extremely massive antenna architectures, and devise a near-field beam tracking framework that initiates near-field beam sweeping only when the base station estimates that its provided beamforming gain drops below a threshold from its theoretically optimum value. Novel analytical expressions for the correlation function between any two beam focusing vectors, the beamforming gain with respect to user coordinate mismatch, the direction of the user movement yielding the fastest beamforming gain deterioration, and the minimum user displacement for a certain performance loss are presented. We also design a non-uniform coordinate grid for effectively sampling the user area of interest at each position estimation slot. Our extensive simulation results validate our theoretical analysis and showcase the superiority of the proposed near-field beam tracking over benchmarks.


title: DA-HFNet: Progressive Fine-Grained Forgery Image Detection and Localization Based on Dual Attention

abstract: The increasing difficulty in accurately detecting forged images generated by AIGC(Artificial Intelligence Generative Content) poses many risks, necessitating the development of effective methods to identify and further locate forged areas. In this paper, to facilitate research efforts, we construct a DA-HFNet forged image dataset guided by text or image-assisted GAN and Diffusion model. Our goal is to utilize a hierarchical progressive network to capture forged artifacts at different scales for detection and localization. Specifically, it relies on a dual-attention mechanism to adaptively fuse multi-modal image features in depth, followed by a multi-branch interaction network to thoroughly interact image features at different scales and improve detector performance by leveraging dependencies between layers. Additionally, we extract more sensitive noise fingerprints to obtain more prominent forged artifact features in the forged areas. Extensive experiments validate the effectiveness of our approach, demonstrating significant performance improvements compared to state-of-the-art methods for forged image detection and localization.The code and dataset will be released in the future.


title: Groupoidal and truncated $n$-quasi-categories

abstract: We define groupoidal and $(n+k)$-truncated $n$-quasi-categories, which are the translation to the world of $n$-quasi-categories of groupoidal and truncated $(\infty, n)$-$\Theta$-spaces defined by Rezk. We show that these objects are the fibrant objects of model structures on the category of presheaves on $\Theta_n$ obtained by localisation of Ara's model structure for $n$-quasi-categories. Furthermore, we prove that the inclusion $\Delta \to \Theta_n$ induces a Quillen equivalence between the model structure for groupoidal (resp. and $n$-truncated) $n$-quasi-categories and the Kan-Quillen model structure for spaces (resp. homotopy $n$-types) on simplicial sets. To get to these results, we also construct a cylinder object for $n$-quasi-categories.


title: Cosmoglobe DR2. II. CIB monopole measurements from COBE-DIRBE through global Bayesian analysis

abstract: We derive new constraints on the CIB monopole spectrum from reprocessed COBE-DIRBE sky maps with lower instrumental and astrophysical contamination than the legacy DIRBE maps. These maps have been generated through a global Bayesian analysis framework that simultaneously fits cosmological, astrophysical, and instrumental parameters, described in a series of papers referred to as Cosmoglobe DR2. We have applied this method to the DIRBE Calibrated Individual Observations, complemented by selected HFI and FIRAS sky maps to break key astrophysical degeneracies, as well as WISE and Gaia compact object catalogs. In this paper, we focus on CIB constraints that result from this work. We report detections of an isotropic signal in five out of the ten DIRBE bands (1.25, 2.2, 3.5, 140, and 240 $\mu$m). For the 2.2 $\mu$m channel, we find an amplitude of $13\pm3\,\mathrm{nW\,m^{-2}\,sr^{-1}}$, 36% lower than reported from the official DIRBE release. For the 240 $\mu$m channel, we find $10\pm3\,\mathrm{nW\,m^{-2}\,sr^{-1}}$, 26% lower than the official DIRBE release. We interpret these lower values as resulting from improved zodiacal light and Galactic foreground modeling. For the bands between 4.9 and 100 $\mu$m, the presence of excess radiation in solar-centric coordinates reported in a companion paper precludes the definition of lower limits. However, the analysis still provides well-defined upper limits. For the 12 $\mu$m channel, we find an upper 95% confidence limit of 103 $\mathrm{nW\,m^{-2}\,sr^{-1}}$, a factor of four lower than the corresponding legacy result of 468 $\mathrm{nW\,m^{-2}\,sr^{-1}}$. The results presented in this paper redefines the state-of-the-art CIB monopole constraints from COBE-DIRBE, and it provides a real-world illustration of the power of global end-to-end analysis of multiple complementary data sets which is the foundational idea of the Cosmoglobe project.


title: The TEMPO Survey II: Science Cases Leveraged from a Proposed 30-Day Time Domain Survey of the Orion Nebula with the Nancy Grace Roman Space Telescope

abstract: The TEMPO (Transiting Exosatellites, Moons, and Planets in Orion) Survey is a proposed 30-day observational campaign using the Nancy Grace Roman Space Telescope. By providing deep, high-resolution, short-cadence infrared photometry of a dynamic star-forming region, TEMPO will investigate the demographics of exosatellites orbiting free-floating planets and brown dwarfs -- a largely unexplored discovery space. Here, we present the simulated detection yields of three populations: extrasolar moon analogs orbiting free-floating planets, exosatellites orbiting brown dwarfs, and exoplanets orbiting young stars. Additionally, we outline a comprehensive range of anticipated scientific outcomes accompanying such a survey. These science drivers include: obtaining observational constraints to test prevailing theories of moon, planet, and star formation; directly detecting widely separated exoplanets orbiting young stars; investigating the variability of young stars and brown dwarfs; constraining the low-mass end of the stellar initial mass function; constructing the distribution of dust in the Orion Nebula and mapping evolution in the near-infrared extinction law; mapping emission features that trace the shocked gas in the region; constructing a dynamical map of Orion members using proper motions; and searching for extragalactic sources and transients via deep extragalactic observations reaching a limiting magnitude of $m_{AB}=29.7$\,mag (F146 filter).


title: Learning Temporally Consistent Video Depth from Video Diffusion Priors

abstract: This work addresses the challenge of video depth estimation, which expects not only per-frame accuracy but, more importantly, cross-frame consistency. Instead of directly developing a depth estimator from scratch, we reformulate the prediction task into a conditional generation problem. This allows us to leverage the prior knowledge embedded in existing video generation models, thereby reducing learning difficulty and enhancing generalizability. Concretely, we study how to tame the public Stable Video Diffusion (SVD) to predict reliable depth from input videos using a mixture of image depth and video depth datasets. We empirically confirm that a procedural training strategy -- first optimizing the spatial layers of SVD and then optimizing the temporal layers while keeping the spatial layers frozen -- yields the best results in terms of both spatial accuracy and temporal consistency. We further examine the sliding window strategy for inference on arbitrarily long videos. Our observations indicate a trade-off between efficiency and performance, with a one-frame overlap already producing favorable results. Extensive experimental results demonstrate the superiority of our approach, termed ChronoDepth, over existing alternatives, particularly in terms of the temporal consistency of the estimated depth. Additionally, we highlight the benefits of more consistent video depth in two practical applications: depth-conditioned video generation and novel view synthesis. Our project page is available at https://jhaoshao.github.io/ChronoDepth/.


title: Robust Classification by Coupling Data Mollification with Label Smoothing

abstract: Introducing training-time augmentations is a key technique to enhance generalization and prepare deep neural networks against test-time corruptions. Inspired by the success of generative diffusion models, we propose a novel approach coupling data augmentation, in the form of image noising and blurring, with label smoothing to align predicted label confidences with image degradation. The method is simple to implement, introduces negligible overheads, and can be combined with existing augmentations. We demonstrate improved robustness and uncertainty quantification on the corrupted image benchmarks of the CIFAR and TinyImageNet datasets.


title: Reflection-Reinforced Self-Training for Language Agents

abstract: Self-training can potentially improve the performance of language agents without relying on demonstrations from humans or stronger models. The general process involves generating samples from a model, evaluating their quality, and updating the model by training on high-quality samples. However, self-training can face limitations because achieving good performance requires a good amount of high-quality samples, yet relying solely on model sampling for obtaining such samples can be inefficient. In addition, these methods often disregard low-quality samples, failing to leverage them effectively. To address these limitations, we present Reflection-Reinforced Self-Training (Re-ReST), which leverages a reflection model to refine low-quality samples and subsequently uses these improved samples to augment self-training. The reflection model takes both the model output and feedback from an external environment (e.g., unit test results in code generation) as inputs and produces improved samples as outputs. By employing this technique, we effectively enhance the quality of inferior samples, and enrich the self-training dataset with higher-quality samples efficiently. We perform extensive experiments on open-source language agents across tasks, including multi-hop question answering, sequential decision-making, code generation, visual question answering, and text-to-image generation. Results demonstrate improvements over self-training baselines across settings. Moreover, ablation studies confirm the reflection model's efficiency in generating quality self-training samples and its compatibility with self-consistency decoding.


title: Evidence for five types of fixation during a random saccade eye tracking task: Implications for the study of oculomotor fatigue

abstract: Our interest was to evaluate changes in fixation duration as a function of time-on-task (TOT) during a random saccade task. We employed a large, publicly available dataset. The frequency histogram of fixation durations was multimodal and modelled as a Gaussian mixture. We found five fixation types. The ``ideal'' response would be a single accurate saccade after each target movement, with a typical saccade latency of 200-250 msec, followed by a long fixation (> 800 msec) until the next target jump. We found fixations like this, but they comprised only 10% of all fixations and were the first fixation after target movement only 23.4% of the time. More frequently (57.4% of the time), the first fixation after target movement was short (117.7 msec mean) and was commonly followed by a corrective saccade. Across the entire 100 sec of the task, median total fixation duration decreased. This decrease was approximated with a power law fit with R^2=0.94. A detailed examination of the frequency of each of our five fixation types over time on task (TOT) revealed that the three shortest duration fixation types became more and more frequent with TOT whereas the two longest fixations became less and less frequent. In all cases, the changes over TOT followed power law relationships, with R^2 values between 0.73 and 0.93. We concluded that, over the 100 second duration of our task, long fixations are common in the first 15 to 22 seconds but become less common after that. Short fixations are relatively uncommon in the first 15 to 22 seconds but become more and more common as the task progressed. Apparently. the ability to produce an ideal response, although somewhat likely in the first 22 seconds, rapidly declines. This might be related to a noted decline in saccade accuracy over time.


title: Modal Separability of Fixpoint Formulae

abstract: We study modal separability for fixpoint formulae: given two mutually exclusive fixpoint formulae $\varphi,\varphi'$, decide whether there is a modal formula $\psi$ that separates them, that is, that satisfies $\varphi\models\psi\models\neg\varphi'$. This problem has applications for finding simple reasons for inconsistency. Our main contributions are tight complexity bounds for deciding modal separability and optimal ways to compute a separator if it exists. More precisely, it is EXPTIME-complete in general and PSPACE-complete over words. Separators can be computed in doubly exponential time in general and in exponential time over words, and this is optimal as well. The results for general structures transfer to arbitrary, finitely branching, and finite trees. The word case results hold for finite, infinite, and arbitrary words.


title: The Hadamard condition on a Cauchy surface and the renormalized stress-energy tensor

abstract: Given a Cauchy surface in a curved spacetime and a suitably defined quantum state on the CCR algebra of the Klein Gordon quantum field on that surface, we show, by expanding the squared spacetime geodesic distance and the '$U$' and '$V$' Hadamard coefficients (and suitable derivatives thereof) in sufficiently accurate covariant Taylor expansions on the surface that the renormalized expectation value of the quantum stress-energy tensor on the surface is determined by the geometry of the surface and the first 4 time derivatives of the metric off the surface, in addition to the Cauchy data for the field's two-point function. This result has been anticipated in and is motivated by a previous investigation by the authors on the initial value problem in semiclassical gravity, for which the geometric initial data corresponds {\it a priori} to the metric on the surface and up to 3 time derivatives off the surface, but where it was argued that the fourth derivative can be obtained with aid of the field equations on the initial surface.


title: Applications of Sparse Hypergraph Colorings

abstract: Many problems in extremal combinatorics can be reduced to determining the independence number of a specific auxiliary hypergraph. We present two such problems, one from discrete geometry and one from hypergraph Tur\'an theory. Using results on hypergraph colorings by Cooper-Mubayi and Li-Postle, we demonstrate that for those two problems the trivial lower bound on the independence number can be improved upon: Erd\H{o}s, Graham, Ruzsa and Taylor asked to determine the largest size, denoted by $g(n)$, of a subset $P$ of the grid $[n]^2$ such that every pair of points in $P$ span a different slope. Improving on a lower bound by Zhang from 1993, we show that $$g(n)=\Omega \left( \frac{n^{2/3} (\log \log n)^{1/3} }{ \log^{1/3}n} \right).$$ Let $H^r_3$ denote an $r$-graph with $r+1$ vertices and $3$ edges. Recently, Sidorenko proved the following lower bounds for the Tur\'an density of this $r$-graph: $\pi(H^r_3)\geq r^{-2}$ for every $r$, and $\pi(H^r_3)\geq (1.7215 - o(1)) r^{-2}$. We present an improved asymptotic bound: $\pi(H^r_3)=\Omega\left(r^{-2} \log^{1/2} r \right).$


title: Going Bananas! - Unfolding Program Synthesis with Origami

abstract: Automatically creating a computer program using input-output examples can be a challenging task, especially when trying to synthesize computer programs that require loops or recursion. Even though the use of recursion can make the algorithmic description more succinct and declarative, this concept creates additional barriers to program synthesis algorithms such as the creation and the (tentative) evaluation of non-terminating programs. One reason is that the recursive function must define how to traverse (or generate) the data structure and, at the same time, how to process it. In functional programming, the concept of recursion schemes decouples these two tasks by putting a major focus on the latter. This can also help to avoid some of the pitfalls of recursive functions during program synthesis, as argued in a previous work where we introduced the Origami technique. In our previous paper, we showed how this technique was effective in finding solutions for programs that require folding lists. In this work, we incorporate other recursion schemes into Origami, such as accumulated folding, unfolding, and the combination of unfolding and folding. We evaluated Origami on the 29 problems of the standard General Program Synthesis Benchmark Suite 1, obtaining favorable results against other well-known algorithms. Overall, Origami achieves the best result in 25% more problems than its predecessor (HOTGP) and an even higher increase when compared to other approaches. Not only that, but it can also consistently find a solution to problems that many algorithms report a low success rate.


title: Recent Trends in Insect and Robot Navigation through the Lens of Reinforcement Learning

abstract: Bees are among the master navigators of the insect world. Despite impressive advances in robot navigation research, the performance of these insects is still unrivaled by any artificial system in terms of training efficiency and generalization capabilities, particularly considering the limited computational capacity. On the other hand, computational principles underlying these extraordinary feats are still only partially understood. The theoretical framework of reinforcement learning (RL) provides an ideal focal point to bring the two fields together for mutual benefit. While RL has long been at the core of robot navigation research, current computational theories of insect navigation are not commonly formulated within this framework, but largely as an associative learning process implemented in the insect brain, especially in a region called the mushroom body. Here we argue that this neural substrate can be understood as implementing a certain class of relatively simple RL algorithms, capable of integrating distinct components of a navigation task, reminiscent of hierarchical RL models used in robot navigation. The efficiency of insect navigation is likely rooted in an efficient and robust internal representation of space, linking retinotopic (egocentric) visual input with the geometry of the environment. We discuss how current models of insect and robot navigation are exploring representations beyond classical, complete map-like representations, with spatial information being embedded in the respective latent representations to varying degrees.


title: Spatiotemporal evolution of PM2.5 diffusion in Cheng-Yu urban agglomeration in response to COVID-19 lockdown using complex network

abstract: As the decrease in human activities resulting from the COVID-19 control measures had a significant impact on air quality, the epidemic provided an opportunity to investigate the extent to which air pollution is influenced by human activities and review existing measures. However, the corresponding diffusion pattern on a city scale is seldom mentioned at present stage, therefore, we chose the Cheng-Yu urban agglomeration, which is the largest city cluster in Southwest China, as our study area during the COVID-19 period, and attempted to investigate the process of PM2.5 diffusion using a complex network method. The results displayed that there was an evident external spillover effect of PM2.5 across all regions, and the PM2.5 spillovers were concentrated in several cities in the Cheng-Yu urban agglomeration during the lockdown period, whereas they are more dispersed during the recovery period. The overall decline in the impact of PM2.5 pollution source areas on receptor areas from a normal year to the pandemic year, and the intensity of PM2.5 spillover decreases gradually as the distance from the center increases. The implementation of the lockdown measures had an impact on both the input and output patterns of PM2.5 pollution in the region, the input pattern of PM2.5 pollution exhibited higher vulnerability, while the output pattern showed higher resilience. Additionally, the spillover relationship of PM2.5 pollution varies between different blocks, with relatively simple spillover relationships observed during the lockdown period and more complex dynamics during the recovery period. These findings have highlighted the importance of joint controls in combating regional air pollution.


title: An inverse obstacle problem with a single pair of Cauchy data: Laplace's equation case

abstract: This paper is concerned with an inverse obstacle problem for the Laplace's equation. The aim is to recover the constant conductivity coefficient in the equation and the boundary of a Dirichlet polygonal obstacle from a single pair of Cauchy data. Uniqueness results are established under some a priori assumptions on the input boundary value data. A domain-defined sampling method, based on the factorization method originating from inverse acoustic scattering, has been proposed to recover both the constant conductivity coefficient and the polygonal obstacle. A hybrid strategy, which combines the sampling method and iterative scheme, is employed {\color{hgh}to reconstruct} the location and shape of the obstacle. Numerical examples indicate that our method is efficient.


title: \v{S}olt\'es' hypergraphs

abstract: More than $30$ years ago, \v{S}olt\'es observed that the total distance of the graph $C_{11}$ does not change by deleting a vertex, and wondered about the existence of other such graphs, called \v{S}olt\'es graphs. We extend the definition of \v{S}olt\'es' graphs to \v{S}olt\'es' hypergraphs, determine all orders for which a \v{S}olt\'es' hypergraph exists, observe infinitely many uniform \v{S}olt\'es' hypergraphs, and find the \v{S}olt\'es' hypergraph with minimum size (spoiler: it is not $C_{11}$).


title: Reducing phenotype-structured PDE models of cancer evolution to systems of ODEs: a generalised moment dynamics approach

abstract: Intratumour phenotypic heterogeneity is nowadays understood to play a critical role in disease progression and treatment failure. Accordingly, there has been increasing interest in the development of mathematical models capable of capturing its role in cancer cell adaptation. This can be systematically achieved by means of models comprising phenotype-structured nonlocal partial differential equations, tracking the evolution of the phenotypic density distribution of the cell population, which may be compared to gene and protein expression distributions obtained experimentally. Nevertheless, given the high analytical and computational cost of solving these models, much is to be gained from reducing them to systems of ordinary differential equations for the moments of the distribution. We propose a generalised method of model-reduction, relying on the use of a moment generating function, Taylor series expansion and truncation closure, to reduce a nonlocal reaction-advection-diffusion equation, with general phenotypic drift and proliferation rate functions, to a system of moment equations up to arbitrary order. Our method extends previous results in the literature, which we address via two examples, by removing any \textit{a priori} assumption on the shape of the distribution, and provides a flexible framework for mathematical modellers to account for the role of phenotypic heterogeneity in cancer adaptive dynamics, in a simpler mathematical framework.


title: The Geometry of Categorical and Hierarchical Concepts in Large Language Models

abstract: Understanding how semantic meaning is encoded in the representation spaces of large language models is a fundamental problem in interpretability. In this paper, we study the two foundational questions in this area. First, how are categorical concepts, such as {'mammal', 'bird', 'reptile', 'fish'}, represented? Second, how are hierarchical relations between concepts encoded? For example, how is the fact that 'dog' is a kind of 'mammal' encoded? We show how to extend the linear representation hypothesis to answer these questions. We find a remarkably simple structure: simple categorical concepts are represented as simplices, hierarchically related concepts are orthogonal in a sense we make precise, and (in consequence) complex concepts are represented as polytopes constructed from direct sums of simplices, reflecting the hierarchical structure. We validate these theoretical results on the Gemma large language model, estimating representations for 957 hierarchically related concepts using data from WordNet.


title: Towards Universal Unfolding of Detector Effects in High-Energy Physics using Denoising Diffusion Probabilistic Models

abstract: The unfolding of detector effects in experimental data is critical for enabling precision measurements in high-energy physics. However, traditional unfolding methods face challenges in scalability, flexibility, and dependence on simulations. We introduce a novel unfolding approach using conditional Denoising Diffusion Probabilistic Models (cDDPM). Our method utilizes the cDDPM for a non-iterative, flexible posterior sampling approach, which exhibits a strong inductive bias that allows it to generalize to unseen physics processes without explicitly assuming the underlying distribution. We test our approach by training a single cDDPM to perform multidimensional particle-wise unfolding for a variety of physics processes, including those not seen during training. Our results highlight the potential of this method as a step towards a "universal" unfolding tool that reduces dependence on truth-level assumptions.


title: Quasinormal modes of hairy black holes in shift-symmetric theories

abstract: Alternative theories of gravity may be put to the test by making use of gravitational wave observations. Scalar-tensor theories provide a relatively simple framework that allows for compact object solutions with characteristics different from those of their GR counterparts. In shift-symmetric theories, black hole hair may arise when a linear coupling with the Gauss-Bonnet (GB) invariant is introduced. The effect of this coupling on the black hole quasinormal modes (QNMs) has been shown to be small, therefore limiting the observational interest in the theory. In general, however, one expects that additional shift-symmetric terms in the Lagrangian may be relevant, and indeed, it has been shown that they can have a nontrivial impact on the mass and scalar charge of the stationary solutions. In this work we explore the effect that various such terms have on the axial and polar QNMs of the hairy black hole solutions.


title: Spectral characterization of the constant sign derivatives of Green's function related to two point boundary value conditions

abstract: In this paper we will study the set of parameters in which certain partial derivatives of the Green's function, related to a $n$-order linear operator $T_{n}[M]$, depending on a real parameter $M$, coupled to different two-point boundary conditions, are of constant sign. We will do it without using the explicit expression of the Green's function. The constant sign interval will be characterized by the first eigenvalue related to suitable boundary conditions of the studied operator. As a consequence of the main result, we will be able to give sufficient conditions to ensure that the derivatives of Green's function cannot be nonpositive (nonnegative). These characterizations and the obtained results can be used to deduce the existence of solutions of nonlinear problems under additional conditions on the nonlinear part. To illustrate the obtained results, some examples are given.


title: Quasisymmetric divided differences

abstract: We develop a quasisymmetric analogue of the combinatorial theory of Schubert polynomials and the associated divided difference operators. Our counterparts are "forest polynomials", and a new family of linear operators, whose theory of compositions is governed by forests and the "Thompson monoid". Our approach extends naturally to $m$-colored quasisymmetric functions. We then give several applications of our theory to fundamental quasisymmetric functions, the study of quasisymmetric coinvariant rings and their associated harmonics, and positivity results for various expansions. In particular we resolve a conjecture of Aval-Bergeron-Li regarding quasisymmetric harmonics.


title: Decoupling of External and Internal Dynamics in Driven Two-level Systems

abstract: We show how a laser driven two-level system including quantized external degrees of freedom for each state can be decoupled into a set of oscillator equations acting only on the external degrees of freedom with operator valued damping representing the detuning. We give a way of characterizing the solvability of this family of problems by appealing to a classical oscillator with time-dependent damping. As a consequence of this classification we (a) obtain analytic and representation-free expressions for Rabi oscillations including external degrees of freedom with and without an external linear potential, (b) show that whenever the detuning operator can be diagonalized (analytically or numerically) the problem decomposes into a set of classical equations and (c) we can use the oscillator equations as a perturbative basis to describe Rabi oscillations in weak but otherwise arbitrary external potentials. Moreover, chirping of the driving fields phase emerges naturally as a means of compensating the Ehrenfest/mean-value part of the detuning operator's dynamics while the presence of driving phase noise leads to a stochastic evolution equation of Langevin type. Lastly, our approach is representation free with respect to the external degrees of freedom and as consequence a suitable representation or basis expansion can be chosen a posteriori depending on the desired application at hand.


title: MAD: Multi-Alignment MEG-to-Text Decoding

abstract: Deciphering language from brain activity is a crucial task in brain-computer interface (BCI) research. Non-invasive cerebral signaling techniques including electroencephalography (EEG) and magnetoencephalography (MEG) are becoming increasingly popular due to their safety and practicality, avoiding invasive electrode implantation. However, current works under-investigated three points: 1) a predominant focus on EEG with limited exploration of MEG, which provides superior signal quality; 2) poor performance on unseen text, indicating the need for models that can better generalize to diverse linguistic contexts; 3) insufficient integration of information from other modalities, which could potentially constrain our capacity to comprehensively understand the intricate dynamics of brain activity. This study presents a novel approach for translating MEG signals into text using a speech-decoding framework with multiple alignments. Our method is the first to introduce an end-to-end multi-alignment framework for totally unseen text generation directly from MEG signals. We achieve an impressive BLEU-1 score on the $\textit{GWilliams}$ dataset, significantly outperforming the baseline from 5.49 to 10.44 on the BLEU-1 metric. This improvement demonstrates the advancement of our model towards real-world applications and underscores its potential in advancing BCI research. Code is available at $\href{https://github.com/NeuSpeech/MAD-MEG2text}{https://github.com/NeuSpeech/MAD-MEG2text}$.


title: Enhancing the efficiency of quantum measurement-based engines with entangling measurements

abstract: We study the impact of entangling measurements on the efficiency of quantum measurement- based engines. We first show that for engines comprising many subsystems their efficiency can be enhanced by performing entangling measurements, as opposed to local measurements over each subsystem. When the collective measurement produces the same local state for the subsystems as individual local measurements, the improvement in the efficiency is proportional to the amount of correlations. Finally, we show that for two level systems these type of engine can operate at perfect efficiency while yielding a finite amount of work, in the limit large the number of subsystems.


title: Decoupled Alignment for Robust Plug-and-Play Adaptation

abstract: We introduce a low-resource safety enhancement method for aligning large language models (LLMs) without the need for supervised fine-tuning (SFT) or reinforcement learning from human feedback (RLHF). Our main idea is to exploit knowledge distillation to extract the alignment information from existing well-aligned LLMs and integrate it into unaligned LLMs in a plug-and-play fashion. Methodology, we employ delta debugging to identify the critical components of knowledge necessary for effective distillation. On the harmful question dataset, our method significantly enhances the average defense success rate by approximately 14.41%, reaching as high as 51.39%, in 17 unaligned pre-trained LLMs, without compromising performance.


title: Unambiguous detection of mesospheric CO2 clouds on Mars using 2.7 {\mu}m absorption band from the ACS/TGO solar occultations

abstract: Mesospheric CO2 clouds are one of two types of carbon dioxide clouds known on Mars. We present observations of mesospheric CO2 clouds made by Atmospheric Chemistry Suit (ACS) onboard the ESA-Roscosmos ExoMars Trace Gas Orbiter (TGO). We analyzed 1663 solar occultation sessions of Thermal InfraRed (TIRVIM) and Middle InfraRed (MIR) channels of ACS covering more than two Martian years that contain spectra of 2.7 {\mu}m carbon dioxide ice absorption band. That allowed us to unambiguously discriminate carbon dioxide ice aerosols from mineral dust and water ice aerosols, not relying on the information of atmospheric thermal conditions. CO2 clouds were detected in eleven solar occultation observations at altitudes from 39 km to 90 km. In five cases, there were two or three layers of CO2 clouds that were vertically separated by 5-15 km gaps. Effective radius of CO2 aerosol particles is in the range of 0.1-2.2 {\mu}m. Spectra produced by the smallest particles indicate a need for a better resolved CO2 ice refractive index. Nadir optical depth of CO2 clouds is in the range 5*10^{-4}-4*10^{-2} at both 2.7 {\mu}m and 0.8 {\mu}m. Asymmetrical diurnal distribution of detections observed by ACS is potentially due to local time variations of temperature induced by thermal tides. Two out of five cases of carbon dioxide cloud detections made by the TIRVIM instrument reveal the simultaneous presence of CO2 ice and H2O ice aerosols. Temperature profiles measured by the Near InfraRed (NIR) channel of ACS are used to calculate CO2 saturation ratio S at locations of carbon dioxide clouds. Supersaturation S > 1 is detected in only 5 out of 19 cases of CO2 cloud layers; extremely low values of S < 0.1 are found in 9 out of 19 cases.


title: Anisotropic hybridization in CeRhSn

abstract: The optical conductivity $\sigma(\omega,T)$ of CeRhSn was studied by broadband infrared spectroscopy. Temperature-dependent spectral weight transfer occurs over high energy ($0.8\,$eV) and temperature (${\sim}500\,$K) scales, classifying CeRhSn as a mixed valent compound. The optical conductivity reveals a substantial anisotropy in the electronic structure. Renormalization of $\sigma(\omega,T)$ occurs as a function of temperature to a coherent Kondo state with concomitant effective mass generation. Associated spectroscopic signatures were reproduced remarkably well by the combination of density functional theory and dynamical mean field theory using a momentum-independent self energy. The theory shows that the anisotropy for energies $>10\,$meV is mainly driven by the bare three-dimensional electronic structure that is renormalized by local electronic correlations. The possible influence of magnetic frustration and quantum criticality is restricted to lower energies.


title: Beyond symmetrization: effective adjacency matrices and renormalization for (un)singed directed graphs

abstract: To address the peculiarities of directed and/or signed graphs, new Laplacian operators have emerged. For instance, in the case of directionality, we encounter the magnetic operator, dilation (which is underexplored), operators based on random walks, and so forth. The definition of these new operators leads to the need for new studies and concepts, and consequently, the development of new computational tools. But is this really necessary? In this work, we define the concept of effective adjacency matrices that arise from the definition of deformed Laplacian operators such as magnetic, dilation, and signal. These effective matrices allow mapping generic graphs to a family of unsigned, undirected graphs, enabling the application of the well-explored toolkit of measures, machine learning methods, and renormalization groups of undirected graphs. To explore the interplay between deformed operators and effective matrices, we show how the Hodge-Helmholtz decomposition can assist us in navigating this complexity.


title: BISON: Blind Identification through Stateless scOpe-specific derivatioN

abstract: Delegating authentication to identity providers like Google or Facebook, while convenient, compromises user privacy. Global identifiers enable internet-wide tracking; furthermore, identity providers can also record users' associations. We show that neither is a necessary evil by presenting the BISON pseudonym derivation protocol, inspired by Oblivious Pseudorandom Functions. It hides the service provider's identity from the identity provider, yet produces a trusted, scoped, immutable pseudonym. Colluding service providers cannot link BISON pseudonyms. This prevents user tracking. BISON does not require long-lived state on the user device, and does not add additional actors to the authentication process. BISON uses lightweight cryptography. Pseudonym derivation requires a total of four elliptic curve scalar-point multiplications and four hash function evaluations, totaling to ~3 ms in our proof of concept implementation. BISON is designed to integrate into existing authentication protocols. We provide an OpenID Connect extension that allows OIDC's PPID pseudonyms to be derived using BISON. This demonstrates that BISON's privacy guarantees can be realized in practice. For these reasons, BISON is a crucial stepping stone towards realizing the privacy-preserving internet of tomorrow.


title: Large values of quadratic Dirichlet $L$-functions

abstract: Assuming the Generalized Riemann Hypothesis (GRH), we utilize the long resonator method to derive $\Omega$-results for the family of quadratic Dirichlet $L$-functions $L(\sigma, \chi_d)$, where $d$ runs over all fundamental discriminants with $|d| \leq X$ and $\sigma\in [1/2, 1]$ is fixed. This study advances understanding of the maximum size of $L(\sigma, \chi_d)$ within the segment $\sigma\in [1/2, 1]$. In particular, we improve upon Soundararajan's results at the central point and provide a lower bound on the proportion of fundamental discriminants, uniformly within an expected order of magnitude, up to optimal values of the constant for a fixed $\sigma \in (1/2, 1]$.


title: Revisiting Artifacts of Kohn-Sham Density Functionals for Biosimulation

abstract: We revisit the problem of unphysical charge density delocalization/fractionalization induced by the self-interaction error of common approximate Kohn-Sham Density Functional Theory functionals on simulation of small to medium-size proteins in vacuum. Aside from producing unphysical electron densities and total energies, the vanishing of the HOMO-LUMO gap associated with the unphysical charge delocalization leads to an unphysical low-energy spectrum and catastrophic failure of most popular solvers for the Kohn-Sham (KS) self-consistent field (SCF) problem. We apply a robust quasi-Newton SCF solver [Phys. Chem. Chem. Phys. 26, 6557 (2024)] to obtain solutions for some of these difficult cases. The anatomy of the charge delocalization is revealed by the natural deformation orbitals obtained from the density matrix difference between the Hartree-Fock and KS solutions; the charge delocalization can occur not only between charged fragments (such as in zwitterionic polypeptides) but also may involve neutral fragments. The vanishing-gap phenomenon and troublesome SCF convergence are both attributed to the unphysical KS Fock operator eigenspectra of molecular fragments (e.g., amino acids or their side chains). Analysis of amino acid pairs suggests that the unphysical charge delocalization can be partially ameliorated by the use of {\em some} range-separated hybrid functionals, but not by semilocal or standard hybrid functionals. Last, we demonstrate that solutions without the unphysical charge delocalization can be located even for semilocal KS functionals highly prone to such defects, but such solutions have non-Aufbau character and are unstable with respect to mixing of the non-overlapping "frontier" orbitals.


title: MOSEAC: Streamlined Variable Time Step Reinforcement Learning

abstract: Traditional reinforcement learning (RL) methods typically employ a fixed control loop, where each cycle corresponds to an action. This rigidity poses challenges in practical applications, as the optimal control frequency is task-dependent. A suboptimal choice can lead to high computational demands and reduced exploration efficiency. Variable Time Step Reinforcement Learning (VTS-RL) addresses these issues by using adaptive frequencies for the control loop, executing actions only when necessary. This approach, rooted in reactive programming principles, reduces computational load and extends the action space by including action durations. However, VTS-RL's implementation is often complicated by the need to tune multiple hyperparameters that govern exploration in the multi-objective action-duration space (i.e., balancing task performance and number of time steps to achieve a goal). To overcome these challenges, we introduce the Multi-Objective Soft Elastic Actor-Critic (MOSEAC) method. This method features an adaptive reward scheme that adjusts hyperparameters based on observed trends in task rewards during training. This scheme reduces the complexity of hyperparameter tuning, requiring a single hyperparameter to guide exploration, thereby simplifying the learning process and lowering deployment costs. We validate the MOSEAC method through simulations in a Newtonian kinematics environment, demonstrating high task and training performance with fewer time steps, ultimately lowering energy consumption. This validation shows that MOSEAC streamlines RL algorithm deployment by automatically tuning the agent control loop frequency using a single parameter. Its principles can be applied to enhance any RL algorithm, making it a versatile solution for various applications.


title: Inferring interaction potentials from stochastic particle trajectories

abstract: Accurate interaction potentials between microscopic components such as colloidal particles or cells are crucial to understanding a range of processes, including colloidal crystallization, bacterial colony formation, and cancer metastasis. Even in systems where the precise interaction mechanisms are unknown, effective interactions can be measured to inform simulation and design. However, these measurements are difficult and time-intensive, and often require conditions that are drastically different from in situ conditions of the system of interest. Moreover, existing methods of measuring interparticle potentials rely on constraining a small number of particles at equilibrium, placing limits on which interactions can be measured. We introduce a method for inferring interaction potentials directly from trajectory data of interacting particles. We explicitly solve the equations of motion to find a form of the potential that maximizes the probability of observing a known trajectory. Our method is valid for systems both in and out of equilibrium, is well-suited to large numbers of particles interacting in typical system conditions, and does not assume a functional form of the interaction potential. We apply our method to infer the interactions of colloidal spheres from experimental data, successfully extracting the range and strength of a depletion interaction from the motion of the particles.


title: Predicting the fatigue life of asphalt concrete using neural networks

abstract: Asphalt concrete's (AC) durability and maintenance demands are strongly influenced by its fatigue life. Traditional methods for determining this characteristic are both resource-intensive and time-consuming. This study employs artificial neural networks (ANNs) to predict AC fatigue life, focusing on the impact of strain level, binder content, and air-void content. Leveraging a substantial dataset, we tailored our models to effectively handle the wide range of fatigue life data, typically represented on a logarithmic scale. The mean square logarithmic error was utilized as the loss function to enhance prediction accuracy across all levels of fatigue life. Through comparative analysis of various hyperparameters, we developed a machine-learning model that captures the complex relationships within the data. Our findings demonstrate that higher binder content significantly enhances fatigue life, while the influence of air-void content is more variable, depending on binder levels. Most importantly, this study provides insights into the intricacies of using ANNs for modeling, showcasing their potential utility with larger datasets. The codes developed and the data used in this study are provided as open source on a GitHub repository, with a link included in the paper for full access.


title: Coarse Grained Molecular Dynamics with Normalizing Flows

abstract: We propose a sampling algorithm relying on a collective variable (CV) of mid-size dimension modelled by a normalizing flow and using non-equilibrium dynamics to propose full configurational moves from the proposition of a refreshed value of the CV made by the flow. The algorithm takes the form of a Markov chain with non-local updates, allowing jumps through energy barriers across metastable states. The flow is trained throughout the algorithm to reproduce the free energy landscape of the CV. The output of the algorithm are a sample of thermalized configurations and the trained network that can be used to efficiently produce more configurations. We show the functioning of the algorithm first on a test case with a mixture of Gaussians. Then we successfully test it on a higher dimensional system consisting in a polymer in solution with a compact and an extended stable state separated by a high free energy barrier.


title: Polynomial Bounds of CFLOBDDs against BDDs

abstract: Binary Decision Diagrams (BDDs) are widely used for the representation of Boolean functions. Context-Free-Language Ordered Decision Diagrams (CFLOBDDs) are a plug-compatible replacement for BDDs -- roughly, they are BDDs augmented with a certain form of procedure call. A natural question to ask is, ``For a given Boolean function $f$, what is the relationship between the size of a BDD for $f$ and the size of a CFLOBDD for $f$?'' Sistla et al. established that, in the best case, the CFLOBDD for a function $f$ can be exponentially smaller than any BDD for $f$ (regardless of what variable ordering is used in the BDD); however, they did not give a worst-case bound -- i.e., they left open the question, ``Is there a family of functions $\{ f_i \}$ for which the size of a CFLOBDD for $f_i$ must be substantially larger than a BDD for $f_i$?'' For instance, it could be that there is a family of functions for which the BDDs are exponentially more succinct than any corresponding CFLOBDDs. This paper studies such questions, and answers the second question posed above in the negative. In particular, we show that by using the same variable ordering in the CFLOBDD that is used in the BDD, the size of a CFLOBDD for any function $f$ cannot be far worse than the size of the BDD for $f$. The bound that relates their sizes is polynomial: If BDD $B$ for function $f$ is of size $|B|$ and uses variable ordering $\textit{Ord}$, then the size of the CFLOBDD $C$ for $f$ that also uses $\textit{Ord}$ is bounded by $O(|B|^3)$. The paper also shows that the bound is tight: there is a family of functions for which $|C|$ grows as $\Omega(|B|^3)$.


title: PARQO: Penalty-Aware Robust Query Optimization

abstract: The effectiveness of a cost-based query optimizer relies on the accuracy of selectivity estimates. The execution plan generated by the optimizer can be extremely poor in reality due to uncertainty in these estimates. This paper presents PARQO (Penalty-Aware Robust Query Optimization), a novel system where users can define powerful robustness metrics that assess the expected penalty of a plan with respect to true optimal plans under a model of uncertainty in selectivity estimates. PARQO uses workload-informed profiling to build error models, and employs principled sensitivity analysis techniques to identify selectivity dimensions with the largest impact on penalty. Experimental evaluation on three benchmarks demonstrates how PARQO is able to find robust, performant plans, and how it enables efficient and effective parametric optimization.


title: Modelling the redshift-space cluster-galaxy correlation function on Mpc scales with emulation of the pairwise velocity distribution

abstract: We present a method for modelling the cluster-galaxy correlation function in redshift-space, down to ~ Mpc scales. The method builds upon the so-called Galaxy Infall Kinematics (GIK) model, a parametric model for the pairwise velocities of galaxies with respect to nearby galaxy clusters. We fit the parameters of the GIK model to a suite of simulations run with different cosmologies, and use Gaussian Processes to emulate how the GIK parameters depend upon cosmology. This emulator can then be combined with knowledge of the real-space clustering of clusters and galaxies, to predict the cluster-galaxy correlation function in redshift space. Fitting this model to an observed correlation function enables the extraction of cosmological parameter constraints, and we present forecasts for a DESI-like survey. We also perform tests of the robustness of our constraints from fitting to mock data extracted from N-body simulations, finding that fitting to scales < 3 Mpc/h leads to a biased inference on cosmology, due to model misspecification on these scales. Finally, we discuss what steps will need to be taken in order to apply our method to real data.


title: Physics-Informed Neural Networks for Dynamic Process Operations with Limited Physical Knowledge and Data

abstract: In chemical engineering, process data is often expensive to acquire, and complex phenomena are difficult to model rigorously, rendering both entirely data-driven and purely mechanistic modeling approaches impractical. We explore using physics-informed neural networks (PINNs) for modeling dynamic processes governed by differential-algebraic equation systems when process data is scarce and complete mechanistic knowledge is missing. In particular, we focus on estimating states for which neither direct observational data nor constitutive equations are available. For demonstration purposes, we study a continuously stirred tank reactor and a liquid-liquid separator. We find that PINNs can infer unmeasured states with reasonable accuracy, and they generalize better in low-data scenarios than purely data-driven models. We thus show that PINNs, similar to hybrid mechanistic/data-driven models, are capable of modeling processes when relatively few experimental data and only partially known mechanistic descriptions are available, and conclude that they constitute a promising avenue that warrants further investigation.


title: How to Count Coughs: An Event-Based Framework for Evaluating Automatic Cough Detection Algorithm Performance

abstract: Chronic cough disorders are widespread and challenging to assess because they rely on subjective patient questionnaires about cough frequency. Wearable devices running Machine Learning (ML) algorithms are promising for quantifying daily coughs, providing clinicians with objective metrics to track symptoms and evaluate treatments. However, there is a mismatch between state-of-the-art metrics for cough counting algorithms and the information relevant to clinicians. Most works focus on distinguishing cough from non-cough samples, which does not directly provide clinically relevant outcomes such as the number of cough events or their temporal patterns. In addition, typical metrics such as specificity and accuracy can be biased by class imbalance. We propose using event-based evaluation metrics aligned with clinical guidelines on significant cough counting endpoints. We use an ML classifier to illustrate the shortcomings of traditional sample-based accuracy measurements, highlighting their variance due to dataset class imbalance and sample window length. We also present an open-source event-based evaluation framework to test algorithm performance in identifying cough events and rejecting false positives. We provide examples and best practice guidelines in event-based cough counting as a necessary first step to assess algorithm performance with clinical relevance.


title: Torsion-free Connections with prescribed Curvature

abstract: We provide necessary and sufficient conditions for a curvature map $S\colon U\longrightarrow K(\mathfrak{g})$ to arise from the curvature tensor of a torsion-free connection on a sufficiently small $U'\subset U$ by using a suitable power series approach. This torsion-free connection is uniquely given. The curvature map $S$ is used to effectively compute the holonomy of this connection.


title: The Optimal Reduction of a 2-Body Problem in R^3

abstract: In this paper we describe optimal reduction for the system of two bodies in $\mathbb{R}^3$ whose Hamiltonian is invariant under rotations and translations. In doing this, we introduce parametrizations and charts which help giving explicit expressions in order to deal with geometric and dynamical aspects of the reduction process. For this system, the standard assumptions of the Marsden-Weinstein reduction process are only partially satisfied while optimal reduction can be readily applied, and we study a comparison between those two reduction processes. We describe potential applications to the study of Post-Newtonian Hamiltonian systems for binary systems in astronomy.


title: Accelerator system parameter estimation using variational autoencoded latent regression

abstract: Particle accelerators are time-varying systems whose components are perturbed by external disturbances. Tuning accelerators can be a time-consuming process involving manual adjustment of multiple components, such as RF cavities, to minimize beam loss due to time-varying drifts. The high dimensionality of the system ($\sim$100 amplitude and phase RF settings in the LANSCE accelerator) makes it difficult to achieve optimal operation. The time-varying drifts and the dimensionality make system parameter estimation a challenging optimization problem. In this work, we propose a Variational Autoencoded Latent Regression (VALeR) model for robust estimation of system parameters using 2D unique projections of a charged particle beam's 6D phase space. In VALeR, VAE projects the phase space projections into a lower-dimensional latent space, and a dense neural network maps the latent space onto the space of system parameters. The trained network can predict system parameters for unseen phase space projections. Furthermore, VALeR can generate new projections by randomly sampling the latent space of VAE and also estimate the corresponding system parameters.


title: Coprime-Universal Quadratic Forms

abstract: Given a prime $p>3$, we characterize positive-definite integral quadratic forms that are coprime-universal for $p$, i.e. representing all positive integers coprime to $p$. This generalizes the $290$-Theorem by Bhargava and Hanke and extends later works by Rouse ($p=2$) and De Benedetto and Rouse ($p=3$). When $p=5,23,29,31$, our results are conditional on the coprime-universality of specific ternary forms. We prove this assumption under GRH (for Dirichlet and modular $L$-functions), following a strategy introduced by Ono and Soundararajan, together with some more elementary techniques borrowed from Kaplansky and Bhargava. Finally, we discuss briefly the problem of representing all integers in an arithmetic progression.