title: Revisiting Deep Generalized Canonical Correlation Analysis

abstract: Canonical correlation analysis (CCA) is a classic statistical method for discovering latent co-variation that underpins two or more observed random vectors. Several extensions and variations of CCA have been proposed that have strengthened our capabilities in terms of revealing common random factors from multiview datasets. In this work, we first revisit the most recent deterministic extensions of deep CCA and highlight the strengths and limitations of these state-of-the-art methods. Some methods allow trivial solutions, while others can miss weak common factors. Others overload the problem by also seeking to reveal what is not common among the views -- i.e., the private components that are needed to fully reconstruct each view. The latter tends to overload the problem and its computational and sample complexities. Aiming to improve upon these limitations, we design a novel and efficient formulation that alleviates some of the current restrictions. The main idea is to model the private components as conditionally independent given the common ones, which enables the proposed compact formulation. In addition, we also provide a sufficient condition for identifying the common random factors. Judicious experiments with synthetic and real datasets showcase the validity of our claims and the effectiveness of the proposed approach.


title: The Frobenius--stable version of the Grauert--Riemenschneider vanishing theorem fails

abstract: We show that the Frobenius--stable version of the Grauert--Riemenschneider vanishing theorem fails for terminal 3-folds in characteristic 2. To prove this, we introduce the notion of $\mathbb{F}_p$-rationality for singularities in positive characteristic and we show that klt singularities in dimension at most 4 are $\mathbb{F}_p$-rational.


title: A new coupled model for laser-induced thermal ablation accounting for tissue water vaporization

abstract: A new model is considered to describe the evolution of tissue temperature and water concentration during a thermal ablation process. The aim of this study is to expand the results obtained in Blauth et. al. 2020, where the tissue water concentration is considered as a known function, experimentally obtained. The model consists of two coupled equations: a parabolic partial differential equation for the temperature $\theta$ and an ordinary differential equation for the water content $w$. The equation for $\theta$ accounts for temperature diffusion, blood perfusion, the heat source provided by the laser applicator and the vaporization effects which act when the temperature approaches 100C. The equation for $w$ accounts for the loss of tissue water that occurs during vaporization. The model equations are solved in a cylindrical domain around the laser applicator and the results are compared with the existing experimental data for porcine liver tissue from H\"ubner et. al. 2017.


title: Fourier Quantum Process Tomography

abstract: The characterization of a quantum device is a crucial step in the development of quantum experiments. This is accomplished via Quantum Process Tomography, which combines the outcomes of different projective measurements to deliver a possible reconstruction of the underlying process. The tomography is typically performed by processing an overcomplete set of measurements and extracting the process matrix from maximum-likelihood estimation. Here, we introduce a new technique, referred to as Fourier Quantum Process Tomography, which requires a reduced number of measurements, and benchmark its performance against the standard maximum-likelihood approach. Fourier Quantum Process Tomography is based on measuring probability distributions in two conjugate spaces for different state preparations and projections. Exploiting the concept of phase retrieval, our scheme achieves a complete and robust characterization of the setup by processing a near-minimal set of measurements. We experimentally test the technique on different space-dependent polarization transformations, reporting average fidelities higher than 90% and significant computational advantage.


title: Prediction of Multiple Features in the Black Hole Mass Function due to Pulsational Pair-Instability Supernovae

abstract: Using high-resolution simulations of black hole formation from the direct collapse of massive stars undergoing pulsational pair-instability supernovae (PPISN), we find a new phenomenon which significantly affects the explosion and leads to two peaks in the resulting black hole mass function (BHMF). Lighter stars experiencing the pair-instability can form a narrow shell in which alpha ladder reactions take place, exacerbating the effect of the PPISN. The shell temperature in higher mass stars ($>62 {\rm M}_\odot $ at the onset of helium burning for population-III stars with metallicity $Z=10^{-5}$) is too low for this to occur. As a result, the spectrum of black holes $M_{\rm BH} (M_i)$ exhibits a shoulder feature whereby a large range of initial masses result in near-identical black hole masses. PPISN therefore predict two peaks in the mass function of astrophysical black holes -- one corresponding to the location of the upper black hole mass gap and a second corresponding to the location of the shoulder. This shoulder effect may explain the peak at $35_{-2.9}^{+1.7}{\rm M}_\odot$ in the LIGO/Virgo/KAGRA GWTC-3 catalog of merging binary black holes.


title: Hierarchical selection of genetic and gene by environment interaction effects in high-dimensional mixed models

abstract: Interactions between genes and environmental factors may play a key role in the etiology of many common disorders. Several regularized generalized linear models (GLMs) have been proposed for hierarchical selection of gene by environment interaction (GEI) effects, where a GEI effect is selected only if the corresponding genetic main effect is also selected in the model. However, none of these methods allow to include random effects to account for population structure, subject relatedness and shared environmental exposure. In this paper, we develop a unified approach based on regularized penalized quasi-likelihood (PQL) estimation to perform hierarchical selection of GEI effects in sparse regularized mixed models. We compare the selection and prediction accuracy of our proposed model with existing methods through simulations under the presence of population structure and shared environmental exposure. We show that for all simulation scenarios, compared to other penalized methods, our proposed method enforced sparsity by controlling the number of false positives in the model while having the best predictive performance. Finally, we apply our method to a real data application using the Orofacial Pain: Prospective Evaluation and Risk Assessment (OPPERA) study, and found that our method retrieves previously reported significant loci.


title: FedSZ: Leveraging Error-Bounded Lossy Compression for Federated Learning Communications

abstract: With the promise of federated learning (FL) to allow for geographically-distributed and highly personalized services, the efficient exchange of model updates between clients and servers becomes crucial. FL, though decentralized, often faces communication bottlenecks, especially in resource-constrained scenarios. Existing data compression techniques like gradient sparsification, quantization, and pruning offer some solutions, but may compromise model performance or necessitate expensive retraining. In this paper, we introduce FedSZ, a specialized lossy-compression algorithm designed to minimize the size of client model updates in FL. FedSZ incorporates a comprehensive compression pipeline featuring data partitioning, lossy and lossless compression of model parameters and metadata, and serialization. We evaluate FedSZ using a suite of error-bounded lossy compressors, ultimately finding SZ2 to be the most effective across various model architectures and datasets including AlexNet, MobileNetV2, ResNet50, CIFAR-10, Caltech101, and Fashion-MNIST. Our study reveals that a relative error bound 1E-2 achieves an optimal tradeoff, compressing model states between 5.55-12.61x while maintaining inference accuracy within <0.5% of uncompressed results. Additionally, the runtime overhead of FedSZ is <4.7% or between of the wall-clock communication-round time, a worthwhile trade-off for reducing network transfer times by an order of magnitude for networks bandwidths <500Mbps. Intriguingly, we also find that the error introduced by FedSZ could potentially serve as a source of differentially private noise, opening up new avenues for privacy-preserving FL.


title: What Do You Mean by Memory? When Engineers Are Lost in the Maze of Complexity

abstract: An accepted practice to decrease applications' memory usage is to reduce the amount and frequency of memory allocations. Factors such as (a) the prevalence of out-of-memory (OOM) killers, (b) memory allocations in modern programming languages done implicitly, (c) overcommitting being a default strategy in the Linux kernel, and (d) the rise in complexity and terminology related to memory management makes the existing guidance inefficient. The industry needs detailed guidelines for optimizing memory usage targeting specific operating systems (OS) and programming language types.


title: The Devil Is in the Command Line: Associating the Compiler Flags With the Binary and Build Metadata

abstract: Engineers build large software systems for multiple architectures, operating systems, and configurations. A set of inconsistent or missing compiler flags generates code that catastrophically impacts the system's behavior. In the authors' industry experience, defects caused by an undesired combination of compiler flags are common in nontrivial software projects. We are unaware of any build and CI/CD systems that track how the compiler produces a specific binary in a structured manner. We postulate that a queryable database of how the compiler compiled and linked the software system will help to detect defects earlier and reduce the debugging time.


title: Quantum automorphisms of matroids

abstract: Motivated by the vast literature of quantum automorphism groups of graphs, we define and study quantum automorphism groups of matroids. A key feature of quantum groups is that there are many quantizations of a classical group, and this phenomenon manifests in the cryptomorphic characterizations of matroids. Our primary goals are to understand, using theoretical and computational techniques, the relationship between these quantum groups and to find when these quantum groups exhibit quantum symmetry. Finally, we prove a matroidal analog of Lov\'asz's theorem characterizing graph isomorphisms in terms of homomorphism counts.


title: Computational detection of antigen specific B cell receptors following immunization

abstract: B cell receptors (BCRs) play a crucial role in recognizing and fighting foreign antigens. High-throughput sequencing enables in-depth sampling of the BCRs repertoire after immunization. However, only a minor fraction of BCRs actively participate in any given infection. To what extent can we accurately identify antigen-specific sequences directly from BCRs repertoires? We present a computational method grounded on sequence similarity, aimed at identifying statistically significant responsive BCRs. This method leverages well-known characteristics of affinity maturation and expected diversity. We validate its effectiveness using longitudinally sampled human immune repertoire data following influenza vaccination and Sars-CoV-2 infections. We show that different lineages converge to the same responding CDR3, demonstrating convergent selection within an individual. The outcomes of this method hold promise for application in vaccine development, personalized medicine, and antibody-derived therapeutics.


title: Critical slowing down in thermal soft-sphere glasses via energy minimization

abstract: Using hybrid molecular dynamics/SWAP Monte Carlo (MD/SMC) simulations, we show that the terminal relaxation times $\tau$ for FIRE energy minimization of soft-sphere glasses exhibit thermal onset as samples become increasingly well-equilibrated. Although $\tau(\phi)$ can decrease by orders of magnitude as equilibration proceeds and the jamming density $\phi_{\rm J}$ increases via thermal onset, it always scales as $\tau(\phi) \sim (\phi_{\rm J} - \phi)^{-2} \sim [Z_{\rm iso} - Z_{\rm ms}(\tau)]^{-2}$, where $\phi_{\rm J}$ is the jamming density and $Z_{\rm ms}(\tau)$ is the average coordination number of particles satisfying a minimal local mechanical stability criterion ($Z \geq d+1$) at the top of the final potential-energy-landscape (PEL) sub-basin the system encounters. This scaling allows us to collapse $\tau$ datasets that look very different when plotted as a function of $\phi$, and to address a closely related question: how does the character of the PEL basins that dense thermal glasses most typically occupy evolve as the glasses age at constant $\phi$ and $T$?


title: Mechanical cosmology: simulating inflationary models in synthetic mechanical lattices

abstract: Inspired by recent advances in observational astrophysics and continued explorations in the field of analog gravity, we discuss the prospect of simulating models of cosmology within the context of synthetic mechanical lattice experiments. We focus on the physics of expanding Universe scenarios described by the Friedmann-Lema\^itre-Robertson-Walker (FLRW) metric. Specifically, quantizing scalar fluctuations in a background FLRW spacetime leads to a quadratic bosonic Hamiltonian with temporally varying pair production terms. Here we present a mapping that provides a one-to-one correspondence between these classes of cosmology models and physical mechanical oscillator systems. As proof-of-principle, we then perform experiments on an actual synthetic lattice system composed of such oscillators. We simulate two different FLRW expansion scenarios driven by inflationary dark energy- and matter-dominated Universes and discuss our experimental results.


title: Semilinear BSPDEs and Applications to McKean-Vlasov Control with Killing

abstract: We introduce a novel class of semilinear nonlocal backward stochastic partial differential equations (BSPDE) on half-spaces driven by an infinite-dimensional c\`adl\`ag martingale. The equations exhibit a degeneracy and have no explicit condition at the boundary of the half-space. To treat the existence and uniqueness of such BSPDEs we establish a generalisation of It\^o's formula for infinite-dimensional c\`adl\`ag semimartingales, which addresses the occurrence of boundary terms. Next, we employ these BSPDEs to study the McKean--Vlasov control problem with killing and common noise proposed in [HJ23]. The particles in this control model live on the real line and are killed at a positive intensity whenever they are in the negative half-line. Accordingly, the interaction between particles occurs through the subprobability distribution of the living particles. We establish the existence of an optimal semiclosed-loop control that only depends on the particles' location and not their cumulative intensity. This problem cannot be addressed through classical mimicking arguments, because the particles' subprobability distribution cannot be reconstructed from their location alone. Instead, we represent optimal controls in terms of the solutions to BSPDEs of the above type and show those solutions do not depend on the intensity variable.


title: Neural feels with neural fields: Visuo-tactile perception for in-hand manipulation

abstract: To achieve human-level dexterity, robots must infer spatial awareness from multimodal sensing to reason over contact interactions. During in-hand manipulation of novel objects, such spatial awareness involves estimating the object's pose and shape. The status quo for in-hand perception primarily employs vision, and restricts to tracking a priori known objects. Moreover, visual occlusion of objects in-hand is imminent during manipulation, preventing current systems to push beyond tasks without occlusion. We combine vision and touch sensing on a multi-fingered hand to estimate an object's pose and shape during in-hand manipulation. Our method, NeuralFeels, encodes object geometry by learning a neural field online and jointly tracks it by optimizing a pose graph problem. We study multimodal in-hand perception in simulation and the real-world, interacting with different objects via a proprioception-driven policy. Our experiments show final reconstruction F-scores of $81$% and average pose drifts of $4.7\,\text{mm}$, further reduced to $2.3\,\text{mm}$ with known CAD models. Additionally, we observe that under heavy visual occlusion we can achieve up to $94$% improvements in tracking compared to vision-only methods. Our results demonstrate that touch, at the very least, refines and, at the very best, disambiguates visual estimates during in-hand manipulation. We release our evaluation dataset of 70 experiments, FeelSight, as a step towards benchmarking in this domain. Our neural representation driven by multimodal sensing can serve as a perception backbone towards advancing robot dexterity. Videos can be found on our project website https://suddhu.github.io/neural-feels/


title: Coffee: Cost-Effective Edge Caching for 360 Degree Live Video Streaming

abstract: While live 360 degree video streaming delivers immersive viewing experience, it poses significant bandwidth and latency challenges for content delivery networks. Edge servers are expected to play an important role in facilitating live streaming of 360 degree videos. In this paper, we propose a novel predictive edge caching algorithm (Coffee) for live 360 degree video that employ collaborative FoV prediction and predictive tile prefetching to reduce bandwidth consumption, streaming cost and improve the streaming quality and robustness. Our light-weight caching algorithms exploit the unique tile consumption patterns of live 360 degree video streaming to achieve high tile caching gains. Through extensive experiments driven by real 360 degree video streaming traces, we demonstrate that edge caching algorithms specifically designed for live 360 degree video streaming can achieve high streaming cost savings with small edge cache space consumption. Coffee, guided by viewer FoV predictions, significantly reduces back-haul traffic up to 76% compared to state-of-the-art edge caching algorithms. Furthermore, we develop a transcoding-aware variant (TransCoffee) and evaluate it using comprehensive experiments, which demonstrate that TransCoffee can achieve 63\% lower cost compared to state-of-the-art transcoding-aware approaches.


title: NeRF-VO: Real-Time Sparse Visual Odometry with Neural Radiance Fields

abstract: We introduce a novel monocular visual odometry (VO) system, NeRF-VO, that integrates learning-based sparse visual odometry for low-latency camera tracking and a neural radiance scene representation for sophisticated dense reconstruction and novel view synthesis. Our system initializes camera poses using sparse visual odometry and obtains view-dependent dense geometry priors from a monocular depth prediction network. We harmonize the scale of poses and dense geometry, treating them as supervisory cues to train a neural implicit scene representation. NeRF-VO demonstrates exceptional performance in both photometric and geometric fidelity of the scene representation by jointly optimizing a sliding window of keyframed poses and the underlying dense geometry, which is accomplished through training the radiance field with volume rendering. We surpass state-of-the-art methods in pose estimation accuracy, novel view synthesis fidelity, and dense reconstruction quality across a variety of synthetic and real-world datasets, while achieving a higher camera tracking frequency and consuming less GPU memory.


title: Task Planning for Multiple Item Insertion using ADMM

abstract: Mixed-integer nonlinear programmings (MINLPs) are powerful formulation tools for task planning. However, it suffers from long solving time especially for large scale problems. In this work, we first formulate the task planning problem for item stowing into a mixed-integer nonlinear programming problem, then solve it using Alternative Direction Method of Multipliers (ADMM). ADMM separates the complete formulation into a nonlinear programming problem and mixed-integer programming problem, then iterate between them to solve the original problem. We show that our ADMM converges better than non-warm-started nonlinear complementary formulation. Our proposed methods are demonstrated on hardware as a high level planner to insert books into the bookshelf.


title: Accuracy vs Memory Advantage in the Quantum Simulation of Stochastic Processes

abstract: Many inference scenarios rely on extracting relevant information from known data in order to make future predictions. When the underlying stochastic process satisfies certain assumptions, there is a direct mapping between its exact classical and quantum simulators, with the latter asymptotically using less memory. Here we focus on studying whether such quantum advantage persists when those assumptions are not satisfied, and the model is doomed to have imperfect accuracy. By studying the trade-off between accuracy and memory requirements, we show that quantum models can reach the same accuracy with less memory, or alternatively, better accuracy with the same memory. Finally, we discuss the implications of this result for learning tasks.


title: Impact of tensor interactions and scalar mixing on covariant energy density functionals

abstract: The recent pioneering campaigns conducted by the Lead Radius Experiment (PREX) and the Calcium Radius Experiment (CREX) collaborations have uncovered major deficiencies in the theoretical description of some fundamental properties of atomic nuclei. Following a recent refinement to the isovector sector of covariant energy density functionals [1], we present here additional improvements to the functional by including both tensor couplings and an isoscalar-isovector mixing term in the scalar sector. Motivated by the distinct surface properties of calcium and lead, we expect that the tensor terms that generate derivative couplings will help break the linear correlation between the neutron skin thickness of these two nuclei. Moreover, the addition of these new terms mitigates most of the problems identified in Ref.[1] in describing the properties of both finite nuclei and neutron stars. While significant progress has been made in reconciling the PREX-CREX results without compromising other observables, the final resolution awaits the completion of a proper calibration for this new class of functionals. We expect that powerful reduced basis methods used recently to create efficient emulators will be essential to accomplish this task.


title: Development of Self-Shunted Josephson Junctions For a Ten-Superconductor-Layer Fabrication Process: Nb/NbN$_x$/Nb Junctions

abstract: To increase integration scale of superconductor electronics, we are developing a new, SFQ7ee, node of the fabrication process at MIT Lincoln Laboratory. In comparison to the existing SFQ5ee node, we increased the number of fully planarized superconducting layers to ten and utilized NbN and NbN/Nb kinetic inductors to increase the inductor number density above 100 million per cm$^2$. Increasing the Josephson junction (JJ) number density to the same level requires implementing self-shunted high-$J_c$ JJs. We investigated properties of Nb/NbN$_x$/Nb trilayer JJs as a potential replacement of high-$J_c$ Nb/Al-AlO$_x$/Nb JJs, where NbN$_x$ is a disordered, nonsuperconducting nitride deposited by reactive sputtering. Dependences of the $I_cR_n$ product and Josephson critical current density, $J_c$ on the NbN$_x$ barrier thickness and on temperature were studied in the thickness range from 5 nm to 20 nm. The fabricated JJs can be described by the microscopic theory of SNS junctions, assuming no suppression of the energy gap in Nb electrodes near the NbN$_x$ interfaces and a Cooper pair decay length in the NbN$_x$ barrier of about 2.3 nm. Current-voltage characteristics of the JJs are well described by the RCSJ model. In the studied range $J_c$ < 10 mA/$\mu$$m^2$, the Nb/NbN$_x$/Nb JJs have lower specific resistance $R_nA$, lower $I_cR_n$ product, and a stronger dependence of the $I_cR_n$ on temperature than self-shunted or critically damped externally shunted Nb/Al-AlO$_x$/Nb JJs with the same critical current density; here $A$ is the JJ area, $R_n$ the JJ effective shunting resistance.


title: Fortify Your Defenses: Strategic Budget Allocation to Enhance Power Grid Cybersecurity

abstract: The abundance of cyber-physical components in modern day power grid with their diverse hardware and software vulnerabilities has made it difficult to protect them from advanced persistent threats (APTs). An attack graph depicting the propagation of potential cyber-attack sequences from the initial access point to the end objective is vital to identify critical weaknesses of any cyber-physical system. A cyber security personnel can accordingly plan preventive mitigation measures for the identified weaknesses addressing the cyber-attack sequences. However, limitations on available cybersecurity budget restrict the choice of mitigation measures. We address this aspect through our framework, which solves the following problem: given potential cyber-attack sequences for a cyber-physical component in the power grid, find the optimal manner to allocate an available budget to implement necessary preventive mitigation measures. We formulate the problem as a mixed integer linear program (MILP) to identify the optimal budget partition and set of mitigation measures which minimize the vulnerability of cyber-physical components to potential attack sequences. We assume that the allocation of budget affects the efficacy of the mitigation measures. We show how altering the budget allocation for tasks such as asset management, cybersecurity infrastructure improvement, incident response planning and employee training affects the choice of the optimal set of preventive mitigation measures and modifies the associated cybersecurity risk. The proposed framework can be used by cyber policymakers and system owners to allocate optimal budgets for various tasks required to improve the overall security of a cyber-physical system.


title: Approximating reproduction numbers: a general numerical method for age-structured models

abstract: In this paper, we introduce a general numerical method to approximate the reproduction numbers of a large class of multi-group, age-structured, population models with a finite age span. To provide complete flexibility in the definition of the birth and transition processes, we propose an equivalent formulation for the age-integrated state within the extended space framework. Then, we discretize the birth and transition operators via pseudospectral collocation. We discuss applications to epidemic models with continuous and piecewise continuous rates, with different interpretations of the age variable (e.g., demographic age, infection age and disease age) and the transmission terms (e.g., horizontal and vertical transmission). The tests illustrate that the method can compute different reproduction numbers, including the basic and type reproduction numbers as special cases.


title: Brain as a complex system, harnessing systems neuroscience tools & notions for an empirical approach

abstract: Finding general principles underlying brain function has been appealing to scientists. Indeed, in some branches of science like physics and chemistry (and to some degree biology) a general theory often can capture the essence of a wide range of phenomena. Whether we can find such principles in neuroscience, and [assuming they do exist] what those principles are, are important questions. Abstracting the brain as a complex system is one of the perspectives that may help us answer this question. While it is commonly accepted that the brain is a (or even the) prominent example of a complex system, the far reaching implications of this are still arguably overlooked in our approaches to neuroscientific questions. One of the reasons for the lack of attention could be the apparent difference in foci of investigations in these two fields -- neuroscience and complex systems. This thesis is an effort toward providing a bridge between systems neuroscience and complex systems by harnessing systems neuroscience tools & notions for building empirical approaches toward the brain as a complex system. Perhaps, in the spirit of searching for principles, we should abstract and approach the brain as a complex adaptive system as the more complete perspective (rather than just a complex system). In the end, the brain, even the most "complex system", need to survive in the environment. Indeed, in the field of complex adaptive systems, the intention is understanding very similar questions in nature. As an outlook, we also touch on some research directions pertaining to the adaptivity of the brain as well.


title: Designing 3D multicomponent self-assembling systems with signal-passing building blocks

abstract: We introduce allostery-mimetic building blocks model for self-assembly of 3D structures. We represent the building blocks as patchy particles, where each binding site (patch) can be irreversibly activated or deactivated by binding of the particle's other controlling patches to another particle. We show that these allostery-mimetic systems can be designed to increase yields of target structures by disallowing mis-assembled states, and can further decrease the smallest number of distinct species needed to assemble a target structure. Next, we show applications to design of a programmable nanoparticle swarm for multifarious assembly: a system of particles which stores multiple possible target structures, and a particular structure is recalled by presenting an external trigger signal. Finally, we outline a possible pathway to realization of such structures at nanoscale using DNA nanotechnology devices.


title: InvertibleNetworks.jl: A Julia package for scalable normalizing flows

abstract: InvertibleNetworks.jl is a Julia package designed for the scalable implementation of normalizing flows, a method for density estimation and sampling in high-dimensional distributions. This package excels in memory efficiency by leveraging the inherent invertibility of normalizing flows, which significantly reduces memory requirements during backpropagation compared to existing normalizing flow packages that rely on automatic differentiation frameworks. InvertibleNetworks.jl has been adapted for diverse applications, including seismic imaging, medical imaging, and CO2 monitoring, demonstrating its effectiveness in learning high-dimensional distributions.


title: Bioadhesive Hydrogel Flexible Laser for Sweat Sensing based on Liquid Crystal Microdroplets

abstract: Flexible photonics offers the possibility to realize wearable sensors by bridging the advantages of flexible materials and photonic sensing elements. Recently, optical resonators have emerged as a tool to improve its over sensitivity by integrating with flexible photonic sensors. However, direct monitoring of multiple psychological information on human skin remains challenging, due to the subtle biological signals and complex tissue interface. To tackle the current challenges, here we developed a functional thin film laser formed by encapsulating multiple liquid crystal microdroplet laser resonators in a flexible hydrogel for monitoring important metabolites in human sweat (lactate, glucose, and urea). The three-dimensional cross-linked hydrophilic polymer serves as the adhesive layer to allow small molecules to penetrate from human tissue to generate strong light-matter interactions on the interface of whispering gallery modes resonators. Both hydrogel and CLC microdroplets were modified specifically to achieve high sensitivity and selectivity. As a proof-of-concept, wavelength-multiplexed sensing and a prototype were demonstrated on human skin to detect human metabolites from perspiration. These results present a significant advance in the fabrication and potential guidance for wearable and functional microlasers in healthcare.


title: Spatially Adaptive Variable Screening in Presurgical fMRI Data Analysis

abstract: Accurate delineation of tumor-adjacent functional brain regions is essential for planning function-preserving neurosurgery. Functional magnetic resonance imaging (fMRI) is increasingly used for presurgical counseling and planning. When analyzing presurgical fMRI data, false negatives are more dangerous to the patients than false positives because patients are more likely to experience significant harm from failing to identify functional regions and subsequently resecting critical tissues. In this paper, we propose a novel spatially adaptive variable screening procedure to enable effective control of false negatives while leveraging the spatial structure of fMRI data. Compared to existing statistical methods in fMRI data analysis, the new procedure directly controls false negatives at a desirable level and is completely data-driven. The new method is also substantially different from existing false-negative control procedures which do not take spatial information into account. Numerical examples show that the new method outperforms several state-of-the-art methods in retaining signal voxels, especially the subtle ones at the boundaries of functional regions, while providing cleaner separation of functional regions from background noise. Such results could be valuable to preserve critical tissues in neurosurgery.


title: SQuADDS: A validated design database and simulation workflow for superconducting qubit design

abstract: We present an open-source database of superconducting quantum device designs that may be used as the starting point for customized devices. Each design can be generated programmatically using the open-source Qiskit Metal package, and simulated using finite-element electromagnetic solvers. We present a robust workflow for achieving high accuracy on design simulations. Many designs in the database are experimentally validated, showing excellent agreement between simulated and measured parameters. Our database includes a front-end interface that allows users to generate ``best-guess'' designs based on desired circuit parameters. This project lowers the barrier to entry for research groups seeking to make a new class of devices by providing them a well-characterized starting point from which to refine their designs.


title: Bayesian Transfer Learning

abstract: Transfer learning is a burgeoning concept in statistical machine learning that seeks to improve inference and/or predictive accuracy on a domain of interest by leveraging data from related domains. While the term "transfer learning" has garnered much recent interest, its foundational principles have existed for years under various guises. Prior literature reviews in computer science and electrical engineering have sought to bring these ideas into focus, primarily surveying general methodologies and works from these disciplines. This article highlights Bayesian approaches to transfer learning, which have received relatively limited attention despite their innate compatibility with the notion of drawing upon prior knowledge to guide new learning tasks. Our survey encompasses a wide range of Bayesian transfer learning frameworks applicable to a variety of practical settings. We discuss how these methods address the problem of finding the optimal information to transfer between domains, which is a central question in transfer learning. We illustrate the utility of Bayesian transfer learning methods via a simulation study where we compare performance against frequentist competitors.


title: Action Duration Generalization for Exact Multi-Agent Collective Construction

abstract: This paper addresses exact approaches to multi-agent collective construction problem which tasks a group of cooperative agents to build a given structure in a blocksworld under the gravity constraint. We propose a generalization of the existing exact model based on mixed integer linear programming by accommodating varying agent action durations. We refer to the model as a fraction-time model. The generalization by introducing action duration enables one to create a more realistic model for various domains. It provides a significant reduction of plan execution duration at the cost of increased computational time, which rises steeply the closer the model gets to the exact real-world action duration. We also propose a makespan estimation function for the fraction-time model. This can be used to estimate the construction time reduction size for the purpose of cost-benefit analysis. The fraction-time model and the makespan estimation function have been evaluated in a series of experiments using a set of benchmark structures. The results show a significant reduction of plan execution duration for non-constant duration actions due to decreasing synchronization overhead at the end of each action. According to the results, the makespan estimation function provides a reasonably accurate estimate of the makespan.


title: Meta-Learning with Versatile Loss Geometries for Fast Adaptation Using Mirror Descent

abstract: Utilizing task-invariant prior knowledge extracted from related tasks, meta-learning is a principled framework that empowers learning a new task especially when data records are limited. A fundamental challenge in meta-learning is how to quickly "adapt" the extracted prior in order to train a task-specific model within a few optimization steps. Existing approaches deal with this challenge using a preconditioner that enhances convergence of the per-task training process. Though effective in representing locally a quadratic training loss, these simple linear preconditioners can hardly capture complex loss geometries. The present contribution addresses this limitation by learning a nonlinear mirror map, which induces a versatile distance metric to enable capturing and optimizing a wide range of loss geometries, hence facilitating the per-task training. Numerical tests on few-shot learning datasets demonstrate the superior expressiveness and convergence of the advocated approach.


title: Understanding and Estimating Domain Complexity Across Domains

abstract: Artificial Intelligence (AI) systems, trained in controlled environments, often struggle in real-world complexities. We propose a general framework for estimating domain complexity across diverse environments, like open-world learning and real-world applications. This framework distinguishes between intrinsic complexity (inherent to the domain) and extrinsic complexity (dependent on the AI agent). By analyzing dimensionality, sparsity, and diversity within these categories, we offer a comprehensive view of domain challenges. This approach enables quantitative predictions of AI difficulty during environment transitions, avoids bias in novel situations, and helps navigate the vast search spaces of open-world domains.


title: On the existence of Parseval frames for vector bundles

abstract: Frames in finite-dimensional vector spaces are spanning sets of vectors which provide redundant representations of signals. The Parseval frames are particularly useful and important, since they provide a simple reconstruction scheme and are maximally robust against certain types of noise. In this paper we describe a theory of frames on arbitrary vector bundles -- this is the natural setting for signals which are realized as parameterized families of vectors rather than as single vectors -- and discuss the existence of Parseval frames in this setting. Our approach is phrased in the language of $G$-bundles, which allows us to use many tools from classical algebraic topology. In particular, we show that orientable vector bundles always admit Parseval frames of sufficiently large size and provide an upper bound on the necessary size. We also give sufficient conditions for the existence of Parseval frames of smaller size for tangent bundles of several families of manifolds, and provide some numerical evidence that Parseval frames on vector bundles share the desirable reconstruction properties of classical Parseval frames.


title: Embedded Shape Matching in Photogrammetry Data for Modeling Making Knowledge

abstract: In three-dimensional models obtained by photogrammetry of existing structures, all of the shapes that the eye can select cannot always find their equivalents in the geometric components of the model. However, the matching of meaningful parts and assemblages with the records acquired with rapid and detailed documentation methods will provide an advantage for the creation of information models of existing structures. While aiming to produce answers to this problem and in order to overcome the difficulties of pattern recognition in three-dimensional models, we used two-dimensional samples obtained by projection. Processing techniques such as ambient occlusion, curvature and normal maps are commonly used in modern computer graphics applications that enable the representation of three-dimensional surface properties in two-dimensional data sets. The method we propose is based on the recognition of patterns through these mappings instead of the usual light-based visualization. The first stage of the application is photogrammetric capture of a few examples of Zeugma mosaics and three-dimensional digital modeling of a set of Seljuk era brick walls based on knowledge obtained through architectural history literature. The second stage covers the creation of digital models byprocessing the surface representation obtained from this data using Alice Vision, OpenCV-Python, and Autodesk Maya to include information on aspects of the making of the walls. What is envisioned for the next stages is that the mapping data contributes and supports the knowledge for rule-based design and making processesof cultural heritage.


title: Dimension-Accuracy Tradeoffs in Contrastive Embeddings for Triplets, Terminals & Top-k Nearest Neighbors

abstract: Metric embeddings traditionally study how to map $n$ items to a target metric space such that distance lengths are not heavily distorted; but what if we only care to preserve the relative order of the distances (and not their length)? In this paper, we are motivated by the following basic question: given triplet comparisons of the form ``item $i$ is closer to item $j$ than to item $k$,'' can we find low-dimensional Euclidean representations for the $n$ items that respect those distance comparisons? Such order-preserving embeddings naturally arise in important applications and have been studied since the 1950s, under the name of ordinal or non-metric embeddings. Our main results are: 1. Nearly-Tight Bounds on Triplet Dimension: We introduce the natural concept of triplet dimension of a dataset, and surprisingly, we show that in order for an ordinal embedding to be triplet-preserving, its dimension needs to grow as $\frac n2$ in the worst case. This is optimal (up to constant) as $n-1$ dimensions always suffice. 2. Tradeoffs for Dimension vs (Ordinal) Relaxation: We then relax the requirement that every triplet should be exactly preserved and present almost tight lower bounds for the maximum ratio between distances whose relative order was inverted by the embedding; this ratio is known as (ordinal) relaxation in the literature and serves as a counterpart to (metric) distortion. 3. New Bounds on Terminal and Top-$k$-NNs Embeddings: Going beyond triplets, we then study two well-motivated scenarios where we care about preserving specific sets of distances (not necessarily triplets). The first scenario is Terminal Ordinal Embeddings and the second scenario is top-$k$-NNs Ordinal Embeddings. To the best of our knowledge, these are some of the first tradeoffs on triplet-preserving ordinal embeddings and the first study of Terminal and Top-$k$-NNs Ordinal Embeddings.


title: Ultraclean two-dimensional hole systems with mobilities exceeding 10$^7$ cm$^2$/Vs

abstract: Owing to their large effective mass, strong and tunable spin-orbit coupling, and complex band-structure, two-dimensional hole systems (2DHSs) in GaAs quantum wells provide rich platforms to probe exotic many-body physics, while also offering potential applications in ballistic and spintronics devices, and fault-tolerant topological quantum computing. We present here a systematic study of molecular-beam-epitaxy grown, modulation-doped, GaAs (001) 2DHSs where we explore the limits of low-temperature 2DHS mobility by optimizing two parameters, the GaAs quantum well width and the alloy fraction ($x$) of the flanking Al$_x$Ga$_{1-x}$As barriers. We obtain a breakthrough in 2DHS mobility, with a peak value $\simeq 18 \times 10^6$ cm$^2$/Vs at a density of 3.8 $\times$ 10$^{10}$ /cm$^{2}$, implying a mean-free-path of $\simeq 57 \mu$m. Using transport calculations tailored to our structures, we analyze the operating scattering mechanisms to explain the non-monotonic evolution of mobility with density. We find it imperative to include the dependence of effective mass on 2DHS density, well width, and $x$. We observe concomitant improvement in quality as evinced by the appearance of delicate fractional quantum Hall states at very low density.


title: Support Vector Machine For Transient Stability Assessment: A Review

abstract: Accurate transient stability assessment is a crucial prerequisite for proper power system operation and planning with various operational constraints. Transient stability assessment of modern power systems is becoming very challenging due to rising uncertainty and continuous integration of renewable energy generation. The stringent requirements of very high accuracy and fast computation speed has further necessitated accurate transient stability assessment for power system planning and operation. The traditional approaches are unable to fulfil these requirements due to their shortcomings. In this regard, the popularity of prospective approaches based on big data and machine learning, such as support vector machine, is constantly on the rise as they have all the features required to fulfil important criteria for real-time TSA. Therefore, this paper aims to review the application of support vector machine for transient stability assessment of power systems. It is believed that this work will provide a solid foundation for researchers in the domain of machine learning and computational intelligence-based applications to power system stability and operation.


title: Lusztig's Quantum Root Vectors and a Dolbeault Complex for the A-Series Full Quantum Flag Manifolds

abstract: For the Drinfeld-Jimbo quantum enveloping algebra $U_q(\frak{sl}_{n+1})$, we show that the span of Lusztig's positive root vectors, with respect to Littlemann's nice reduced decompositions of the longest element of the Weyl group, form quantum tangent spaces for the full quantum flag manifold $\mathcal{O}_q(\mathrm{F}_{n+1})$. The associated differential calculi are direct $q$-deformations of the anti-holomorphic Dolbeault complex of the classical full flag manifold $\mathrm{F}_{n+1}$. As an application we establish a quantum Borel-Weil theorem for the $A_n$-series full quantum flag manifold, giving a noncommutative differential geometric realisation of all the finite-dimensional type-$1$ irreducible representations of $U_q(\frak{sl}_{n+1})$. Restricting this differential calculus to the quantum Grassmannians is shown to reproduce the celebrated Heckenberger-Kolb anti-holomorphic Dolbeault complex. Lusztig's positive root vectors for non-nice decompositions of the longest element of the Weyl group are examined for low orders, and are exhibited to either not give tangents spaces, or to produce differential calculi of non-classical dimension.


title: Visual Tomography: Physically Faithful Volumetric Models of Partially Translucent Objects

abstract: When created faithfully from real-world data, Digital 3D representations of objects can be useful for human or computer-assisted analysis. Such models can also serve for generating training data for machine learning approaches in settings where data is difficult to obtain or where too few training data exists, e.g. by providing novel views or images in varying conditions. While the vast amount of visual 3D reconstruction approaches focus on non-physical models, textured object surfaces or shapes, in this contribution we propose a volumetric reconstruction approach that obtains a physical model including the interior of partially translucent objects such as plankton or insects. Our technique photographs the object under different poses in front of a bright white light source and computes absorption and scattering per voxel. It can be interpreted as visual tomography that we solve by inverse raytracing. We additionally suggest a method to convert non-physical NeRF media into a physically-based volumetric grid for initialization and illustrate the usefulness of the approach using two real-world plankton validation sets, the lab-scanned models being finally also relighted and virtually submerged in a scenario with augmented medium and illumination conditions. Please visit the project homepage at www.marine.informatik.uni-kiel.de/go/vito


title: Decoupling Representation and Knowledge for Few-Shot Intent Classification and Slot Filling

abstract: Few-shot intent classification and slot filling are important but challenging tasks due to the scarcity of finely labeled data. Therefore, current works first train a model on source domains with sufficiently labeled data, and then transfer the model to target domains where only rarely labeled data is available. However, experience transferring as a whole usually suffers from gaps that exist among source domains and target domains. For instance, transferring domain-specific-knowledge-related experience is difficult. To tackle this problem, we propose a new method that explicitly decouples the transferring of general-semantic-representation-related experience and the domain-specific-knowledge-related experience. Specifically, for domain-specific-knowledge-related experience, we design two modules to capture intent-slot relation and slot-slot relation respectively. Extensive experiments on Snips and FewJoint datasets show that our method achieves state-of-the-art performance. The method improves the joint accuracy metric from 27.72% to 42.20% in the 1-shot setting, and from 46.54% to 60.79% in the 5-shot setting.


title: Decay properties of Vlasov fields on non-trapping asymptotically hyperbolic manifolds

abstract: In this paper, we study pointwise decay estimates in time for Vlasov fields on non-trapping asymptotically hyperbolic manifolds. We prove optimal decay estimates in time for the spatial density induced by Vlasov fields on these geometric backgrounds in dimension two. First, we show exponential decay for Vlasov fields on hyperbolic space supported away from the zero velocity set. In contrast, we obtain inverse polynomial decay for general Vlasov fields on hyperbolic space. In the second part of the article, we prove exponential decay for Vlasov fields on non-trapping asymptotically hyperbolic manifolds supported away from the zero velocity set. The proofs are obtained through a commuting vector field approach. We exploit the hyperbolicity of the geodesic flow in these geometric backgrounds, by making use of a commuting vector field in the unstable invariant distribution of phase space.


title: An occupation number quantum subspace expansion approach to compute the single-particle Green function

abstract: We introduce a hybrid quantum-classical algorithm to compute the Green function for strongly correlated electrons on noisy intermediate-scale quantum (NISQ) devices. The technique consists in the construction of a non-orthogonal excitation basis composed of a set of single-particle excitations generated by occupation number operators. The excited sectors of the Hamiltonian in this basis can then be measured on the quantum device and a classical post-processing procedure yields the Green function in the Lehmann representation. The technique allow for noise filtering, a useful feature for NISQ devices. To validate the approach, we carry out a set of proof-of-principle calculations on the single-band Hubbard model on IBM quantum hardware. For a 2 site system we find good agreement between the results of quantum simulations and the exact result for the local spectral function. A simulation of a 4 site system carried out on classical hardware suggests that the approach can achieve similar accuracy for larger systems.


title: Extracting subleading corrections in entanglement entropy at quantum phase transitions

abstract: We systematically investigate the finite size scaling behavior of the R\'enyi entanglement entropy (EE) of several representative 2d quantum many-body systems between a subregion and its complement, with smooth boundaries as well as boundaries with corners. In order to reveal the subleading correction, we investigate the quantity ``subtracted EE" $S^s(l) = S(2l) - 2S(l)$ for each model, which is designed to cancel out the leading perimeter law. We find that $\mathbf{(1)}$ for a spin-1/2 model on a 2d square lattice whose ground state is the Neel order, the coefficient of the logarithmic correction to the perimeter law is consistent with the prediction based on the Goldstone modes; $\mathbf{(2)}$ for the $(2+1)d$ O(3) Wilson-Fisher quantum critical point (QCP), realized with the bilayer antiferromagnetic Heisenberg model, a logarithmic subleading correction exists when there is sharp corner of the subregion, but for subregion with a smooth boundary our data suggests the absence of the logarithmic correction to the best of our efforts; $\mathbf{(3)}$ for the $(2+1)d$ SU(2) J-Q$_2$ and J-Q$_3$ model for the deconfined quantum critical point (DQCP), we find a logarithmic correction for the EE even with smooth boundary.


title: Impact of the MARATHON data on \texorpdfstring{$F_{2n}/F_{2p}$}{F2n/F2p} and off-shell effects in light nuclei

abstract: The neutron structure function, $F_{2n}$, has historically been extracted from measurements of the deuteron structure function, but our understanding of the nuclear effects on the bound proton and neutron limits the extraction of $F_{2n}$. The MARATHON collaboration recently extracted $F_{2n}$ from the comparison of $^3$H and $^3$He targets, where the nuclear effects are larger but nearly identical, yielding a precise extraction of $F_{2n}/F_{2p}$. This precise extraction can then be compared to deuteron extractions, providing important constraints on the nuclear effects in the deuteron. To ensure that this comparison is not biased by the specific model of nuclear effects used by MARATHON, we examine a range of models of the nuclear effects to obtain a more conservative, but more model-independent, extraction of $F_{2n}/F_{2p}$ for comparison with deuteron extractions. Even with the more conservative approach, the comparison suggests the need for significant off-shell corrections or other nuclear effects, beyond those include in most calculations, even for the weakly-bound deuteron.


abstract: In a privacy-focused era, Federated Learning (FL) has emerged as a promising machine learning technique. However, most existing FL studies assume that the data distribution remains nearly fixed over time, while real-world scenarios often involve dynamic and continual changes. To equip FL systems with continual model evolution capabilities, we focus on an important problem called Federated Continual Novel Class Learning (FedCN) in this work. The biggest challenge in FedCN is to merge and align novel classes that are discovered and learned by different clients without compromising privacy. To address this, we propose a Global Alignment Learning (GAL) framework that can accurately estimate the global novel class number and provide effective guidance for local training from a global perspective, all while maintaining privacy protection. Specifically, GAL first locates high-density regions in the representation space through a bi-level clustering mechanism to estimate the novel class number, with which the global prototypes corresponding to novel classes can be constructed. Then, GAL uses a novel semantic weighted loss to capture all possible correlations between these prototypes and the training data for mitigating the impact of pseudo-label noise and data heterogeneity. Extensive experiments on various datasets demonstrate GAL's superior performance over state-of-the-art novel class discovery methods. In particular, GAL achieves significant improvements in novel-class performance, increasing the accuracy by 5.1% to 10.6% in the case of one novel class learning stage and by 7.8% to 17.9% in the case of two novel class learning stages, without sacrificing known-class performance. Moreover, GAL is shown to be effective in equipping a variety of different mainstream FL algorithms with novel class discovery and learning capability, highlighting its potential for many real-world applications.


title: Adaptive Decision-Objective Loss for Forecast-then-Optimize in Power Systems

abstract: Forecast-then-optimize is a widely-used framework for decision-making problems in power systems. Traditionally, statistical losses have been employed to train forecasting models, but recent research demonstrated that improved decision utility in downstream optimization tasks can be achieved by using decision loss as an alternative. However, the implementation of decision loss in power systems faces challenges in 1) accommodating multi-stage decision-making problems where upstream optimality cannot guarantee final optimality; 2) adapting to dynamic environments such as changing parameters and nature of the problem like continuous or discrete optimization tasks. To this end, this paper proposes a novel adaptive decision-objective loss (ADOL) to address the above challenges. Specifically, ADOL first redefines the decision loss as objective utilities rather than objective loss to eliminate the need to manually set the optimal decision, thus ensuring the globally optimal decision. ADOL enables one-off training in a dynamic environment by introducing additional variables. The differentiability and convexity of ADOL provide useful gradients for forecasting model training in conjunction with continuous and discrete optimization tasks. Experiments are conducted for both linear programming-based and mixed integer linear programming-based power system two-stage dispatching cases with changing costs, and the results show that the proposed ADOL is capable of achieving globally optimal decision-making and adaptability to dynamic environments. The method can be extended to other multi-stage tasks in complex systems.


title: Energy Relaxation and dynamics in the correlated metal Sr$_2$RuO$_4$ via THz two-dimensional coherent spectroscopy

abstract: Separating out the contributions of different scattering channels in strongly interacting metals is crucial in identifying the mechanisms that govern their properties. While momentum or current relaxation rates can be readily probed via \textit{dc} resistivity or optical/THz spectroscopy, distinguishing different kinds of inelastic scattering can be more challenging. Using nonlinear THz 2D coherent spectroscopy, we measure the rates of energy relaxation after THz excitation in the strongly interacting Fermi liquid, Sr$_2$RuO$_4$. Energy relaxation is a bound on the total scattering and specifically a measure of contributions to the electron self-energy that arise from {\it inelastic} coupling to a bath. We observe two distinct energy relaxation channels: a fast process that we interpret as energy loss to the phonon system and a much slower relaxation that we interpret as arising from a non-equilibrium phonon effects and subsequent heat loss through diffusion. Interestingly, even the faster energy relaxation rate is at least an order of magnitude slower than the overall momentum relaxation rate, consistent with strong electron interactions and the dominance of energy-conserving umklapp or interband electron-electron scattering in momentum relaxation. The slowest energy relaxation rate decays on a sub-GHz scale, consistent with the relaxation dynamics of non-equilibrium phonons. Our observations reveal the versatility of nonlinear THz spectroscopy to measure the energy relaxation dynamics in correlated metals. Our work also highlights the need for improved theoretical understanding of such processes in interacting metals.


title: InfoVisDial: An Informative Visual Dialogue Dataset by Bridging Large Multimodal and Language Models

abstract: In this paper, we build a visual dialogue dataset, named InfoVisDial, which provides rich informative answers in each round even with external knowledge related to the visual content. Different from existing datasets where the answer is compact and short, InfoVisDial contains long free-form answers with rich information in each round of dialogue. For effective data collection, the key idea is to bridge the large-scale multimodal model (e.g., GIT) and the language models (e.g., GPT-3). GIT can describe the image content even with scene text, while GPT-3 can generate informative dialogue based on the image description and appropriate prompting techniques. With such automatic pipeline, we can readily generate informative visual dialogue data at scale. Then, we ask human annotators to rate the generated dialogues to filter the low-quality conversations.Human analyses show that InfoVisDial covers informative and diverse dialogue topics: $54.4\%$ of the dialogue rounds are related to image scene texts, and $36.7\%$ require external knowledge. Each round's answer is also long and open-ended: $87.3\%$ of answers are unique with an average length of $8.9$, compared with $27.37\%$ and $2.9$ in VisDial. Last, we propose a strong baseline by adapting the GIT model for the visual dialogue task and fine-tune the model on InfoVisDial. Hopefully, our work can motivate more effort on this direction.


title: Annealing reduces Si$_3$N$_4$ microwave-frequency dielectric loss in superconducting resonators

abstract: The dielectric loss of silicon nitride (Si$_3$N$_4$) limits the performance of microwave-frequency devices that rely on this material for sensing, signal processing, and quantum communication. Using superconducting resonant circuits, we measure the cryogenic loss tangent of either as-deposited or high-temperature annealed stoichiometric Si$_3$N$_4$ as a function of drive strength and temperature. The internal loss behavior of the electrical resonators is largely consistent with the standard tunneling model of two-level systems (TLS), including damping caused by resonant energy exchange with TLS and by the relaxation of non-resonant TLS. We further supplement the TLS model with a self-heating effect to explain an increase in the loss observed in as-deposited films at large drive powers. Critically, we demonstrate that annealing remedies this anomalous power-induced loss, reduces the relaxation-type damping by more than two orders of magnitude, and reduces the resonant-type damping by a factor of three. Employing infrared absorption spectroscopy, we find that annealing reduces the concentration of hydrogen in the Si$_3$N$_4$, suggesting that hydrogen impurities cause substantial dissipation.


title: Understanding vehicular routing behavior with location-based service data

abstract: Properly extracting patterns of individual mobility with high resolution data sources such as the one extracted from smartphone applications offers important opportunities. Potential opportunities not offered by call detailed records (CDRs), which offer resolutions triangulated from antennas, are route choices, travel modes detection and close encounters. Nowadays, there is not a standard and large scale data set collected over long periods that allows us to characterize these. In this work we thoroughly examine the use of data from smartphone applications, also referred to as location-based services (LBS) data, to extract and understand the vehicular route choice behavior. Taking the Dallas-Fort Worth metroplex as an example, we first extract the vehicular trips with simple rules and reconstruct the origin-destination matrix by coupling the extracted vehicular trips of the active LBS users and the United States census data. We then present a method to derive the commonly used routes by individuals from the LBS traces with varying sample rate intervals. We further inspect the relation between the number of routes and the trip characteristics, including the departure time, trip length and travel time. Specifically, we consider the travel time index and buffer index for the LBS users taking different number of routes. Empirical results demonstrate that during the peak hours, travelers tend to reduce the impact of traffic congestion by taking alternative routes. Overall, the proposed data analysis framework is cost-effective to treat sparse data generated from the use of smartphones to inform routing behavior. The potential in practice is to inform demand management strategies, by targeting individual users while generating large scale estimates of congestion mitigation.


title: SPDGAN: A Generative Adversarial Network based on SPD Manifold Learning for Automatic Image Colorization

abstract: This paper addresses the automatic colorization problem, which converts a gray-scale image to a colorized one. Recent deep-learning approaches can colorize automatically grayscale images. However, when it comes to different scenes which contain distinct color styles, it is difficult to accurately capture the color characteristics. In this work, we propose a fully automatic colorization approach based on Symmetric Positive Definite (SPD) Manifold Learning with a generative adversarial network (SPDGAN) that improves the quality of the colorization results. Our SPDGAN model establishes an adversarial game between two discriminators and a generator. The latter is based on ResNet architecture with few alterations. Its goal is to generate fake colorized images without losing color information across layers through residual connections. Then, we employ two discriminators from different domains. The first one is devoted to the image pixel domain, while the second one is to the Riemann manifold domain which helps to avoid color misalignment. Extensive experiments are conducted on the Places365 and COCO-stuff databases to test the effect of each component of our SPDGAN. In addition, quantitative and qualitative comparisons with state-of-the-art methods demonstrate the effectiveness of our model by achieving more realistic colorized images with less artifacts visually, and good results of PSNR, SSIM, and FID values.


title: Antiferromagnetic Tunnel Junctions for Spintronics

abstract: Antiferromagnetic (AFM) spintronics has emerged as a subfield of spintronics, where an AFM N\'eel vector is used as a state variable. Efficient electric control and detection of the N\'eel vector are critical for spintronic applications. This review article features fundamental properties of AFM tunnel junctions (AFMTJs) as spintronic devices where such electric control and detection can be realized. We emphasize critical requirements for observing a large tunneling magnetoresistance (TMR) effect in AFMTJs with collinear and noncollinear AFM electrodes, such as a momentum-dependent spin polarization and N\'eel spin currents. We further discuss spin torques in AFMTJs that are capable of N\'eel vector switching. Overall, AFMTJs have potential to become a new standard for spintronics providing larger magnetoresistive effects, few orders of magnitude faster switching speed, and much higher packing density than conventional magnetic tunnel junctions (MTJs).


title: Multimodal Federated Learning with Missing Modality via Prototype Mask and Contrast

abstract: In real-world scenarios, multimodal federated learning often faces the practical challenge of intricate modality missing, which poses constraints on building federated frameworks and significantly degrades model inference accuracy. Existing solutions for addressing missing modalities generally involve developing modality-specific encoders on clients and training modality fusion modules on servers. However, these methods are primarily constrained to specific scenarios with either unimodal clients or complete multimodal clients, struggling to generalize effectively in the intricate modality missing scenarios. In this paper, we introduce a prototype library into the FedAvg-based Federated Learning framework, thereby empowering the framework with the capability to alleviate the global model performance degradation resulting from modality missing during both training and testing. The proposed method utilizes prototypes as masks representing missing modalities to formulate a task-calibrated training loss and a model-agnostic uni-modality inference strategy. In addition, a proximal term based on prototypes is constructed to enhance local training. Experimental results demonstrate the state-of-the-art performance of our approach. Compared to the baselines, our method improved inference accuracy by 3.7\% with 50\% modality missing during training and by 23.8\% during uni-modality inference. Code is available at https://github.com/BaoGuangYin/PmcmFL.


title: MR-STGN: Multi-Residual Spatio Temporal Graph Network Using Attention Fusion for Patient Action Assessment

abstract: Accurate assessment of patient actions plays a crucial role in healthcare as it contributes significantly to disease progression monitoring and treatment effectiveness. However, traditional approaches to assess patient actions often rely on manual observation and scoring, which are subjective and time-consuming. In this paper, we propose an automated approach for patient action assessment using a Multi-Residual Spatio Temporal Graph Network (MR-STGN) that incorporates both angular and positional 3D skeletons. The MR-STGN is specifically designed to capture the spatio-temporal dynamics of patient actions. It achieves this by integrating information from multiple residual layers, with each layer extracting features at distinct levels of abstraction. Furthermore, we integrate an attention fusion mechanism into the network, which facilitates the adaptive weighting of various features. This empowers the model to concentrate on the most pertinent aspects of the patient's movements, offering precise instructions regarding specific body parts or movements that require attention. Ablation studies are conducted to analyze the impact of individual components within the proposed model. We evaluate our model on the UI-PRMD dataset demonstrating its performance in accurately predicting real-time patient action scores, surpassing state-of-the-art methods.


title: Moving a Derivation Along a Derivation Preserves the Spine in Adhesive High-level Replacement Systems

abstract: In this paper, we investigate the relationship between two elementary operations on derivations in adhesive high-level replacement systems that are well-known in the context of graph transformation: moving a derivation along a derivation based on parallel and sequential independence on one hand and restriction of a derivation with respect to a monomorphism into the start object on the other hand. Intuitively, a restriction clips off parts of the start object that are never matched by a rule application throughout the derivation on the other hand. As main result, it is shown that moving a derivation preserves its spine being the minimal restriction.


title: Symmetry-enforcing neural networks with applications to constitutive modeling

abstract: The use of machine learning techniques to homogenize the effective behavior of arbitrary microstructures has been shown to be not only efficient but also accurate. In a recent work, we demonstrated how to combine state-of-the-art micromechanical modeling and advanced machine learning techniques to homogenize complex microstructures exhibiting non-linear and history dependent behaviors. The resulting homogenized model, termed smart constitutive law (SCL), enables the adoption of microstructurally informed constitutive laws into finite element solvers at a fraction of the computational cost required by traditional concurrent multiscale approaches. In this work, the capabilities of SCLs are expanded via the introduction of a novel methodology that enforces material symmetries at the neuron level, applicable across various neural network architectures. This approach utilizes tensor-based features in neural networks, facilitating the concise and accurate representation of symmetry-preserving operations, and is general enough to be extend to problems beyond constitutive modeling. Details on the construction of these tensor-based neural networks and their application in learning constitutive laws are presented for both elastic and inelastic materials. The superiority of this approach over traditional neural networks is demonstrated in scenarios with limited data and strong symmetries, through comprehensive testing on various materials, including isotropic neo-Hookean materials and tensegrity lattice metamaterials. This work is concluded by a discussion on the potential of this methodology to discover symmetry bases in materials and by an outline of future research directions.


title: Optimizing carbon dioxide trapping for geological storage

abstract: Carbon dioxide (CO2) trapping in capillary networks of reservoir rocks is a pathway to long-term geological storage. At pore scale, the CO2 trapping potential depends on injection pressure, temperature, and the rock's interaction with the surrounding fluids. Modeling this interaction requires adequate representations of both capillary volume and surface. For the lack of scalable representations, however, the prediction of a rock's CO2 storage potential has been challenging. Here, we report how to represent a rock's pore space by statistically sampled capillary networks (ssCN) that preserve morphological rock characteristics. We have used the ssCN method to simulate CO2 drainage within a representative sandstone sample at reservoir pressures and temperatures, exploring intermediate- and CO2-wet conditions. This wetting regime is often neglected, despite evidence of plausibility. By raising pressure and temperature we observe increasing CO2 penetration within the capillary network. For contact angles approaching 90 degrees, the CO2 saturation exhibits a pronounced maximum reaching 80 percent of the accessible pore volume. This is about twice as high as the saturation values reported previously. For enabling validation of our results and a broader application of our methodology, we have made available the rock tomography data, the digital rock computational workflows, and the ssCN models used in this study.


title: An integrated framework for accelerating reactive flow simulation using GPU and machine learning models

abstract: Recent progress in artificial intelligence (AI) and high-performance computing (HPC) have brought potentially game-changing opportunities in accelerating reactive flow simulations. In this study, we introduce an open-source computational fluid dynamics (CFD) framework that integrates the strengths of machine learning (ML) and graphics processing unit (GPU) to demonstrate their combined capability. Within this framework, all computational operations are solely executed on GPU, including ML-accelerated chemistry integration, fully-implicit solving of PDEs, and computation of thermal and transport properties, thereby eliminating the CPU-GPU memory copy overhead. Optimisations both within the kernel functions and during the kernel launch process are conducted to enhance computational performance. Strategies such as static data reorganisation and dynamic data allocation are adopted to reduce the GPU memory footprint. The computational performance is evaluated in two turbulent flame benchmarks using quasi-DNS and LES modelling, respectively. Remarkably, while maintaining a similar level of accuracy to the conventional CPU/CVODE-based solver, the GPU/ML-accelerated approach shows an overall speedup of over two orders of magnitude for both cases. This result highlights that high-fidelity turbulent combustion simulation with finite-rate chemistry that requires normally hundreds of CPUs can now be performed on portable devices such as laptops with a medium-end GPU.


title: Rethinking of Feature Interaction for Multi-task Learning on Dense Prediction

abstract: Existing works generally adopt the encoder-decoder structure for Multi-task Dense Prediction, where the encoder extracts the task-generic features, and multiple decoders generate task-specific features for predictions. We observe that low-level representations with rich details and high-level representations with abundant task information are not both involved in the multi-task interaction process. Additionally, low-quality and low-efficiency issues also exist in current multi-task learning architectures. In this work, we propose to learn a comprehensive intermediate feature globally from both task-generic and task-specific features, we reveal an important fact that this intermediate feature, namely the bridge feature, is a good solution to the above issues. Based on this, we propose a novel Bridge-Feature-Centirc Interaction (BRFI) method. A Bridge Feature Extractor (BFE) is designed for the generation of strong bridge features and Task Pattern Propagation (TPP) is applied to ensure high-quality task interaction participants. Then a Task-Feature Refiner (TFR) is developed to refine final task predictions with the well-learned knowledge from the bridge features. Extensive experiments are conducted on NYUD-v2 and PASCAL Context benchmarks, and the superior performance shows the proposed architecture is effective and powerful in promoting different dense prediction tasks simultaneously.


title: Recognising natural capital on the balance sheet: options for water utilities

abstract: Purpose: The aim of this study was to explore the feasibility of natural capital accounting for the purpose of strengthening sustainability claims by reporting entities. The study linked riparian land improvement to ecosystem services and tested options for incorporating natural capital into financial accounting practices, specifically on the balance sheet. Methodology: To test the approach, the study used a public asset manager (a water utility) with accountabilities to protect the environment including maintaining and enhancing riparian land assets. Research activities included stakeholder engagement, physical asset measurement, monetary valuation and financial recognition of natural capital income and assets. Natural capital income was estimated by modelling and valuing ecosystem services relating to stormwater filtration and carbon storage. Findings: This research described how a water utility could disclose changes in the natural capital assets they manage either through voluntary disclosures, in notes to the financial statements or as balance sheet items. We found that current accounting standards allowed the recognition of some types of environmental income and assets where ecosystem services were associated with cost savings. The proof-of-concept employed to estimate environmental income through ecosystem service modelling proved useful to strengthen sustainability claims or report financial returns on natural capital investment. Originality/value: This study applied financial accounting processes and principles to a realistic public asset management scenario with direct participation by the asset manager working together with academic researchers and a sub-national government environment management agency. Importantly it established that natural assets could be included in financial statements, proposing a new approach to measuring and reporting on natural capital.


title: Stochastic Maximum Principle for a generalized Volterra Control System

abstract: In this paper, we consider the stochastic optimal control problem for a generalized Volterra control system. The corresponding state process is a kind of a generalized stochastic Volterra integral differential equations. We prove the existence and uniqueness of the solution of this type of equations. We obtain the stochastic maximum principle of the optimal control system by introducing a kind of generalized anticipated backward stochastic differential equations. We prove the existence and uniqueness of the solution of this adjoint equation, which may be singular at some points. As an application, the linear quadratic control problem is investigated to illustrate the main results.


title: An utopic adventure in the modelling of conditional univariate and multivariate extremes

abstract: The EVA 2023 data competition consisted of four challenges, ranging from interval estimation for very high quantiles of univariate extremes conditional on covariates, point estimation of unconditional return levels under a custom loss function, to estimation of the probabilities of tail events for low and high-dimensional multivariate data. We tackle these tasks by revisiting the current and existing literature on conditional univariate and multivariate extremes. We propose new cross-validation methods for covariate-dependent models, validation metrics for exchangeable multivariate models, formulae for the joint probability of exceedance for multivariate generalized Pareto vectors and a composition sampling algorithm for generating multivariate tail events for the latter. We highlight overarching themes ranging from model validation at extremely high quantile levels to building custom estimation strategies that leverage model assumptions.


title: Revisit the phase diagram and piezoelectricity of lead zirconate titanate from first principles

abstract: Lead zirconate titanate (PbZr1-xTixO3, PZT) exhibits excellent piezoelectric properties in the morphotropic phase boundary (MPB) region of its temperature-composition phase diagram. However, the microscopic origin of its high piezoelectric response remains controversial. Here, we develop a machine-learning-based deep potential (DP) model of PZT using the training dataset from first principles density functional theory calculations. Based on DP-assisted large-scale atomic simulations, we reproduce the temperature-composition phase diagram of PZT, in good agreement with the experiment except the absence of structural transition from R3c to R3m. We find that the rhombohedral phase maintains R3c symmetry with slight oxygen octahedral tilting as increase of temperature, instead of appearing R3m symmetry. This discrepancy can trace back to the lack of experimental measurements to identify such slight octahedral tilting. More importantly, we clarify the atomic-level feature of PZT at the MPB, exhibiting the competing coupling of ferroelectric nanodomains with various polarization orientations. The high piezoelectric response is driven by polarization rotation of nanodomains induced by an external electric field.


title: Secure Information Embedding in Images with Hybrid Firefly Algorithm

abstract: Various methods have been proposed to secure access to sensitive information over time, such as the many cryptographic methods in use to facilitate secure communications on the internet. But other methods like steganography have been overlooked which may be more suitable in cases where the act of transmission of sensitive information itself should remain a secret. Multiple techniques that are commonly discussed for such scenarios suffer from low capacity and high distortion in the output signal. This research introduces a novel steganographic approach for concealing a confidential portable document format (PDF) document within a host image by employing the Hybrid Firefly algorithm (HFA) proposed to select the pixel arrangement. This algorithm combines two widely used optimization algorithms to improve their performance. The suggested methodology utilizes the HFA algorithm to conduct a search for optimal pixel placements in the spatial domain. The purpose of this search is to accomplish two main goals: increasing the host image's capacity and reducing distortion. Moreover, the proposed approach intends to reduce the time required for the embedding procedure. The findings indicate a decrease in image distortion and an accelerated rate of convergence in the search process. The resultant embeddings exhibit robustness against steganalytic assaults, hence rendering the identification of the embedded data a formidable undertaking.


title: Anomalous Thresholds for the S-matrix of Unstable Particles

abstract: In this work, we study the analytic properties of S-matrix for unstable particles, which is defined as the residues on the unphysical sheets where unstable poles reside. We demonstrate that anomalous threshold associated with UV physics is unavoidable for unstable particles. This is in contrast to stable particles, where the anomalous thresholds are due to IR physics, set by the scale of the external kinematics. As a result any dispersive representation for the amplitude will involve contributions from these thresholds that are not computable from the IR theory, and thus invalidates general positivity bound. Indeed using toy models, we explicitly demonstrate that the four-derivative couplings for unstable particles can become negative, violating positivity bounds even for non-gravitational theories. Along the way we show that contributions from anomalous thresholds in a given channel can be captured by the double discontinuity of that channel.


title: Preparing to Integrate Generative Pretrained Transformer Series 4 models into Genetic Variant Assessment Workflows: Assessing Performance, Drift, and Nondeterminism Characteristics Relative to Classifying Functional Evidence in Literature

abstract: Background. Large Language Models (LLMs) hold promise for improving genetic variant literature review in clinical testing. We assessed Generative Pretrained Transformer 4's (GPT-4) performance, nondeterminism, and drift to inform its suitability for use in complex clinical processes. Methods. A 2-prompt process for classification of functional evidence was optimized using a development set of 45 articles. The prompts asked GPT-4 to supply all functional data present in an article related to a variant or indicate that no functional evidence is present. For articles indicated as containing functional evidence, a second prompt asked GPT-4 to classify the evidence into pathogenic, benign, or intermediate/inconclusive categories. A final test set of 72 manually classified articles was used to test performance. Results. Over a 2.5-month period (Dec 2023-Feb 2024), we observed substantial differences in intraday (nondeterminism) and across day (drift) results, which lessened after 1/18/24. This variability is seen within and across models in the GPT-4 series, affecting different performance statistics to different degrees. Twenty runs after 1/18/24 identified articles containing functional evidence with 92.2% sensitivity, 95.6% positive predictive value (PPV) and 86.3% negative predictive value (NPV). The second prompt's identified pathogenic functional evidence with 90.0% sensitivity, 74.0% PPV and 95.3% NVP and for benign evidence with 88.0% sensitivity, 76.6% PPV and 96.9% NVP. Conclusion. Nondeterminism and drift within LLMs must be assessed and monitored when introducing LLM based functionality into clinical workflows. Failing to do this assessment or accounting for these challenges could lead to incorrect or missing information that is critical for patient care. The performance of our prompts appears adequate to assist in article prioritization but not in automated decision making.


title: Optimization of COVID-19 Vaccination Process Using Queueing Theory

abstract: This research is about COVID-19, which is a contagious virus that reached many countries, including Lebanon. Monitoring the outbreak, researchers have been involved in introducing COVID-19 targeting vaccines. Already facing financial and political issues, Lebanon was further affected by the COVID-19 outbreak. The hereby research tends to design the optimum vaccination plan to reach the recommended herd immunity in Lebanon. The scheme is drafted per application of the queue modeling where the essential parameters revolve around the arrival rate (the mean of which is 536 people) and service rate. Based on a two-stage cluster sampling method, this data is collected from six vaccination centers located in Beirut. The outcomes were computed through R statistical software after validating the stability condition. Per the results, the mean number of people in the network queue ranges between 4.1 and 5.2. In contrast, the time spent by individuals extends from around 5.7 up to 8 minutes, having an average of 5 servers for system one and 4 servers for system two. Therefore, the optimization of the vaccination plan followed in Lebanon necessitates the consistency of arrivals and the decrease of the service time. Furthermore, the service rate can be maximized by adding servers on both systems of the network queue. Further studies might include applying queue modeling in other medical sectors, for instance, the emergency section of hospitals.


title: High-resolution myelin-water fraction and quantitative relaxation mapping using 3D ViSTa-MR fingerprinting

abstract: Purpose: This study aims to develop a high-resolution whole-brain multi-parametric quantitative MRI approach for simultaneous mapping of myelin-water fraction (MWF), T1, T2, and proton-density (PD), all within a clinically feasible scan time. Methods: We developed 3D ViSTa-MRF, which combined Visualization of Short Transverse relaxation time component (ViSTa) technique with MR Fingerprinting (MRF), to achieve high-fidelity whole-brain MWF and T1/T2/PD mapping on a clinical 3T scanner. To achieve fast acquisition and memory-efficient reconstruction, the ViSTa-MRF sequence leverages an optimized 3D tiny-golden-angle-shuffling spiral-projection acquisition and joint spatial-temporal subspace reconstruction with optimized preconditioning algorithm. With the proposed ViSTa-MRF approach, high-fidelity direct MWF mapping was achieved without a need for multi-compartment fitting that could introduce bias and/or noise from additional assumptions or priors. Results: The in-vivo results demonstrate the effectiveness of the proposed acquisition and reconstruction framework to provide fast multi-parametric mapping with high SNR and good quality. The in-vivo results of 1mm- and 0.66mm-iso datasets indicate that the MWF values measured by the proposed method are consistent with standard ViSTa results that are 30x slower with lower SNR. Furthermore, we applied the proposed method to enable 5-minute whole-brain 1mm-iso assessment of MWF and T1/T2/PD mappings for infant brain development and for post-mortem brain samples. Conclusions: In this work, we have developed a 3D ViSTa-MRF technique that enables the acquisition of whole-brain MWF, quantitative T1, T2, and PD maps at 1mm and 0.66mm isotropic resolution in 5 and 15 minutes, respectively. This advancement allows for quantitative investigations of myelination changes in the brain.


title: Time and event symmetry in quantum mechanics

abstract: We investigate two types of temporal symmetry in quantum mechanics. The first type, time symmetry, refers to the inclusion of opposite time orientations on an equivalent physical footing. The second, event symmetry, refers to the inclusion of all time instants in a history sequence on an equivalent physical footing. We find that recent time symmetric interpretations of quantum mechanics fail to respect event symmetry. Building on the recent fixed-point formulation (FPF) of quantum theory, we formulate the notion of an event precisely as a fixed point constraint on the Keldysh time contour. Then, considering a sequence of measurement events in time, we show that both time and event symmetry can be retained in this multiple-time formulation of quantum theory. We then use this model to resolve conceptual paradoxes with time symmetric quantum mechanics within an `all-at-once', atemporal picture.


title: Formal sine functions in harmonic algebra

abstract: In this paper, we introduce formal sine functions whose coefficients are elements of a generalized harmonic algebra and investigate their properties corresponding to the classical addition formula and Pythagorean theorem. By taking their image under a linear map with some conditions, they coincide with the classical sine function. Moreover, we show that one such linear map is obtained from iterated integrals.


title: New Tools for Peak Memory Scheduling

abstract: We study scheduling of computation graphs to minimize peak memory consumption, an increasingly critical task due to the surge in popularity of large deep-learning models. This problem corresponds to the weighted version of the classical one-shot black pebbling game. We propose the notion of a dominant schedule to capture the idea of finding the ``best'' schedule for a subgraph and introduce new tools to compute and utilize dominant schedules. Surprisingly, we show that despite the strong requirements, a dominant schedule exists for any computation graph; and, moreover, that it is possible to compute the dominant schedule efficiently whenever we can find optimal schedules efficiently for a particular class of graphs (under mild technical conditions). We apply these new tools to analyze trees and series-parallel graphs. We show that the weighted one-shot black pebbling game is strongly NP-complete even when the graph is an out-tree -- or simpler still, a pumpkin, one of the simplest series-parallel graphs. On the positive side, we design a fixed-parameter tractable algorithm to find a dominant schedule (hence also a peak memory minimizing schedule) for series-parallel graphs when parameterized by the out-degree. This algorithm runs in time $2^{O(d \log d)} \cdot poly(n)$ for series-parallel graphs with $n$ nodes and maximum out-degree $d$; for pumpkins, we can improve the dependence on $d$ to $O(2^d \cdot poly(n))$.


title: MindOpt Adapter for CPLEX Benchmarking Performance Analysis

abstract: This report provides a comprehensive analysis of the performance of MindOpt Adapter for CPLEX 12.9 in benchmark testing. CPLEX, recognized as a robust Mixed Integer Programming (MIP) solver, has faced some scrutiny regarding its performance on MIPLIB 2017 when configured to default settings. MindOpt Adapter aims to enhance CPLEX's performance by automatically applying improved configurations for solving optimization problems. Our testing demonstrates that MindOpt Adapter for CPLEX yields successfully solved 232 of the 240 problems in the MIPLIB 2017 benchmark set. This performance surpasses all the other solvers in terms of the number of problems solved and the geometric mean of running times. The report provides a comparison of the benchmark results against the outcomes achieved by CPLEX under its default configuration.


title: DyBluRF: Dynamic Deblurring Neural Radiance Fields for Blurry Monocular Video

abstract: Neural Radiance Fields (NeRF), initially developed for static scenes, have inspired many video novel view synthesis techniques. However, the challenge for video view synthesis arises from motion blur, a consequence of object or camera movement during exposure, which hinders the precise synthesis of sharp spatio-temporal views. In response, we propose a novel dynamic deblurring NeRF framework for blurry monocular video, called DyBluRF, consisting of a Base Ray Initialization (BRI) stage and a Motion Decomposition-based Deblurring (MDD) stage. Our DyBluRF is the first that handles the novel view synthesis for blurry monocular video with a novel two-stage framework. In the BRI stage, we coarsely reconstruct dynamic 3D scenes and jointly initialize the base ray, which is further used to predict latent sharp rays, using the inaccurate camera pose information from the given blurry frames. In the MDD stage, we introduce a novel Incremental Latent Sharp-rays Prediction (ILSP) approach for the blurry monocular video frames by decomposing the latent sharp rays into global camera motion and local object motion components. We further propose two loss functions for effective geometry regularization and decomposition of static and dynamic scene components without any mask supervision. Experiments show that DyBluRF outperforms qualitatively and quantitatively the SOTA methods.


title: Stochastic diffusion within expanding space-time

abstract: The paper examines stochastic diffusion within an expanding space-time framework. It starts with providing a rationale for the considered model and its motivation from cosmology where the expansion of space-time is used in modelling various phenomena. Contrary to other results in the literature, the considered in this paper general stochastic model takes into consideration the expansion of space-time. It leads to a stochastic diffusion equations with coefficients that are non-constant and evolve with the expansion factor. Then, the Cauchy problem with random initial conditions is posed and investigated. The exact solution to a stochastic diffusion equation on the expanding sphere is derived. Various probabilistic properties of the solution are studied, including its dependence structure, evolution of the angular power spectrum and local properties of the solution and its approximations by finite truncations. The paper also characterises the extremal behaviour of the random solution by establishing upper bounds on the probabilities of large deviations. Numerical studies are undertaken to illustrate the obtained theoretical results and demonstrate the evolution of the random solution.