title: I2EDL: Interactive Instruction Error Detection and Localization

abstract: In the Vision-and-Language Navigation in Continuous Environments (VLN-CE) task, the human user guides an autonomous agent to reach a target goal via a series of low-level actions following a textual instruction in natural language. However, most existing methods do not address the likely case where users may make mistakes when providing such instruction (e.g. "turn left" instead of "turn right"). In this work, we address a novel task of Interactive VLN in Continuous Environments (IVLN-CE), which allows the agent to interact with the user during the VLN-CE navigation to verify any doubts regarding the instruction errors. We propose an Interactive Instruction Error Detector and Localizer (I2EDL) that triggers the user-agent interaction upon the detection of instruction errors during the navigation. We leverage a pre-trained module to detect instruction errors and pinpoint them in the instruction by cross-referencing the textual input and past observations. In such way, the agent is able to query the user for a timely correction, without demanding the user's cognitive load, as we locate the probable errors to a precise part of the instruction. We evaluate the proposed I2EDL on a dataset of instructions containing errors, and further devise a novel metric, the Success weighted by Interaction Number (SIN), to reflect both the navigation performance and the interaction effectiveness. We show how the proposed method can ask focused requests for corrections to the user, which in turn increases the navigation success, while minimizing the interactions.


title: Pulsar Timing Arrays require hierarchical models

abstract: Pulsar Timing Array projects have found evidence of a stochastic background of gravitational waves (GWB) using data from an ensemble of pulsars. In the literature, minimal assumptions are made about the signal and noise processes that affect data from these pulsars, such as pulsar spin noise. These assumptions are encoded as uninformative priors in Bayesian searches, though Frequentist approaches make similar assumptions. Uninformative priors are not suitable for (noise) properties of pulsars in an ensemble, and they bias estimates of model parameters such as gravitational-wave signal parameters. Both Frequentist and Bayesian searches are affected. In this letter, more appropriate priors are proposed in the language of Hierarchical Bayesian Modeling, where the properties of the ensemble of pulsars are jointly described with the properties of the individual components of the ensemble. Results by Pulsar Timing Array projects should be re-evaluated using Hierarchical Models.


title: CoNo: Consistency Noise Injection for Tuning-free Long Video Diffusion

abstract: Tuning-free long video diffusion has been proposed to generate extended-duration videos with enriched content by reusing the knowledge from pre-trained short video diffusion model without retraining. However, most works overlook the fine-grained long-term video consistency modeling, resulting in limited scene consistency (i.e., unreasonable object or background transitions), especially with multiple text inputs. To mitigate this, we propose the Consistency Noise Injection, dubbed CoNo, which introduces the "look-back" mechanism to enhance the fine-grained scene transition between different video clips, and designs the long-term consistency regularization to eliminate the content shifts when extending video contents through noise prediction. In particular, the "look-back" mechanism breaks the noise scheduling process into three essential parts, where one internal noise prediction part is injected into two video-extending parts, intending to achieve a fine-grained transition between two video clips. The long-term consistency regularization focuses on explicitly minimizing the pixel-wise distance between the predicted noises of the extended video clip and the original one, thereby preventing abrupt scene transitions. Extensive experiments have shown the effectiveness of the above strategies by performing long-video generation under both single- and multi-text prompt conditions. The project has been available in https://wxrui182.github.io/CoNo.github.io/.


title: On the $abc$ and the $abcd$ conjectures

abstract: We revisit a subexponential bound for the $abc$ conjecture due to the first author, and we establish a variation of it using linear forms in logarithms. As an application, we prove an unconditional subexponential bound towards the $4$-terms $abc$ conjecture under a suitable hypothesis on the size of the variables.


title: On Ambiguity and the Expressive Function of Law: The Role of Pragmatics in Smart Legal Ecosystems

abstract: This is a long paper, an essay, on ambiguity, pragmatics, legal ecosystems, and the expressive function of law. It is divided into two parts and fifteen sections. The first part (Pragmatics) addresses ambiguity from the perspective of linguistic and cognitive pragmatics in the legal field. The second part (Computing) deals with this issue from the point of view of human-centered design and artificial intelligence, specifically focusing on the notion and modelling of rules and what it means to comply with the rules. This is necessary for the scaffolding of smart legal ecosystems (SLE). I will develop this subject with the example of the architecture, information flows, and smart ecosystem of OPTIMAI, an EU project of Industry 4.0 for zero-defect manufacturing (Optimizing Manufacturing Processes through Artificial Intelligence and Virtualization).


title: Multi-Head RAG: Solving Multi-Aspect Problems with LLMs

abstract: Retrieval Augmented Generation (RAG) enhances the abilities of Large Language Models (LLMs) by enabling the retrieval of documents into the LLM context to provide more accurate and relevant responses. Existing RAG solutions do not focus on queries that may require fetching multiple documents with substantially different contents. Such queries occur frequently, but are challenging because the embeddings of these documents may be distant in the embedding space, making it hard to retrieve them all. This paper introduces Multi-Head RAG (MRAG), a novel scheme designed to address this gap with a simple yet powerful idea: leveraging activations of Transformer's multi-head attention layer, instead of the decoder layer, as keys for fetching multi-aspect documents. The driving motivation is that different attention heads can learn to capture different data aspects. Harnessing the corresponding activations results in embeddings that represent various facets of data items and queries, improving the retrieval accuracy for complex queries. We provide an evaluation methodology and metrics, synthetic datasets, and real-world use cases to demonstrate MRAG's effectiveness, showing improvements of up to 20% in relevance over standard RAG baselines. MRAG can be seamlessly integrated with existing RAG frameworks and benchmarking tools like RAGAS as well as different classes of data stores.


title: Robust Reward Design for Markov Decision Processes

abstract: The problem of reward design examines the interaction between a leader and a follower, where the leader aims to shape the follower's behavior to maximize the leader's payoff by modifying the follower's reward function. Current approaches to reward design rely on an accurate model of how the follower responds to reward modifications, which can be sensitive to modeling inaccuracies. To address this issue of sensitivity, we present a solution that offers robustness against uncertainties in modeling the follower, including 1) how the follower breaks ties in the presence of nonunique best responses, 2) inexact knowledge of how the follower perceives reward modifications, and 3) bounded rationality of the follower. Our robust solution is guaranteed to exist under mild conditions and can be obtained numerically by solving a mixed-integer linear program. Numerical experiments on multiple test cases demonstrate that our solution improves robustness compared to the standard approach without incurring significant additional computing costs.


title: Corpus Poisoning via Approximate Greedy Gradient Descent

abstract: Dense retrievers are widely used in information retrieval and have also been successfully extended to other knowledge intensive areas such as language models, e.g., Retrieval-Augmented Generation (RAG) systems. Unfortunately, they have recently been shown to be vulnerable to corpus poisoning attacks in which a malicious user injects a small fraction of adversarial passages into the retrieval corpus to trick the system into returning these passages among the top-ranked results for a broad set of user queries. Further study is needed to understand the extent to which these attacks could limit the deployment of dense retrievers in real-world applications. In this work, we propose Approximate Greedy Gradient Descent (AGGD), a new attack on dense retrieval systems based on the widely used HotFlip method for efficiently generating adversarial passages. We demonstrate that AGGD can select a higher quality set of token-level perturbations than HotFlip by replacing its random token sampling with a more structured search. Experimentally, we show that our method achieves a high attack success rate on several datasets and using several retrievers, and can generalize to unseen queries and new domains. Notably, our method is extremely effective in attacking the ANCE retrieval model, achieving attack success rates that are 17.6\% and 13.37\% higher on the NQ and MS MARCO datasets, respectively, compared to HotFlip. Additionally, we demonstrate AGGD's potential to replace HotFlip in other adversarial attacks, such as knowledge poisoning of RAG systems.\footnote{Code can be find in \url{https://github.com/JinyanSu1/AGGD}}


title: Optimizing Time Series Forecasting Architectures: A Hierarchical Neural Architecture Search Approach

abstract: The rapid development of time series forecasting research has brought many deep learning-based modules in this field. However, despite the increasing amount of new forecasting architectures, it is still unclear if we have leveraged the full potential of these existing modules within a properly designed architecture. In this work, we propose a novel hierarchical neural architecture search approach for time series forecasting tasks. With the design of a hierarchical search space, we incorporate many architecture types designed for forecasting tasks and allow for the efficient combination of different forecasting architecture modules. Results on long-term-time-series-forecasting tasks show that our approach can search for lightweight high-performing forecasting architectures across different forecasting tasks.


title: Discovery of An Apparent Red, High-Velocity Type Ia Supernova at z = 2.9 with JWST

abstract: We present the JWST discovery of SN 2023adsy, a transient object located in a host galaxy JADES-GS$+53.13485$$-$$27.82088$ with a host spectroscopic redshift of $2.903\pm0.007$. The transient was identified in deep James Webb Space Telescope (JWST)/NIRCam imaging from the JWST Advanced Deep Extragalactic Survey (JADES) program. Photometric and spectroscopic followup with NIRCam and NIRSpec, respectively, confirm the redshift and yield UV-NIR light-curve, NIR color, and spectroscopic information all consistent with a Type Ia classification. Despite its classification as a likely SN Ia, SN 2023adsy is both fairly red (E(B-V)$\sim0.9$) despite a host galaxy with low-extinction and has a high Ca II velocity ($19,000\pm2,000$km/s) compared to the general population of SNe Ia. While these characteristics are consistent with some Ca-rich SNe Ia, particularly SN 2016hnk, SN 2023adsy is intrinsically brighter than the low-z Ca-rich population. Although such an object is too red for any low-z cosmological sample, we apply a fiducial standardization approach to SN 2023adsy and find that the SN 2023adsy luminosity distance measurement is in excellent agreement ($\lesssim1\sigma$) with $\Lambda$CDM. Therefore unlike low-z Ca-rich SNe Ia, SN 2023adsy is standardizable and gives no indication that SN Ia standardized luminosities change significantly with redshift. A larger sample of distant SNe Ia is required to determine if SN Ia population characteristics at high-z truly diverge from their low-z counterparts, and to confirm that standardized luminosities nevertheless remain constant with redshift.


title: Provably Better Explanations with Optimized Aggregation of Feature Attributions

abstract: Using feature attributions for post-hoc explanations is a common practice to understand and verify the predictions of opaque machine learning models. Despite the numerous techniques available, individual methods often produce inconsistent and unstable results, putting their overall reliability into question. In this work, we aim to systematically improve the quality of feature attributions by combining multiple explanations across distinct methods or their variations. For this purpose, we propose a novel approach to derive optimal convex combinations of feature attributions that yield provable improvements of desired quality criteria such as robustness or faithfulness to the model behavior. Through extensive experiments involving various model architectures and popular feature attribution techniques, we demonstrate that our combination strategy consistently outperforms individual methods and existing baselines.


title: Searching for stellar population in the molecular cloud GRSMC 045.49+00.04

abstract: Understanding the characteristics of young stellar populations is essential for deriving insights into star formation processes within parent molecular clouds and the influence of massive stars. This study focuses on YSOs in the G 045.49+00.04 molecular cloud, including three UC HII regions. Using infrared photometric data and radiation models, we identified 1482 YSOs with masses ranging from 1.5 to 22 Msol. Among these, 315 form dense clusters near IRAS sources, with high-mass stars responsible for ionization. The non-cluster YSOs (1168) are uniformly distributed on the field. The distribution of YSOs from both samples on the colour-magnitude diagram and by the evolutionary ages is different. About 75% of objects in the IRAS clusters are concentrated around the ZAMS and have a well-defined peak at an age of Log(Age[years]) = 6.75, with a narrow spread. The non-cluster objects have two concentrations located to the right and left of the 0.1 Myr isochrone and two well-defined peaks at Log(Age) = 6.25 and 5.25. The K luminosity functions alpha slopes for the IRAS clusters and non-cluster objects are 0.32 and 0.72, respectively. The steeper alpha slope is suggesting that the non-cluster objects are less evolved, which is well consistent with the evolutionary age. Similar patterns were observed in the neighboring G 45.14+00.14 region. The both regions (G 045.49+00.04 and G 45.14+00.14) are located and distinguished by their brightness and density at the edge of the bubble around the highly variable X-ray binary GRS 1915+105, which includes a black hole and a K-giant companion. Based on the above, we can assume that the process of star formation in the young IRAS clusters was triggered by the GRS 915+105-initiated shock front inside the ISM massive condensation, through the process of "collecting and collapse". Most non-cluster objects probably belong to a later generation.


title: Comprehensive description of color centers by wave function theory: a CASSCF-NEVPT2 study of the NV defect in diamond

abstract: Paramagnetic point defects in wide-bandgap semiconductors, characterized by atomic-like in-gap defect states, constitute a unique challenge for ab initio modeling. In this theoretical study, we aim to devise a wave-function only computational protocol, exemplified on the prominent nitrogen-vacancy (NV) center in diamond, which enables the full characterization of future quantum bit candidates implemented in color centers. We propose the application of the second order $n$-electron valence state perturbation theory on top of the complete active space self-consistent field approximation (CASSCF-NEVPT2) to provide a balanced ab initio level description of the correlation effects yielded from the defect orbitals and the embedding nanodiamond. By relaxing the molecular cluster under the compression of the surrounding bulk material, we manage to model both the vertical and relaxed experimental electronic spectra within an average error margin of 0.1 eV. Furthermore, the experimentally observed Jahn-Teller behavior of $^3E$ and $^1E$ states, the measured fine structure of the triplet electronic states, as well as the expected spin-selectivity are quantitatively reproduced by the presented methodology. Our findings showcase that using conventional wave-function-based quantum chemical approaches on carefully crafted cluster models can be a competing alternative for discussing the energetics of point defects in solids.


title: UVIT Study of the MAgellanic Clouds (U-SMAC) I. Recent star formation history and kinematics of the Shell region in the North-Eastern Small Magellanic Cloud

abstract: The interactions between the Magellanic Clouds significantly affect the shape and distribution of the young stellar population, particularly in the periphery of the Small Magellanic Cloud (SMC). We present the first far-UV (FUV) map of the north-east SMC-Shell region using the Ultra Violet Imaging Telescope (UVIT) onboard AstroSat. The detected FUV stars are combined with Gaia Early Data Release 3 data to create a FUV-optical catalog of ~ 14,400 stars. FUV-optical colour-magnitude diagrams are used along with isochrones to estimate the stellar ages. The detected stars are formed in multiple episodes. We identified two episodes of star formation (~ 60 and ~ 260 Myr ago) where the episode at ~ 260 Myr is linked to the recent interaction with the Large Magellanic Cloud (LMC) and the episode at ~ 60 Myr is linked to the pericentric passage of the SMC around our Galaxy. The median proper motion (PM) and velocity dispersion are found to be similar to the SMC main body, indicating that this region has not experienced significant tidal effects. The FUV stellar surface density and the dispersion in PM suggest an extent of the inner SMC in the north-east direction to be around 2.2 deg. We detect arm-like and arc-like structures in the FUV stellar density map, and their kinematics appear to be similar to the SMC main body. These extended outer features are the spatial stellar overdensities formed over multiple episodes of star formation, but without apparent kinematic distinction.


title: Investigating the price determinants of the European Emission Trading System: a non-parametric approach

abstract: The European carbon market plays a pivotal role in the European Union's ambitious target of achieving carbon neutrality by 2050. Understanding the intricacies of factors influencing European Union Emission Trading System (EU ETS) market prices is paramount for effective policy making and strategy implementation. We propose the use of the Information Imbalance, a recently introduced non-parametric measure quantifying the degree to which a set of variables is informative with respect to another one, to study the relationships among macroeconomic, economic, uncertainty, and energy variables concerning EU ETS prices. Our analysis shows that in Phase 3 commodity related variables such as the ERIX index are the most informative to explain the behaviour of the EU ETS market price. Transitioning to Phase 4, financial fluctuations take centre stage, with the uncertainty in the EUR/CHF exchange rate emerging as a crucial determinant. These results reflect the disruptive impacts of the COVID-19 pandemic and the energy crisis in reshaping the importance of the different variables. Beyond variable analysis, we also propose to leverage the Information Imbalance to address the problem of mixed-frequency forecasting, and we identify the weekly time scale as the most informative for predicting the EU ETS price. Finally, we show how the Information Imbalance can be effectively combined with Gaussian Process regression for efficient nowcasting and forecasting using very small sets of highly informative predictors.


title: On orientations with forbidden out-degrees

abstract: Let $G$ be a $d$-regular graph and let $F\subseteq\{0, 1, 2, \ldots, d\}$ be a list of forbidden out-degrees. Akbari, Dalirrooyfard, Ehsani, Ozeki, and Sherkati conjectured that if $|F|<\tfrac{1}{2}d$, then $G$ should admit an $F$-avoiding orientation, i.e., an orientation where no out-degrees are in the forbidden list $F$. The conjecture is known for $d\leq 4$ due to work of Ma and Lu, and here we extend this to $d\leq 6$. The conjecture has also been studied in a generalized version, where $d, F$ are changed from constant values to functions $d(v), F(v)$ that vary over all $v\in V(G)$. We provide support for this generalized version by verifying it for some new cases, including when $G$ is 2-degenerate and when every $F(v)$ has some specific structure.


title: A Novel Time Series-to-Image Encoding Approach for Weather Phenomena Classification

abstract: Rainfall estimation through the analysis of its impact on electromagnetic waves has sparked increasing interest in the research community. Recent studies have delved into its effects on cellular network performance, demonstrating the potential to forecast rainfall levels based on electromagnetic wave attenuation during precipitations. This paper aims to solve the problem of identifying the nature of specific weather phenomena from the received signal level (RSL) in 4G/LTE mobile terminals. Specifically, utilizing time-series data representing RSL, we propose a novel approach to encode time series as images and model the task as an image classification problem, which we finally address using convolutional neural networks (CNNs). The main benefit of the abovementioned procedure is the opportunity to utilize various data augmentation techniques simultaneously. This encompasses applying traditional approaches, such as moving averages, to the time series and enhancing the generated images. We have investigated various image data augmentation methods to identify the most effective combination for this scenario. In the upcoming sections, we will introduce the task of rainfall estimation and conduct a comprehensive analysis of the dataset used. Subsequently, we will formally propose a new approach for converting time series into images. To conclude, the paper's final section will present and discuss the experiments conducted, providing the reader with a brief yet comprehensive overview of the results.


title: Identification of moment equations via data-driven approaches in nonlinear schrodinger models

abstract: The moment quantities associated with the nonlinear Schrodinger equation offer important insights towards the evolution dynamics of such dispersive wave partial differential equation (PDE) models. The effective dynamics of the moment quantities is amenable to both analytical and numerical treatments. In this paper we present a data-driven approach associated with the Sparse Identification of Nonlinear Dynamics (SINDy) to numerically capture the evolution behaviors of such moment quantities. Our method is applied first to some well-known closed systems of ordinary differential equations (ODEs) which describe the evolution dynamics of relevant moment quantities. Our examples are, progressively, of increasing complexity and our findings explore different choices within the SINDy library. We also consider the potential discovery of coordinate transformations that lead to moment system closure. Finally, we extend considerations to settings where a closed analytical form of the moment dynamics is not available.


title: Cosmological parameters from the joint analysis of Density Split and Second Order Statistics: an Emulator based on the Halo Occupation Distribution

abstract: In this work, we develop a simulation-based model to predict the density split (DSS) and second-order shear and clustering statistics. A simulation-based model has the potential to model highly non-linear scales where current DSS models fail. To build this model, we use the \texttt{AbacusSummit} N-body simulation suite from which we measure all necessary statistics and train an emulator based on \texttt{CosmoPower}. In that context, we discuss possible improvements for future emulators to make the measurement less noisy and biased, resulting in more accurate and precise model predictions. Regarding the emulator's accuracy, we find that the most important aspect is the average of the summary statistics over multiple-shot noise realizations of the foreground galaxies. However, these results probably depend on the chosen number density of the foreground galaxies. Regarding the parameter forecast based on preliminary LOWZxUNIONS data, we find that DSS has more constraining power to derive cosmological parameters and that the joint analysis with second-order statistics is particularly useful for extracting parameters of the galaxy-halo connection.


title: Canonicalizing zeta generators: genus zero and genus one

abstract: Zeta generators are derivations associated with odd Riemann zeta values that act freely on the Lie algebra of the fundamental group of Riemann surfaces with marked points. The genus-zero incarnation of zeta generators are Ihara derivations of certain Lie polynomials in two generators that can be obtained from the Drinfeld associator. We characterize a canonical choice of these polynomials, together with their non-Lie counterparts at even degrees $w\geq 2$, through the action of the dual space of formal and motivic multizeta values. Based on these canonical polynomials, we propose a canonical isomorphism that maps motivic multizeta values into the $f$-alphabet. The canonical Lie polynomials from the genus-zero setup determine canonical zeta generators in genus one that act on the two generators of Enriquez' elliptic associators. Up to a single contribution at fixed degree, the zeta generators in genus one are systematically expanded in terms of Tsunogai's geometric derivations dual to holomorphic Eisenstein series, leading to a wealth of explicit high-order computations. Earlier ambiguities in defining the non-geometric part of genus-one zeta generators are resolved by imposing a new representation-theoretic condition. The tight interplay between zeta generators in genus zero and genus one unravelled in this work connects the construction of single-valued multiple polylogarithms on the sphere with iterated-Eisenstein-integral representations of modular graph forms.


title: Dynamical correlation functions in the Ising field theory

abstract: We study finite temperature dynamical correlation functions of the magnetization operator in the one-dimensional Ising quantum field theory. Our approach is based on a finite temperature form factor series and on a Fredholm determinant representation of the correlators. While for space-like separations the Fredholm determinant can be efficiently evaluated numerically, for the time-like region it has convergence issues inherited from the form factor series. We develop a method to compute the correlation functions at time-like separations based on the analytic continuation of the space-time coordinates to complex values. Using this numerical technique, we explore all space-time and temperature regimes in both the ordered and disordered phases including short, large, and near-light-cone separations at low and high temperatures. We confirm the existing analytic predictions for the asymptotic behavior of the correlations except in the case of space-like correlations in the paramagnetic phase. For this case we derive a new closed form expression for the correlation length that has some unusual properties: it is a non-analytic function of both the space-time direction and the temperature, and its temperature dependence is non-monotonic.


title: Measurement of inclusive and differential cross sections for W$^+$W$^-$ production in proton-proton collisions at $\sqrt{s}$ = 13.6 TeV

abstract: Measurements at $\sqrt{s}$ = 13.6 TeV of the opposite-sign W boson pair production cross section in proton-proton collisions are presented. The data used in this study were collected with the CMS detector at the CERN LHC in 2022, and correspond to an integrated luminosity of 34.8 fb$^{-1}$. Events are selected by requiring one electron and one muon of opposite charge. A maximum likelihood fit is performed on signal- and background-enriched data categories defined by the flavour and charge of the leptons, the number of jets, and number of jets originating from b quarks. An inclusive W$^+$W$^-$ production cross section of 125.7 $\pm$ 5.6 pb is measured, in agreement with standard model predictions. Cross sections are also reported in a fiducial region close to that of the detector acceptance, both inclusively and differentially, as a function of the jet multiplicity in the event. For first time in proton-proton collisions, WW events with at least two reconstructed jets are studied and compared with recent theoretical predictions.


title: Timing-based mass measurement of exotic long-lived particles at the FCC-ee

abstract: The very high luminosity run foreseen at the $Z$-pole for the FCC-ee will allow the detection in $Z$ decays of new particles with very low couplings to the Standard Model. These particles will have measurable flight paths before they decay. If the timing and the position of the decay vertex can be measured with high precision, the mass of such particles can be measured by exploiting the constrained kinematics of an $e^+e^-$ collider. The mass resolution achievable with this technique is studied through a detailed analysis in the framework of a parametrised simulation of the performance of the IDEA detector. The adopted benchmark model is the production of Heavy Neutral Leptons, which is one of the key channels for new physics discovery at the FCC-ee.


title: Curvature induced magnetization of altermagnetic films

abstract: We consider a thin film of $d$-wave altermagnet bent in a stretching-free manner and demonstrate that gradients of the film curvature induce a local magnetization which is approximately tangential to the film. The magnetization amplitude directly reflects the altermagnetic symmetry and depends on the direction of bending. It is maximal for the bending along directions of the maximal altermagnetic splitting of the magnon bands. A periodically bent film of sinusoidal shape possesses a total magnetic moment per period $\propto\mathscr{A}^2q^4$ where $\mathscr{A}$ and $q$ are the bending amplitude and wave vector, respectively. The total magnetic moment is perpendicular to the plane of the unbent film and its direction (up or down) is determined by the bending direction. A film roll up to a nanotube possesses a toroidal moment directed along the tube $\propto \delta_r/r^2$ per one coil, where $r$ and $\delta_r$ are the coil radius and the pitch between coils. All these analytical predictions agree with numerical spin-lattice simulations.


title: New results on biorthogonal families in cylindrical domains and controllability consequences

abstract: In this article we consider moment problems equivalent to null controllability of some linear parabolic partial differential equations in space dimension higher than one. For these moment problems, we prove existence of an associated biorthogonal family and estimate its norm. The considered setting requires the space domain to be a cylinder and the evolution operator to be tensorized. Roughly speaking, we assume that the so-called Lebeau-Robbiano spectral inequality holds but only for the eigenvectors of the transverse operator. In the one dimensional tangent variable we assume the solvability of block moment problem as introduced in [Benabdallah, Boyer and Morancey - \textit{Ann. H. Lebesgue.} 3 (2020)]. We apply this abstract construction of biorthogonal families to the characterization of the minimal time for simultaneous null controllability of two heat-like equations in a cylindrical domain. To the best of our knowledge, this result is unattainable with other known techniques.


title: IRIS observational approach to the oscillatory and damping nature of network and internetwork chromosphere small-scale brightening (SSBs) and their unusual dynamical and morphological differences in different regions on the solar disk

abstract: One of the most exciting benefits of solar small-scale brightening is their oscillations, this study investigated the properties of small-scale brightening (SSBs) in different regions of the Sun and found that there are differences and similarities in the properties of oscillated and non-oscillated SSBs in different regions of the Sun, including quiet Sun (QS), the adjacent to active regions (AAR), and coronal hole (CH). The damping per period (Q-factor) and maximum Doppler velocity of SSBs varied depending on the region, with the less bright internetwork SSBs in QS having lower damping time (120 seconds) and higher maximum Doppler velocities (47 km/s) compared to the brighter network SSBs (with 216 seconds & 37 km/s, respectively), while in AAR, internetwork SSBs tend to have higher damping time (about of 220 seconds) and wider maximum Doppler velocity (10 to 140 km/s) ranges compared to network SSBs (130 seconds & 10 to 85 km/s). In CH, both types of SSBs show similar damping time (120 seconds), but internetwork SSBs tend to have higher maximum Doppler velocities (100 km/s) compared to network SSBs (85 km/s). Also, it was pointed out that the majority of network SSBs in AARs are in the overdamping mode, while in QS, internetwork SSBs demonstrate overdamping behavior and oscillated network SSBs exhibit critical damping behavior. It is important to bear in mind, however, that the physical mechanisms underlying the damping of SSBs may vary depending on the local plasma conditions and magnetic environment.


title: Vapor cell Rydberg atom electrometry with time-separated fields

abstract: Rydberg atoms have large transition electric dipole moments and high sensitivity to electric fields. We describe a new method for microwave field sensing in a vapor cell consisting of separate excitation, quantum evolution between two Rydberg levels in the dark and state-dependent detection with probe laser transmission. Using microwave pulse techniques we study homogeneous and inhomogeneous relaxation of the coherence between Rydberg levels and demonstrate detection of a 10 GHz signal with electric field sensitivity of 10 nV/cm/Hz$^{1/2}$.


title: LINX: A Language Driven Generative System for Goal-Oriented Automated Data Exploration

abstract: Data exploration is a challenging process in which users examine a dataset by iteratively employing a series of queries. While in some cases the user explores a new dataset to become familiar with it, more often, the exploration process is conducted with a specific analysis goal or question in mind. To assist users in exploring a new dataset, Automated Data Exploration (ADE) systems have been devised in previous work. These systems aim to auto-generate a full exploration session, containing a sequence of queries that showcase interesting elements of the data. However, existing ADE systems are often constrained by a predefined objective function, thus always generating the same session for a given dataset. Therefore, their effectiveness in goal-oriented exploration, in which users need to answer specific questions about the data, are extremely limited. To this end, this paper presents LINX, a generative system augmented with a natural language interface for goal-oriented ADE. Given an input dataset and an analytical goal described in natural language, LINX generates a personalized exploratory session that is relevant to the user's goal. LINX utilizes a Large Language Model (LLM) to interpret the input analysis goal, and then derive a set of specifications for the desired output exploration session. These specifications are then transferred to a novel, modular ADE engine based on Constrained Deep Reinforcement Learning (CDRL), which can adapt its output according to the specified instructions. To validate LINX's effectiveness, we introduce a new benchmark dataset for goal-oriented exploration and conduct an extensive user study. Our analysis underscores LINX's superior capability in producing exploratory notebooks that are significantly more relevant and beneficial than those generated by existing solutions, including ChatGPT, goal-agnostic ADE, and commercial systems.


title: Adapting Physics-Informed Neural Networks To Optimize ODEs in Mosquito Population Dynamics

abstract: Physics informed neural networks have been gaining popularity due to their unique ability to incorporate physics laws into data-driven models, ensuring that the predictions are not only consistent with empirical data but also align with domain-specific knowledge in the form of physics equations. The integration of physics principles enables the method to require less data while maintaining the robustness of deep learning in modeling complex dynamical systems. However, current PINN frameworks are not sufficiently mature for real-world ODE systems, especially those with extreme multi-scale behavior such as mosquito population dynamical modelling. In this research, we propose a PINN framework with several improvements for forward and inverse problems for ODE systems with a case study application in modelling the dynamics of mosquito populations. The framework tackles the gradient imbalance and stiff problems posed by mosquito ordinary differential equations. The method offers a simple but effective way to resolve the time causality issue in PINNs by gradually expanding the training time domain until it covers entire domain of interest. As part of a robust evaluation, we conduct experiments using simulated data to evaluate the effectiveness of the approach. Preliminary results indicate that physics-informed machine learning holds significant potential for advancing the study of ecological systems.


title: Large Generative Graph Models

abstract: Large Generative Models (LGMs) such as GPT, Stable Diffusion, Sora, and Suno are trained on a huge amount of language corpus, images, videos, and audio that are extremely diverse from numerous domains. This training paradigm over diverse well-curated data lies at the heart of generating creative and sensible content. However, all previous graph generative models (e.g., GraphRNN, MDVAE, MoFlow, GDSS, and DiGress) have been trained only on one dataset each time, which cannot replicate the revolutionary success achieved by LGMs in other fields. To remedy this crucial gap, we propose a new class of graph generative model called Large Graph Generative Model (LGGM) that is trained on a large corpus of graphs (over 5000 graphs) from 13 different domains. We empirically demonstrate that the pre-trained LGGM has superior zero-shot generative capability to existing graph generative models. Furthermore, our pre-trained LGGM can be easily fine-tuned with graphs from target domains and demonstrate even better performance than those directly trained from scratch, behaving as a solid starting point for real-world customization. Inspired by Stable Diffusion, we further equip LGGM with the capability to generate graphs given text prompts (Text-to-Graph), such as the description of the network name and domain (i.e., "The power-1138-bus graph represents a network of buses in a power distribution system."), and network statistics (i.e., "The graph has a low average degree, suitable for modeling social media interactions."). This Text-to-Graph capability integrates the extensive world knowledge in the underlying language model, offering users fine-grained control of the generated graphs. We release the code, the model checkpoint, and the datasets at https://lggm-lg.github.io/.


title: Graphical sequences and plane trees

abstract: A sequence $d_1\le\cdots\le d_n$ is graphical if it is the degree sequence of a graph. Balister, the second author, Groenland, Johnston and Scott showed that there are asymptotically $C4^n/n^{3/4}$ such sequences. However, the constant $C$ involves a probability that is only approximated. Using random walks and limit theory for infinitely divisible probability distributions, we describe $C$ in terms of Walkup's formula for the number of rooted, unlabelled and cyclically distinct plane trees.


title: Categorizing Sources of Information for Explanations in Conversational AI Systems for Older Adults Aging in Place

abstract: As the permeability of AI systems in interpersonal domains like the home expands, their technical capabilities of generating explanations are required to be aligned with user expectations for transparency and reasoning. This paper presents insights from our ongoing work in understanding the effectiveness of explanations in Conversational AI systems for older adults aging in place and their family caregivers. We argue that in collaborative and multi-user environments like the home, AI systems will make recommendations based on a host of information sources to generate explanations. These sources may be more or less salient based on user mental models of the system and the specific task. We highlight the need for cross technological collaboration between AI systems and other available sources of information in the home to generate multiple explanations for a single user query. Through example scenarios in a caregiving home setting, this paper provides an initial framework for categorizing these sources and informing a potential design space for AI explanations surrounding everyday tasks in the home.


title: Ohms law lost and regained: observation and impact of zeros and poles

abstract: The quantum conductance and its classical wave analogue, the transmittance, are given by the sum of the eigenvalues of the transmission matrix. The lowest transmission eigenvalue in diffusive media might be expected to play a negligible role in the conductance, and, in any case, to be too small to be observed. Here, we observe the lowest transmission eigenchannel in microwave waveguides, though it is orders of magnitude below the nominal noise level, and show that the transmittance is pulled down by global correlation among transmission eigenvalues and among zeros and poles of the transmission matrix. Transmission vanishes either when the energy density on the sample output vanishes at topological transmission zeros or when the longitudinal velocity vanishes precisely at the crossover to a new channel. This lowers the conductance by an amount proportional to the modulation of the density of states. In accord with the correspondence principle, the conductance approaches Ohms law as the number of channels increases with sample width. The exploration of the transmission matrix opens the door to a new understanding of mesoscopic transport and ultrasensitive detection techniques.


title: LLavaGuard: VLM-based Safeguards for Vision Dataset Curation and Safety Assessment

abstract: We introduce LlavaGuard, a family of VLM-based safeguard models, offering a versatile framework for evaluating the safety compliance of visual content. Specifically, we designed LlavaGuard for dataset annotation and generative model safeguarding. To this end, we collected and annotated a high-quality visual dataset incorporating a broad safety taxonomy, which we use to tune VLMs on context-aware safety risks. As a key innovation, LlavaGuard's new responses contain comprehensive information, including a safety rating, the violated safety categories, and an in-depth rationale. Further, our introduced customizable taxonomy categories enable the context-specific alignment of LlavaGuard to various scenarios. Our experiments highlight the capabilities of LlavaGuard in complex and real-world applications. We provide checkpoints ranging from 7B to 34B parameters demonstrating state-of-the-art performance, with even the smallest models outperforming baselines like GPT-4. We make our dataset and model weights publicly available and invite further research to address the diverse needs of communities and contexts.


title: The Expanding Scope of the Stability Gap: Unveiling its Presence in Joint Incremental Learning of Homogeneous Tasks

abstract: Recent research identified a temporary performance drop on previously learned tasks when transitioning to a new one. This drop is called the stability gap and has great consequences for continual learning: it complicates the direct employment of continually learning since the worse-case performance at task-boundaries is dramatic, it limits its potential as an energy-efficient training paradigm, and finally, the stability drop could result in a reduced final performance of the algorithm. In this paper, we show that the stability gap also occurs when applying joint incremental training of homogeneous tasks. In this scenario, the learner continues training on the same data distribution and has access to all data from previous tasks. In addition, we show that in this scenario, there exists a low-loss linear path to the next minima, but that SGD optimization does not choose this path. We perform further analysis including a finer batch-wise analysis which could provide insights towards potential solution directions.


title: An event generator for Lepton-Hadron Deep Inelastic Scattering at NLO+PS with POWHEG including mass effects

abstract: We present a generator for lepton nucleon collisions in the DIS regime, focusing in particular on processes with a massive lepton and/or a massive quark in the final state. We have built a full code matching NLO QCD corrections to parton shower Monte Carlo programs in the POWHEG-BOX framework. Our code can be used to compute NLO+PS accurate fully differential predictions for neutral current and charged current processes, including processes with an incoming tau neutrino, and/or including charm quarks in the final state. We also made comparisons with available data and predictions for the new neutrino experiments at CERN.


title: Kru\v{z}kov-type uniqueness theorem for the chemical flood conservation law system with local vanishing viscosity admissibility

abstract: We study the uniqueness of solutions of the initial-boundary value problem in the quarter-plane for the chemical flood conservation law system in the class of piece-wise $\mathcal C^1$-smooth functions under certain restrictions. The vanishing viscosity method is used locally on the discontinuities of the solution to determine admissible and inadmissible shocks. The Lagrange coordinate transformation is utilized in order to split the equations. The proof of uniqueness is based on an entropy inequality similar to the one used in the classical Kru\v{z}kov's theorem.


title: On the Double Sequence Space $\mathcal{H}_{\vartheta}$ as an Extension of Hahn Space $h$

abstract: Double sequence spaces have become a significant area of research within functional analysis due to their applications in various branches of mathematics and mathematical physics. In this study, we investigate Hahn double sequence space denoted as $\mathcal{H}_{\vartheta}$, where $\vartheta\in\{p,bp,r\}$, as an extension of the Hahn sequence space $h$. Our investigation begins with an analysis of several topological properties of $\mathcal{H}_{\vartheta}$, apart from a comprehensive analysis of the relationship between Hahn double sequences and some other classical double sequence spaces. The $\alpha-$dual, algebraic dual and $\beta(bp)-$dual, and $\gamma-$dual of the space $\mathcal{H}_{\vartheta}$ are detrmined. Furthermore, we define the determining set of $\mathcal{H}_{\vartheta}$ and we state the conditions concerning the characterization of four-dimensional (4D) matrix classes $(\mathcal{H}_{\vartheta},\lambda)$, where $\lambda=\{\mathcal{H}_{\vartheta},\mathcal{BV}, \mathcal{BV}_{\vartheta 0}, \mathcal{CS}_{\vartheta},\mathcal{CS}_{\vartheta 0},\mathcal{BS}\}$ and $(\mu,\mathcal{H}_{\vartheta})$, where $\mu=\{\mathcal{L}_u, \mathcal{C}_{\vartheta 0}, \mathcal{C}_{\vartheta},\mathcal{M}_{u}\}$. In conclusion, this research contributes non-standard investigation and various significant results into the space $\mathcal{H}_{\vartheta}$. The conducted results are deepen the understanding of the space $\mathcal{H}_{\vartheta}$ and open up new avenues for further research and applications in sequence space theory.


title: The SRG/eROSITA All-Sky Survey: X-ray beacons at late cosmic dawn

abstract: The SRG/eROSITA All-Sky Survey (eRASS) is expected to contain ~100 quasars that emitted their light when the universe was less than a billion years old, i.e. at z>5.6. By selection, these quasars populate the bright end of the AGN X-ray luminosity function and their count offers a powerful demographic diagnostic of the parent super-massive black hole population. Of the >~ 400 quasars that have been discovered at z>5.6 to date, less than 15 % have been X-ray detected. We present a pilot survey to uncover the elusive X-ray luminous end of the distant quasar population. We have designed a quasar selection pipeline based on optical, infrared and X-ray imaging data from DES DR2, VHS DR5, CatWISE2020 and the eRASS. The core selection method relies on SED template fitting. We performed optical follow-up spectroscopy with the Magellan/LDSS3 instrument for the redshift confirmation of a subset of candidates. We have further obtained a deeper X-ray image of one of our candidates with Chandra ACIS-S. We report the discovery of five new quasars in the redshift range 5.6 < z < 6.1. Two of these quasars are detected in eRASS and are by selection X-ray ultra-luminous. These quasars are also detected at radio frequencies. The first one is a broad absorption line quasar which shows significant X-ray dimming over 3.5 years, i.e. about 6 months in the quasar rest frame. The second radio-detected quasar is a jetted source with compact morphology. We show that a blazar configuration is likely for this source, making it the second most distant blazar known to date. With our pilot study, we demonstrate the power of eROSITA as a discovery machine for luminous quasars in the epoch of reionization. The X-ray emission of the two eROSITA detected quasars are likely to be driven by different high-energetic emission mechanisms a diversity which will be further explored in a future systematic full-hemisphere survey.


title: Compositional Curvature Bounds for Deep Neural Networks

abstract: A key challenge that threatens the widespread use of neural networks in safety-critical applications is their vulnerability to adversarial attacks. In this paper, we study the second-order behavior of continuously differentiable deep neural networks, focusing on robustness against adversarial perturbations. First, we provide a theoretical analysis of robustness and attack certificates for deep classifiers by leveraging local gradients and upper bounds on the second derivative (curvature constant). Next, we introduce a novel algorithm to analytically compute provable upper bounds on the second derivative of neural networks. This algorithm leverages the compositional structure of the model to propagate the curvature bound layer-by-layer, giving rise to a scalable and modular approach. The proposed bound can serve as a differentiable regularizer to control the curvature of neural networks during training, thereby enhancing robustness. Finally, we demonstrate the efficacy of our method on classification tasks using the MNIST and CIFAR-10 datasets.


title: Contextual fusion enhances robustness to image blurring

abstract: Mammalian brains handle complex reasoning by integrating information across brain regions specialized for particular sensory modalities. This enables improved robustness and generalization versus deep neural networks, which typically process one modality and are vulnerable to perturbations. While defense methods exist, they do not generalize well across perturbations. We developed a fusion model combining background and foreground features from CNNs trained on Imagenet and Places365. We tested its robustness to human-perceivable perturbations on MS COCO. The fusion model improved robustness, especially for classes with greater context variability. Our proposed solution for integrating multiple modalities provides a new approach to enhance robustness and may be complementary to existing methods.


title: Energy Propagation in Scattering Convolution Networks Can Be Arbitrarily Slow

abstract: We analyze energy decay for deep convolutional neural networks employed as feature extractors, such as Mallat's wavelet scattering transform. For time-frequency scattering transforms based on Gabor filters, it has been established that energy decay is exponential, for arbitrary square-integrable input signals. Our main results allow to prove that this is wrong for wavelet scattering in arbitrary dimensions. In this setting, the energy decay of the scattering transform acting on a generic square-integrable signal turns out to be arbitrarily slow. The fact that this behavior holds for dense subsets of $L^2(\mathbb{R}^d)$ emphasizes that fast energy decay is generally not a stable property of signals. We complement these findings with positive results allowing to conclude fast (up to exponential) energy decay for generalized Sobolev spaces that are tailored to the frequency localization of the underlying filter bank. Both negative and positive results highlight that energy decay in scattering networks critically depends on the interplay of the respective frequency localizations of the signal on the one hand, and of the employed filters on the other.


title: Third-order intrinsic alignment of SDSS BOSS LOWZ galaxies

abstract: Cosmic shear is a powerful probe of cosmology, but it is affected by the intrinsic alignment (IA) of galaxy shapes with the large-scale structure. Upcoming surveys like Euclid and Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) require an accurate understanding of IA, particularly for higher-order cosmic shear statistics that are vital for extracting the most cosmological information. In this paper, we report the first detection of third-order IA correlations using the LOWZ galaxy sample from the Sloan Digital Sky Survey (SDSS) Baryon Oscillation Spectroscopic Survey (BOSS). We compare our measurements with predictions from the MICE cosmological simulation and an analytical NLA-inspired model informed by second-order correlations. We also explore the dependence of the third-order correlation on the galaxies' luminosity. We find that the amplitude $A_\mathrm{IA}$ of the IA signal is non-zero at the $4.7\sigma$ ($7.6\sigma$) level for scales between $6 h^{-1} \mathrm{Mpc}$ ($1 h^{-1} \mathrm{Mpc}$) and $20 h^{-1} \mathrm{Mpc}$. For scales above $6 h^{-1}\mathrm{Mpc}$ the inferred AIA agrees both with the prediction from the simulation and estimates from second-order statistics within $1\sigma$ but deviations arise at smaller scales. Our results demonstrate the feasibility of measuring third-order IA correlations and using them for constraining IA models. The agreement between second- and third-order IA constraints also opens the opportunity for a consistent joint analysis and IA self-calibration, promising tighter parameter constraints for upcoming cosmological surveys.


title: Born-Oppenheimer Potentials for $SU(3)$ Gauge Theory

abstract: We develop parameterizations of 8 of the lowest Born-Oppenheimer potentials for quarkonium hybrid mesons as functions of the separation $r$ of the static quark and antiquark sources. The parameters are determined by fitting results calculated using pure $SU(3)$ lattice gauge theory. The parameterizations have the correct limiting behavior at small $r$, where the potentials form multiplets associated with gluelumps. They have the correct limiting behavior at large $r$, where the potentials form multiplets associated with excitations of a relativistic string. There is a narrow avoided crossing in the small-$r$ region between two potentials with the same Born-Oppenheimer quantum numbers.


title: Optimizing Exit Queues for Proof-of-Stake Blockchains: A Mechanism Design Approach

abstract: Byzantine fault-tolerant consensus protocols have provable safety and liveness properties for static validator sets. In practice, however, the validator set changes over time, potentially eroding the protocol's security guarantees. For example, systems with accountable safety may lose some of that accountability over time as adversarial validators exit. As a result, protocols must rate limit entry and exit so that the set changes slowly enough to ensure security. Here, the system designer faces a fundamental trade-off. Slower exits increase friction, making it less attractive to stake in the first place. Faster exits provide more utility to stakers but weaken the protocol's security. This paper provides the first systematic study of exit queues for Proof-of-Stake blockchains. Given a collection of validator-set consistency constraints imposed by the protocol, the social planner's goal is to provide a constrained-optimal mechanism that minimizes disutility for the participants. We introduce the MINSLACK mechanism, a dynamic capacity first-come-first-served queue in which the amount of stake that can exit in a period depends on the number of previous exits and the consistency constraints. We show that MINSLACK is optimal when stakers equally value the processing of their withdrawal. When stakers values are heterogeneous, the optimal mechanism resembles a priority queue with dynamic capacity. However, this mechanism must reserve exit capacity for the future in case a staker with a much higher need for liquidity arrives. We conclude with a survey of known consistency constraints and highlight the diversity of existing exit mechanisms.


title: Eccentricity effects on the SMBH GW background

abstract: We study how eccentricity affects the gravitational wave (GW) spectrum from supermassive black hole (SMBH) binaries. We develop a fast and accurate semi-analytic method for computing the GW spectra, the distribution for the spectral fluctuations and the correlations between different frequencies. As GW emission circularizes binaries, the suppression of the signal strength due to eccentricity will be relevant for signals from wider binaries emitting at lower frequencies. Such a feature is present in the signal observed at pulsar timing arrays. We find that, when orbital decay of the SMBH binaries is driven by GWs only, the shape of the observed signal prefers highly eccentric binaries $\langle e \rangle_{2\,{\rm nHz}} = 0.83^{+0.04}_{-0.05}$. However, when environmental effects are included, the initial eccentricity can be significantly lowered yet the scenario with purely circular binaries is mildly disfavored.


title: GR-Athena++: magnetohydrodynamical evolution with dynamical space-time

abstract: We present a self-contained overview of GR-Athena++, a general-relativistic magnetohydrodynamics (GRMHD) code, that incorporates treatment of dynamical space-time, based on the recent work of (Daszuta+, 2021)[49] and (Cook+, 2023)[45]. General aspects of the Athena++ framework we build upon, such as oct-tree based, adaptive mesh refinement (AMR) and constrained transport, together with our modifications, incorporating the Z4c formulation of numerical relativity, judiciously coupled, enables GRMHD with dynamical space-times. Initial verification testing of GR-Athena++ is performed through benchmark problems that involve isolated and binary neutron star space-times. This leads to stable and convergent results. Gravitational collapse of a rapidly rotating star through black hole formation is shown to be correctly handled. In the case of non-rotating stars, magnetic field instabilities are demonstrated to be correctly captured with total relative violation of the divergence-free constraint remaining near machine precision. The use of AMR is show-cased through investigation of the Kelvin-Helmholtz instability which is resolved at the collisional interface in a merger of magnetised binary neutron stars. The underlying task-based computational model enables GR-Athena++ to achieve strong scaling efficiencies above $80\%$ in excess of $10^5$ CPU cores and excellent weak scaling up to $\sim 5 \times 10^5$ CPU cores in a realistic production setup. GR-Athena++ thus provides a viable path towards robust simulation of GRMHD flows in strong and dynamical gravity with exascale high performance computational infrastructure.


title: Towards Semantic Equivalence of Tokenization in Multimodal LLM

abstract: Multimodal Large Language Models (MLLMs) have demonstrated exceptional capabilities in processing vision-language tasks. One of the crux of MLLMs lies in vision tokenization, which involves efficiently transforming input visual signals into feature representations that are most beneficial for LLMs. However, existing vision tokenizers, essential for semantic alignment between vision and language, remain problematic. Existing methods aggressively fragment visual input, corrupting the visual semantic integrity. To address this, this paper proposes a novel dynamic Semantic-Equivalent Vision Tokenizer (SeTok), which groups visual features into semantic units via a dynamic clustering algorithm, flexibly determining the number of tokens based on image complexity. The resulting vision tokens effectively preserve semantic integrity and capture both low-frequency and high-frequency visual features. The proposed MLLM (Setokim) equipped with SeTok significantly demonstrates superior performance across various tasks, as evidenced by our experimental results. The project page is at https://chocowu.github.io/SeTok-web/.


title: Differentiable Time-Varying Linear Prediction in the Context of End-to-End Analysis-by-Synthesis

abstract: Training the linear prediction (LP) operator end-to-end for audio synthesis in modern deep learning frameworks is slow due to its recursive formulation. In addition, frame-wise approximation as an acceleration method cannot generalise well to test time conditions where the LP is computed sample-wise. Efficient differentiable sample-wise LP for end-to-end training is the key to removing this barrier. We generalise the efficient time-invariant LP implementation from the GOLF vocoder to time-varying cases. Combining this with the classic source-filter model, we show that the improved GOLF learns LP coefficients and reconstructs the voice better than its frame-wise counterparts. Moreover, in our listening test, synthesised outputs from GOLF scored higher in quality ratings than the state-of-the-art differentiable WORLD vocoder.


title: PatchSVD: A Non-uniform SVD-based Image Compression Algorithm

abstract: Storing data is particularly a challenge when dealing with image data which often involves large file sizes due to the high resolution and complexity of images. Efficient image compression algorithms are crucial to better manage data storage costs. In this paper, we propose a novel region-based lossy image compression technique, called PatchSVD, based on the Singular Value Decomposition (SVD) algorithm. We show through experiments that PatchSVD outperforms SVD-based image compression with respect to three popular image compression metrics. Moreover, we compare PatchSVD compression artifacts with those of Joint Photographic Experts Group (JPEG) and SVD-based image compression and illustrate some cases where PatchSVD compression artifacts are preferable compared to JPEG and SVD artifacts.


title: An Empirical Study on Parameter-Efficient Fine-Tuning for MultiModal Large Language Models

abstract: Multimodal large language models (MLLMs) fine-tuned with multimodal instruction datasets have demonstrated remarkable capabilities in multimodal tasks. However, fine-tuning all parameters of MLLMs has become challenging as they usually contain billions of parameters. To address this issue, we study parameter-efficient fine-tuning (PEFT) methods for MLLMs. We aim to identify effective methods for enhancing the performance of MLLMs in scenarios where only a limited number of parameters are trained. This paper conducts empirical studies using four popular PEFT methods to fine-tune the LLM component of open-source MLLMs. We present a comprehensive analysis that encompasses various aspects, including the impact of PEFT methods on various models, parameters and location of the PEFT module, size of fine-tuning data, model stability based on PEFT methods, MLLM's generalization, and hallucination. We evaluated four PEFT methods on seven datasets from two different categories: unseen and seen datasets. Across all experiments, we show that the adapter is the best-performing PEFT method. At the same time, fine-tuning the connector layers leads to improved performance in most MLLMs. Code and data are available at https://github.com/alenai97/PEFT-MLLM.git.


title: DVOS: Self-Supervised Dense-Pattern Video Object Segmentation

abstract: Video object segmentation approaches primarily rely on large-scale pixel-accurate human-annotated datasets for model development. In Dense Video Object Segmentation (DVOS) scenarios, each video frame encompasses hundreds of small, dense, and partially occluded objects. Accordingly, the labor-intensive manual annotation of even a single frame often takes hours, which hinders the development of DVOS for many applications. Furthermore, in videos with dense patterns, following a large number of objects that move in different directions poses additional challenges. To address these challenges, we proposed a semi-self-supervised spatiotemporal approach for DVOS utilizing a diffusion-based method through multi-task learning. Emulating real videos' optical flow and simulating their motion, we developed a methodology to synthesize computationally annotated videos that can be used for training DVOS models; The model performance was further improved by utilizing weakly labeled (computationally generated but imprecise) data. To demonstrate the utility and efficacy of the proposed approach, we developed DVOS models for wheat head segmentation of handheld and drone-captured videos, capturing wheat crops in fields of different locations across various growth stages, spanning from heading to maturity. Despite using only a few manually annotated video frames, the proposed approach yielded high-performing models, achieving a Dice score of 0.82 when tested on a drone-captured external test set. While we showed the efficacy of the proposed approach for wheat head segmentation, its application can be extended to other crops or DVOS in other domains, such as crowd analysis or microscopic image analysis.


title: 3D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination

abstract: The integration of language and 3D perception is crucial for developing embodied agents and robots that comprehend and interact with the physical world. While large language models (LLMs) have demonstrated impressive language understanding and generation capabilities, their adaptation to 3D environments (3D-LLMs) remains in its early stages. A primary challenge is the absence of large-scale datasets that provide dense grounding between language and 3D scenes. In this paper, we introduce 3D-GRAND, a pioneering large-scale dataset comprising 40,087 household scenes paired with 6.2 million densely-grounded scene-language instructions. Our results show that instruction tuning with 3D-GRAND significantly enhances grounding capabilities and reduces hallucinations in 3D-LLMs. As part of our contributions, we propose a comprehensive benchmark 3D-POPE to systematically evaluate hallucination in 3D-LLMs, enabling fair comparisons among future models. Our experiments highlight a scaling effect between dataset size and 3D-LLM performance, emphasizing the critical role of large-scale 3D-text datasets in advancing embodied AI research. Notably, our results demonstrate early signals for effective sim-to-real transfer, indicating that models trained on large synthetic data can perform well on real-world 3D scans. Through 3D-GRAND and 3D-POPE, we aim to equip the embodied AI community with essential resources and insights, setting the stage for more reliable and better-grounded 3D-LLMs. Project website: https://3d-grand.github.io


title: Hierarchical Bayesian approach for adaptive integration of Bragg peaks in time-of-flight neutron scattering data

abstract: The Spallation Neutron Source (SNS) at Oak Ridge National Laboratory (ORNL) operates in the event mode. Time-of-flight (TOF) information about each detected neutron is collected separately and saved as a descriptive entry in a database enabling unprecedented accuracy of the collected experimental data. Nevertheless, the common data processing pipeline still involves the binning of data to perform analysis and feature extraction. For weak reflections, improper binning leads to sparse histograms with low signal-to-noise ratios, rendering them uninformative. In this study, we propose the Bayesian approach for the identification of Bragg peaks in TOF diffraction data. The method is capable of adaptively handling the varying sampling rates found in different regions of the reciprocal space. Unlike histogram fitting methods, our approach focuses on estimating the true neutron flux function. We accomplish this by employing a profile fitting algorithm based on the event-level likelihood, along with a multiresolution histogram-level prior. By using this approach, we ensure that there is no loss of information due to data reduction in strong reflections and that the search space is appropriately restricted for weak reflections. To demonstrate the effectiveness of our proposed model, we apply it to real experimental data collected at the TOPAZ single crystal diffractometer at SNS.


title: oBAKE: an Online Biometric-Authenticated Key Exchange Protocol

abstract: In this writing, we introduce a novel biometric-authenticated key exchange protocol that allows secure and privacy-preserving key establishment between a stateless biometric sensing system and a "smart" user token that possesses biometric templates of the user. The protocol yields a shared secret incorporating random nonce from both parties when they positively authenticate each other. Mutual positive authentication here is defined as when the feature vector calculated from the sensor data captured by the biometric sensing system only differs from the feature vector stored as the biometric template within the user token by less than a predefined threshold. The parties exchange only randomized data and cryptographically derived verifiers; no significant information regarding the vectors is ever exchanged. The protocol essentially utilizes the BBKDF scheme for feature vector matching, and as a result, the threshold is compared per component of the two vectors to be matched. This fact makes it straightforward to employ multiple biometric modalities. The protocol also allows online authentication where the biometric sensing system can potentially send multiple queries derived from different sensor data samples, in one or more rounds. The protocol is designed in such a way that the user token can very efficiently answer a multitude of such queries. This makes the protocol especially suitable for interactive systems while posing a minimal computational burden on the user token. The biometric sensing system can be made stateless, i.e. user registration in advance is not required. Furthermore, the protocol is bidirectionally privacy-preserving in the sense that unless mutual authentication is achieved first, neither the biometric sensing system, nor the user token can gain useful information, respectively regarding the biometric template, or sensor-data-derived feature vectors.


title: Smart Navigation System for Parking Assignment at Large Events: Incorporating Heterogeneous Driver Characteristics

abstract: Parking challenges escalate significantly during large events such as concerts or sports games, yet few studies address dynamic parking lot assignments for such occasions. This paper introduces a smart navigation system designed to optimize parking assignments swiftly during large events, utilizing a mixed search algorithm that accounts for the heterogeneous characteristics of drivers. We conducted simulations in the Berkeley city area during the "Big Game" to validate our system and demonstrate the benefits of our innovative parking assignment approach.


title: Generative Geostatistical Modeling from Incomplete Well and Imaged Seismic Observations with Diffusion Models

abstract: In this study, we introduce a novel approach to synthesizing subsurface velocity models using diffusion generative models. Conventional methods rely on extensive, high-quality datasets, which are often inaccessible in subsurface applications. Our method leverages incomplete well and seismic observations to produce high-fidelity velocity samples without requiring fully sampled training datasets. The results demonstrate that our generative model accurately captures long-range structures, aligns with ground-truth velocity models, achieves high Structural Similarity Index (SSIM) scores, and provides meaningful uncertainty estimations. This approach facilitates realistic subsurface velocity synthesis, offering valuable inputs for full-waveform inversion and enhancing seismic-based subsurface modeling.


title: Multi-sensor Intrusion Detection System

abstract: Security, defined as protection against external threats, is a critical concern for homes and offices. Intrusion, characterized by unauthorized access, presents a significant challenge to maintaining security. This research aims to address this issue by designing and implementing an automated intrusion detection system utilizing a combination of sensors and communication technologies. The research introduced an automated intrusion detection system for homes and offices, combining sensors such as a PIR sensor for detecting unauthorized motion, magnetic switches for unauthorized entry detection, and a GSM module for notifying property owners. Employing the ATmega328P microcontroller, sensor data is analysed to generate early intrusion alerts, prompting phone call notifications via the GSM module. Practical implementation involved breadboarding, soldering, and rigorous testing, ensuring proper functionality under real-world conditions. The implemented intrusion detection system effectively utilizes magnetic switches and a Passive Infrared (PIR) sensor to detect unauthorized entry and motion within the premises, respectively. Upon detection, the system promptly analyses the situation and alerts the property owner via phone call, enabling swift response measures. This real-time notification system enhances proactive security management, minimizing the risk of further intrusion and ensuring the safety of the property. The multi-sensor intrusion detection system, incorporating PIR sensors, magnetic switches, and a GSM-based phone call gateway, effectively alerts property owners of unauthorized intrusions in real-time. Demonstrating its efficacy through rigorous testing, the system offers enhanced security for both residential and commercial environments.


title: A Novel Coupled bES-FEM Formulation with SUPG stabilization for Thermo-Hydro-Mechanical Analysis in Saturated Porous Media

abstract: Two primary types of numerical instabilities often occur in low-order finite element method (FEM) analyses of thermo-hydro-mechanical (THM) phenomena: (1) pressure oscillations arising improper interpolation of pressure and displacement fields; and (2) spatial oscillations induced by nonlinear convection terms in convection-dominated scenarios. In response to these issues, this paper proposes a novel stabilized edge-based smoothed FEM with a bubble function (bES-FEM) for THM analysis within saturated porous media. In the proposed framework, a cubic bubble function is first incorporated into ES-FEM to efficiently mitigate pressure oscillations that breach the Inf-Sup condition, and then the Streamline Upwind Petrov-Galerkin (SUPG) scheme is adopted in bES-FEM to effectively reduce the spurious oscillations in convection-dominated heat transfer scenarios. The accuracy of the bES-FEM with SUPG formulation for THM coupled problems is validated through a series of five benchmark tests. Moreover, the simulations of open-loop ground source energy systems demonstrate the proposed method's exceptional capability in tackling complex THM challenges in real-world applications. All the obtained results showcase the superiority of proposed bES-FEM with SUPG in eliminating the spatial and pressure oscillations, marking it as a promising tool for the exploration of coupled THM issues.


title: A Geometric Application of Soliton Surfaces associated with the Betchov-Da Rios Equation using an Extended Darboux Frame Field in $E^{4}$

abstract: In this paper, for a soliton surface $\Omega=\Omega(u,v)$ associated with the Betchov-Da Rios equation, we obtain the derivative formulas of an extended Darboux frame field of a unit speed curve $u$-parameter curve $\Omega=\Omega(u,v)$ for all $v$. Also, we get the geometric invariants $k$ and $h$ of the soliton surface $\Omega=\Omega(u,v)$ and we obtain the Gaussian curvature, mean curvature vector and Gaussian torsion of $\Omega$. We give some important geometric characterizations such as flatness, minimality and semi-umbilicaly with the aid of these invariants. Additionally, we study the curvature ellipse of the Betchov-Da Rios soliton surface and Wintgen ideal (superconformal) Betchov-Da Rios soliton surface with respect to an extended Darboux frame field. Finally, we construct an application for the Betchov-Da Rios soliton surface with the aid of an extended Darboux frame field.


title: Towards Long Range Detection of Elephants Using Seismic Signals; A Geophone-Sensor Interface for Embedded Systems

abstract: The long-distance detection of the presence of elephants is pivotal to addressing the human-elephant conflict. IoT-based solutions utilizing seismic signals originating from the movement of elephants are a novel approach to solving this problem. This study introduces an instrumentation system comprising a specially designed geophone-sensor interface for non-invasive, long-range elephant detection using seismic waves while minimizing the vulnerability of seismic signals to noise. The geophone-sensor interface involves a cascade array of an instrumentation amplifier, a second-order Butterworth filter for signal filtering, and a signal amplifier. The introduced geophone-sensor interface was tested under laboratory conditions, and then real-world experiments were carried out for tamed, partly tamed, and untamed elephants. The experimental results reveal that the system remains stable within the tested frequency range from 1 Hz to 1 kHz and the temperature range of 10C to 40C. The system successfully captured the seismic signals generated by the footfalls of elephants within a maximum detection range of 155.6 m, with an overall detection accuracy of 99.5%.


title: Maximal Line Digraphs

abstract: A line digraph $L(G) = (A, E)$ is the digraph constructed from the digraph $G = (V, A)$ such that there is an arc $(a,b)$ in $L(G)$ if the terminal node of $a$ in $G$ is the initial node of $b$. The maximum number of arcs in a line digraph with $m$ nodes is $(m/2)^2 + (m/2)$ if $m$ is even, and $((m - 1)/2)^2 + m - 1$ otherwise. For $m \geq 7$, there is only one line digraph with as many arcs if $m$ is even, and if $m$ is odd, there are two line digraphs, each being the transpose of the other.


title: Machine Learning-Driven Optimization of TPMS Architected Materials Using Simulated Annealing

abstract: The research paper presents a novel approach to optimizing the tensile stress of Triply Periodic Minimal Surface (TPMS) structures through machine learning and Simulated Annealing (SA). The study evaluates the performance of Random Forest, Decision Tree, and XGBoost models in predicting tensile stress, using a dataset generated from finite element analysis of TPMS models. The objective function minimized the negative R-squared value on the validation set to enhance model accuracy. The SA-XGBoost model outperformed the others, achieving an R-squared value of 0.96. In contrast, the SA-Random Forest model achieved an R squared value of 0.89 while the SA-Decision Tree model exhibited greater fluctuations in validation scores. This demonstrates that the SA-XGBoost model is most effective in capturing the complex relationships within the data. The integration of SA helps in optimizing the hyperparameters of these machine learning models, thereby enhancing their predictive capabilities.


title: Determining Domain of Machine Learning Models using Kernel Density Estimates: Applications in Materials Property Prediction

abstract: Knowledge of the domain of applicability of a machine learning model is essential to ensuring accurate and reliable model predictions. In this work, we develop a new approach of assessing model domain and demonstrate that our approach provides accurate and meaningful designation of in-domain versus out-of-domain when applied across multiple model types and material property data sets. Our approach assesses the distance between a test and training data point in feature space by using kernel density estimation and shows that this distance provides an effective tool for domain determination. We show that chemical groups considered unrelated based on established chemical knowledge exhibit significant dissimilarities by our measure. We also show that high measures of dissimilarity are associated with poor model performance (i.e., high residual magnitudes) and poor estimates of model uncertainty (i.e., unreliable uncertainty estimation). Automated tools are provided to enable researchers to establish acceptable dissimilarity thresholds to identify whether new predictions of their own machine learning models are in-domain versus out-of-domain.


title: Simulating flow-induced reconfiguration by coupling corotational plate finite elements with a simplified pressure drag

abstract: Developing engineering systems that rely on flow-induced reconfiguration, the phenomenon where a structure deforms under flow to reduce its drag, requires design tools that can predict the behavior of these flexible structures. Current methods include using fully coupled computational fluid dynamics and finite element analysis solvers or highly specialized theories for specific geometries. Coupled numerical methods are computationally expensive to use and non-trivial to setup, while specialized theories are difficult to generalize and take a long time to develop. A compromise between speed, accuracy, and versatility is required to be implemented into the design cycle of flexible structures under flow. This paper offers a new numerical implementation of the pressure drag in the context of a corotational finite element formulation on MATLAB. The presented software is verified against different semi-analytical theories applied to slender plates and disks cut along their radii as well as validated against experiments on kirigami sheets and draping disks.


title: The regulation of symmetry-breaking-dependent electronic structures in ReSeS monolayer

abstract: Due to the excellent physical properties, two dimensional materials have attracted widespread attention from researchers. In this article, we discuss a transition metal dichalcogenide, ReSeS monolayer with 1T" phase, with extremely low symmetry through the first principles calculation. It belongs to the space group P1 and has Jauns structure. Due to the broken of the central inversion symmetry. Raman and infrared active modes in the vibrational spectrum no longer mutually exclusive, which has become a spectral fingerprint of this material. First principles calculation indicates that the bandgap decreases when the material has geometric deformation, and we propose two models to explain this phenomenon and provide the physical pictures. The first model requires constructing a low symmetry Wannier analytically simplify Hamiltonian to obtain 4 energy levels of mixed orbital, Then the changes of bandgap can be qualitatively described through the difference between these energy levels; The second model analyzes the variations of bandgap through the bonding or antibonding characteristics of the valence and conduction band. We point out that it is a "saturation effect", where the energy of the valence and conduction band has difficulties in further changing under the deformation, resulting in the reduction of the bandgap under both compression and tensile deformation. Meanwhile, we discuss a metallic phase of ReSeS, called 1T' phase, to explain the formation of the bandgap. Compared to the 1T" phase, it has higher symmetry. Semi-filled d-orbital bands in 1T' phases will become unstable and split into bonding and antibonding bands, leading to the opening of bandgap. This process is also known as Peierls phase transition. Finally, we calculated the effective mass of electron and the absorption spectrum. Results point out the potential of ReSeS in the preparation of electrical or optical devices.


title: Cross-scale covariance for material property prediction

abstract: A simulation can stand its ground against experiment only if its prediction uncertainty is known. The unknown accuracy of interatomic potentials (IPs) is a major source of prediction uncertainty, severely limiting the use of large-scale classical atomistic simulations in a wide range of scientific and engineering applications. Here we explore covariance between predictions of metal plasticity, from 178 large-scale ($\sim 10^8$ atoms) molecular dynamics (MD) simulations, and a variety of indicator properties computed at small-scales ($\leq 10^2$ atoms). All simulations use the same 178 IPs. In a manner similar to statistical studies in public health, we analyze correlations of strength with indicators, identify the best predictor properties, and build a cross-scale ``strength-on-predictors'' regression model. This model is then used to quantify uncertainty over the statistical pool of IPs. Small-scale predictors found to be highly covariant with strength are computed using expensive quantum-accurate calculations and used to predict flow strength, within the uncertainty bounds established in our statistical study.


title: Convergence Properties of Dynamic Processes on Graphs

abstract: Theoretical computer science plays an important role in the understanding of social networks and their properties. We can model information rippling throughout social networks, or the opinions of social media users for example, using graph theory and Markov chains. In this thesis, we model social networks as graphs, and consider two such processes: 1. Nodes talk to other nodes and find middle ground, causing their opinions to come closer to consensus (the load balancing model) 2. All nodes take the maximum value of their neighbours in lockstep (the synchronous maximum model) We study the convergence behaviours of each process, such as the eventual state of the graph, the convergence time and the period. We provide proofs of the eventual states and periods for each of the above models, and theoretical bounds for the worst case convergence times. We verify these with experiments, and explore further questions such as the average case convergence time of various special classes of graphs, or the convergence times when the model is altered slightly.


title: Photoemission Spectroscopy on photoresist materials: A protocol for analysis of radiation sensitive materials

abstract: Device architectures and dimensions are now at an unimaginable level not thought possible even 10 years ago. The continued downscaling, following the so-called Moore's law, has motivated the development and use of extreme ultraviolet (EUV) lithography scanners with specialized photoresists. Since the quality and precision of the transferred circuit pattern is determined by the EUV induced chemical changes in the photoresist, having a deep understanding of these chemical changes is of pivotal importance. For this purpose, several spectroscopic and material characterization techniques have already been employed so far. Among them, photoemission can be essential as it not only allows direct probing of chemical bonds in a quantitative way but also provides useful information regarding the generation and distribution of primary and secondary electrons. However, since high energy photons are being employed for characterization of a photosensitive material, modification of the sample during the measurement is possible and this must be considered when investigating the chemical changes in the photoresist before and after exposure to EUV light.


title: Effective Data Selection for Seismic Interpretation through Disagreement

abstract: This paper presents a discussion on data selection for deep learning in the field of seismic interpretation. In order to achieve a robust generalization to the target volume, it is crucial to identify the specific samples are the most informative to the training process. The selection of the training set from a target volume is a critical factor in determining the effectiveness of the deep learning algorithm for interpreting seismic volumes. This paper proposes the inclusion of interpretation disagreement as a valuable and intuitive factor in the process of selecting training sets. The development of a novel data selection framework is inspired by established practices in seismic interpretation. The framework we have developed utilizes representation shifts to effectively model interpretation disagreement within neural networks. Additionally, it incorporates the disagreement measure to enhance attention towards geologically interesting regions throughout the data selection workflow. By combining this approach with active learning, a well-known machine learning paradigm for data selection, we arrive at a comprehensive and innovative framework for training set selection in seismic interpretation. In addition, we offer a specific implementation of our proposed framework, which we have named ATLAS. This implementation serves as a means for data selection. In this study, we present the results of our comprehensive experiments, which clearly indicate that ATLAS consistently surpasses traditional active learning frameworks in the field of seismic interpretation. Our findings reveal that ATLAS achieves improvements of up to 12% in mean intersection-over-union.


title: Experimental Bounds on Deformed Muon Lifetime Dilation

abstract: We analyze Planck scale induced modifications of the relativistic time dilation using data from the Muon Storage Ring experiment at CERN. By examining the lifetimes of muons, we establish, for the first time, a constraint on such quantum gravity-inspired deformations using this channel.


title: CredSec: A Blockchain-based Secure Credential Management System for University Adoption

abstract: University education play a critical role in shaping intellectual and professional development of the individuals and contribute significantly to the advancement of knowledge and society. Generally, university authority has a direct control of students result making and stores the credential in their local dedicated server. So, there is chance to alter the credential and also have a very high possibility to encounter various threats and different security attacks. To resolve these, we propose a blockchain based secure credential management system (BCMS) for efficiently storing, managing and recovering credential without involving the university authority. The proposed BCMS incorporates a modified two factor encryption (m2FE) technique, a combination of RSA cryptosystem and a DNA encoding to ensure credential privacy and an enhanced authentication scheme for teachers and students. Besides, to reduce size of the cipher credential and its conversion time, we use character to integer (C2I) table instead of ASCII table. Finally, the experimental result and analysis of the BCMS illustrate the effectiveness over state of the art works.


title: Fight Scene Detection for Movie Highlight Generation System

abstract: In this paper of a research based project, using Bidirectional Long Short-Term Memory (BiLSTM) networks, we provide a novel Fight Scene Detection (FSD) model which can be used for Movie Highlight Generation Systems (MHGS) based on deep learning and Neural Networks . Movies usually have Fight Scenes to keep the audience amazed. For trailer generation, or any other application of Highlight generation, it is very tidious to first identify all such scenes manually and then compile them to generate a highlight serving the purpose. Our proposed FSD system utilises temporal characteristics of the movie scenes and thus is capable to automatically identify fight scenes. Thereby helping in the effective production of captivating movie highlights. We observe that the proposed solution features 93.5% accuracy and is higher than 2D CNN with Hough Forests which being 92% accurate and is significantly higher than 3D CNN which features an accuracy of 65%.


title: Elastic Full-Waveform Inversion : How the physics of problem improves data-driven techniques?

abstract: Full-Waveform Inversion (FWI) is a nonlinear iterative seismic imaging technique that, by reducing the misfit between recorded and predicted seismic waveforms, can produce detailed estimates of subsurface geophysical properties. Nevertheless, the strong nonlinearity of FWI can trap the optimization in local minima. This issue arises due to factors such as improper initial values, the absence of low frequencies in the measurements, noise, and other related considerations. To address this challenge and with the advent of advanced machine-learning techniques, data-driven methods, such as deep learning, have attracted significantly increasing attention in the geophysical community. Furthermore, the elastic wave equation should be included in FWI to represent elastic effects accurately. The intersection of data-driven techniques and elastic scattering theories presents opportunities and challenges. In this paper, by using the knowledge of elastic scattering (Physics of problem) and integrating it with deep learning techniques, we propose methods for the solution of time-harmonic FWI to enhance accuracy compared to pure data-driven approaches. Moreover, by modifying the structure of the Variational Autoencoder, we introduce a probabilistic deep learning method based on the physics of the problem that enables us to explore the uncertainties of the solution. According to the limited availability of datasets in this field and to assess the performance and accuracy of the proposed methods, we create a comprehensive dataset close to reality and conduct a comparative analysis of the presented approaches to it.


title: Superstep wavefield propagation

abstract: This paper describes how to propagate wavefields for arbitrary numbers of traditional time steps in a single step, called a superstep. We show how to construct operators that accomplish this task for finite-difference time domain schemes, including temporal first-order schemes in isotropic, anisotropic and elastic media, as well as temporal second-order schemes for acoustic media. This task is achieved by implementing a computational tradeoff differing from traditional single step wavefield propagators by precomputing propagator matrices for each model location for k timesteps (a superstep) and using these propagator matrices to advance the wavefield k time steps at once. This tradeoff separates the physics of the propagator matrix computation from the computer science of wavefield propagation and allows each discipline to provide their optimal modular solutions.


title: Multifractality and hyperuniformity in quasicrystalline Bose-Hubbard models with and without disorder

abstract: Clarifying similarities and differences in physical properties between crystalline and quasicrystalline systems is one of central issues in studying quasicrystals. To contribute to this, we apply multifractal and hyperuniform analyses to nonuniform spatial patterns in the Bose-Hubbard model on the Penrose and Ammann-Beenker tilings. Based on the mean-field approximation, we obtain real-space distributions of boson density and bosonic condensate. In both Mott insulating and superfluid phases, the distributions are hyperuniform. Analyzing the order metric that quantifies the complexity of nonuniform spatial patterns, we find that both quasicrystals show a divergence of the order metric at a phase boundary between the Mott insulating and superfluid phases, in stark contrast to the case of a periodic square lattice. Our results suggest that hyperuniformity is a useful concept to differentiate between crystalline and quasicrystalline bosonic systems. Moreover, we introduce on-site random potentials into these quasicrystalline Bose-Hubbard models, leading to a Bose glass phase. Contrary to the Mott insulating and superfluid phases, we find that the Bose glass phase is multifractal. The same multifractality appears on a Bose glass phase in the periodic square lattice. Therefore, multifractality is common in a Bose glass phase irrespective of the periodicity of systems.

categories: cond-mat.quant-gas cond-mat.dis-nn cond-mat.stat-mech cond-mat.str-el