title: Resilient Containment Control of Heterogeneous Multi-Agent Systems Against Unbounded Sensor and Actuator Attacks

abstract: Accurate local state measurement is important to ensure the reliable operation of distributed multi-agent systems (MAS). Existing fault-tolerant control strategies generally assume the sensor faults to be bounded and uncorrelated. In this paper, we study the ramifications of allowing the sensor attack injections to be unbounded and correlated. These malicious sensor attacks may bypass the conventional attack-detection methods and compromise the cooperative performance and even stability of the distributed networked MAS. Moreover, the attackers may gain access to the actuation computing channels and manipulate the control input commands. To this end, we consider the resilient containment control problem of general linear heterogeneous MAS in the face of correlated and unbounded sensor attacks, as well as general unbounded actuator attacks. We propose an attack-resilient control framework to guarantee the uniform ultimate boundedness of the closed-loop dynamical systems and preserve the bounded containment performance. Compared with existing literature addressing bounded faults and/or disturbances that are unintentionally caused in the sensor and actuator channels, the proposed control protocols are resilient against unknown unbounded attack signals simultaneously injected into sensor and actuator channels, and hence are more practical in the real-world security applications. A numerical example illustrates the efficacy of the proposed result, by highlighting the resilience improvement over the conventional cooperative control method.


title: Augmenting a Physics-Informed Neural Network for the 2D Burgers Equation by Addition of Solution Data Points

abstract: We implement a Physics-Informed Neural Network (PINN) for solving the two-dimensional Burgers equations. This type of model can be trained with no previous knowledge of the solution; instead, it relies on evaluating the governing equations of the system in points of the physical domain. It is also possible to use points with a known solution during training. In this paper, we compare PINNs trained with different amounts of governing equation evaluation points and known solution points. Comparing models that were trained purely with known solution points to those that have also used the governing equations, we observe an improvement in the overall observance of the underlying physics in the latter. We also investigate how changing the number of each type of point affects the resulting models differently. Finally, we argue that the addition of the governing equations during training may provide a way to improve the overall performance of the model without relying on additional data, which is especially important for situations where the number of known solution points is limited.


title: XTrace: Making the most of every sample in stochastic trace estimation

abstract: The implicit trace estimation problem asks for an approximation of the trace of a square matrix, accessed via matrix-vector products (matvecs). This paper designs new randomized algorithms, XTrace and XNysTrace, for the trace estimation problem by exploiting both variance reduction and the exchangeability principle. For a fixed budget of matvecs, numerical experiments show that the new methods can achieve errors that are orders of magnitude smaller than existing algorithms, such as the Girard-Hutchinson estimator or the Hutch++ estimator. A theoretical analysis confirms the benefits by offering a precise description of the performance of these algorithms as a function of the spectrum of the input matrix. The paper also develops an exchangeable estimator, XDiag, for approximating the diagonal of a square matrix using matvecs.


title: Quadratic-soliton-enhanced mid-IR molecular sensing

abstract: Optical solitons have long been of interest both from a fundamental perspective and because of their application potential. Both cubic (Kerr) and quadratic nonlinearities can lead to soliton formation, but quadratic solitons can practically benefit from stronger nonlinearity and achieve substantial wavelength conversion. However, despite their rich physics, quadratic cavity solitons have been used only for broadband frequency comb generation, especially in the mid-IR. Here, we show that the formation dynamics of mid-IR quadratic cavity solitons can be effectively leveraged to enhance molecular sensing. We demonstrate significant sensitivity enhancement while circumventing constraints of traditional cavity enhancement mechanisms. We perform experiments sensing CO$_2$ using quadratic cavity solitons around 4 $\mu$m and achieve an equivalent path length enhancement of 6000. Additionally, we demonstrate large sensitivity at high concentrations of CO$_2$, beyond what can be achieved using an equivalent high-finesse linear cavity by orders of magnitude. Our results highlight a path for utilizing quadratic cavity nonlinear dynamics and solitons for molecular sensing beyond what can be achieved using linear methods.


title: Highly sensitive detection of magneto-optical markers based on magneto-optical gate effect

abstract: In this paper, a new concept of magnetic nanoparticles as magneto-optical markers is proposed, and a "magneto-optical gate" effect is explored. High-sensitivity detection of magnetic nanoparticles (MNPs) was developed based on this principle. Under irradiation from monochromatic light with a wavelength much larger than the size of a given MNP, Rayleigh scattering occurs on the MNP surface. The MNPs anisotropic and orientate themselves into chains, meaning that the Rayleigh scattering now decreases under magnetic field excitation. After applying an AC magnetic field of frequency f, the transmitted light passing through the MNPs reagent generates an AC signal with a frequency of 2f. Moreover, the 2f signal disappears after removal of the magnetic field. This creates a "magneto-optical gate" effect. The instantaneous and highly sensitive detection of magneto-optical markers with a concentration of 0.2 {\mu}g/mL and an effective optical path length of 10 {\mu}m is realized based on this "magneto-optical gate" effect.


title: On invariant means and pre-syndetic subgroups

abstract: Beyond the locally compact case, equivalent notions of amenability diverge, and some properties no longer hold, for instance amenability is not inherited by topological subgroups. This investigation is guided by some amenability-type properties of groups of paths and loops. It is shown that a version of amenability called skew-amenability is inherited by pre-syndetic subgroups in the sense of Basso and Zucker (in particular, by co-compact subgroups). It follows that co-compact subgroups of amenable topological groups whose left and right uniformities coincide are amenable. We discuss a version of amenability belonging to P. Malliavin and M.-P. Malliavin: the existence of a mean on bounded Borel functions that is invariant under the left action of a dense subgroup. We observe that this property is in general strictly stronger than amenability, and establish for it Reiter- and F{\o}lner-type criteria. Finally, there is a review of open problems.


title: Warning: Humans Cannot Reliably Detect Speech Deepfakes

abstract: Speech deepfakes are artificial voices generated by machine learning models. Previous literature has highlighted deepfakes as one of the biggest security threats arising from progress in artificial intelligence due to their potential for misuse. However, studies investigating human detection capabilities are limited. We presented genuine and deepfake audio to n = 529 individuals and asked them to identify the deepfakes. We ran our experiments in English and Mandarin to understand if language affects detection performance and decision-making rationale. We found that detection capability is unreliable. Listeners only correctly spotted the deepfakes 73% of the time, and there was no difference in detectability between the two languages. Increasing listener awareness by providing examples of speech deepfakes only improves results slightly. As speech synthesis algorithms improve and become more realistic, we can expect the detection task to become harder. The difficulty of detecting speech deepfakes confirms their potential for misuse and signals that defenses against this threat are needed.


title: Fixed-point iterative algorithm for SVI model

abstract: The stochastic volatility inspired (SVI) model is widely used to fit the implied variance smile. Presently, most optimizer algorithms for the SVI model have a strong dependence on the input starting point. In this study, we develop an efficient iterative algorithm for the SVI model based on a fixed-point and least-square optimizer. Furthermore, we present the convergence results in certain situations for this novel iterative algorithm. Compared with the quasi-explicit SVI method, we demonstrate the advantages of the fixed-point iterative algorithm using simulation and market data.


title: Multi-output multilevel best linear unbiased estimators via semidefinite programming

abstract: Multifidelity forward uncertainty quantification (UQ) problems often involve multiple quantities of interest and heterogeneous models (e.g., different grids, equations, dimensions, physics, surrogate and reduced-order models). While computational efficiency is key in this context, multi-output strategies in multilevel/multifidelity methods are either sub-optimal or non-existent. In this paper we extend multilevel best linear unbiased estimators (MLBLUE) to multi-output forward UQ problems and we present new semidefinite programming formulations for their optimal setup. Not only do these formulations yield the optimal number of samples required, but also the optimal selection of low-fidelity models to use. While existing MLBLUE approaches are single-output only and require a non-trivial nonlinear optimization procedure, the new multi-output formulations can be solved reliably and efficiently. We demonstrate the efficacy of the new methods and formulations in practical UQ problems with model heterogeneity.


title: Internal and external alignment of carbonaceous grains within the radiative torque paradigm

abstract: We study the internal and external alignment of carbonaceous grains, including graphite and hydrogenated amorphous carbon (HAC), in the interstellar medium (ISM) within the RAdiative Torque (RAT) paradigm. For internal alignment (IA), we find that HAC grains having nuclear paramagnetism due to hydrogen protons can have efficient nuclear relaxation, whereas both HAC and graphite grains can have efficient inelastic relaxation for grains aligned both at low$-J$ and high$-J$ attractors. For external alignment, HAC and graphite grains can align with the radiation direction ($k$-RAT) at low$-J$ attractors but cannot have stable alignment at high$-J$ attractors due to the suppression of radiative precession. HAC also has slow Larmor precession compared to the randomization by gas collisions and cannot be aligned with the magnetic field ($B$-RAT). Small HAC grains of $a<0.05\mu$m drifting through the diffuse ISM can be weakly aligned along the induced electric field ($E$-RAT) at high$-J$ attractors due to its fast precession. Paramagnetic relaxation by nuclear magnetism is found inefficient for HAC grains due to the rapid suppression of nuclear susceptibility when grains rotate at high$-J$ attractors. We then study the alignment of carbon dust in the envelope of a typical C-rich Asymptotic Giant Branch star, IRC+10216. We find that grains aligned at low$-J$ attractors can occur via $k$-RAT with the wrong IA in the inner region but via $B$-RAT in the outermost region. However, grains aligned at high$-J$ attractors have the right IA alignment via $k$-RAT due to efficient inelastic relaxation. The polarization pattern observed toward IRC+10216 by SOFIA/HAWC+ can reproduced when only grains at low$-J$ attractors are present due to removal of grains at high$-J$ attractors by the RAT disruption.


title: Single Higgs Boson Production at Electron-Positron Colliders in Gauge-Higgs Unification

abstract: We examine contributions to single Higgs boson production processes via $Z'$ and $W'$ bosons in the $SU(3)_C\times SO(5)_W\times U(1)_X$ gauge-Higgs unification (GHU) model. In particular, we analyze the cross sections of three single Higgs boson production processes $e^-e^+\to Zh$, $e^-e^+\to \nu\bar{\nu}h$, and $e^-e^+\to e^-e^+h$ in the SM and the GHU model. For the Higgs strahlung process $e^-e^+\to Zh$, we show that for a parameter region satisfying the current experimental constraints, a maximum deviation from the SM is about up to 6% for the center-of-mass energy of the initial electron and positron $\sqrt{s}=250$ GeV and that from the SM is about up to 20% for $\sqrt{s}=500$ GeV, depending on the initial polarization of electron and positron. The deviation from the SM is monotonically increasing with respect to $\sqrt{s}$ for $\sqrt{s}\lesssim 1$ TeV. By using the Higgs strahlung process, it is possible to explore up to the region of tens of TeV in terms of the Kaluza-Klein (KK) mass. We also show that the sign of the bulk mass of a lepton multiplet in the GHU model can be determined by examining the deviation of the left-right symmetry of the $e^-e^+\to Zh$ process from the SM. The contributions to the cross sections of the $e^-e^+\to \nu\bar{\nu}h$ and $e^-e^+\to e^-e^+h$ processes via the $Z'$ and $W'$ bosons are relatively small compared to that for $e^-e^+\to Zh$ at least for $\sqrt{s}\leq 1$ TeV. As is the same as in the SM, the $e^-e^+\to\nu\bar{\nu}h$ process gives a main contribution to the single Higgs boson production processes for $\sqrt{s}\gtrsim 500$ GeV, but large deviations from the SM are only observed on energy scales close to the masses of the first KK gauge bosons or higher.


title: Cutting the traintracks: Cauchy, Schubert and Calabi-Yau

abstract: In this note we revisit the maximal-codimension residues, or leading singularities, of four-dimensional $L$-loop traintrack integrals with massive legs, both in Feynman parameter space and in momentum (twistor) space. We identify a class of "half traintracks" as the most general degenerations of traintracks with conventional (0-form) leading singularities, although the integrals themselves still have rigidity $\lfloor\frac{L-1}2\rfloor$ due to lower-loop "full traintrack'' subtopologies. As a warm-up exercise, we derive closed-form expressions for their leading singularities both via (Cauchy's) residues in Feynman parameters, and more geometrically using the so-called Schubert problems in momentum twistor space. For $L$-loop full traintracks, we compute their leading singularities as integrals of $(L{-}1)$-forms, which proves that the rigidity is $L{-}1$ as expected; the form is given by an inverse square root of an irreducible polynomial quartic with respect to each variable, which characterizes an $(L{-}1)$-dim Calabi-Yau manifold (elliptic curve, K3 surface, etc.) for any $L$. We also briefly comment on the implications for the "symbology" of these traintrack integrals.


title: Decision-Focused Evaluation: Analyzing Performance of Deployed Restless Multi-Arm Bandits

abstract: Restless multi-arm bandits (RMABs) is a popular decision-theoretic framework that has been used to model real-world sequential decision making problems in public health, wildlife conservation, communication systems, and beyond. Deployed RMAB systems typically operate in two stages: the first predicts the unknown parameters defining the RMAB instance, and the second employs an optimization algorithm to solve the constructed RMAB instance. In this work we provide and analyze the results from a first-of-its-kind deployment of an RMAB system in public health domain, aimed at improving maternal and child health. Our analysis is focused towards understanding the relationship between prediction accuracy and overall performance of deployed RMAB systems. This is crucial for determining the value of investing in improving predictive accuracy towards improving the final system performance, and is useful for diagnosing, monitoring deployed RMAB systems. Using real-world data from our deployed RMAB system, we demonstrate that an improvement in overall prediction accuracy may even be accompanied by a degradation in the performance of RMAB system -- a broad investment of resources to improve overall prediction accuracy may not yield expected results. Following this, we develop decision-focused evaluation metrics to evaluate the predictive component and show that it is better at explaining (both empirically and theoretically) the overall performance of a deployed RMAB system.


title: Masked Autoencoding Does Not Help Natural Language Supervision at Scale

abstract: Self supervision and natural language supervision have emerged as two exciting ways to train general purpose image encoders which excel at a variety of downstream tasks. Recent works such as M3AE and SLIP have suggested that these approaches can be effectively combined, but most notably their results use small pre-training datasets (<50M samples) and don't effectively reflect the large-scale regime (>100M examples) that is commonly used for these approaches. Here we investigate whether a similar approach can be effective when trained with a much larger amount of data. We find that a combination of two state of the art approaches: masked auto-encoders, MAE and contrastive language image pre-training, CLIP provides a benefit over CLIP when trained on a corpus of 11.3M image-text pairs, but little to no benefit (as evaluated on a suite of common vision tasks) over CLIP when trained on a large corpus of 1.4B images. Our work provides some much needed clarity into the effectiveness (or lack thereof) of self supervision for large-scale image-text training.


title: Distributed Reproduction Numbers of Networked Epidemics

abstract: Reproduction numbers are widely used for the estimation and prediction of epidemic spreading processes over networks. However, reproduction numbers do not enable estimation and prediction in individual communities within networks, and they can be difficult to compute due to the aggregation of infection data that is required to do so. Therefore, in this work we propose a novel concept of distributed reproduction numbers to capture the spreading behaviors of each entity in the network, and we show how to compute them using certain parameters in networked SIS and SIR epidemic models. We use distributed reproduction numbers to derive new conditions under which an outbreak can occur. These conditions are then used to derive new conditions for the existence, uniqueness, and stability of equilibrium states. Finally, in simulation we use synthetic infection data to illustrate how distributed reproduction numbers provide more fine-grained analyses of networked spreading processes than ordinary reproduction numbers.


title: Robust Chauvenet Rejection: Powerful, but Easy to Use Outlier Detection for Heavily Contaminated Data Sets

abstract: In Maples et al. (2018) we introduced Robust Chauvenet Outlier Rejection, or RCR, a novel outlier rejection technique that evolves Chauvenet's Criterion by sequentially applying different measures of central tendency and empirically determining the rejective sigma value. RCR is especially powerful for cleaning heavily-contaminated samples, and unlike other methods such as sigma clipping, it manages to be both accurate and precise when characterizing the underlying uncontaminated distributions of data sets, by using decreasingly robust but increasingly precise statistics in sequence. For this work, we present RCR from a software standpoint, newly implemented as a Python package while maintaining the speed of the C++ original. RCR has been well-tested, calibrated and simulated, and it can be used for both one-dimensional outlier rejection and $n$-dimensional model-fitting, with or without weighted data. RCR is free to use for academic and non-commercial purposes, and the code, documentation and accompanying web calculator can be found and easily used online at https://github.com/nickk124/RCR


title: Theory of Cation Solvation and Ionic Association in Non-Aqueous Solvent Mixtures

abstract: Conventional lithium-ion batteries, and many next-generation technologies, rely on organic electrolytes with multiple solvents to achieve the desired physicochemical and interfacial properties. The complex interplay between these properties can often be elucidated via the coordination environment of the cation. We develop a theory for the coordination shell of cations in non-aqueous solvent mixtures that can be applied with high fidelity, up to super-concentrated electrolytes. Our theory can naturally explain simulation and experimental values of cation solvation in ''classical'' non-aqueous electrolytes. Moreover, we utilise our theory to understand general design principles of emerging classes of non-aqueous electrolyte mixtures, such as high entropy electrolytes. It is hoped that this theory provides a systematic framework to understand simulations and experiments which engineer the solvation structure and ionic associations of concentrated non-aqueous electrolytes.


title: Multifrequency microwave imaging of weak transients from the quiet solar corona

abstract: Understanding the dynamics of the quiet solar corona is important for answering key questions including the coronal heating problem. Multiple studies have suggested small-scale magnetic reconnection events may play a crucial role. These reconnection events are expected to involve acceleration of electrons to suprathermal energies, which can then produce nonthermal observational signatures. However, due to the paucity of sensitive high-fidelity observations capable of probing these nonthermal signatures, most studies were unable to quantify their nonthermal nature. Here we use joint radio observations from the Very Large Array (VLA) and the Expanded Owens Valley Solar Array (EOVSA) to detect transient emissions from the quiet solar corona in the microwave (GHz) domain. While similar transients have been reported in the past, their nonthermal nature could not be adequately quantified due to the unavailability of broadband observations. Using a much larger bandwidth available now with the VLA and EOVSA, in this study, we are able to quantify the nonthermal energy associated with two of these transients. We find that the total nonthermal energy associated with some of these transients can be comparable to or even larger than the total thermal energy of a nanoflare, which underpins the importance of nonthermal energy in the total coronal energy budget.


title: Quantum-parallel vectorized data encodings and computations on trapped-ions and transmons QPUs

abstract: Compact quantum data representations are essential to the emerging field of quantum algorithms for data analysis. We introduce two new data encoding schemes, QCrank and QBArt, which have a high degree of quantum parallelism through uniformly controlled rotation gates. QCrank encodes a sequence of real-valued data as rotations of the data qubits, allowing for high storage density. QBArt directly embeds a binary representation of the data in the computational basis, requiring fewer quantum measurements and lending itself to well-understood arithmetic operations on binary data. We present several applications of the proposed encodings for different types of data. We demonstrate quantum algorithms for DNA pattern matching, Hamming weight calculation, complex value conjugation, and retrieving an O(400) bits image, all executed on the Quantinuum QPU. Finally, we use various cloud-accessible QPUs, including IBMQ and IonQ, to perform additional benchmarking experiments.


title: A Light-Weight Communication-Efficient Data Sharing Approach in 5G NR V2X

abstract: Timeliness of information is critical for Basic Safety Messages (BSMs) in Vehicle-to-Everything (V2X) communication to enable highly reliable autonomous driving. However, the current semi-persistent scheduling (SPS) algorithms in the 5th generation New Radio (5G NR) standard can still generate collisions probability, close to 20% with 100 vehicles per kilometer, such that they cannot meet this requirement for BSMs. This paper proposes a Ledger concept, which can communicate collision information to every vehicle in the network within one Resource Reservation Interval (RRI) through the broadcasting of Ledger information. The colliding vehicle is aware that it has collided with other vehicles and will reselect for the next SPS period. Besides that, other protocols follow the SPS. Although it sacrifices 14.29% of resources by including Ledger, it can eventually reduce the collision probability. In this paper, a Monte Carlo simulator is used to verify and analyze the performance of the Ledger system. Numerical results show that abide by the SPS protocol, the Ledger system can make the collision probability converge to zero after amount of RRIs.


title: Spatio-temporal neural structural causal models for bike flow prediction

abstract: As a representative of public transportation, the fundamental issue of managing bike-sharing systems is bike flow prediction. Recent methods overemphasize the spatio-temporal correlations in the data, ignoring the effects of contextual conditions on the transportation system and the inter-regional timevarying causality. In addition, due to the disturbance of incomplete observations in the data, random contextual conditions lead to spurious correlations between data and features, making the prediction of the model ineffective in special scenarios. To overcome this issue, we propose a Spatio-temporal Neural Structure Causal Model(STNSCM) from the perspective of causality. First, we build a causal graph to describe the traffic prediction, and further analyze the causal relationship between the input data, contextual conditions, spatiotemporal states, and prediction results. Second, we propose to apply the frontdoor criterion to eliminate confounding biases in the feature extraction process. Finally, we propose a counterfactual representation reasoning module to extrapolate the spatio-temporal state under the factual scenario to future counterfactual scenarios to improve the prediction performance. Experiments on real-world datasets demonstrate the superior performance of our model, especially its resistance to fluctuations caused by the external environment. The source code and data will be released.


title: Topological flat bands in strained graphene: substrate engineering and optical control

abstract: The discovery of correlated phases in twisted moir\'e superlattices accelerated the search for low-dimensional materials with exotic properties. A promising approach uses engineered substrates to strain the material. However, designing substrates for tailored properties is hindered by the incomplete understanding of the relationship between substrate's shapes and electronic properties of the deposited materials. By analyzing effective models of graphene under periodic deformations with generic crystalline profiles, we identify strong $C_{2z}$ symmetry breaking as the critical substrate geometric feature for emerging energy gaps and quasi-flat bands. We find continuous strain profiles producing connected pseudo-magnetic field landscapes are important for band topology. We show that the resultant electronic and topological properties from a substrate can be controlled with circularly polarized light, which also offers unique signatures for identifying the band topology imprinted by strain. Our results can guide experiments on strain engineering for exploring interesting transport and topological phenomena.


title: Foresee What You Will Learn: Data Augmentation for Domain Generalization in Non-stationary Environment

abstract: Existing domain generalization aims to learn a generalizable model to perform well even on unseen domains. For many real-world machine learning applications, the data distribution often shifts gradually along domain indices. For example, a self-driving car with a vision system drives from dawn to dusk, with the sky darkening gradually. Therefore, the system must be able to adapt to changes in ambient illumination and continue to drive safely on the road. In this paper, we formulate such problems as Evolving Domain Generalization, where a model aims to generalize well on a target domain by discovering and leveraging the evolving pattern of the environment. We then propose Directional Domain Augmentation (DDA), which simulates the unseen target features by mapping source data as augmentations through a domain transformer. Specifically, we formulate DDA as a bi-level optimization problem and solve it through a novel meta-learning approach in the representation space. We evaluate the proposed method on both synthetic datasets and realworld datasets, and empirical results show that our approach can outperform other existing methods.


title: ClusterLog: Clustering Logs for Effective Log-based Anomaly Detection

abstract: With the increasing prevalence of scalable file systems in the context of High Performance Computing (HPC), the importance of accurate anomaly detection on runtime logs is increasing. But as it currently stands, many state-of-the-art methods for log-based anomaly detection, such as DeepLog, have encountered numerous challenges when applied to logs from many parallel file systems (PFSes), often due to their irregularity and ambiguity in time-based log sequences. To circumvent these problems, this study proposes ClusterLog, a log pre-processing method that clusters the temporal sequence of log keys based on their semantic similarity. By grouping semantically and sentimentally similar logs, this approach aims to represent log sequences with the smallest amount of unique log keys, intending to improve the ability of a downstream sequence-based model to effectively learn the log patterns. The preliminary results of ClusterLog indicate not only its effectiveness in reducing the granularity of log sequences without the loss of important sequence information but also its generalizability to different file systems' logs.


title: Stability for Time-domain Elastic Wave Equations

abstract: This paper is concerned with the inverse scattering problem involving the time-domain elastic wave equations in a bounded $d$-dimensional domain. First, an explicit reconstruction formula for the density is established by means of the Dirichlet-to-Neumann operator. The reconstruction is mainly based on the modified boundary control method and complex geometric optics solutions for the elastic wave. Next, the stable observability is obtained by a Carleman estimate. Finally, the stability for the density is presented by the connect operator.


title: Disentangling Losses in Tantalum Superconducting Circuits

abstract: Superconducting qubits are a leading system for realizing large scale quantum processors, but overall gate fidelities suffer from coherence times limited by microwave dielectric loss. Recently discovered tantalum-based qubits exhibit record lifetimes exceeding 0.3 ms. Here we perform systematic, detailed measurements of superconducting tantalum resonators in order to disentangle sources of loss that limit state-of-the-art tantalum devices. By studying the dependence of loss on temperature, microwave photon number, and device geometry, we quantify materials-related losses and observe that the losses are dominated by several types of saturable two level systems (TLSs), with evidence that both surface and bulk related TLSs contribute to loss. Moreover, we show that surface TLSs can be altered with chemical processing. With four different surface conditions, we quantitatively extract the linear absorption associated with different surface TLS sources. Finally, we quantify the impact of the chemical processing at single photon powers, the relevant conditions for qubit device performance. In this regime we measure resonators with internal quality factors ranging from 5 to 15 x 10^6, comparable to the best qubits reported. In these devices the surface and bulk TLS contributions to loss are comparable, showing that systematic improvements in materials on both fronts will be necessary to improve qubit coherence further.


title: Efficient Computation in Congested Anonymous Dynamic Networks

abstract: An anonymous dynamic network is a network of indistinguishable processes whose communication links may appear or disappear unpredictably over time. Previous research has shown that deterministically computing an arbitrary function of a multiset of input values given to these processes takes only a linear number of communication rounds (Di Luna-Viglietta, FOCS 2022). However, fast algorithms for anonymous dynamic networks rely on the construction and transmission of large data structures called "history trees", whose size is polynomial in the number of processes. This approach is unfeasible if the network is congested, and only messages of logarithmic size can be sent through its links. Observe that sending a large message piece by piece over several rounds is not in itself a solution, due to the anonymity of the processes combined with the dynamic nature of the network. Moreover, it is known that certain basic tasks such as all-to-all token dissemination (by means of single-token forwarding) require $\Omega(n^2/\log n)$ rounds in congested networks (Dutta et al., SODA 2013). In this work, we develop a series of practical and efficient techniques that make it possible to use history trees in congested anonymous dynamic networks. Among other applications, we show how to compute arbitrary functions in such networks in $O(n^3)$ communication rounds, greatly improving upon previous state-of-the-art algorithms for congested networks.


title: Concept Discovery for Fast Adapatation

abstract: The advances in deep learning have enabled machine learning methods to outperform human beings in various areas, but it remains a great challenge for a well-trained model to quickly adapt to a new task. One promising solution to realize this goal is through meta-learning, also known as learning to learn, which has achieved promising results in few-shot learning. However, current approaches are still enormously different from human beings' learning process, especially in the ability to extract structural and transferable knowledge. This drawback makes current meta-learning frameworks non-interpretable and hard to extend to more complex tasks. We tackle this problem by introducing concept discovery to the few-shot learning problem, where we achieve more effective adaptation by meta-learning the structure among the data features, leading to a composite representation of the data. Our proposed method Concept-Based Model-Agnostic Meta-Learning (COMAML) has been shown to achieve consistent improvements in the structured data for both synthesized datasets and real-world datasets.


title: From English to More Languages: Parameter-Efficient Model Reprogramming for Cross-Lingual Speech Recognition

abstract: In this work, we propose a new parameter-efficient learning framework based on neural model reprogramming for cross-lingual speech recognition, which can \textbf{re-purpose} well-trained English automatic speech recognition (ASR) models to recognize the other languages. We design different auxiliary neural architectures focusing on learnable pre-trained feature enhancement that, for the first time, empowers model reprogramming on ASR. Specifically, we investigate how to select trainable components (i.e., encoder) of a conformer-based RNN-Transducer, as a frozen pre-trained backbone. Experiments on a seven-language multilingual LibriSpeech speech (MLS) task show that model reprogramming only requires 4.2% (11M out of 270M) to 6.8% (45M out of 660M) of its original trainable parameters from a full ASR model to perform competitive results in a range of 11.9% to 8.1% WER averaged across different languages. In addition, we discover different setups to make large-scale pre-trained ASR succeed in both monolingual and multilingual speech recognition. Our methods outperform existing ASR tuning architectures and their extension with self-supervised losses (e.g., w2v-bert) in terms of lower WER and better training efficiency.


title: On an inverse problem for the plate equation with passive measurement

abstract: This paper focuses on an inverse problem associated with the plate equation which is derived from models in fluid mechanics and elasticity. We establish the unique identifying results in simultaneously determining both the unknown density and internal sources from passive boundary measurement. The proof mainly relies on the asymptotic analysis and harmonic analysis on integral transforms


title: DECISIVE Benchmarking Data Report: sUAS Performance Results from Phase I

abstract: This report reviews all results derived from performance benchmarking conducted during Phase I of the Development and Execution of Comprehensive and Integrated Subterranean Intelligent Vehicle Evaluations (DECISIVE) project by the University of Massachusetts Lowell, using the test methods specified in the DECISIVE Test Methods Handbook v1.1 for evaluating small unmanned aerial systems (sUAS) performance in subterranean and constrained indoor environments, spanning communications, field readiness, interface, obstacle avoidance, navigation, mapping, autonomy, trust, and situation awareness. Using those 20 test methods, over 230 tests were conducted across 8 sUAS platforms: Cleo Robotics Dronut X1P (P = prototype), FLIR Black Hornet PRS, Flyability Elios 2 GOV, Lumenier Nighthawk V3, Parrot ANAFI USA GOV, Skydio X2D, Teal Golden Eagle, and Vantage Robotics Vesper. Best in class criteria is specified for each applicable test method and the sUAS that match this criteria are named for each test method, including a high-level executive summary of their performance.


title: FE-TCM: Filter-Enhanced Transformer Click Model for Web Search

abstract: Constructing click models and extracting implicit relevance feedback information from the interaction between users and search engines are very important to improve the ranking of search results. Using neural network to model users' click behaviors has become one of the effective methods to construct click models. In this paper, We use Transformer as the backbone network of feature extraction, add filter layer innovatively, and propose a new Filter-Enhanced Transformer Click Model (FE-TCM) for web search. Firstly, in order to reduce the influence of noise on user behavior data, we use the learnable filters to filter log noise. Secondly, following the examination hypothesis, we model the attraction estimator and examination predictor respectively to output the attractiveness scores and examination probabilities. A novel transformer model is used to learn the deeper representation among different features. Finally, we apply the combination functions to integrate attractiveness scores and examination probabilities into the click prediction. From our experiments on two real-world session datasets, it is proved that FE-TCM outperforms the existing click models for the click prediction.


title: Digital Divide: Empirical Study of CIUS 2020

abstract: Canada and other major countries are investigating the implementation of ``digital money'' or Central Bank Digital Currencies, necessitating answers to key questions about how demographic and geographic factors influence the population's digital literacy. This paper uses the Canadian Internet Use Survey (CIUS) 2020 and survey versions of Lasso inference methods to assess the digital divide in Canada and determine the relevant factors that influence it. We find that a significant divide in the use of digital technologies, e.g., online banking and virtual wallet, continues to exist across different demographic and geographic categories. We also create a digital divide score that measures the survey respondents' digital literacy and provide multiple correspondence analyses that further corroborate these findings.


title: BD+30$^\circ$549: young helium-weak silicon star in NGC 1333 star-forming region

abstract: We present results of the spectroscopic study of the chemically peculiar star BD+30$^\circ$549 which is bona-fide member of young NGC 1333 star forming region. We found that the star possesses negligible rotation and helium-weak spectroscopic pattern with strongly enhanced Si II and Si III lines. The fundamental parameters of the star $T_{eff}$=13100~K and $\log (L/L_{\odot})$=2.1 indicate its age of about 2.7 Myr and position on the Hertzsprung-Russell diagram at the end of the Pre-Main Sequence evolutionary track, close to the Zero Age Main Sequence. Abundance analysis reveals the modest deficit of almost all elements with exception of Si, Fe, Ca and P which are overabundant. We performed the non-LTE calculations for Si II/Si III, Mg II and Ca II in order to check the influence of departures from LTE on line formation. Non-LTE calculations lead to much better reproduction of individual silicon line profiles, but does not completely remove the abundance discrepancy between Si II and Si III lines. We also investigate the effects of possible chemical stratification in BD+30$^\circ$549. We suspect that the "Si II/Si III anomaly", observed in BD+30$^\circ$549 spectrum arises under the combined action of the vertical and horizontal abundance gradients and non-LTE effects. We suppose that evolutionary status and phenomena observed in BD+30$^\circ$549 indicate that conditions favorable for the selective diffusion and formation of the surface chemical composition peculiarities (slow rotation and stabilization of the atmosphere) can be built up already at the Pre-Main Sequence phase.


title: Fatigue failure of amorphous alloys under cyclic shear deformation

abstract: The accumulation of plastic deformation and flow localization in amorphous alloys under periodic shear are investigated using molecular dynamics simulations. We study a well-annealed binary mixture of one million atoms subjected to oscillatory shear deformation with strain amplitudes slightly above a critical value. We find that upon approaching a critical strain amplitude from above, the number of shear cycles until the yielding transition is well described by a power-law function. Remarkably, the potential energy at the end of each cycle as a function of the normalized number of cycles is nearly independent of the strain amplitude, which allows for estimation of the fatigue lifetime at a given strain amplitude. The analysis on nonaffine displacements of atoms elucidates the process of strain localization, including irreversible rearrangements of small clusters until the formation of a system-spanning shear band.


title: Robust Gaussian Process Regression with Huber Likelihood

abstract: Gaussian process regression in its most simplified form assumes normal homoscedastic noise and utilizes analytically tractable mean and covariance functions of predictive posterior distribution using Gaussian conditioning. Its hyperparameters are estimated by maximizing the evidence, commonly known as type II maximum likelihood estimation. Unfortunately, Bayesian inference based on Gaussian likelihood is not robust to outliers, which are often present in the observational training data sets. To overcome this problem, we propose a robust process model in the Gaussian process framework with the likelihood of observed data expressed as the Huber probability distribution. The proposed model employs weights based on projection statistics to scale residuals and bound the influence of vertical outliers and bad leverage points on the latent functions estimates while exhibiting a high statistical efficiency at the Gaussian and thick tailed noise distributions. The proposed method is demonstrated by two real world problems and two numerical examples using datasets with additive errors following thick tailed distributions such as Students t, Laplace, and Cauchy distribution.


title: Autonomous Material Composite Morphing Wing

abstract: Aeronautics research has continually sought to achieve the adaptability and morphing performance of avian wings, but in practice, wings of all scales continue to use the same hinged control-surface embodiment. Recent research into compliant and bio-inspired mechanisms for morphing wings and control surfaces has indicated promising results, though often these are mechanically complex, or limited in the number of degrees-of-freedom (DOF) they can control. Seeking to improve on these limitations, we apply a new paradigm denoted Autonomous Material Composites to the design of avian-scale morphing wings. With this methodology, we reduce the need for complex actuation and mechanisms, and allow for three-dimensional placement of stretchable fiber optic strain gauges (Optical Lace) throughout the metamaterial structure. This structure centers around elastomeric conformal lattices, and by applying functionally-graded warping and thickening to this lattice, we allow for local tailoring of the compliance properties to fit the desired morphing. As a result, the wing achieves high-deformation morphing in three DOF: twist, camber, and extension/compression, with these morphed shapes effectively modifying the aerodynamic performance of the wing, as demonstrated in low-Reynolds wind tunnel testing. Our sensors also successfully demonstrate differentiable trends across all degrees of morphing, enabling the future state estimation and control of this wing.


title: A Multilevel Scheduling Framework for Distributed Time-domain Large-area Sky Survey Telescope Array

abstract: Telescope arrays are receiving increasing attention due to their promise of higher resource utilization, greater sky survey area, and higher frequency of full space-time monitoring than single telescopes. Compared with the ordinary coordinated operation of several telescopes, the new astronomical observation mode has an order of magnitude difference in the number of telescopes. It requires efficient coordinated observation by large-domain telescopes distributed at different sites. Coherent modeling of various abstract environmental constraints is essential for responding to multiple complex science goals. Also, due to competing science priorities and field visibility, how the telescope arrays are scheduled for observations can significantly affect observation efficiency. This paper proposes a multilevel scheduling model oriented toward the problem of telescope-array scheduling for time-domain surveys. A flexible framework is developed with basic functionality encapsulated in software components implemented on hierarchical architectures. An optimization metric is proposed to self-consistently weight contributions from time-varying observation conditions to maintain uniform coverage and efficient time utilization from a global perspective. The performance of the scheduler is evaluated through simulated instances. The experimental results show that our scheduling framework performs correctly and provides acceptable solutions considering the percentage of time allocation efficiency and sky coverage uniformity in a feasible amount of time. Using a generic version of the telescope-array scheduling framework, we also demonstrate its scalability and its potential to be applied to other astronomical applications.


title: Improving Food Detection For Images From a Wearable Egocentric Camera

abstract: Diet is an important aspect of our health. Good dietary habits can contribute to the prevention of many diseases and improve the overall quality of life. To better understand the relationship between diet and health, image-based dietary assessment systems have been developed to collect dietary information. We introduce the Automatic Ingestion Monitor (AIM), a device that can be attached to one's eye glasses. It provides an automated hands-free approach to capture eating scene images. While AIM has several advantages, images captured by the AIM are sometimes blurry. Blurry images can significantly degrade the performance of food image analysis such as food detection. In this paper, we propose an approach to pre-process images collected by the AIM imaging sensor by rejecting extremely blurry images to improve the performance of food detection.


title: Tight Bounds on 3-Team Manipulations in Randomized Death Match

abstract: Consider a round-robin tournament on n teams, where a winner must be (possibly randomly) selected as a function of the results from the ${n \choose 2}$ pairwise matches. A tournament rule is said to be k-SNM-${\alpha}$ if no set of k teams can ever manipulate the ${k \choose 2}$ pairwise matches between them to improve 2 the joint probability that one of these k teams wins by more than ${\alpha}$. Prior work identifies multiple simple tournament rules that are 2-SNM-1/3 (Randomized Single Elimination Bracket [SSW17], Randomized King of the Hill [SWZZ20], Randomized Death Match [DW21]), which is optimal for k = 2 among all Condorcet-consistent rules (that is, rules that select an undefeated team with probability 1). Our main result establishes that Randomized Death Match is 3-SNM-(31/60), which is tight (for Randomized Death Match). This is the first tight analysis of any Condorcet-consistent tournament rule and at least three manipulating teams. Our proof approach is novel in this domain: we explicitly find the most-manipulable tournament, and directly show that no other tournament can be more manipulable. In addition to our main result, we establish that Randomized Death Match disincentivizes Sybil attacks (where a team enters multiple copies of themselves into the tournament, and arbitrarily manipulates the outcomes of matches between their copies). Specifically, for any tournament, and any team u that is not a Condorcet winner, the probability that u or one of its Sybils wins in Randomized Death Match approaches 0 as the number of Sybils approaches $\infty$.


title: Discover governing differential equations from evolving systems

abstract: Discovering the governing equations of evolving systems from available observations is essential and challenging. In this paper, we consider a new scenario: discovering governing equations from streaming data. Current methods struggle to discover governing differential equations with considering measurements as a whole, leading to failure to handle this task. We propose an online modeling method capable of handling samples one by one sequentially by modeling streaming data instead of processing the entire dataset. The proposed method performs well in discovering ordinary differential equations (ODEs) and partial differential equations (PDEs) from streaming data. Evolving systems are changing over time, which invariably changes with system status. Thus, finding the exact change points is critical. The measurement generated from a changed system is distributed dissimilarly to before; hence, the difference can be identified by the proposed method. Our proposal is competitive in identifying the change points and discovering governing differential equations in three hybrid systems and two switching linear systems.

categories: physics.comp-ph cs.LG cs.SC math.DS nlin.CD


title: Exciton condensation in biased bilayer graphene

abstract: We consider suspened bilayer graphene under applied perpendicular electric bias field that is known to generate a single particle gap $2\Delta$ and a related electric polarization ${\cal P}$. We argue that the bias also drives a quantum phase transition from band insulator to superfluid exciton condensate. The transition occurs when the exciton binding energy exceeds the band gap $2\Delta$. We predict the critical bias (converted to band gap), $\Delta_c\approx 60$ meV, below which the excitons condense. The critical temperature, $T_c(\Delta)$, is maximum at $\Delta \approx 25$ meV, $T_c^\text{max}\approx 115$ K, decreasing significantly at smaller $\Delta$ due to thermal screening. Entering the condensate phase, the superfluid transition is accompanied by a cusp in the electric polarization ${\cal P}(\Delta)$ at $\Delta\to\Delta_c$, which provides a striking testable signature. Additionally, we find that the condensate prefers to form a pair density wave.


title: Spin-constrained Hartree-Fock and the generator coordinate method for the 2-site Hubbard model

abstract: We present a mathematical analysis of the spin-constrained Hartree-Fock solutions (CHF) of the 2-site Hubbard model. The analysis sheds light on the spin symmetry breaking process around the Coulson-Fischer point. CHF states are useful as input states for the Generator Coordinate Method (GCM) in which CHF states can be used as a basis for multiconfigurational calculations in the Hill-Wheeler equations. The spin degree of freedom provides the generator coordinate in the GCM related to static electron correlation.


title: The unexpected magnetism in 2D group-IV-doped GaN for spintronic applications

abstract: In this study, the structural and magnetic properties of group-IV-doped monolayer GaN were systematically investigated by first-principles calculations. Among all the group-IV dopants, only Ge and Sn atoms prefer to substitute the Ga atom of monolayer GaN and form a buckling structure with a magnetic moment of 1 $\mu_B$ per dopant. The N-rich growth conditions are more desirable for such a substitution process than the Ga-rich grow conditions. With a large diffusion barrier vertical to the monolayer GaN, both Ge and Sn atoms tend to stay on the same side of monolayer GaN with an antiferromagnetic coupling between them. When intrinsic vacancies exist in monolayer GaN, the magnetic moments of group-IV dopants vanish due to the charge transferring from the dopants to Ga or N vacancies. The precondition creation of Ga vacancies, a plentiful supply of Ge or Sn dopants, and the N-rich conditions can be adopted to maintain the magnetic properties of group-IV-doped monolayer GaN. These theoretical results help to promote the applications of 2D GaN-based materials in spintronics.


title: Randomly stacked open-cylindrical shells as a functional mechanical device

abstract: Structures with artificial mechanical properties, often called mechanical metamaterials, exhibit divergent yet tunable performance. Various types of mechanical metamaterials have been proposed, which harness light or magnetic interactions, structural instabilities in slender or hollow structures, and contact friction. However, most of the designs are precisely engineered without any imperfections, in order to perform as programmed. Here, we study the mechanical performance of randomly stacked cylindrical-shells, which act as a disordered mechanical metamaterial. Combining experiments and simulations, we demonstrate that the stacked shells can absorb and store mechanical energy upon compression by exploiting large deformation and relocation of shells, snap-fits, and friction. Although shells are oriented randomly, the system exhibits robust mechanical performance controlled by friction and geometry. Our results demonstrate that the rearrangement of flexible components could yield versatile but predictive mechanical responses.


title: MV-Adapter: Multimodal Video Transfer Learning for Video Text Retrieval

abstract: State-of-the-art video-text retrieval (VTR) methods typically involve fully fine-tuning a pre-trained model (e.g. CLIP) on specific datasets. However, this can result in significant storage costs in practical applications as a separate model per task must be stored. To address this issue, we present our pioneering work that enables parameter-efficient VTR using a pre-trained model, with only a small number of tunable parameters during training. Towards this goal, we propose a new method dubbed Multimodal Video Adapter (MV-Adapter) for efficiently transferring the knowledge in the pre-trained CLIP from image-text to video-text. Specifically, MV-Adapter utilizes bottleneck structures in both video and text branches, along with two novel components. The first is a Temporal Adaptation Module that is incorporated in the video branch to introduce global and local temporal contexts. We also train weights calibrations to adjust to dynamic variations across frames. The second is Cross Modality Tying that generates weights for video/text branches through sharing cross modality factors, for better aligning between modalities. Thanks to above innovations, MV-Adapter can achieve comparable or better performance than standard full fine-tuning with negligible parameters overhead. Notably, MV-Adapter consistently outperforms various competing methods in V2T/T2V tasks with large margins on five widely used VTR benchmarks (MSR-VTT, MSVD, LSMDC, DiDemo, and ActivityNet).


title: On Siegel Zeros of Symmetric Power L-functions

abstract: Let $f$ be a holomorphic cusp form of even weight $k$ for the modular group $SL(2,\mathbb{Z})$, which is assumed to be a common eigenfunction for all Hecke operators. For positive integer $n$, let $\text{Sym}^n(f)$ be the symmetric nth power lifting of $f$ , which was shown by Newton and Thorne to be automorphic and cuspidal. In this paper, we construct certain auxiliary $L$-functions to show that Siegel zeros of $\text{Sym}^n(f)$ do not exist, for each given $n$, utilizing the above functoriality result. As an application, we give a lower bound of those symmetric power $L$-functions at $s=1$ of logarithm power type.


title: Fast-BEV: Towards Real-time On-vehicle Bird's-Eye View Perception

abstract: Recently, the pure camera-based Bird's-Eye-View (BEV) perception removes expensive Lidar sensors, making it a feasible solution for economical autonomous driving. However, most existing BEV solutions either suffer from modest performance or require considerable resources to execute on-vehicle inference. This paper proposes a simple yet effective framework, termed Fast-BEV, which is capable of performing real-time BEV perception on the on-vehicle chips. Towards this goal, we first empirically find that the BEV representation can be sufficiently powerful without expensive view transformation or depth representation. Starting from M2BEV baseline, we further introduce (1) a strong data augmentation strategy for both image and BEV space to avoid over-fitting (2) a multi-frame feature fusion mechanism to leverage the temporal information (3) an optimized deployment-friendly view transformation to speed up the inference. Through experiments, we show Fast-BEV model family achieves considerable accuracy and efficiency on edge. In particular, our M1 model (R18@256x704) can run over 50FPS on the Tesla T4 platform, with 47.0% NDS on the nuScenes validation set. Our largest model (R101@900x1600) establishes a new state-of-the-art 53.5% NDS on the nuScenes validation set. The code is released at: https://github.com/Sense-GVT/Fast-BEV.


title: On Finite Blocklength Lossy Source Coding

abstract: In this monograph, we review recent advances in second-order asymptotics for lossy source coding, which provides approximations to the finite blocklength performance of optimal codes. The monograph is divided into three parts. In part I, we motivate the monograph, present basic definitions, introduce mathematical tools and illustrate the motivation of non-asymptotic and second-order asymptotics via the example of lossless source coding. In part II, we first present existing results for the rate-distortion problem with proof sketches. Subsequently, we present five generations of the rate-distortion problem to tackle various aspects of practical quantization tasks: noisy source, noisy channel, mismatched code, Gauss-Markov source and fixed-to-variable length compression. By presenting theoretical bounds for these settings, we illustrate the effect of noisy observation of the source, the influence of noisy transmission of the compressed information, the effect of using a fixed coding scheme for an arbitrary source and the roles of source memory and variable rate. In part III, we present four multiterminal generalizations of the rate-distortion problem to consider multiple encoders, decoders or source sequences: the Kaspi problem, the successive refinement problem, the Fu-Yeung problem and the Gray-Wyner problem. By presenting theoretical bounds for these multiterminal problems, we illustrate the role of side information, the optimality of stop and transmit, the effect of simultaneous lossless and lossy compression, and the tradeoff between encoders' rates in compressing correlated sources. Finally, we conclude the monograph, mention related results and discuss future directions.


title: Automorphisms of weighted projective hypersurfaces

abstract: We prove several results concerning automorphism groups of quasismooth complex weighted projective hypersurfaces; these generalize and strengthen existing results for hypersurfaces in ordinary projective space. First, we prove in most cases that automorphisms extend to the ambient weighted projective space. We next provide a characterization of when the linear automorphism group is finite and find an explicit uniform upper bound on the size of this group. Finally, we describe the automorphisms of a generic quasismooth hypersurface with given weights and degree.


title: Topological dynamical systems induced by polynomials and combinatorial consequences

abstract: Let $d\in {\mathbb N}$ and $p_i$ be an integral polynomial with $p_i(0)=0$, $1\le i\le d$. It is shown that if $S$ is piecewise syndetic in $\mathbb Z$, then $$\{(m,n)\in{\mathbb Z}^2: m+p_1(n),\ldots,m+p_d(n)\in S\}$$ is piecewise syndetic in ${\mathbb Z}^2$, which extends the result by Glasner and Furstenberg for linear polynomials. Our result is obtained by showing the density of minimal points of a dynamical system of ${\mathbb Z}^2$ action associated with the piecewise syndetic set $S$ and the polynomials $\{p_1,\ldots,p_d\}$. Moreover, it is proved that if $(X,T)$ is minimal, then for each non-empty open subset $U$ of $X$, there is $x\in U$ with $\{n\in {\mathbb Z}: T^{p_1(n)}x\in U, \ldots, T^{p_d(n)}x\in U\}$ piecewise syndetic.


title: Bounds for the geometric-arithmetic index of unicyclic graphs

abstract: We present lower and upper bounds for the geometric-arithmetic index of unicyclic graphs and provide extremal graphs for the corresponding bounds.


title: Increasing stability of a linearized inverse boundary value problem for a nonlinear Schr\"odinger equation on transversally anisotropic manifolds

abstract: We consider the problem of recovering a nonlinear potential function in a nonlinear Schr\"odinger equation on transversally anisotropic manifolds from the linearized Dirichlet-to-Neumann map at a large wavenumber. By calibrating the complex geometric optics (CGO) solutions according to the wavenumber, we prove the increasing stability of recovering the coefficient of a cubic term as the wavenumber becomes large.


title: Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based control

abstract: In this work, we aim to analyze how the trade-off between the modeling error, the terminal value function error, and the prediction horizon affects the performance of a nominal receding-horizon linear quadratic (LQ) controller. By developing a novel perturbation result of the Riccati difference equation, a novel performance upper bound is obtained and suggests that for many cases, the prediction horizon can be either one or infinity to improve the control performance, depending on the relative difference between the modeling error and the terminal value function error. The result also shows that when an infinite horizon is desired, a finite prediction horizon that is larger than the controllability index can be sufficient for achieving a near-optimal performance, revealing a close relation between the prediction horizon and controllability. The obtained suboptimality performance bound is also applied to provide novel sample complexity and regret guarantees for nominal receding-horizon LQ controllers in a learning-based setting.


title: A disk-wind driving the rotating molecular outflow in CB 26

abstract: We present 12CO (J=2-1) sensitive molecular line and 1.3 mm continuum observations made with the Submillimeter Array (SMA) of the bipolar outflow associated with the young star located in the Bok globule known as CB 26. The SMA observations were carried out in its extended configuration allowing us to study the kinematics and structure of the outflow with about 1 arcsec or 140 au resolution. We find that the dusty and edge-on circumstellar disk related with the outflow has an projected spatial (deconvolved) size of 196 au x 42 au with a total (gas and dust) mass of 0.031 Msun. We estimated a dynamical mass for the central object of 0.66 Msun, and the mass of the molecular outflow of 5x10-5 Msun. The observations confirm that the outflow rotation has a similar orientation to that of the edge-on disk. For the outflow, we find that the following quantities: the rotation velocity, the specific angular momentum, and the launching radius, decrease with the height above mid-plane, as observed in other molecular rotating outflows. The radius, and expansion velocity also increase with the height above the disk midplane. Estimations for the outflow linear momentum rate, the outflow angular momentum rate, and the accretion luminosity seem to be well explained by a disk wind present in CB26.


title: Structure and evolution of a tidally heated star

abstract: The shearing motion of tidal flows that are excited in non-equilibrium binary stars transform kinetic energy into heat via a process referred to as tidal heating. In this paper we aim to explore the way tidal heating affects the stellar structure. We used the TIDES code, which solves the equations of motion of the three-dimensional (3D) grid of volume elements that conform multiple layers of a rotating binary star to obtain an instantaneous value for the angular velocity, $\omega''$, as a function of position in the presence of gravitational, centrifugal, Coriolis, gas pressure, and viscous forces. The released energy, $\dot{E,}$ was computed using a prescription for turbulent viscosity that depends on the instantaneous velocity gradients. The $\dot{E}$ values for each radius were injected into a MESA stellar structure calculation. The method is illustrated for a 1.0+0.8 M$_\odot$ binary system, with an orbital period of $P$=1.44d and departures from synchronous rotation of 5% and 10%. We find that heated models have a larger radius and surface luminosity, a smaller surface convection zone, and lower nuclear reaction rates than the equivalent standard stellar models, and their evolutionary tracks extend to higher temperatures. The magnitude of these effects depends on the amount of injected energy, which, for a fixed set of stellar, rotation and orbital parameters, depends on the perturbed star's density structure and turbulent viscosity. Tidal heating offers a possible alternative for describing phenomena such as bloated or overluminous binary components, age discrepancies, and aspherical mass ejection, as well as the extended main sequence turnoff in clusters. However, establishing its actual role requires 3D stellar structure models commensurate with the nonspherically symmetric properties of tidal perturbations.


title: Unposed: Unsupervised Pose Estimation based Product Image Recommendations

abstract: Product images are the most impressing medium of customer interaction on the product detail pages of e-commerce websites. Millions of products are onboarded on to webstore catalogues daily and maintaining a high quality bar for a product's set of images is a problem at scale. Grouping products by categories, clothing is a very high volume and high velocity category and thus deserves its own attention. Given the scale it is challenging to monitor the completeness of image set, which adequately details the product for the consumers, which in turn often leads to a poor customer experience and thus customer drop off. To supervise the quality and completeness of the images in the product pages for these product types and suggest improvements, we propose a Human Pose Detection based unsupervised method to scan the image set of a product for the missing ones. The unsupervised approach suggests a fair approach to sellers based on product and category irrespective of any biases. We first create a reference image set of popular products with wholesome imageset. Then we create clusters of images to label most desirable poses to form the classes for the reference set from these ideal products set. Further, for all test products we scan the images for all desired pose classes w.r.t. reference set poses, determine the missing ones and sort them in the order of potential impact. These missing poses can further be used by the sellers to add enriched product listing image. We gathered data from popular online webstore and surveyed ~200 products manually, a large fraction of which had at least 1 repeated image or missing variant, and sampled 3K products(~20K images) of which a significant proportion had scope for adding many image variants as compared to high rated products which had more than double image variants, indicating that our model can potentially be used on a large scale.


title: Computing multiple roots of inexact polynomials

abstract: We present a combination of two algorithms that accurately calculate multiple roots of general polynomials. Algorithm I transforms the singular root-finding into a regular nonlinear least squares problem on a pejorative manifold, and calculates multiple roots simultaneously from a given multiplicity structure and initial root approximations. To fulfill the input requirement of Algorithm I, we develop a numerical GCD-finder containing a successive singular value updating and an iterative GCD refinement as the main engine of Algorithm II that calculates the multiplicity structure and the initial root approximation. While limitations of our algorithm exist in identifying the multiplicity structure in certain situations, the combined method calculates multiple roots with high accuracy and consistency in practice without using multiprecision arithmetic even if the coefficients are inexact. This is perhaps the first blackbox-type root-finder with such capabilities. To measure the sensitivity of the multiple roots, a structure-preserving condition number is proposed and error bounds are established. According to our computational experiments and error analysis, a polynomial being ill-conditioned in the conventional sense can be well conditioned with the multiplicity structure being preserved, and its multiple roots can be computed with high accuracy.


title: Polynomial Furstenberg joinings and its applications

abstract: In this paper, a polynomial version of Furstenberg joining is introduced and its structure is investigated. Particularly, it is shown that if all polynomials are non-linear, then almost every ergodic component of the joining is a direct product of an infinity-step pro-nilsystem and a Bernoulli system. As applications, some new convergence theorems are obtained. Particularly, it is proved that if $T$ and $S$ are ergodic measure preserving transformations on a probability space $(X,{\mathcal X},\mu)$ and $T$ has zero entropy, then for all $c_i\in {\mathbb Z}\setminus \{0\}$, all integral polynomials $p_j$ with $\deg {p_j}\ge 2$, and for all $f_i, g_j\in L^\infty(X,\mu)$, $1\le i\le m$ and $1\le j\le d$, $$\lim_{N\to\infty} \frac{1}{N}\sum_{n=0}^{N-1}f_1(T^{c_1n}x)\cdots f_m(T^{c_mn}x)\cdot g_1(S^{p_1(n)}x)\cdots g_d(S^{p_d(n)}x),$$ exists in $L^2(X,\mu)$, which extends the recent result by Host and Frantzikinakis. Moreover, it is shown that for an ergodic measure-preserving system $(X,{\mathcal X},\mu,T)$, a non-linear integral polynomial $p$ and $f\in L^\infty(X,\mu)$, the Furstenberg systems of $\big(f(T^{p(n)})x\big)_{n\in {\mathbb Z}}$ are ergodic and isomorphic to direct products of infinite-step pro-nilsystems and Bernoulli systems for almost every $x\in X$, which answers a problem by Frantzikinakis.


title: Mathematical analysis of singularities in the diffusion model under the submanifold assumption

abstract: This paper provide several mathematical analyses of the diffusion model in machine learning. The drift term of the backwards sampling process is represented as a conditional expectation involving the data distribution and the forward diffusion. The training process aims to find such a drift function by minimizing the mean-squared residue related to the conditional expectation. Using small-time approximations of the Green's function of the forward diffusion, we show that the analytical mean drift function in DDPM and the score function in SGM asymptotically blow up in the final stages of the sampling process for singular data distributions such as those concentrated on lower-dimensional manifolds, and is therefore difficult to approximate by a network. To overcome this difficulty, we derive a new target function and associated loss, which remains bounded even for singular data distributions. We illustrate the theoretical findings with several numerical examples.


title: A Littlewood-Richardson rule for Grassmannian Schubert varieties

abstract: We propose a combinatorial model for the Schubert structure constants of the complete flag manifold when one of the factors is Grassmannian.


title: Bayesian inference of nucleus resonance and neutron skin

abstract: In this proceeding, we have presented some highlight results on the constraints of the nuclear matter equation of state (EOS) from the data of nucleus resonance and neutron-skin thickness using the Bayesian approach based on the Skyrme-Hartree-Fock model and its extension. Typically, we have discussed the anti-correlation and positive correlation between the slope parameter and the value of the symmetry energy at the saturation density under the constraint of, respectively, the neutron-skin thickness and the isovector giant dipole resonance. We have shown that the Bayesian analysis can help to find a compromise for the ``PREXII puzzle'' and the ``soft Tin puzzle". We have further illustrated the possible modifications on the constraints of lower-order EOS parameters as well as the relevant correlation when higher-order EOS parameters are incorporated as independent variables. For a given model and parameter space, the Bayesian approach serves as a good analysis tool suitable for multi-messengers versus multi-variables, and is helpful for constraining quantitatively the model parameters as well as their correlations.


title: Nucleon form factors and the pion-nucleon sigma term

abstract: This talk summarizes the progress made since Lattice 2021 in understanding and controlling the contributions of towers of multihadron excited states with mass gaps starting lower than of radial excitations, and in increasing our confidence in the extraction of ground state nucleon matrix elements. The most clear evidence for multihadron excited state contributions (ESC) is in axial/pseudoscalar form factors that are required to satisfy the PCAC relation between them. The talk examines the broader question--which and how many of the theoretically allowed positive parity states $N(\textbf p)\pi(-\textbf p)$, $N(\textbf 0)\pi(\textbf 0)\pi(\textbf 0)$, $N(\textbf p)\pi(\textbf 0)$, $N(\textbf 0)\pi(\textbf p),\ \ldots$ make significant contributions to a given nucleon matrix element? New data for the axial, electric and magnetic form factors are presented. They continue to show trends observed in Ref[1]. The N${}^2$LO $\chi$PT analysis of the ESC to the pion-nucleon sigma term, $\sigma_{\pi N}$, has been extended to include the $\Delta$ as an explicit degree of freedom [2]. The conclusion reached in Ref [3] that $N \pi$ and $N \pi \pi$ states each contribute about 10 MeV to $\sigma_{\pi N}$, and the consistency between the lattice result with $N \pi$ state included and the phenomenological estimate is not changed by this improvement.


title: Unusual anisotropic magnetoresistance due to magnetization-dependent spin-orbit interactions

abstract: One of recent surprising discoveries is the unusual anisotropic magnetoresistance (UAMR) that depends on two magnetization components perpendicular to the current differently, in contrast to the conventional anisotropic magnetoresistance (AMR) that predicts no change in resistance when the magnetization varies in the plane perpendicular to the current. Using density functional theory and Boltzmann transport equation calculations for bcc Fe, hcp Co, and bcc FeCo alloys, we show that UAMR can be accounted by the magnetization-dependent spin-orbit interactions (SOI): Magnetization-dependent SOI modifies electron energy bands that, in turn, changes resistance. A phenomenological model reveals the intrinsic connection between SOI and order-parameters. Such a mechanism is confirmed by the strong biaxial stain effect on UAMR. Our findings provide an efficient way of searching and optimizing materials with large UAMR, important in the design of high-performance spintronic devices.


title: Which differential equations correspond to the Lindblad equation?

abstract: The Lindblad master equation can always be transformed into a first-order linear ordinary differential equation (1ODE) for the coherence vector. We pose the inverse problem: given a finite-dimensional, non-homogeneous 1ODE, does a corresponding Lindblad equation exist? If so, what are the corresponding Hamiltonian and Lindblad operators? We provide a general solution to this problem, including a complete positivity test in terms of the parameters of the 1ODE. We also derive a host of properties relating the two representations (master equation and 1ODE), which are of independent interest.


title: Exterior diffraction problems for a triangular lattice

abstract: Exterior Dirichlet problems for two-dimensional lattice waves on the semi-infinite triangular lattice are considered. Namely, we study Dirichlet problems for the two-dimensional discrete Helmholtz equation in a plane with a hole. New results are obtained for the existence and uniqueness of the solution in the case of the real wave number $k \in (0, 2\sqrt{2})$ without passing to a complex wave number. Besides, Green's representation formula for the solution is derived with the help of difference potentials. To demonstrate the results, we propose a method for numerical calculation.


title: Blockchain Education: Current State, Limitations, Career Scope, Challenges, and Future Directions

abstract: Blockchain is a revolutionary technology, and its growth started in various industries (such as IT, education, business, banking, and many others) to capitalize on it. Currently, in higher education institutions (HEIs) adoption of blockchain education needs to be improved in the academic programs and curriculums. In addition, HEIs must make many intense changes in the teaching and learning methods to educate learners about blockchain technology and its applications to meet the current industry workforce demand. Due to a lack of academic programs and courses, students nowadays rely on online resources and pay non-academic organizations a high fee. This paper provides a comprehensive survey of blockchain education's current state of the art by reviewing the different academic programs and industry workforce demand. In addition, blockchain application trends which include market growth and demands are discussed. Moreover, the blockchain career scope for different disciplines of students is examined.


title: Update on Flavor Diagonal Nucleon Charges

abstract: This talk provides an update on the calculation of matrix elements of flavor diagonal axial, scalar and tensor quark bilinear operators between the nucleon ground state. The simulations are done using Wilson-clover fermions on a sea of eight 2+1+1-flavor HISQ ensembles generated by the MILC collaboration. We discuss the signal in the sum of the connected and disconnected contributions for the up, down and strange quarks, control over fits to remove excited state contamination, and the simultaneous chiral-continuum fit used to extract the charges.


title: Simulation of environmental impacts on the synthesis of carbyne with more than 6000 atoms for emerging continuously tunable energy barriers in CNT-based transistors

abstract: Transistors made up of carbon nanotubes CNT have demonstrated excellent current-voltage characteristics which outperform some high-grade silicon-based transistors. A continuously tunable energy barrier across semiconductor interfaces is desired to make the CNT-based transistors more robust. Despite the direct band gap of carbyne inside a CNT can be widely tuned by strain, the size of carbyne cannot be controlled easily. The production of a monoatomic chain with more than 6000 carbon atoms is an enormous technological challenge. To predict the optimal chain length of a carbyne in different molecular environments, we have developed a Monte Carlo model in which a finite-length carbyne with a size of 4000-15000 atoms is encapsulated by a CNT at finite temperatures. Our simulation shows that the stability of the carbyne@nanotube is strongly influenced by the nature and porosity of the CNT, the external pressure, the temperature and the chain length. We have observed an initiation of chain-breaking process in a compressed carbyne@nanotube. Our work provides much needed input for optimising the carbyne length to produce carbon chains much longer than 6000 atoms at ~300K. Design rules are proposed for synthesizing ~1% strained carbyne@(6,5)CNT as a component in CNT-based transistors to tune the energy barriers continuously.


title: Population Effects Driving Active Material Degradation in Intercalation Electrodes

abstract: In battery modeling, the electrode is discretized at the macroscopic scale with a single representative particle in each volume. This lacks the accurate physics to describe interparticle interactions in electrodes. To remedy this, we formulate a model that describes the evolution of degradation of a population of battery active material particles using ideas in population genetics of fitness evolution, where the state of a system depends on the health of each particle that contributes to the system. With the fitness formulation, the model incorporates effects of particle size and heterogeneous degradation effects which accumulate in the particles as the battery is cycled, accounting for different active material degradation mechanisms. At the particle scale, degradation progresses nonuniformly across the population of active particles, observed from the autocatalytic relationship between fitness and degradation. Electrode-level degradation is formed from various contributions of the particle-level degradation, especially from smaller particles. It is shown that specific mechanisms of particle-level degradation can be associated with characteristic signatures in the capacity-loss and voltage profiles. Conversely, certain features in the electrode-level phenomena can also provide insight into the relative importance of different particle-level degradation mechanisms.


title: Measuring deformed neutron skin with free spectator nucleons in relativistic heavy-ion collisions

abstract: The neutron skin in deformed nuclei is generally not uniformly distributed but has an angular distribution, depending on both the spin-dependent nuclear interaction and the nuclear symmetry energy. To extract the information of the deformed neutron skin, we have explored the possibility of using free spectator nucleons in central tip-tip and body-body collisions at top RHIC energy with four typical deformed nuclei. The density distributions of neutrons and protons are consistently obtained from the Skyrme-Hartree-Fock-Bogolyubov calculation, and the angular distribution of the neutron skin can be varied by adjusting the strength of the nuclear spin-orbit coupling. With the information of spectator nucleons obtained based on a Monte-Carlo Glauber model, the free spectator nucleons are generated from a multifragmentation process. By investigating the results from different systems and with different collision configurations, we found that although it is difficult to probe the deformed neutron skin in $^{96}$Zr and $^{238}$U by their collisions, it is promising to extract the polar angular distributions of the neutron skin in $^{96}$Ru and $^{197}$Au by comparing the yield ratios of free spectator neutrons to protons in their central tip-tip and body-body collisions. The proposed observables can be measured by dedicated zero-degree calorimeters in heavy-ion collision experiments that have been carried out in recent years by RHIC.


title: Subject-Independent Brain-Computer Interfaces with Open-Set Subject Recognition

abstract: A brain-computer interface (BCI) can't be effectively used since electroencephalography (EEG) varies between and within subjects. BCI systems require calibration steps to adjust the model to subject-specific data. It is widely acknowledged that this is a major obstacle to the development of BCIs. To address this issue, previous studies have trained a generalized model by removing the subjects' information. In contrast, in this work, we introduce a style information encoder as an auxiliary task that classifies various source domains and recognizes open-set domains. Open-set recognition method was used as an auxiliary task to learn subject-related style information from the source subjects, while at the same time helping the shared feature extractor map features in an unseen target. This paper compares various OSR methods within an open-set subject recognition (OSSR) framework. As a result of our experiments, we found that the OSSR auxiliary network that encodes domain information improves generalization performance.


title: Spatially Covariant Lesion Segmentation

abstract: Compared to natural images, medical images usually show stronger visual patterns and therefore this adds flexibility and elasticity to resource-limited clinical applications by injecting proper priors into neural networks. In this paper, we propose spatially covariant pixel-aligned classifier (SCP) to improve the computational efficiency and meantime maintain or increase accuracy for lesion segmentation. SCP relaxes the spatial invariance constraint imposed by convolutional operations and optimizes an underlying implicit function that maps image coordinates to network weights, the parameters of which are obtained along with the backbone network training and later used for generating network weights to capture spatially covariant contextual information. We demonstrate the effectiveness and efficiency of the proposed SCP using two lesion segmentation tasks from different imaging modalities: white matter hyperintensity segmentation in magnetic resonance imaging and liver tumor segmentation in contrast-enhanced abdominal computerized tomography. The network using SCP has achieved 23.8%, 64.9% and 74.7% reduction in GPU memory usage, FLOPs, and network size with similar or better accuracy for lesion segmentation.


title: Supercharging Distributed Computing Environments For High Performance Data Engineering

abstract: The data engineering and data science community has embraced the idea of using Python & R dataframes for regular applications. Driven by the big data revolution and artificial intelligence, these applications are now essential in order to process terabytes of data. They can easily exceed the capabilities of a single machine, but also demand significant developer time & effort. Therefore it is essential to design scalable dataframe solutions. There have been multiple attempts to tackle this problem, the most notable being the dataframe systems developed using distributed computing environments such as Dask and Ray. Even though Dask/Ray distributed computing features look very promising, we perceive that the Dask Dataframes/Ray Datasets still have room for optimization. In this paper, we present CylonFlow, an alternative distributed dataframe execution methodology that enables state-of-the-art performance and scalability on the same Dask/Ray infrastructure (thereby supercharging them!). To achieve this, we integrate a high performance dataframe system Cylon, which was originally based on an entirely different execution paradigm, into Dask and Ray. Our experiments show that on a pipeline of dataframe operators, CylonFlow achieves 30x more distributed performance than Dask Dataframes. Interestingly, it also enables superior sequential performance due to the native C++ execution of Cylon. We believe the success of Cylon & CylonFlow extends beyond the data engineering domain, and can be used to consolidate high performance computing and distributed computing ecosystems.


title: New late-time constraints on $f(R)$ gravity

abstract: Modification of general relativity (GR) inspired by theories like $f(R)$ gravity is among the most popular ones to explain the late-time acceleration of the Universe as an alternative to the $\Lambda$CDM model. In this work, we use the state-of-the-art BAO+BBN data and the most recent Type Ia supernovae (SNe Ia) sample namely PantheonPlus, including the Cepheid host distances and covariance from SH0ES samples, to robustly constrain the $f(R)$ gravity framework via two of the most popular $f(R)$ models in literature, namely, the Hu-Sawicki and Starobinsky models. Additionally, we consider how the time variation of the Newton's gravitational constant affects the supernovae distance modulus relation. We find a minor evidence for $f(R)$ gravity under the Hu-Sawicki dynamics from BAO+BBN and BAO+BBN+uncalibrated supernovae joint analysis, but the inclusion of Cepheid host distances, makes the model compatible with GR. Further, we notice tendency of this model to relax the $H_0$ tension. In general, in all the analyses carried out in this study with the late time probes, we find both the $f(R)$ models to be consistent with GR at 95\% CL.


title: Spectral Submanifolds of the Navier-Stokes Equations

abstract: Spectral subspaces of a linear dynamical system identify a large class of invariant structures that highlight/isolate the dynamics associated to select subsets of the spectrum. The corresponding notion for nonlinear systems is that of spectral submanifolds -- manifolds invariant under the full nonlinear dynamics that are determined by their tangency to spectral subspaces of the linearized system. In light of the recently-emerged interest in their use as tools in model reduction, we propose an extension of the relevant theory to the realm of fluid dynamics. We show the existence of a large (and the most pertinent) subclass of spectral submanifolds and foliations - describing the behaviour of nearby trajectories - about fixed points and periodic orbits of the Navier-Stokes equations. Their uniqueness and smoothness properties are discussed in detail, due to their significance from the perspective of model reduction. The machinery is then put to work via a numerical algorithm developed along the lines of the parameterization method, that computes the desired manifolds as power series expansions. Results are shown within the context of 2D channel flows.


title: Non-Invertible Duality Transformation Between SPT and SSB Phases

abstract: In 1992, Kennedy and Tasaki constructed a non-local unitary transformation that maps between a $\mathbb{Z}_2\times \mathbb{Z}_2$ spontaneously symmetry breaking phase and the Haldane gap phase, which is a prototypical Symmetry-Protected Topological phase in modern framework, on an open spin chain. In this work, we propose a way to define it on a closed chain, by sacrificing unitarity. The operator realizing such a non-unitary transformation satisfies non-invertible fusion rule, and implements a generalized gauging of the $\mathbb{Z}_2\times \mathbb{Z}_2$ global symmetry. These findings connect the Kennedy-Tasaki transformation to numerous other concepts developed for SPT phases, and opens a way to construct SPT phases systematically using the duality mapping.


title: Three-dimensional QCD phase diagram in the pNJL model

abstract: Based on the three-flavor Polyakov-looped Nambu$-$Jona-Lasinio (pNJL) model, we have studied the structure of the three-dimensional QCD phase diagram with respect to the temperature, the baryon chemical potential, and the isospin chemical potential, by investigating the interplay among the chiral quark condensate, the pion condensate, and the Polyakov loop. While the pNJL model leads to qualitatively similar structure of the normal quark phase, the pion superfluid phase, and the Sarma phase as well as their phase boundaries, when compared to the NJL model, the inclusion of the Polyakov loop enlarges considerably the areas of the pion superfluid phase and the Sarma phase, and leads to critical end points at higher temperatures. With the contribution of the gluon dynamics effectively included, the present study is expected to give a more reliable prediction of the three-dimensional QCD phase diagram compared to that in the NJL model.


title: Bayesian seismic tomography based on velocity-space Stein variational gradient descent for physics-informed neural network

abstract: In this study, we propose a Bayesian seismic tomography inference method using physics-informed neural networks (PINN). PINN represents a recent advance in deep learning, offering the possibility to enhance physics-based simulations and inverse analyses. PINN-based deterministic seismic tomography uses two separate neural networks (NNs) to predict seismic velocity and travel time. Naive Bayesian NN (BNN) approaches are unable to handle the high-dimensional spaces spanned by the weight parameters of these two NNs. Hence, we reformulate the problem to perform the Bayesian estimation exclusively on the NN predicting seismic velocity, while the NN predicting travel time is used only for deterministic travel time calculations, with the help of the adjoint method. Furthermore, we perform BNN by introducing a function-space Stein variational gradient descent (SVGD), which performs particle-based variational inference in the space of the function predicted by the NN (i.e., seismic velocity), instead of in the traditional weight space. The result is a velocity-space SVGD for the PINN-based seismic tomography model (vSVGD-PINN-ST) that decreases the complexity of the problem thus enabling a more accurate and physically consistent Bayesian estimation, as confirmed by synthetic tests in one- and two-dimensional tomographic problem settings. The method allows PINN to be applied to Bayesian seismic tomography practically for the first time. Not only that, it can be a powerful tool not only for geophysical but also for general PINN-based Bayesian estimation problems associated with compatible NNs formulations and similar, or reduced, complexity.


title: A Nonstochastic Control Approach to Optimization

abstract: Selecting the best hyperparameters for a particular optimization instance, such as the learning rate and momentum, is an important but nonconvex problem. As a result, iterative optimization methods such as hypergradient descent lack global optimality guarantees in general. We propose an online nonstochastic control methodology for mathematical optimization. First, we formalize the setting of meta-optimization, an online learning formulation of learning the best optimization algorithm from a class of methods. The meta-optimization problem over gradient-based methods can be framed as a feedback control problem over the choice of hyperparameters, including the learning rate, momentum, and the preconditioner. Although the original optimal control problem is nonconvex, we show how recent methods from online nonstochastic control using convex relaxations can be used to overcome the challenge of nonconvexity, and obtain regret guarantees against the best offline solution. This guarantees that in meta-optimization, given a sequence of optimization problems, we can learn a method that attains convergence comparable to that of the best optimization method in hindsight from a class of methods.


title: On the wave turbulence theory for the beam wave equation

abstract: Starting from the beam wave equation, which has a Schr\"odinger structure, on a hypercubic lattice of size $L$, with weak nonlinearity of strength $\lambda$, we show that the two point correlation function can be asymptotically expressed as the solution of the 3-wave kinetic equation at the kinetic limit under very general assumptions. The limit is taken in the physical order: first taking $L\to\infty$, then letting $\lambda\to0$. The initial condition is assumed out of equilibrium and the physical dimension is $d= 3$. The combination of previous works on the derivations of the wave kinetic equations from the lattice ZK equation [42,74] (with stochasticity, due to the singularity of the lattice ZK dispersion relation) and the present work (without stochasticity, thanks to the Schr\"odinger structure) give a detailed and general picture of how sensitive the kinetic descriptions are with respect to the regularities of the dispersion relations in the physical order of taking the limits. In terms of technical novelties, the current paper introduces new tools that produce the first obtained control of the Duhamel expansions when the number of collisions is of order $\mathcal{O}(\lambda^{-\gamma})$ (with $\gamma>0$) in the nonlinear context. To the best of our knowledge, such a strong control is a major step in understanding the long time dynamics of weakly nonlinear interactions of waves, and until now it could only be achieved in the linear context (see the work of Erdos-Salmhofer-Yau [34]).


title: Bayesian inference of neutron-star observables based on effective nuclear interactions

abstract: Based on the Skyrme-Hartree-Fock model (SHF) as well as its extension (the Korea-IBS-Daegu-SKKU (KIDS) model) and the relativistic mean-field (RMF) model, we have studied the constraints on the parameters of the nuclear matter equation of state (EOS) from adopted astrophysical observables using a Bayesian approach. While the masses and radii of neutron stars generally favors a stiff isoscalar EOS and a moderately soft nuclear symmetry energy, model dependence on the constraints is observed and mostly originates from the incorporation of higher-order EOS parameters and difference between relativistic and non-relativistic models. At twice saturation density, the value of the symmetry energy is constrained to be $48^{+15}_{-11}$ MeV in the standard SHF model, $48^{+8}_{-15}$ MeV in the KIDS model, and $48^{+5}_{-6}$ MeV in the RMF model, around their maximum {\it a posteriori} values within $68\%$ confidence intervals. Our study helps to obtain a robust constraint on nuclear matter EOS, and meanwhile, to understand the model dependence of the results.