title: Learning a Tracking Controller for Rolling $\mu$bots

abstract: Micron-scale robots ($\mu$bots) have recently shown great promise for emerging medical applications. Accurate controlling $\mu$bots, while critical to their successful deployment, is challenging. In this work, we consider the problem of tracking a reference trajectory using a $\mu$bot in the presence of disturbances and uncertainty. The disturbances primarily come from Brownian motion and other environmental phenomena, while the uncertainty originates from errors in the model parameters. We model the $\mu$bot as an uncertain unicycle that is controlled by a global magnetic field. To compensate for disturbances and uncertainties, we develop a nonlinear mismatch controller. We define the model mismatch error as the difference between our model's predicted velocity and the actual velocity of the $\mu$bot. We employ a Gaussian Process to learn the model mismatch error as a function of the applied control input. Then we use a least-squares minimization to select a control action that minimizes the difference between the actual velocity of the $\mu$bot and a reference velocity. We demonstrate the online performance of our joint learning and control algorithm in simulation, where our approach accurately learns the model mismatch and improves tracking performance. We also validate our approach in an experiment and show that certain error metrics are reduced by up to $40\%$.


title: Sublinear Algorithms for $(1.5+\epsilon)$-Approximate Matching

abstract: We study sublinear time algorithms for estimating the size of maximum matching. After a long line of research, the problem was finally settled by Behnezhad [FOCS'22], in the regime where one is willing to pay an approximation factor of $2$. Very recently, Behnezhad et al.[SODA'23] improved the approximation factor to $(2-\frac{1}{2^{O(1/\gamma)}})$ using $n^{1+\gamma}$ time. This improvement over the factor $2$ is, however, minuscule and they asked if even $1.99$-approximation is possible in $n^{2-\Omega(1)}$ time. We give a strong affirmative answer to this open problem by showing $(1.5+\epsilon)$-approximation algorithms that run in $n^{2-\Theta(\epsilon^{2})}$ time. Our approach is conceptually simple and diverges from all previous sublinear-time matching algorithms: we show a sublinear time algorithm for computing a variant of the edge-degree constrained subgraph (EDCS), a concept that has previously been exploited in dynamic [Bernstein Stein ICALP'15, SODA'16], distributed [Assadi et al. SODA'19] and streaming [Bernstein ICALP'20] settings, but never before in the sublinear setting. Independent work: Behnezhad, Roghani and Rubinstein [BRR'23] independently showed sublinear algorithms similar to our Theorem 1.2 in both adjacency list and matrix models. Furthermore, in [BRR'23], they show additional results on strictly better-than-1.5 approximate matching algorithms in both upper and lower bound sides.


title: Mixed Neural Voxels for Fast Multi-view Video Synthesis

abstract: Synthesizing high-fidelity videos from real-world multi-view input is challenging because of the complexities of real-world environments and highly dynamic motions. Previous works based on neural radiance fields have demonstrated high-quality reconstructions of dynamic scenes. However, training such models on real-world scenes is time-consuming, usually taking days or weeks. In this paper, we present a novel method named MixVoxels to better represent the dynamic scenes with fast training speed and competitive rendering qualities. The proposed MixVoxels represents the 4D dynamic scenes as a mixture of static and dynamic voxels and processes them with different networks. In this way, the computation of the required modalities for static voxels can be processed by a lightweight model, which essentially reduces the amount of computation, especially for many daily dynamic scenes dominated by the static background. To separate the two kinds of voxels, we propose a novel variation field to estimate the temporal variance of each voxel. For the dynamic voxels, we design an inner-product time query method to efficiently query multiple time steps, which is essential to recover the high-dynamic motions. As a result, with 15 minutes of training for dynamic scenes with inputs of 300-frame videos, MixVoxels achieves better PSNR than previous methods. Codes and trained models are available at https://github.com/fengres/mixvoxels


title: Lasing at a Stationary Inflection Point

abstract: The concept of lasers based on the frozen mode regime in active periodic optical waveguides with a 3rd-order exceptional point of degeneracy (EPD) is advanced. The frozen mode regime in a lossless and gainless waveguide is associated with a stationary inflection point (SIP) in the Bloch dispersion relation, where three Bloch eigenmodes coalesce forming the frozen mode. As a practical example, we consider an asymmetric serpentine optical waveguide (ASOW). An ASOW operating near the SIP frequency displays a large group delay of a non-resonant nature that scales as the cube of the waveguide length, leading to a strong gain enhancement when active material is included. Therefore, a laser operating in the close vicinity of an SIP has a gain threshold that scales as a negative cube of the waveguide length. We determine that this scaling law is maintained in the presence of small distributed losses, such as radiation associated with waveguide bends and roughness. In addition, we show that although gain causes a distortion in the modes coalescing at the SIP, the properties of the frozen mode are relatively resistant to such small perturbations and we still observe a large degree of exceptional degeneracy for gain values that bring the system above threshold. Finally, our study also reveals that lasing near an SIP is favored over lasing near a photonic band edge located in close proximity to the SIP. In particular, we observe that an SIP-induced lasing in an ASOW displays lower gain threshold compared to lasing near the photonic regular band edge (RBE), even though the SIP resonance has a lower quality factor than the RBE resonance.


title: Towards Practical Few-shot Federated NLP

abstract: Transformer-based pre-trained models have emerged as the predominant solution for natural language processing (NLP). Fine-tuning such pre-trained models for downstream tasks often requires a considerable amount of labeled private data. In practice, private data is often distributed across heterogeneous mobile devices and may be prohibited from being uploaded. Moreover, well-curated labeled data is often scarce, presenting an additional challenge. To address these challenges, we first introduce a data generator for federated few-shot learning tasks, which encompasses the quantity and skewness of scarce labeled data in a realistic setting. Subsequently, we propose AUG-FedPrompt, a prompt-based federated learning system that exploits abundant unlabeled data for data augmentation. Our experiments indicate that AUG-FedPrompt can perform on par with full-set fine-tuning with a limited amount of labeled data. However, such competitive performance comes at a significant system cost.


title: Distilling Reasoning Capabilities into Smaller Language Models

abstract: Step-by-step reasoning approaches like chain of thought (CoT) have proved to be very effective in inducing reasoning capabilities in large language models. However, the success of the CoT approach is fundamentally tied to the model size, and billion parameter-scale models are often needed to get CoT to work. In this paper, we propose a knowledge distillation approach that leverages the step-by-step CoT reasoning capabilities of larger models and distills these abilities into smaller models. In this work, we propose an alternative reasoning scheme, Socratic CoT, that learns a decomposition of the original problem into a sequence of subproblems and uses it to guide the intermediate reasoning steps. We use Socratic CoT to train a combination of two small distilled models: a problem decomposer and a subproblem solver. In practice, given a new problem, the two distilled models work in sync to decompose and solve complex problems. On multiple reasoning datasets (GSM8K, StrategyQA, and SVAMP), our proposed distillation strategies boosts the performance of smaller models over 70% compared to the baselines. Finally, we investigate when Socratic CoT is an effective alternative to CoT, demonstrating cases where a much smaller model (GPT-2 large) can outperform a 10X larger model (GPT-3 6B). Our code is available here: https://github.com/kumar-shridhar/Distiiling-LM


title: Complementarity and the unitarity of the black hole $S$-matrix

abstract: Recently, Akers et al. proposed a non-isometric holographic map from the interior of a black hole to its exterior. Within this model, we study properties of the black hole $S$-matrix, which are in principle accessible to observers who stay outside the black hole. Specifically, we investigate a scenario in which an infalling agent interacts with radiation both outside and inside the black hole. Because the holographic map involves postselection, the unitarity of the $S$-matrix is not guaranteed in this scenario, but we find that unitarity is satisfied to very high precision if suitable conditions are met. If the internal black hole dynamics is described by a pseudorandom unitary transformation, and if the operations performed by the infaller have computational complexity scaling polynomially with the black hole entropy, then the $S$-matrix is unitary up to corrections that are superpolynomially small in the black hole entropy. Furthermore, while in principle quantum computation assisted by postselection can be very powerful, we find under similar assumptions that the $S$-matrix of an evaporating black hole has polynomial computational complexity.


title: Introduction to topological symmetry in QFT

abstract: This brief note publicizes the quantum framework for symmetry that is developed in our joint paper arXiv:2209.07471 with Greg Moore and Constantin Teleman. We include additional motivation and an application to a selection rule for line defects in 4-dimensional gauge theories.


title: Data-Efficient Finetuning Using Cross-Task Nearest Neighbors

abstract: Obtaining labeled data to train a model for a task of interest is often expensive. Prior work shows training models on multitask data augmented with task descriptions (prompts) effectively transfers knowledge to new tasks. Towards efficiently building task-specific models, we assume access to a small number (32-1000) of unlabeled target-task examples and use those to retrieve the most similar labeled examples from a large pool of multitask data augmented with prompts. Compared to the current practice of finetuning models on uniformly sampled prompted multitask data (e.g.: FLAN, T0), our approach of finetuning on cross-task nearest neighbors is significantly more data-efficient. Using only 2% of the data from the P3 pool without any labeled target-task data, our models outperform strong baselines trained on all available data by 3-30% on 12 out of 14 datasets representing held-out tasks including legal and scientific document QA. Similarly, models trained on cross-task nearest neighbors from SuperNaturalInstructions, representing about 5% of the pool, obtain comparable performance to state-of-the-art models on 12 held-out tasks from that pool. Moreover, the models produced by our approach also provide a better initialization than single multitask finetuned models for few-shot finetuning on target-task data, as shown by a 2-23% relative improvement over few-shot finetuned T0-3B models on 8 datasets.


title: GAN-MC: a Variance Reduction Tool for Derivatives Pricing

abstract: We propose a parameter-free model for estimating the price or valuation of financial derivatives like options, forwards and futures using non-supervised learning networks and Monte Carlo. Although some arbitrage-based pricing formula performs greatly on derivatives pricing like Black-Scholes on option pricing, generative model-based Monte Carlo estimation(GAN-MC) will be more accurate and holds more generalizability when lack of training samples on derivatives, underlying asset's price dynamics are unknown or the no-arbitrage conditions can not be solved analytically. We analyze the variance reduction feature of our model and to validate the potential value of the pricing model, we collect real world market derivatives data and show that our model outperforms other arbitrage-based pricing models and non-parametric machine learning models. For comparison, we estimate the price of derivatives using Black-Scholes model, ordinary least squares, radial basis function networks, multilayer perception regression, projection pursuit regression and Monte Carlo only models.


title: Collinear and triangular solutions to the coplanar and circular three-body problem in the parametrized post-Newtonian formalism

abstract: This paper investigates the coplanar and circular three-body problem in the parametrized post-Newtonian (PPN) formalism, for which we focus on a class of fully conservative theories characterized by the Eddington-Robertson parameters $\beta$ and $\gamma$. It is shown that there can still exist a collinear equilibrium configuration and a triangular one, each of which is a generalization of the post-Newtonian equilibrium configuration in general relativity. The collinear configuration can exist for arbitrary mass ratio, $\beta$, and $\gamma$. On the other hand, the PPN triangular configuration depends on the nonlinearity parameter $\beta$ but not on $\gamma$. For any value of $\beta$, the equilateral configuration is possible, if and only if three finite masses are equal or two test masses orbit around one finite mass. For general mass cases, the PPN triangle is not equilateral as in the post-Newtonian case. It is shown also that the PPN displacements from the Lagrange points in the Newtonian gravity $L_1$, $L_2$ and $L_3$ depend on $\beta$ and $\gamma$, whereas those to $L_4$ and $L_5$ rely only on $\beta$.


title: Evidence of $\phi$0-Josephson junction from skewed diffraction patterns in Sn-InSb nanowires

abstract: We study Josephson junctions based on InSb nanowires with Sn shells. We observe skewed critical current diffraction patterns: the maxima in forward and reverse current bias are at different magnetic flux, with a displacement of 20-40 mT. The skew is greatest when the external field is nearly perpendicular to the nanowire, in the substrate plane. This orientation suggests that spin-orbit interaction plays a role. We develop a phenomenological model and perform tight-binding calculations, both methods reproducing the essential features of the experiment. The effect modeled is the $\phi$0-Josephson junction with higher-order Josephson harmonics. The system is of interest for Majorana studies: the effects are either precursor to or concomitant with topological superconductivity. Current-phase relations that lack inversion symmetry can also be used to design quantum circuits with engineered nonlinearity.


title: Three dimensional magnetorotational core-collapse supernova explosions of a 39 solar mass progenitor star

abstract: We perform three-dimensional simulations of magnetorotational supernovae using a $39\,M_{\odot}$ progenitor star with two different initial magnetic field strengths of $10^{10}$ G and $10^{12}$ G in the core. Both models rapidly undergo shock revival and their explosion energies asymptote within a few hundred milliseconds to values of $\gtrsim 2\times10^{51}$ erg after conservatively correcting for the binding energy of the envelope. Magnetically collimated, non-relativistic jets form in both models, though the jets are subject to non-axisymmetric instabilities. The jets do not appear crucial for driving the explosion, as they only emerge once the shock has already expanded considerably. Our simulations predict moderate neutron star kicks of about $150\, \mathrm{km}\,\mathrm{s}^{-1}$, no spin-kick alignment, and rapid early spin-down that would result in birth periods of about $20\, \mathrm{ms}$, too slow to power an energetic gamma-ray burst jet. More than $0.2\,M_\odot$ of iron-group material are ejected, but we estimate that the mass of ejected $^{56}\mathrm{Ni}$ will be considerably smaller as the bulk of this material is neutron-rich. Explosive burning does not contribute appreciable amounts of $^{56}\mathrm{Ni}$ because the burned material originates from the slightly neutron-rich silicon shell. The iron-group ejecta also show no pronounced bipolar geometry by the end of the simulations. The models thus do not immediately fit the characteristics of observed hypernovae, but may be representative of other transients with moderately high explosion energies. The gravitational-wave emission reaches high frequencies of up to 2000 Hz and amplitudes of over 100 cm. The gravitational-wave emission is detectable out to distances of $\sim4$ Mpc in the planned Cosmic Explorer detector.


title: An assessment of the Association Between a Fast Radio Burst and Binary Neutron Star Merger

abstract: Fast radio bursts (FRBs) are mysterious bright millisecond-duration radio bursts at cosmological distances. While young magnetars have been put forward as the leading source candidate, recent observations suggest there may be multiple FRB progenitor classes. It has long been theorised that FRBs could be emitted from compact object mergers - cataclysmic events such as binary neutron star (BNS) mergers that may be detectable in gravitational waves (GWs) by the ground-based Laser Interferometer Gravitational Wave Observatory (LIGO)and Virgo. Here we report a potential coincidence between the only BNS merger event GW190425 out of 21 GW sources detected during the first six months of LIGO-Virgo's 3rd Science Run and a bright, non-repeating FRB event, FRB 20190425A, from a search using public GW and CHIME FRB data. The FRB is located within the GW's sky localization area, occurred 2.5 hours after the GW event, and has a dispersion measure consistent with the distance inferred from GW parameter estimation. The chance probability of a coincidence between unrelated FRB and GW events in the databases is estimated to be 0.0052 ($2.8 \sigma$). We estimate the chance of CHIME detecting such an event to range from 0.4% for a beam-centre detection to 68% if a bright burst is detectable in a far sidelobe. This potential association is consistent with the theory that the BNS merger leaves behind a supramassive, highly magnetized compact object, which collapses to form a black hole after losing angular momentum due to spindown and makes an FRB through ejecting the magnetosphere. If such a physical association is established, the equation of state of the post-merger compact object is likely stiff, with a Tolman-Oppenheimer-Volkoff non-spinning maximum mass $M_{TOV} > 2.63_{-0.23}^{+0.39} M_\odot$ for a neutron star remnant, or $M_{TOV} > 2.31_{-0.08}^{+0.24} M_\odot$ for a quark star remnant.


title: Lattice study on a tetraquark state $T_{bb}$ in the HAL QCD method

abstract: We investigate a doubly-bottomed tetraquark state $T_{bb}$ $(bb \bar{u}\bar{d})$ with quantum number $I(J^P)=0(1^+)$ in $(2+1)$-flavor lattice QCD. Using the Non-Relativistic QCD (NRQCD) quark action for $b$ quarks, we have extracted the coupled channel potential between $\bar{B}\bar{B}^*$ and $\bar{B}^* \bar{B}^*$ in the HAL QCD method at $a \approx 0.09$ {fm} on $32^3\times 64$ lattices. The potential predicts an existence of a bound $T_{bb}$ below the $\bar{B}\bar{B}^*$ threshold. At the physical pion mass $m_\pi\approx140$ {MeV} extrapolated from $m_\pi\approx 410,\, 570,\, 700$ {MeV}, a binding energy with its statistical error is given by $E_{\rm binding}^{\rm (coupled)} = 83(10)$ MeV from a coupled channel analysis where effects due to virtual $\bar{B}^* \bar{B}^*$ states are included through the coupled channel potential, while we obtain $E_{\rm binding}^{\rm (single)} = 155(17)$ MeV only from a potential for a single $\bar{B}\bar{B}^*$ channel. This difference indicates that the effect from virtual $\bar{B}^* \bar{B}^*$ states is sizable to the binding energy of $T_{bb}$. Adding $\pm 20$ MeV as empirical systematic error caused by the NRQCD approximation for $b$ quarks, our estimate of the $T_{bb}$ binding energy becomes $83(10)(20)$ MeV.


title: Realization of Dirac quantization in loop quantum gravity

abstract: The system of gravity coupled to the non-rotational dust field is studied at both classical and quantum levels. The scalar constraint of the system can be written in the form of a true physical Hamiltonian with respect to the dust time. In the framework of loop quantum gravity, the scalar constraint is promoted to a well-defined operator in a suitable Hilbert space of the coupled system, such that the physical Hamiltonian becomes a symmetric operator. By the deparametrized form, a general expression of the solutions to the quantum scalar constraint is obtained, and the observables on the space of solutions can be constructed. Moreover, the Dirac quantization procedure can be fully carried out in loop quantum gravity by this system.


title: Pseudospin-2 in photonic chiral borophene

abstract: Pseudospin is an angular momentum degree of freedom introduced in analogy to the real electron spin in the effective massless Dirac-like equation used to describe wave evolution at conical intersections such as the Dirac cones of graphene. Here, we study a photonic implementation of a chiral borophene allotrope hosting a pseudospin-2 conical intersection in its energy-momentum spectrum. The presence of this fivefold spectral degeneracy gives rise to quasiparticles with pseudospin up to $\pm2$. We report on conical diffraction and pseudospin-orbit interaction of light in photonic chiral borophene, which, as a result of topological charge conversion, leads to the generation of highly charged optical phase vortices.


title: Taylor-Couette flow of hard-sphere suspensions: Overview of current understanding

abstract: Although inertial particle-laden flows occur in a wide range of industrial and natural processes, there is both a lack of fundamental understanding of these flows and continuum-level governing equations needed to predict transport and particle distribution. Towards this effort, the Taylor-Couette flow (TCF) system has been used recently to study the flow behavior of particle-laden fluids under inertia. This article provides an overview of experimental, theoretical, and computational work related to the TCF of neutrally buoyant non-Brownian suspensions, with an emphasis on the effect of finite-sized particles on the series of flow transitions and flow structures. Particles, depending on their size and concentration, cause several significant deviations from Newtonian fluid behavior, including shifting the Reynolds number corresponding to transitions in flow structure and changing the possible structures present in the flow. Furthermore, particles may also migrate depending on the flow structure, leading to hysteretic effects that further complicate the flow behavior. The current state of theoretical and computational modeling efforts to describe the experimental observations is discussed, and suggestions for potential future directions to improve the fundamental understanding of inertial particle-laden flows are provided.


title: Clustering and Analysis of GPS Trajectory Data using Distance-based Features

abstract: The proliferation of smartphones has accelerated mobility studies by largely increasing the type and volume of mobility data available. One such source of mobility data is from GPS technology, which is becoming increasingly common and helps the research community understand mobility patterns of people. However, there lacks a standardized framework for studying the different mobility patterns created by the non-Work, non-Home locations of Working and Nonworking users on Workdays and Offdays using machine learning methods. We propose a new mobility metric, Daily Characteristic Distance, and use it to generate features for each user together with Origin-Destination matrix features. We then use those features with an unsupervised machine learning method, $k$-means clustering, and obtain three clusters of users for each type of day (Workday and Offday). Finally, we propose two new metrics for the analysis of the clustering results, namely User Commonality and Average Frequency. By using the proposed metrics, interesting user behaviors can be discerned and it helps us to better understand the mobility patterns of the users.


title: Calculation of the pion charge radius from an improved model-independent method

abstract: We propose a new improved model-independent method for calculating the pion charge radius. In a recently-proposed model-independent method for the pion charge radius, we find it difficult to compute the pion charge radius for small pole mass $M_{\rm{pole}}^2$ and volume due to systematic errors coming from finite volume effect and higher-order contamination of the Taylor expansion of the form factor. We circumvent this difficulty by introducing a new appropriate function and propose a modified method that can calculate the pion charge radius with less systematic errors in the small $M_{\rm{pole}}^2$ and volume cases. As preliminary results, we check that our improved model-independent method works well on a mockup data and also an actual lattice QCD data at the pion mass of 0.51 GeV.


title: Haagerup bound for quaternionic Grothendieck inequality

abstract: We present here several versions of the Grothendieck inequality over the skew field of quaternions: The first one is the standard Grothendieck inequality for rectangular matrices, and two additional inequalities for self-adjoint matrices, as introduced by the first and the last authors in a recent paper. We give several results on ``conic Grothendieck inequality'': as Nesterov $\pi/2$-Theorem, which corresponds to the cones of positive semidefinite matrices; the Goemans--Williamson inequality, which corresponds to the cones of weighted Laplacians; the diagonally dominant matrices. The most challenging technical part of this paper is the proof of the analog of Haagerup result that the inverse of the hypergeometric function $x {}_2F_1(\frac{1}{2}, \frac{1}{2}; 3; x^2)$ has first positive Taylor coefficient and all other Taylor coefficients are nonpositive.


title: Risk-Averse Self-Scheduling of Storage in Decentralized Markets

abstract: Storage is expected to be a critical source of firming in low-carbon grids. A common concern raised from ex-post assessments is that storage resources can fail to respond to strong price signals during times of scarcity. While commonly attributed to forecast error or failures in operations, we posit that this behavior can be explained from the perspective of risk-averse scheduling. Using a stochastic self-scheduling framework and real-world data harvested from the Australian National Electricity Market, we demonstrate that risk-averse storage resources tend to have a myopic operational perspective, that is, they typically engage in near-term price arbitrage and chase only few extreme price spikes and troughs, thus remaining idle in several time periods with markedly high and low prices. This has important policy implications given the non-transparency of unit risk aversion and apparent risk in intervention decision-making.


title: Shape-Guided Diffusion with Inside-Outside Attention

abstract: We introduce precise object silhouette as a new form of user control in text-to-image diffusion models, which we dub Shape-Guided Diffusion. Our training-free method uses an Inside-Outside Attention mechanism during the inversion and generation process to apply a shape constraint to the cross- and self-attention maps. Our mechanism designates which spatial region is the object (inside) vs. background (outside) then associates edits to the correct region. We demonstrate the efficacy of our method on the shape-guided editing task, where the model must replace an object according to a text prompt and object mask. We curate a new ShapePrompts benchmark derived from MS-COCO and achieve SOTA results in shape faithfulness without a degradation in text alignment or image realism according to both automatic metrics and annotator ratings. Our data and code will be made available at https://shape-guided-diffusion.github.io.


title: A Unified Algorithm Framework for Unsupervised Discovery of Skills based on Determinantal Point Process

abstract: Learning rich skills under the option framework without supervision of external rewards is at the frontier of reinforcement learning research. Existing works mainly fall into two distinctive categories: variational option discovery that maximizes the diversity of the options through a mutual information loss (while ignoring coverage) and Laplacian-based methods that focus on improving the coverage of options by increasing connectivity of the state space (while ignoring diversity). In this paper, we show that diversity and coverage in unsupervised option discovery can indeed be unified under the same mathematical framework. To be specific, we explicitly quantify the diversity and coverage of the learned options through a novel use of Determinantal Point Process (DPP) and optimize these objectives to discover options with both superior diversity and coverage. Our proposed algorithm, ODPP, has undergone extensive evaluation on challenging tasks created with Mujoco and Atari. The results demonstrate that our algorithm outperforms state-of-the-art baselines in both diversity- and coverage-driven categories.


title: Simpler flag optimization

abstract: We study the geometry of flag manifolds under different embeddings into a product of Grassmannians. We show that differential geometric objects and operations -- tangent vector, metric, normal vector, exponential map, geodesic, parallel transport, gradient, Hessian, etc -- have closed-form analytic expressions that are computable with standard numerical linear algebra. Furthermore, we are able to derive a coordinate descent method in the flag manifold that performs well compared to other gradient descent methods.


title: Modern Definition of Bioactive Glasses and Glass-Ceramics

abstract: Bioactive glasses (BGs) and glass-ceramics (BGCs) have become a diverse family of materials being applied for treatment of many medical conditions. The traditional understanding of bioactive glasses and glass-ceramics pins them to bone-bonding capability without considering the other fields where they excel, such as soft tissue repair. We attempt to provide an updated definition of BGs and BGCs by comparing their structure, processing, and properties to those of other biomaterials. The proposed modern definition allows for consideration of all applications where the BGs and BGCs are currently used in the clinic and where the future of these promising biomaterials will grow. The new proposed definition of a bioactive glass is "a non-equilibrium, non-crystalline material that has been designed to induce specific biological activity". The proposed definition of a bioactive glass-ceramic is "an inorganic, non-metallic material that contains at least one crystalline phase within a glassy matrix and has been designed to induce specific biological activity." BGs and BGCs can bond to bone and soft tissues or contribute to their regeneration. They can deliver a specified concentration of inorganic therapeutic ions, heat for magnetic-induced hyperthermia or laser-induced phototherapy, radiation for brachytherapy, and drug delivery to combat pathogens and cancers.

categories: cond-mat.soft physics.app-ph physics.bio-ph physics.med-ph


title: Test-Time Mixup Augmentation for Data and Class-Specific Uncertainty Estimation in Deep Learning Image Classification

abstract: Uncertainty estimation of trained deep learning networks is valuable for optimizing learning efficiency and evaluating the reliability of network predictions. In this paper, we propose a method for estimating uncertainty in deep learning image classification using test-time mixup augmentation (TTMA). To improve the ability to distinguish correct and incorrect predictions in existing aleatoric uncertainty, we introduce TTMA data uncertainty (TTMA-DU) by applying mixup augmentation to test data and measuring the entropy of the predicted label histogram. In addition to TTMA-DU, we propose TTMA class-specific uncertainty (TTMA-CSU), which captures aleatoric uncertainty specific to individual classes and provides insight into class confusion and class similarity within the trained network. We validate our proposed methods on the ISIC-18 skin lesion diagnosis dataset and the CIFAR-100 real-world image classification dataset. Our experiments show that (1) TTMA-DU more effectively differentiates correct and incorrect predictions compared to existing uncertainty measures due to mixup perturbation, and (2) TTMA-CSU provides information on class confusion and class similarity for both datasets.


title: On the bright-end of the UV luminosity functions of galaxies at $z \sim 0.6-1.2$

abstract: We derive the Ultra-Violet (UV) luminosity function (LF) of star-forming galaxies in the redshift range $z = 0.6 - 1.2$, in the rest-frame far-UV ($1500$ \r{A}) wavelength. For this work, we are in particular interested in the bright end of the UV LF in this redshift range. Data from the XMM-Newton Optical Monitor (XMM-OM), near-ultraviolet ($2410-3565$ \r{A}) observations over 1.5 sq. deg of the COSMOS field are employed for this purpose. We compile a source-list of $879$ sources with $UVW1_\mathrm{AB}$ in the range $\sim 21-24$ mags from the wide-area UVW1 image of the COSMOS field in the two bins $0.6 \leq z \leq 0.8$ and $0.8 \leq z \leq 1.2$. The $M_{1500}$ for these sources lies in the interval $[-19.10,-22.50]$. We use the maximum likelihood to fit a Schechter function model to the un-binned data to estimate the parameters (faint-end slope, characteristic magnitude, and normalisation) of the Schechter function. We find the shape of the LF to be consistent with the Schechter model, and the parameters are in fair agreement with other studies conducted using direct measurements of the $1500$\r{A} flux. We see a brightening of the characteristic magnitude as we move from lower ($0.7$) to higher ($1.0$) redshift. The measures for luminosity density are within the error margins of past studies. We examine the brightest sources in our sample for the AGN contribution. These sources are characterised by their spectral energy distributions, integrated infrared luminosities, and morphologies. We also explore their overlap with the brightest IR galaxies in a similar redshift range.


title: A novel TomoSAR imaging method with few observations based on nested array

abstract: Synthetic aperture radar tomography (TomoSAR) baseline optimization technique is capable of reducing system complexity and improving the temporal coherence of data, which has become an important research in the field of TomoSAR. In this paper, we propose a nested TomoSAR technique, which introduces the nested array into TomoSAR as the baseline configuration. This technique obtains uniform and continuous difference co-array through nested array to increase the degrees of freedom (DoF) of the system and expands the virtual aperture along the elevation direction. In order to make full use of the difference co-array, covariance matrix of the echo needs to be obtained. Therefore, we propose a TomoSAR sparse reconstruction algorithm based on nested array, which uses adaptive covariance matrix estimation to improve the estimation performance in complex scenes. We demonstrate the effectiveness of the proposed method through simulated and real data experiments. Compared with traditional TomoSAR and coprime TomoSAR, the imaging results of our proposed method have a better anti-noise performance and retain more image information.


title: Physics-Constrained Generative Adversarial Networks for 3D Turbulence

abstract: Generative Adversarial Networks (GANs) have received wide acclaim among the machine learning (ML) community for their ability to generate realistic 2D images. ML is being applied more often to complex problems beyond those of computer vision. However, current frameworks often serve as black boxes and lack physics embeddings, leading to poor ability in enforcing constraints and unreliable models. In this work, we develop physics embeddings that can be stringently imposed, referred to as hard constraints, in the neural network architecture. We demonstrate their capability for 3D turbulence by embedding them in GANs, particularly to enforce the mass conservation constraint in incompressible fluid turbulence. In doing so, we also explore and contrast the effects of other methods of imposing physics constraints within the GANs framework, especially penalty-based physics constraints popular in literature. By using physics-informed diagnostics and statistics, we evaluate the strengths and weaknesses of our approach and demonstrate its feasibility.


title: Secondary Neutron Production from Thick Target Deuteron Breakup

abstract: Thick target deuteron breakup is a variable-energy accelerator-based source of high-energy neutrons, with applications in fundamental and applied nuclear science and engineering. However, the breakup mechanism remains poorly understood, and data on neutron yields from thick target breakup remains relatively scarce. In this work, the double-differential neutron yields from deuteron breakup have been measured on a thick beryllium target at $\epsilon_d=33$ and 40 MeV, using both time-of-flight and activation techniques. We have also introduced a simple hybrid model for the double-differential deuteron breakup cross section, applicable in the $\epsilon_d=10$--$100$ MeV energy range on light ($Z\leq 6$) targets. This model features four empirical parameters that have been fit to reproduce experimental breakup measurements on beryllium targets, using the method of least-squares. It was shown that these parameters extrapolate well to higher energies, and to other low-Z target materials. We also include optimization of the parameters that modify the Kalbach systematics for compound and pre-equilibrium reactions, in order to better reproduce the experimental data for beryllium targets at large angles.


title: Are you using test log-likelihood correctly?

abstract: Test log-likelihood is commonly used to compare different models of the same data or different approximate inference algorithms for fitting the same probabilistic model. We present simple examples demonstrating how comparisons based on test log-likelihood can contradict comparisons according to other objectives. Specifically, our examples show that (i) approximate Bayesian inference algorithms that attain higher test log-likelihoods need not also yield more accurate posterior approximations and (ii) conclusions about forecast accuracy based on test log-likelihood comparisons may not agree with conclusions based on root mean squared error.


title: Cup products and the higher topological complexity of configuration spaces of the circle with two anchored points

abstract: In this paper we show how to compute cup products in the anchored configuration space of the circle with two anchored points using discrete Morse theory. Knowing how to compute cup products allows us to obtain bounds for the (higher) topological complexity $TC_s$, which are sharp for a sufficiently large value of $s$.


title: Polytopes, polyhedra, and the Farkas lemma

abstract: The Farkas lemma is proved and applied to obtain a structure theorem for polyhedra. These notes are based on a talk in the New York Number Theory Seminar on October, 20, 2022.


title: Experimental Observations of the Topology of Convolutional Neural Network Activations

abstract: Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of parameters associated with a series of transformations defined by the model architecture, resulting in high-dimensional, difficult-to-interpret internal representations of input data. As DNNs become more ubiquitous across multiple sectors of our society, there is increasing recognition that mathematical methods are needed to aid analysts, researchers, and practitioners in understanding and interpreting how these models' internal representations relate to the final classification. In this paper, we apply cutting edge techniques from TDA with the goal of gaining insight into the interpretability of convolutional neural networks used for image classification. We use two common TDA approaches to explore several methods for modeling hidden-layer activations as high-dimensional point clouds, and provide experimental evidence that these point clouds capture valuable structural information about the model's process. First, we demonstrate that a distance metric based on persistent homology can be used to quantify meaningful differences between layers, and we discuss these distances in the broader context of existing representational similarity metrics for neural network interpretability. Second, we show that a mapper graph can provide semantic insight into how these models organize hierarchical class knowledge at each layer. These observations demonstrate that TDA is a useful tool to help deep learning practitioners unlock the hidden structures of their models.


title: Biomedical NER for the Enterprise with Distillated BERN2 and the Kazu Framework

abstract: In order to assist the drug discovery/development process, pharmaceutical companies often apply biomedical NER and linking techniques over internal and public corpora. Decades of study of the field of BioNLP has produced a plethora of algorithms, systems and datasets. However, our experience has been that no single open source system meets all the requirements of a modern pharmaceutical company. In this work, we describe these requirements according to our experience of the industry, and present Kazu, a highly extensible, scalable open source framework designed to support BioNLP for the pharmaceutical sector. Kazu is a built around a computationally efficient version of the BERN2 NER model (TinyBERN2), and subsequently wraps several other BioNLP technologies into one coherent system. KAZU framework is open-sourced: https://github.com/AstraZeneca/KAZU


title: Neumann problem on a torus

abstract: We consider the Dirichlet-to-Neumann mapping and the Neumann problem for the Laplace operator on a torus, given in toroidal coordinates. The Dirichlet-to-Neumann mapping is expressed with respect to series expansions in toroidal harmonics and thereby reduced to algebraic manipulations on the coefficients. A method for computing the numerical solutions of the corresponding Neumann problem is presented, and numerical illustrations are provided. We combine the results for interior and exterior domains to solve the Neumann problem for a toroidal shell.


title: Nonreciprocal Phonon Propagation in a Metallic Chiral Magnet

abstract: The phonon magnetochiral effect (MChE) is the nonreciprocal acoustic and thermal transports of phonons caused by the simultaneous breaking of the mirror and time-reversal symmetries. So far, the phonon MChE has been observed only in a ferrimagnetic insulator Cu2OSeO3, where the nonreciprocal response disappears above the Curie temperature of 58 K. Here, we study the nonreciprocal acoustic properties of a room-temperature ferromagnet Co9Zn9Mn2 for unveiling the phonon MChE close to the room temperature. Surprisingly, the nonreciprocity in this metallic compound is enhanced at higher temperatures and observed up to 250 K. This clear contrast between insulating Cu2OSeO3 and metallic Co9Zn9Mn2 suggests that metallic magnets have a mechanism to enhance the nonreciprocity at higher temperatures. From the ultrasound and microwave-spectroscopy experiments, we conclude that the magnitude of the phonon MChE of Co9Zn9Mn2 mostly depends on the magnon bandwidth, which increases at low temperatures and hinders the magnon-phonon hybridization. Our results suggest that the phonon nonreciprocity could be further enhanced by engineering the magnon band of materials.


title: Learning Progressive Modality-shared Transformers for Effective Visible-Infrared Person Re-identification

abstract: Visible-Infrared Person Re-Identification (VI-ReID) is a challenging retrieval task under complex modality changes. Existing methods usually focus on extracting discriminative visual features while ignoring the reliability and commonality of visual features between different modalities. In this paper, we propose a novel deep learning framework named Progressive Modality-shared Transformer (PMT) for effective VI-ReID. To reduce the negative effect of modality gaps, we first take the gray-scale images as an auxiliary modality and propose a progressive learning strategy. Then, we propose a Modality-Shared Enhancement Loss (MSEL) to guide the model to explore more reliable identity information from modality-shared features. Finally, to cope with the problem of large intra-class differences and small inter-class differences, we propose a Discriminative Center Loss (DCL) combined with the MSEL to further improve the discrimination of reliable features. Extensive experiments on SYSU-MM01 and RegDB datasets show that our proposed framework performs better than most state-of-the-art methods. For model reproduction, we release the source code at https://github.com/hulu88/PMT.


title: Wireless Image Transmission with Semantic and Security Awareness

abstract: Semantic communication is an increasingly popular framework for wireless image transmission due to its high communication efficiency. With the aid of the joint-source-and-channel (JSC) encoder implemented by neural network, semantic communication directly maps original images into symbol sequences containing semantic information. Compared with the traditional separate source and channel coding design used in bitlevel communication systems, semantic communication systems are known to be more efficient and accurate especially in the low signal-to-the-noise ratio (SNR) regime. This thus prompts an critical while yet to be tackled issue of security in semantic communication: it makes the eavesdropper more easier to crack the semantic information as it can be decoded even in a quite noisy channel. In this letter, we develop a semantic communication framework that accounts for both semantic meaning decoding efficiency and its risk of privacy leakage. To achieve this, targeting wireless image transmission, we on the one hand propose an JSC autoencoder featuring residual for efficient semantic meaning extraction and transmission, and on the other hand, propose a data-driven scheme that balances the efficiency-privacy tradeoff. Extensive experimental results are provided to show the effectiveness and robustness of the proposed scheme.


title: Gated Recurrent Neural Networks with Weighted Time-Delay Feedback

abstract: We introduce a novel gated recurrent unit (GRU) with a weighted time-delay feedback mechanism in order to improve the modeling of long-term dependencies in sequential data. This model is a discretized version of a continuous-time formulation of a recurrent unit, where the dynamics are governed by delay differential equations (DDEs). By considering a suitable time-discretization scheme, we propose $\tau$-GRU, a discrete-time gated recurrent unit with delay. We prove the existence and uniqueness of solutions for the continuous-time model, and we demonstrate that the proposed feedback mechanism can help improve the modeling of long-term dependencies. Our empirical results show that $\tau$-GRU can converge faster and generalize better than state-of-the-art recurrent units and gated recurrent architectures on a range of tasks, including time-series classification, human activity recognition, and speech recognition.


title: NIR-Prompt: A Multi-task Generalized Neural Information Retrieval Training Framework

abstract: Information retrieval aims to find information that meets users' needs from the corpus. Different needs correspond to different IR tasks such as document retrieval, open-domain question answering, retrieval-based dialogue, etc., while they share the same schema to estimate the relationship between texts. It indicates that a good IR model can generalize to different tasks and domains. However, previous studies indicate that state-of-the-art neural information retrieval (NIR) models, e.g, pre-trained language models (PLMs) are hard to generalize. Mainly because the end-to-end fine-tuning paradigm makes the model overemphasize task-specific signals and domain biases but loses the ability to capture generalized essential signals. To address this problem, we propose a novel NIR training framework named NIR-Prompt for retrieval and reranking stages based on the idea of decoupling signal capturing and combination. NIR-Prompt exploits Essential Matching Module (EMM) to capture the essential matching signals and gets the description of tasks by Matching Description Module (MDM). The description is used as task-adaptation information to combine the essential matching signals to adapt to different tasks. Experiments under in-domain multi-task, out-of-domain multi-task, and new task adaptation settings show that NIR-Prompt can improve the generalization of PLMs in NIR for both retrieval and reranking stages compared with baselines.


title: Top-k data selection via distributed sample quantile inference

abstract: We consider the problem of determining the top-$k$ largest measurements from a dataset distributed among a network of $n$ agents with noisy communication links. We show that this scenario can be cast as a distributed convex optimization problem called sample quantile inference, which we solve using a two-time-scale stochastic approximation algorithm. Herein, we prove the algorithm's convergence in the almost sure sense to an optimal solution. Moreover, our algorithm handles noise and empirically converges to the correct answer within a small number of iterations.


title: Modeling Complex Dialogue Mappings via Sentence Semantic Segmentation Guided Conditional Variational Auto-Encoder

abstract: Complex dialogue mappings (CDM), including one-to-many and many-to-one mappings, tend to make dialogue models generate incoherent or dull responses, and modeling these mappings remains a huge challenge for neural dialogue systems. To alleviate these problems, methods like introducing external information, reconstructing the optimization function, and manipulating data samples are proposed, while they primarily focus on avoiding training with CDM, inevitably weakening the model's ability of understanding CDM in human conversations and limiting further improvements in model performance. This paper proposes a Sentence Semantic \textbf{Seg}mentation guided \textbf{C}onditional \textbf{V}ariational \textbf{A}uto-\textbf{E}ncoder (SegCVAE) method which can model and take advantages of the CDM data. Specifically, to tackle the incoherent problem caused by one-to-many, SegCVAE uses response-related prominent semantics to constrained the latent variable. To mitigate the non-diverse problem brought by many-to-one, SegCVAE segments multiple prominent semantics to enrich the latent variables. Three novel components, Internal Separation, External Guidance, and Semantic Norms, are proposed to achieve SegCVAE. On dialogue generation tasks, both the automatic and human evaluation results show that SegCVAE achieves new state-of-the-art performance.


title: On fake subfields of number fields

abstract: We investigate the failure of a local-global principle with regard to "containment of number fields"; i.e., we are interested in pairs of number fields $(K_1,K_2)$ such that $K_2$ is not a subfield of any algebraic conjugate $K_1^\sigma$ of $K_1$, but the splitting type of any single rational prime $p$ unramified in $K_1$ and in $K_2$ is such that it cannot rule out the containment $K_2\subseteq K_1^\sigma$. Examples of such situations arise naturally, but not exclusively, via the well-studied concept of arithmetically equivalent number fields. We give some systematic constructions yielding "fake subfields" (in the above sense) which are not induced by arithmetic equivalence. This may also be interpreted as a failure of a certain local-global principle related to zeta functions of number fields.


title: Microdomains and Stress Distributions in Bacterial Monolayers on Curved Interfaces

abstract: Monolayers of growing non-motile rod-shaped bacteria act as active nematic materials composed of hard particles rather than the flexible components of other commonly studied active nematics. The organization of these granular monolayers has been studied on flat surfaces but not on curved surfaces, which are known to change the behavior of other active nematics. We use molecular dynamics simulations to track alignment and stress in growing monolayers fixed to curved surfaces, and investigate how these vary with changing surface curvature and cell aspect ratio. We find that the length scale of alignment (measured by average microdomain size) increases with cell aspect ratio and decreases with curvature. Additionally, we find that alignment controls the distribution of extensile stresses in the monolayer by concentrating stress in low-order regions. These results connect active nematic physics to bacterial monolayers and can be applied to model bacteria growing on droplets, such as marine oil-degrading bacteria.


title: Existence and Uniqueness of Constraint Minimizers for the Planar Schrodinger-Poisson System with Logarithmic Potentials

abstract: In this paper, we study constraint minimizers $u$ of the planar Schr\"odinger-Poisson system with a logarithmic convolution potential $\ln |x|\ast u^2$ and a logarithmic external potential $V(x)=\ln (1+|x|^2)$, which can be described by the $L^2$-critical constraint minimization problem with a subcritical perturbation. We prove that there is a threshold $\rho ^* \in (0,\infty)$ such that constraint minimizers exist if and only if $0<\rho<\rho^*$. In particular, the local uniqueness of positive constraint minimizers as $\rho\nearrow\rho^*$ is analyzed by overcoming the sign-changing property of the logarithmic convolution potential and the non-invariance under translations of the logarithmic external potential.


title: VIDM: Video Implicit Diffusion Models

abstract: Diffusion models have emerged as a powerful generative method for synthesizing high-quality and diverse set of images. In this paper, we propose a video generation method based on diffusion models, where the effects of motion are modeled in an implicit condition manner, i.e. one can sample plausible video motions according to the latent feature of frames. We improve the quality of the generated videos by proposing multiple strategies such as sampling space truncation, robustness penalty, and positional group normalization. Various experiments are conducted on datasets consisting of videos with different resolutions and different number of frames. Results show that the proposed method outperforms the state-of-the-art generative adversarial network-based methods by a significant margin in terms of FVD scores as well as perceptible visual quality.


title: Hyperfiniteness of boundary actions of relatively hyperbolic groups

abstract: We show that if $G$ is a finitely generated group hyperbolic relative to a finite collection of subgroups $\mathcal{P}$, then the natural action of $G$ on the geodesic boundary of the associated relative Cayley graph induces a hyperfinite equivalence relation. As a corollary of this, we obtain that the natural action of $G$ on its Bowditch boundary $\partial (G,\mathcal{P})$ also induces a hyperfinite equivalence relation. This strengthens a result of Ozawa obtained for $\mathcal{P}$ consisting of amenable subgroups and uses a recent work of Marquis and Sabok.


title: Inference of Media Bias and Content Quality Using Natural-Language Processing

abstract: Media bias can significantly impact the formation and development of opinions and sentiments in a population. It is thus important to study the emergence and development of partisan media and political polarization. However, it is challenging to quantitatively infer the ideological positions of media outlets. In this paper, we present a quantitative framework to infer both political bias and content quality of media outlets from text, and we illustrate this framework with empirical experiments with real-world data. We apply a bidirectional long short-term memory (LSTM) neural network to a data set of more than 1 million tweets to generate a two-dimensional ideological-bias and content-quality measurement for each tweet. We then infer a ``media-bias chart'' of (bias, quality) coordinates for the media outlets by integrating the (bias, quality) measurements of the tweets of the media outlets. We also apply a variety of baseline machine-learning methods, such as a naive-Bayes method and a support-vector machine (SVM), to infer the bias and quality values for each tweet. All of these baseline approaches are based on a bag-of-words approach. We find that the LSTM-network approach has the best performance of the examined methods. Our results illustrate the importance of leveraging word order into machine-learning methods in text analysis.


title: Evidence of a decreasing trend for the Hubble constant

abstract: The current discrepancy between the Hubble constant $H_0$ derived from the local distance ladder and from the cosmic microwave background is one of the most crucial issues in cosmology, as it possibly indicates unknown systematics or new physics. Here we present a novel non-parametric method to estimate Hubble constant as a function of redshift. We establish independent estimates of the evolution of Hubble constant by diagonalizing the covariance matrix. From type Ia supernovae and the observed Hubble parameter data, a decreasing trend of Hubble constant with a significance of 5.6$\sigma$ confidence level is found. At low redshift, its value is dramatically consistent with that measured from the local distance ladder, and it drops to the value measured from the cosmic microwave background at high redshift. Our results can relieve the Hubble tension, and prefer the late-time solutions of it, especially the new physics.


title: Inconsistency Ranking-based Noisy Label Detection for High-quality Data

abstract: The success of deep learning requires high-quality annotated and massive data. However, the size and the quality of a dataset are usually a trade-off in practice, as data collection and cleaning are expensive and time-consuming. In real-world applications, especially those using crowdsourcing datasets, it is important to exclude noisy labels. To address this, this paper proposes an automatic noisy label detection (NLD) technique with inconsistency ranking for high-quality data. We apply this technique to the automatic speaker verification (ASV) task as a proof of concept. We investigate both inter-class and intra-class inconsistency ranking and compare several metric learning loss functions under different noise settings. Experimental results confirm that the proposed solution could increase both the efficient and effective cleaning of large-scale speaker recognition datasets.


title: Weak approximation of nonlinear filtering for multiscale McKean-Vlasov stochastic systems

abstract: The work concerns the nonlinear filtering problem for a class of multiscale McKean-Vlasov stochastic systems. First of all, by a Poisson equation we prove that the solution of the slow part for a multiscale system weakly converges to the solution of the average equation. Then we define nonlinear filtering of the origin multiscale system and the average equation, and again through the same Poisson equation show the weak approximation between nonlinear filtering of the slow part for the origin multiscale system and that of the average equation.


title: Integrated Communication and Positioning Design in RIS-empowered OFDM System: a Correlation Dispersion Scheme

abstract: In this paper, we propose a novel integrated communication and positioning design for orthogonal frequency division multiplexing system aided by a reconfigurable intelligent surface (RIS) in indoor circumstances. The channel frequency responses on pilots (CFROPs) of places of interest are used for online mapping with the offline CFROP database. We transform the objective of minimizing the similarity of different CFROPs into creating a differentiated database by optimizing the phase coefficients of RIS. Imperfect channel state information is considered due to time-varying caused by the two-stage mapping. We formulate a universal optimization problem for maximizing either the average or the minimum virtual distance of CFROPs. The communication service requirements are converted as constraints. A moderate case is discussed to reduce computational complexity with minor accuracy loss. A special property called correlation dispersion is analyzed. It is capable of eliminating the spatial consistency that incurs inaccuracy to traditional positioning methods. The property and the moderate case complement each other well with clear and logical physical interpretation. The particular characteristic makes our design outperform others especially in high-level-noise environments. It works even better when the prior information of user's potential location is available. The validity of our design is confirmed by numerical results.


title: Rogue Emitter Detection Using Hybrid Network of Denoising Autoencoder and Deep Metric Learning

abstract: Rogue emitter detection (RED) is a crucial technique to maintain secure internet of things applications. Existing deep learning-based RED methods have been proposed under the friendly environments. However, these methods perform unstable under low signal-to-noise ratio (SNR) scenarios. To address this problem, we propose a robust RED method, which is a hybrid network of denoising autoencoder and deep metric learning (DML). Specifically, denoising autoencoder is adopted to mitigate noise interference and then improve its robustness under low SNR while DML plays an important role to improve the feature discrimination. Several typical experiments are conducted to evaluate the proposed RED method on an automatic dependent surveillance-Broadcast dataset and an IEEE 802.11 dataset and also to compare it with existing RED methods. Simulation results show that the proposed method achieves better RED performance and higher noise robustness with more discriminative semantic vectors than existing methods.


title: Ellipsoidal and hyperbolic Radon transforms; microlocal properties and injectivity

abstract: We present novel microlocal and injectivity analyses of ellipsoid and hyperboloid Radon transforms. We introduce a new Radon transform, $R$, which defines the integrals of a compactly supported $L^2$ function, $f$, over ellipsoids and hyperboloids with centers on a smooth connected surface, $S$. $R$ is shown to be a Fourier Integral Operator (FIO) and in our main theorem we prove that $R$ satisfies the Bolker condition if the support of $f$ is connected and not intersected by any plane tangent to $S$. Under certain conditions, this is an equivalence. We give examples where our theory can be applied. Focusing specifically on a cylindrical geometry of interest in Ultrasound Reflection Tomography (URT), we prove injectivity results and investigate the visible singularities. In addition, we present example reconstructions of image phantoms in two-dimensions, and validate our microlocal theory.


title: CL3D: Unsupervised Domain Adaptation for Cross-LiDAR 3D Detection

abstract: Domain adaptation for Cross-LiDAR 3D detection is challenging due to the large gap on the raw data representation with disparate point densities and point arrangements. By exploring domain-invariant 3D geometric characteristics and motion patterns, we present an unsupervised domain adaptation method that overcomes above difficulties. First, we propose the Spatial Geometry Alignment module to extract similar 3D shape geometric features of the same object class to align two domains, while eliminating the effect of distinct point distributions. Second, we present Temporal Motion Alignment module to utilize motion features in sequential frames of data to match two domains. Prototypes generated from two modules are incorporated into the pseudo-label reweighting procedure and contribute to our effective self-training framework for the target domain. Extensive experiments show that our method achieves state-of-the-art performance on cross-device datasets, especially for the datasets with large gaps captured by mechanical scanning LiDARs and solid-state LiDARs in various scenes. Project homepage is at https://github.com/4DVLab/CL3D.git


title: Distinct spin and orbital dynamics in Sr$_{2}$RuO$_{4}$

abstract: The unconventional superconductor Sr$_2$RuO$_4$ has long served as a benchmark for theories of correlated-electron materials. The determination of the superconducting pairing mechanism requires detailed experimental information on collective bosonic excitations as potential mediators of Cooper pairing. We have used Ru $L_3$-edge resonant inelastic x-ray scattering to obtain comprehensive maps of the electronic excitations of Sr$_2$RuO$_4$ over the entire Brillouin zone. We observe multiple branches of dispersive spin and orbital excitations associated with distinctly different energy scales. The spin and orbital dynamical response functions calculated within the dynamical mean-field theory are in excellent agreement with the experimental data. Our results highlight the Hund metal nature of Sr$_{2}$RuO$_{4}$ and provide key information for the understanding of its unconventional superconductivity.


title: A Novel Semisupervised Contrastive Regression Framework for Forest Inventory Mapping with Multisensor Satellite Data

abstract: Accurate mapping of forests is critical for forest management and carbon stocks monitoring. Deep learning is becoming more popular in Earth Observation (EO), however, the availability of reference data limits its potential in wide-area forest mapping. To overcome those limitations, here we introduce contrastive regression into EO based forest mapping and develop a novel semisupervised regression framework for wall-to-wall mapping of continuous forest variables. It combines supervised contrastive regression loss and semi-supervised Cross-Pseudo Regression loss. The framework is demonstrated over a boreal forest site using Copernicus Sentinel-1 and Sentinel-2 imagery for mapping forest tree height. Achieved prediction accuracies are strongly better compared to using vanilla UNet or traditional regression models, with relative RMSE of 15.1% on stand level. We expect that developed framework can be used for modeling other forest variables and EO datasets.


title: Phenomenology of Strong Interactions -- Towards an Effective Theory for Low Energy QCD

abstract: In this paper, we develop models applicable to phenomenological particle physics by using the string analogy of particles. These theories can be used to investigate the phenomenology of confinement, deconfinement, chiral condensate, QGP phase transitions, and even the evolution of the early universe. Other confining properties such as scalar glueball mass, gluon mass, glueball-meson mixing states, QCD vacuum, and color superconductivity can also be investigated in these model frameworks. We use one of the models to describe the phenomenon of color confinement among glueballs at the end of the paper. The models are built based on the Dirac-Born-Infeld (DBI) action modified for opened strings with their endpoints on a D$p$-brane or brane-anti-brane at a tachyonic vacuum.


title: A Cuntz-Krieger Uniqueness Theorem for Cuntz-Pimsner Algebras

abstract: We introduce a property of C*-correspondences, which we call Condition (S), to serve as an analogue of Condition (L) of graphs. We use Condition (S) to prove a Cuntz-Krieger Uniqueness Theorem for Cuntz-Pimsner algebras and obtain sufficient conditions for simplicity of Cuntz-Pimsner algebras. We also prove that if Q is a topological quiver with no sinks and X(Q) is the associated C*-correspondence, then X(Q) satisfies Condition (S) if and only if Q satisfies Condition(L). Finally, we consider several examples to compare and contrast Condition (S) with Schweizer's nonperiodic condition.


title: Optimal Control From Inverse Scattering via Single-Sided Focusing

abstract: We describe an algorithm to solve Bellman optimization that replaces a sum over paths determining the optimal cost-to-go by an analytic method localized in state space. Our approach follows from the established relation between stochastic control problems in the class of linear Markov decision processes and quantum inverse scattering. We introduce a practical online computational method to solve for a potential function that informs optimal agent actions. This approach suggests that optimal control problems, including those with many degrees of freedom, can be solved with parallel computations.


title: Split Learning without Local Weight Sharing to Enhance Client-side Data Privacy

abstract: Split learning (SL) aims to protect user data privacy by distributing deep models between client-server and keeping private data locally. In SL training with multiple clients, the local model weights are shared among the clients for local model update. This paper first reveals data privacy leakage exacerbated from local weight sharing among the clients in SL through model inversion attacks. Then, to reduce the data privacy leakage issue, we propose and analyze privacy-enhanced SL (P-SL) (or SL without local weight sharing). We further propose parallelized P-SL to expedite the training process by duplicating multiple server-side model instances without compromising accuracy. Finally, we explore P-SL with late participating clients and devise a server-side cache-based training method to address the forgetting phenomenon in SL when late clients join. Experimental results demonstrate that P-SL helps reduce up to 50% of client-side data leakage, which essentially achieves a better privacy-accuracy trade-off than the current trend by using differential privacy mechanisms. Moreover, P-SL and its cache-based version achieve comparable accuracy to baseline SL under various data distributions, while cost less computation and communication. Additionally, caching-based training in P-SL mitigates the negative effect of forgetting, stabilizes the learning, and enables practical and low-complexity training in a dynamic environment with late-arriving clients.


title: Thermally-driven scintillator flow in the SNO+ neutrino detector

abstract: The SNO+ neutrino detector is an acrylic sphere of radius 6 m filled with liquid scintillator, immersed in a water-filled underground cavern, with a thin vertical neck (radius 0.75 m) extending upwards about 7 m from the sphere to a purified nitrogen cover gas. To explain a period of unexpected motion of the scintillator, time-dependent flow simulations have been performed using OpenFoam. It appears that the motion, inferred from subsequent 24 h-averaged patterns of transient $^{222}\mathrm{Rn}$ contamination introduced during earlier recirculation of scintillator, can be explained as owing to heat transfer through the detector wall that induced buoyant flow in a thin wall boundary layer. This mechanism can result in transport of contaminant, should it be introduced, down the neck to the sphere on a time scale of several hours. If the scintillator happens to be thermally stratified, the same forcing produces internal gravity waves in the spherical flow domain, at the Brunt-V\"{a}is\"{a}l\"{a} frequency. Nevertheless, oscillatory motion being by its nature non-diffusive, simulations confirm that imposing strong thermal stratification over the depth of the neck can mitigate mixing due to transient heat fluxes.


title: Few-Shot Specific Emitter Identification via Hybrid Data Augmentation and Deep Metric Learning

abstract: Specific emitter identification (SEI) is a potential physical layer authentication technology, which is one of the most critical complements of upper layer authentication. Radio frequency fingerprint (RFF)-based SEI is to distinguish one emitter from each other by immutable RF characteristics from electronic components. Due to the powerful ability of deep learning (DL) to extract hidden features and perform classification, it can extract highly separative features from massive signal samples, thus enabling SEI. Considering the condition of limited training samples, we propose a novel few-shot SEI (FS-SEI) method based on hybrid data augmentation and deep metric learning (HDA-DML) which gets rid of the dependence on auxiliary datasets. Specifically, HDA consisting rotation and CutMix is designed to increase data diversity, and DML is used to extract high discriminative semantic features. The proposed HDA-DML-based FS-SEI method is evaluated on an open source large-scale real-world automatic-dependent surveillance-broadcast (ADS-B) dataset and a real-world WiFi dataset. The simulation results of two datasets show that the proposed method achieves better identification performance and higher feature discriminability than five latest FS-SEI methods.


title: Distributed Deep Reinforcement Learning: A Survey and A Multi-Player Multi-Agent Learning Toolbox

abstract: With the breakthrough of AlphaGo, deep reinforcement learning becomes a recognized technique for solving sequential decision-making problems. Despite its reputation, data inefficiency caused by its trial and error learning mechanism makes deep reinforcement learning hard to be practical in a wide range of areas. Plenty of methods have been developed for sample efficient deep reinforcement learning, such as environment modeling, experience transfer, and distributed modifications, amongst which, distributed deep reinforcement learning has shown its potential in various applications, such as human-computer gaming, and intelligent transportation. In this paper, we conclude the state of this exciting field, by comparing the classical distributed deep reinforcement learning methods, and studying important components to achieve efficient distributed learning, covering single player single agent distributed deep reinforcement learning to the most complex multiple players multiple agents distributed deep reinforcement learning. Furthermore, we review recently released toolboxes that help to realize distributed deep reinforcement learning without many modifications of their non-distributed versions. By analyzing their strengths and weaknesses, a multi-player multi-agent distributed deep reinforcement learning toolbox is developed and released, which is further validated on Wargame, a complex environment, showing usability of the proposed toolbox for multiple players and multiple agents distributed deep reinforcement learning under complex games. Finally, we try to point out challenges and future trends, hoping this brief review can provide a guide or a spark for researchers who are interested in distributed deep reinforcement learning.


title: Selective Reverse PAC Coding for Sphere Decoding

abstract: Convolutional precoding in polarization-adjusted convolutional (PAC) codes can reduce the number of minimum weight codewords (a.k.a error coefficient) of polar codes. This can result in improving the error correction performance of (near) maximum likelihood (ML) decoders such as sequential decoders and sphere decoders. However, PAC codes cannot be decoded by sphere decoding. The reason is twofold: 1) Sphere decoding of polar codes is performed from the last bit - due to the lower rectangular shape of the polar transform. Whereas the shape of PAC codes generator matrix is no longer triangular. 2) One may modify the precoding matrix to get a lower-triangular shape. However, this may reduce the minimum distance of the code due to the formation of unwanted cosets. This work proposes a selective convolutional precoding scheme with transposed precoding matrix to reduce the error coefficient while avoiding the reduction in the minimum distance. The numerical results show the improvement of block error rate by 0.2-0.6 dB, depending on the code rate, in medium and high SNR regimes.


title: Momentum transfer dependence of kaon semileptonic form factor on (10 fm)$^4$ at the physical point

abstract: We calculate the kaon semileptonic form factors using the two sets of the PACS10 configuration, whose physical volumes are more than (10 fm)$^4$ at the physical point. The lattice spacings are 0.063 and 0.085 fm. The configurations were generated using the Iwasaki gauge action and $N_f=2+1$ stout-smeared nonperturbatively $O(a)$-improved Wilson quark action. From the momentum transfer dependence of the form factors, we evaluate the slope and curvature for the form factors at the zero momentum transfer. Furthermore, we calculate the phase space factor, which is used to obtain $|V_{us}|$ through the kaon semileptonic decay. These results are compared with previous lattice results and experimental values.


title: Face Animation with Multiple Source Images

abstract: Face animation has received a lot of attention from researchers in recent years due to its wide range of promising applications. Many face animation models based on optical flow or deep neural networks have achieved great success. However, these models are likely to fail in animated scenarios with significant view changes, resulting in unrealistic or distorted faces. One of the possible reasons is that such models lack prior knowledge of human faces and are not proficient to imagine facial regions they have never seen before. In this paper, we propose a flexible and generic approach to improve the performance of face animation without additional training. We use multiple source images as input as compensation for the lack of prior knowledge of faces. The effectiveness of our method is experimentally demonstrated, where the proposed method successfully supplements the baseline method.


title: Revisiting the Shadow Stress Tensor in Celestial CFT

abstract: We revisit the standard construction of the celestial stress tensor as a shadow of the subleading conformally soft graviton. In its original formulation there is an obstruction to reproducing the expected TT OPE in the double soft limit. We propose a modification to the definition which circumvents this obstruction and then extend this change of basis beyond the conformally soft and single helicity sectors. In the process we investigate how (non)-commutativity of double soft limits is tied to the decoupling of primary descendants, and how our choice of celestial basis determines which symmetries are manifest at the level of the OPE beyond the MHV sector.


title: To think inside the box, or to think out of the box? Scientific discovery via the reciprocation of insights and concepts

abstract: If scientific discovery is one of the main driving forces of human progress, insight is the fuel for the engine, which has long attracted behavior-level research to understand and model its underlying cognitive process. However, current tasks that abstract scientific discovery mostly focus on the emergence of insight, ignoring the special role played by domain knowledge. In this concept paper, we view scientific discovery as an interplay between $thinking \ out \ of \ the \ box$ that actively seeks insightful solutions and $thinking \ inside \ the \ box$ that generalizes on conceptual domain knowledge to keep correct. Accordingly, we propose Mindle, a semantic searching game that triggers scientific-discovery-like thinking spontaneously, as infrastructure for exploring scientific discovery on a large scale. On this basis, the meta-strategies for insights and the usage of concepts can be investigated reciprocally. In the pilot studies, several interesting observations inspire elaborated hypotheses on meta-strategies, context, and individual diversity for further investigations.


title: Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning

abstract: Visual Question Answering (VQA) models often perform poorly on out-of-distribution data and struggle on domain generalization. Due to the multi-modal nature of this task, multiple factors of variation are intertwined, making generalization difficult to analyze. This motivates us to introduce a virtual benchmark, Super-CLEVR, where different factors in VQA domain shifts can be isolated in order that their effects can be studied independently. Four factors are considered: visual complexity, question redundancy, concept distribution and concept compositionality. With controllably generated data, Super-CLEVR enables us to test VQA methods in situations where the test data differs from the training data along each of these axes. We study four existing methods, including two neural symbolic methods NSCL and NSVQA, and two non-symbolic methods FiLM and mDETR; and our proposed method, probabilistic NSVQA (P-NSVQA), which extends NSVQA with uncertainty reasoning. P-NSVQA outperforms other methods on three of the four domain shift factors. Our results suggest that disentangling reasoning and perception, combined with probabilistic uncertainty, form a strong VQA model that is more robust to domain shifts. The dataset and code are released at https://github.com/Lizw14/Super-CLEVR.


title: A Matrix Big Bang on a Quantum Computer

abstract: M-theory is a mysterious theory that seeks to unite different string theories in one lower dimension. The most studied example is eleven dimensional but other dimensions have been considered. The non-critical M-theories seek to unite different non-critical string theories. From the point of view of computing, non-critical M-theories should be simpler to simulate as they have fewer fields than eleven dimensional M-theory. The simplicity of non-critical M-theory carries over to quantum computing and we show that the quantum simulation requires fewer qubits and Pauli terms than critical M-theory. As an example quantum calculation we study the quantum computation of the ground state energy of Matrix models of non-critical M-theory in 3d in the finite difference and oscillator basis and compare the accuracy, number of qubits and number of Pauli terms of the different basis using the Variational Quantum Eigensolver (VQE) algorithm. We study non-critical M- Theory solutions with space-time singularities referred to as a "Matrix Big Bang" on the Quantum Computer using the Evolution of Hamiltonian (EOH) quantum algorithm using the Trotter approximation and compare the accuracy and results the can be obtained using quantum computation. Finally we consider the BRST quantization of the 3d M-theory Matrix model using quantum computation and compute BRST invariant states by studying the BRST Laplacian using the VQE algorithm.


title: Task Discovery: Finding the Tasks that Neural Networks Generalize on

abstract: When developing deep learning models, we usually decide what task we want to solve then search for a model that generalizes well on the task. An intriguing question would be: what if, instead of fixing the task and searching in the model space, we fix the model and search in the task space? Can we find tasks that the model generalizes on? How do they look, or do they indicate anything? These are the questions we address in this paper. We propose a task discovery framework that automatically finds examples of such tasks via optimizing a generalization-based quantity called agreement score. We demonstrate that one set of images can give rise to many tasks on which neural networks generalize well. These tasks are a reflection of the inductive biases of the learning framework and the statistical patterns present in the data, thus they can make a useful tool for analysing the neural networks and their biases. As an example, we show that the discovered tasks can be used to automatically create adversarial train-test splits which make a model fail at test time, without changing the pixels or labels, but by only selecting how the datapoints should be split between the train and test sets. We end with a discussion on human-interpretability of the discovered tasks.


title: Low-Rank Tensor Function Representation for Multi-Dimensional Data Recovery

abstract: Since higher-order tensors are naturally suitable for representing multi-dimensional data in real-world, e.g., color images and videos, low-rank tensor representation has become one of the emerging areas in machine learning and computer vision. However, classical low-rank tensor representations can only represent data on finite meshgrid due to their intrinsical discrete nature, which hinders their potential applicability in many scenarios beyond meshgrid. To break this barrier, we propose a low-rank tensor function representation (LRTFR), which can continuously represent data beyond meshgrid with infinite resolution. Specifically, the suggested tensor function, which maps an arbitrary coordinate to the corresponding value, can continuously represent data in an infinite real space. Parallel to discrete tensors, we develop two fundamental concepts for tensor functions, i.e., the tensor function rank and low-rank tensor function factorization. We theoretically justify that both low-rank and smooth regularizations are harmoniously unified in the LRTFR, which leads to high effectiveness and efficiency for data continuous representation. Extensive multi-dimensional data recovery applications arising from image processing (image inpainting and denoising), machine learning (hyperparameter optimization), and computer graphics (point cloud upsampling) substantiate the superiority and versatility of our method as compared with state-of-the-art methods. Especially, the experiments beyond the original meshgrid resolution (hyperparameter optimization) or even beyond meshgrid (point cloud upsampling) validate the favorable performances of our method for continuous representation.


title: Lattice thermal conductivity and elastic modulus of XN4 (X=Be, Mg and Pt) 2D materials using machine learning interatomic potentials

abstract: The newly synthesized BeN4 monolayer has introduced a novel group of 2D materials called nitrogen-rich 2D materials. In the present study, the anisotropic mechanical and thermal properties of three members of this group, BeN4, MgN4, and PtN4, are investigated. To this end, a machine learning-based interatomic potential (MLIP) is developed on the basis of the moment tensor potential (MTP) method and utilized in classical molecular dynamics (MD) simulation. Mechanical properties are calculated by extracting the stress-strain curve and thermal properties by non-equilibrium molecular dynamics (NEMD) method. Acquired results show the anisotropic elastic modulus and lattice thermal conductivity of these materials. Generally, elastic modulus and thermal conductivity in the armchair direction are higher than in the zigzag direction. Also, the elastic anisotropy is almost constant at every temperature for BeN4 and MgN4, while for PtN4, this parameter is decreased by increasing the temperature. The findings of this research are not only evidence of the application of machine learning in MD simulations, but also provide information on the basic anisotropic mechanical and thermal properties of these newly discovered 2D nanomaterials.


title: Reflection Equivariant Quantum Neural Networks for Enhanced Image Classification

abstract: Machine learning is among the most widely anticipated use cases for near-term quantum computers, however there remain significant theoretical and implementation challenges impeding its scale up. In particular, there is an emerging body of work which suggests that generic, data agnostic quantum machine learning (QML) architectures may suffer from severe trainability issues, with the gradient of typical variational parameters vanishing exponentially in the number of qubits. Additionally, the high expressibility of QML models can lead to overfitting on training data and poor generalisation performance. A promising strategy to combat both of these difficulties is to construct models which explicitly respect the symmetries inherent in their data, so-called geometric quantum machine learning (GQML). In this work, we utilise the techniques of GQML for the task of image classification, building new QML models which are equivariant with respect to reflections of the images. We find that these networks are capable of consistently and significantly outperforming generic ansatze on complicated real-world image datasets, bringing high-resolution image classification via quantum computers closer to reality. Our work highlights a potential pathway for the future development and implementation of powerful QML models which directly exploit the symmetries of data.


title: PIZZA: A new benchmark for complex end-to-end task-oriented parsing

abstract: Much recent work in task-oriented parsing has focused on finding a middle ground between flat slots and intents, which are inexpressive but easy to annotate, and powerful representations such as the lambda calculus, which are expressive but costly to annotate. This paper continues the exploration of task-oriented parsing by introducing a new dataset for parsing pizza and drink orders, whose semantics cannot be captured by flat slots and intents. We perform an extensive evaluation of deep-learning techniques for task-oriented parsing on this dataset, including different flavors of seq2seq systems and RNNGs. The dataset comes in two main versions, one in a recently introduced utterance-level hierarchical notation that we call TOP, and one whose targets are executable representations (EXR). We demonstrate empirically that training the parser to directly generate EXR notation not only solves the problem of entity resolution in one fell swoop and overcomes a number of expressive limitations of TOP notation, but also results in significantly greater parsing accuracy.


title: Multi-view Tracking, Re-ID, and Social Network Analysis of a Flock of Visually Similar Birds in an Outdoor Aviary

abstract: The ability to capture detailed interactions among individuals in a social group is foundational to our study of animal behavior and neuroscience. Recent advances in deep learning and computer vision are driving rapid progress in methods that can record the actions and interactions of multiple individuals simultaneously. Many social species, such as birds, however, live deeply embedded in a three-dimensional world. This world introduces additional perceptual challenges such as occlusions, orientation-dependent appearance, large variation in apparent size, and poor sensor coverage for 3D reconstruction, that are not encountered by applications studying animals that move and interact only on 2D planes. Here we introduce a system for studying the behavioral dynamics of a group of songbirds as they move throughout a 3D aviary. We study the complexities that arise when tracking a group of closely interacting animals in three dimensions and introduce a novel dataset for evaluating multi-view trackers. Finally, we analyze captured ethogram data and demonstrate that social context affects the distribution of sequential interactions between birds in the aviary.


title: Tuning Structural, Transport and Magnetic Properties of Epitaxial SrRuO3 through Ba-Substitution

abstract: The perovskite ruthenates (ARuO3, A = Ca, Ba, or Sr) exhibit unique properties owing to a subtle interplay of crystal structure and electronic-spin degrees of freedom. Here, we demonstrate an intriguing continuous tuning of crystal symmetry from orthorhombic to tetragonal (no octahedral rotations) phases in epitaxial SrRuO3 achieved via Ba-substitution (Sr1-xBaxRuO3 with 0 < x < 0.7). An initial Ba-substitution to SrRuO3 not only changes the ferromagnetic properties, but also tunes the perpendicular magnetic anisotropy via flattening the Ru-O-Ru bond angle (to 180{\deg}), resulting in the maximum Curie temperature and an extinction of RuO6 rotational distortions at x = 0.20. For x > 0.2, the suppression of RuO6 octahedral rotational distortion dominantly enhances the ferromagnetism in the system, though competing with the impact of the RuO6 tetragonal distortion. Further increasing x > 0.2 gradually enhances the tetragonal-type distortion, resulting in the tuning of Ru-4d orbital occupancy and suppression of ferromagnetism. Our results demonstrate that isovalent substitution of the A-site cations significantly and controllably impacts both electronic and magnetic properties of perovskite oxides.


title: Gaussian Process Barrier States for Safe Trajectory Optimization and Control

abstract: This paper proposes embedded Gaussian Process Barrier States (GP-BaS), a methodology to safely control unmodeled dynamics of nonlinear system using Bayesian learning. Gaussian Processes (GPs) are used to model the dynamics of the safety-critical system, which is subsequently used in the GP-BaS model. We derive the barrier state dynamics utilizing the GP posterior, which is used to construct a safety embedded Gaussian process dynamical model (GPDM). We show that the safety-critical system can be controlled to remain inside the safe region as long as we can design a controller that renders the BaS-GPDM's trajectories bounded (or asymptotically stable). The proposed approach overcomes various limitations in early attempts at combining GPs with barrier functions due to the abstention of restrictive assumptions such as linearity of the system with respect to control, relative degree of the constraints and number or nature of constraints. This work is implemented on various examples for trajectory optimization and control including optimal stabilization of unstable linear system and safe trajectory optimization of a Dubins vehicle navigating through an obstacle course and on a quadrotor in an obstacle avoidance task using GP differentiable dynamic programming (GP-DDP). The proposed framework is capable of maintaining safe optimization and control of unmodeled dynamics and is purely data driven.


title: Model-independent test for the cosmic distance duality relation with Pantheon and eBOSS DR16 quasar sample

abstract: In this paper, we carry out a new model-independent cosmological test for the cosmic distance duality relation~(CDDR) by combining the latest five baryon acoustic oscillations (BAO) measurements and the Pantheon type Ia supernova (SNIa) sample. Particularly, the BAO measurement from extended Baryon Oscillation Spectroscopic Survey~(eBOSS) data release~(DR) 16 quasar sample at effective redshift $z=1.48$ is used, and two methods, i.e. a compressed form of Pantheon sample and the Artificial Neural Network~(ANN) combined with the binning SNIa method, are applied to overcome the redshift-matching problem. Our results suggest that the CDDR is compatible with the observations, and the high-redshift BAO and SNIa data can effectively strengthen the constraints on the violation parameters of CDDR with the confidence interval decreasing by more than 20 percent. In addition, we find that the compressed form of observational data can provide a more rigorous constraint on the CDDR, and thus can be generalized to the applications of other actual observational data with limited sample size in the test for CDDR.


title: On the Compatibility between Neural Networks and Partial Differential Equations for Physics-informed Learning

abstract: We shed light on a pitfall and an opportunity in physics-informed neural networks (PINNs). We prove that a multilayer perceptron (MLP) only with ReLU (Rectified Linear Unit) or ReLU-like Lipschitz activation functions will always lead to a vanished Hessian. Such a network-imposed constraint contradicts any second- or higher-order partial differential equations (PDEs). Therefore, a ReLU-based MLP cannot form a permissible function space for the approximation of their solutions. Inspired by this pitfall, we prove that a linear PDE up to the $n$-th order can be strictly satisfied by an MLP with $C^n$ activation functions when the weights of its output layer lie on a certain hyperplane, as called the out-layer-hyperplane. An MLP equipped with the out-layer-hyperplane becomes "physics-enforced", no longer requiring a loss function for the PDE itself (but only those for the initial and boundary conditions). Such a hyperplane exists not only for MLPs but for any network architecture tailed by a fully-connected hidden layer. To our knowledge, this should be the first PINN architecture that enforces point-wise correctness of PDEs. We show a closed-form expression of the out-layer-hyperplane for second-order linear PDEs, which can be generalised to higher-order nonlinear PDEs.


title: Decision Market Based Learning For Multi-agent Contextual Bandit Problems

abstract: Information is often stored in a distributed and proprietary form, and agents who own information are often self-interested and require incentives to reveal their information. Suitable mechanisms are required to elicit and aggregate such distributed information for decision making. In this paper, we use simulations to investigate the use of decision markets as mechanisms in a multi-agent learning system to aggregate distributed information for decision-making in a contextual bandit problem. The system utilises strictly proper decision scoring rules to assess the accuracy of probabilistic reports from agents, which allows agents to learn to solve the contextual bandit problem jointly. Our simulations show that our multi-agent system with distributed information can be trained as efficiently as a centralised counterpart with a single agent that receives all information. Moreover, we use our system to investigate scenarios with deterministic decision scoring rules which are not incentive compatible. We observe the emergence of more complex dynamics with manipulative behaviour, which agrees with existing theoretical analyses.