title: Bayesian data selection

abstract: Insights into complex, high-dimensional data can be obtained by discovering features of the data that match or do not match a model of interest. To formalize this task, we introduce the "data selection" problem: finding a lower-dimensional statistic - such as a subset of variables - that is well fit by a given parametric model of interest. A fully Bayesian approach to data selection would be to parametrically model the value of the statistic, nonparametrically model the remaining "background" components of the data, and perform standard Bayesian model selection for the choice of statistic. However, fitting a nonparametric model to high-dimensional data tends to be highly inefficient, statistically and computationally. We propose a novel score for performing both data selection and model selection, the "Stein volume criterion", that takes the form of a generalized marginal likelihood with a kernelized Stein discrepancy in place of the Kullback-Leibler divergence. The Stein volume criterion does not require one to fit or even specify a nonparametric background model, making it straightforward to compute - in many cases it is as simple as fitting the parametric model of interest with an alternative objective function. We prove that the Stein volume criterion is consistent for both data selection and model selection, and we establish consistency and asymptotic normality (Bernstein-von Mises) of the corresponding generalized posterior on parameters. We validate our method in simulation and apply it to the analysis of single-cell RNA sequencing datasets using probabilistic principal components analysis and a spin glass model of gene regulation.


title: Baryonic Imprints on DM Halos: Population Statistics from Dwarf Galaxies to Galaxy Clusters

abstract: In a purely cold dark matter universe, the initial matter power spectrum and its subsequent gravitational growth contain no special mass- or time-scales, and so neither do the emergent population statistics of internal dark matter (DM) halo properties. Using 1.5 million halos from three IllustrisTNG realizations of a LambdaCDM universe, we show that galaxy formation physics drives non-monotonic features ("wiggles") into DM property statistics across six decades in halo mass, from dwarf galaxies to galaxy clusters. We characterize these features by extracting the halo mass-dependent statistics of five DM halo properties -- velocity dispersion, NFW concentration, density- and velocity-space shapes, and formation time -- using kernel-localized linear regression (KLLR). Comparing precise estimates of normalizations, slopes, and covariances between realizations with and without galaxy formation, we find systematic deviations across all mass-scales, with maximum deviations of 25% at the Milky-Way mass of 1e12 Msun. The mass-dependence of the wiggles is set by the interplay between different cooling and feedback mechanisms, and we discuss its observational implications. The property covariances depend strongly on halo mass and physics treatment, but the correlations are mostly robust. Using multivariate KLLR and interpretable machine learning, we show the halo concentration and velocity-space shape are principal contributors, at different mass, to the velocity dispersion variance. Statistics of mass accretion rate and DM surface pressure energy are provided in an appendix. We publicly release halo property catalogs and KLLR parameters for the TNG runs at twenty epochs up to z = 12.


title: On the Utility of Transmission Color Analysis I: Differentiating Super-Earths and Sub-Neptunes

abstract: The majority of exoplanets found to date have been discovered via the transit method, and transmission spectroscopy represents the primary method of studying these distant worlds. Currently, in-depth atmospheric characterization of transiting exoplanets entails the use of spectrographs on large telescopes, requiring significant observing time to study each planet. Previous studies have demonstrated trends for solar system worlds using color-color photometry of reflectance spectra, as well as trends within transmission spectra for hot Jupiters. Building on these concepts, we have investigated the use of transmission color photometric analysis for efficient, coarse categorization of exoplanets and for assessing the nature of these worlds, with a focus on resolving the bulk composition degeneracy to aid in discriminating super-Earths and sub-Neptunes. We present our methodology and first results, including spectrum models, model comparison frameworks, and wave band selection criteria. We present our results for different transmission "color" metrics, filter selection methods, and numbers of filters. Assuming noise-free spectra of isothermal atmospheres in chemical equilibrium, with our pipeline, we are able to constrain atmospheric mean molecular weight in order to distinguish between super-Earth and sub-Neptune atmospheres with >90$\%$ overall accuracy using as few as two specific low-resolution filter combinations. We also found that increasing the number of filters does not substantially impact this performance. This method could allow for broad characterization of large numbers of planets much more efficiently than current methods permit, enabling population and system-level studies. Additionally, data collected via this method could inform follow-up observing time by large telescopes for more detailed studies of worlds of interest.


title: Individual Mobility Prediction via Attentive Marked Temporal Point Processes

abstract: Individual mobility prediction is an essential task for transportation demand management and traffic system operation. There exist a large body of works on modeling location sequence and predicting the next location of users; however, little attention is paid to the prediction of the next trip, which is governed by the strong spatiotemporal dependencies between diverse attributes, including trip start time $t$, origin $o$, and destination $d$. To fill this gap, in this paper we propose a novel point process-based model -- Attentive Marked temporal point processes (AMTPP) -- to model human mobility and predict the whole trip $(t,o,d)$ in a joint manner. To encode the influence of history trips, AMTPP employs the self-attention mechanism with a carefully designed positional embedding to capture the daily/weekly periodicity and regularity in individual travel behavior. Given the unique peaked nature of inter-event time in human behavior, we use an asymmetric log-Laplace mixture distribution to precisely model the distribution of trip start time $t$. Furthermore, an origin-destination (OD) matrix learning block is developed to model the relationship between every origin and destination pair. Experimental results on two large metro trip datasets demonstrate the superior performance of AMTPP.


title: Vision Transformers For Weeds and Crops Classification Of High Resolution UAV Images

abstract: Crop and weed monitoring is an important challenge for agriculture and food production nowadays. Thanks to recent advances in data acquisition and computation technologies, agriculture is evolving to a more smart and precision farming to meet with the high yield and high quality crop production. Classification and recognition in Unmanned Aerial Vehicles (UAV) images are important phases for crop monitoring. Advances in deep learning models relying on Convolutional Neural Network (CNN) have achieved high performances in image classification in the agricultural domain. Despite the success of this architecture, CNN still faces many challenges such as high computation cost, the need of large labelled datasets, ... Natural language processing's transformer architecture can be an alternative approach to deal with CNN's limitations. Making use of the self-attention paradigm, Vision Transformer (ViT) models can achieve competitive or better results without applying any convolution operations. In this paper, we adopt the self-attention mechanism via the ViT models for plant classification of weeds and crops: red beet, off-type beet (green leaves), parsley and spinach. Our experiments show that with small set of labelled training data, ViT models perform better compared to state-of-the-art CNN-based models EfficientNet and ResNet, with a top accuracy of 99.8\% achieved by the ViT model.


title: Iterative Pseudo-Labeling with Deep Feature Annotation and Confidence-Based Sampling

abstract: Training deep neural networks is challenging when large and annotated datasets are unavailable. Extensive manual annotation of data samples is time-consuming, expensive, and error-prone, notably when it needs to be done by experts. To address this issue, increased attention has been devoted to techniques that propagate uncertain labels (also called pseudo labels) to large amounts of unsupervised samples and use them for training the model. However, these techniques still need hundreds of supervised samples per class in the training set and a validation set with extra supervised samples to tune the model. We improve a recent iterative pseudo-labeling technique, Deep Feature Annotation (DeepFA), by selecting the most confident unsupervised samples to iteratively train a deep neural network. Our confidence-based sampling strategy relies on only dozens of annotated training samples per class with no validation set, considerably reducing user effort in data annotation. We first ascertain the best configuration for the baseline -- a self-trained deep neural network -- and then evaluate our confidence DeepFA for different confidence thresholds. Experiments on six datasets show that DeepFA already outperforms the self-trained baseline, but confidence DeepFA can considerably outperform the original DeepFA and the baseline.


title: Homeostatic Criticality in Neuronal Networks

abstract: In self-organized criticality (SOC) models, as well as in standard phase transitions, criticality is only present for vanishing external fields $h \to 0$. Considering that this is rarely the case for natural systems, such a restriction poses a challenge to the explanatory power of these models. Besides that, in models of dissipative systems like earthquakes, forest fires, and neuronal networks, there is no true critical behavior, as expressed in clean power laws obeying finite-size scaling, but a scenario called "dirty" criticality or self-organized quasi-criticality (SOqC). Here, we propose simple homeostatic mechanisms which promote self-organization of coupling strengths, gains, and firing thresholds in neuronal networks. We show that with an adequate separation of the timescales for the coupling strength and firing threshold dynamics, near criticality (SOqC) can be reached and sustained even in the presence of significant external input. The firing thresholds adapt to and cancel the inputs ($h$ decreases towards zero). Similar mechanisms can be proposed for the couplings and local thresholds in spin systems and cellular automata, which could lead to applications in earthquake, forest fire, stellar flare, voting, and epidemic modeling.

categories: nlin.AO cond-mat.dis-nn cond-mat.stat-mech q-bio.NC


title: Azimuthal propagation of star formation in nearby spiral galaxies: NGC 628, NGC 3726 and NGC 6946

abstract: Star formation induced by a spiral shock wave, which in turn is generated by a spiral density wave, produces an azimuthal age gradient across the spiral arm, which has opposite signs on either side of the corotational resonance. An analysis of the spatial separation between young star clusters and nearby HII regions made it possible to determine the position of the corotation radius in the studied galaxies. Fourier analysis of the gas velocity field in the same galaxies independently confirmed the corotation radius estimates obtained by the morphological method presented here.


title: Moduli of Fontaine--Laffaille representations and a mod-$p$ local-global compatibility result

abstract: Let $F/F^+$ be a CM field and let $\widetilde{v}$ be a finite unramified place of $F$ above the prime $p$. Let $\overline{r}: \mathrm{Gal}(\overline{\mathbb{Q}}/F)\rightarrow \mathrm{GL}_n(\overline{\mathbb{F}}_p)$ be a continuous representation which we assume to be modular for a unitary group over $F^+$ which is compact at all real places. We prove, under Taylor--Wiles hypotheses, that the smooth $\mathrm{GL}_n(F_{\widetilde{v}})$-action on the corresponding Hecke isotypical part of the mod-$p$ cohomology with infinite level above $\widetilde{v}|_{F^+}$ determines $\overline{r}|_{\mathrm{Gal}(\overline{\mathbb{Q}}_p/F_{\widetilde{v}})}$, when this latter restriction is Fontaine--Laffaille and has a suitably generic semisimplification.


title: Tractability Frontier for Dually-Closed Temporal Quantified Constraint Satisfaction Problems

abstract: A temporal (constraint) language is a relational structure with a first-order definition in the rational numbers with the order. We study here the complexity of the Quantified Constraint Satisfaction Problem (QCSP) for temporal constraint languages. Our main contribution is a dichotomy for the restricted class of dually-closed temporal languages. We prove that QCSP for such a language is either solvable in polynomial time or it is hard for NP or coNP. Our result generalizes a similar dichotomy of QCSPs for equality languages, which are relational structures definable by Boolean combinations of equalities.


title: Automatic Landmarks Correspondence Detection in Medical Images with an Application to Deformable Image Registration

abstract: Purpose: Deformable Image Registration (DIR) can benefit from additional guidance using corresponding landmarks in the images. However, the benefits thereof are largely understudied, especially due to the lack of automatic landmark detection methods for three-dimensional (3D) medical images. Approach: We present a Deep Convolutional Neural Network (DCNN), called DCNN-Match, that learns to predict landmark correspondences in 3D images in a self-supervised manner. We trained DCNN-Match on pairs of Computed Tomography (CT) scans containing simulated deformations. We explored five variants of DCNN-Match that use different loss functions and assessed their effect on the spatial density of predicted landmarks and the associated matching errors. We also tested DCNN-Match variants in combination with the open-source registration software Elastix to assess the impact of predicted landmarks in providing additional guidance to DIR. Results: We tested our approach on lower-abdominal CT scans from cervical cancer patients: 121 pairs containing simulated deformations and 11 pairs demonstrating clinical deformations. The results showed significant improvement in DIR performance when landmark correspondences predicted by DCNN-Match were used in the case of simulated (p = $0e^0$) as well as clinical deformations (p = 0.030). We also observed that the spatial density of the automatic landmarks with respect to the underlying deformation affect the extent of improvement in DIR. Finally, DCNN-Match was found to generalize to Magnetic Resonance Imaging (MRI) scans without requiring retraining, indicating easy applicability to other datasets. Conclusions: DCNN-Match learns to predict landmark correspondences in 3D medical images in a self-supervised manner, which can improve DIR performance.


title: OKSP: A Novel Deep Learning Automatic Event Detection Pipeline for Seismic Monitoringin Costa Rica

abstract: Small magnitude earthquakes are the most abundant but the most difficult to locate robustly and well due to their low amplitudes and high frequencies usually obscured by heterogeneous noise sources. They highlight crucial information about the stress state and the spatio-temporal behavior of fault systems during the earthquake cycle, therefore, its full characterization is then crucial for improving earthquake hazard assessment. Modern DL algorithms along with the increasing computational power are exploiting the continuously growing seismological databases, allowing scientists to improve the completeness for earthquake catalogs, systematically detecting smaller magnitude earthquakes and reducing the errors introduced mainly by human intervention. In this work, we introduce OKSP, a novel automatic earthquake detection pipeline for seismic monitoring in Costa Rica. Using Kabre supercomputer from the Costa Rica High Technology Center, we applied OKSP to the day before and the first 5 days following the Puerto Armuelles, M6.5, earthquake that occurred on 26 June, 2019, along the Costa Rica-Panama border and found 1100 more earthquakes previously unidentified by the Volcanological and Seismological Observatory of Costa Rica. From these events, a total of 23 earthquakes with magnitudes below 1.0 occurred a day to hours prior to the mainshock, shedding light about the rupture initiation and earthquake interaction leading to the occurrence of this productive seismic sequence. Our observations show that for the study period, the model was 100% exhaustive and 82% precise, resulting in an F1 score of 0.90. This effort represents the very first attempt for automatically detecting earthquakes in Costa Rica using deep learning methods and demonstrates that, in the near future, earthquake monitoring routines will be carried out entirely by AI algorithms.


title: Bringing a Ruler Into the Black Box: Uncovering Feature Impact from Individual Conditional Expectation Plots

abstract: As machine learning systems become more ubiquitous, methods for understanding and interpreting these models become increasingly important. In particular, practitioners are often interested both in what features the model relies on and how the model relies on them--the feature's impact on model predictions. Prior work on feature impact including partial dependence plots (PDPs) and Individual Conditional Expectation (ICE) plots has focused on a visual interpretation of feature impact. We propose a natural extension to ICE plots with ICE feature impact, a model-agnostic, performance-agnostic feature impact metric drawn out from ICE plots that can be interpreted as a close analogy to linear regression coefficients. Additionally, we introduce an in-distribution variant of ICE feature impact to vary the influence of out-of-distribution points as well as heterogeneity and non-linearity measures to characterize feature impact. Lastly, we demonstrate ICE feature impact's utility in several tasks using real-world data.


title: From dS to AdS and back

abstract: We describe in more detail the general relation uncovered in our previous work between boundary correlators in de Sitter (dS) and in Euclidean anti-de Sitter (EAdS) space, at any order in perturbation theory. Assuming the Bunch-Davies vacuum at early times, any given diagram contributing to a boundary correlator in dS can be expressed as a linear combination of Witten diagrams for the corresponding process in EAdS, where the relative coefficients are fixed by consistent on-shell factorisation in dS. These coefficients are given by certain sinusoidal factors which account for the change in coefficient of the contact sub-diagrams from EAdS to dS, which we argue encode (perturbative) unitary time evolution in dS. dS boundary correlators with Bunch-Davies initial conditions thus perturbatively have the same singularity structure as their Euclidean AdS counterparts and the identities between them allow to directly import the wealth of techniques, results and understanding from AdS to dS. This includes the Conformal Partial Wave expansion and, by going from single-valued Witten diagrams in EAdS to Lorentzian AdS, the Froissart-Gribov inversion formula. We give a few (among the many possible) applications both at tree and loop level. Such identities between boundary correlators in dS and EAdS are made manifest by the Mellin-Barnes representation of boundary correlators, which we point out is a useful tool in its own right as the analogue of the Fourier transform for the dilatation group. The Mellin-Barnes representation in particular makes manifest factorisation and dispersion formulas for bulk-to-bulk propagators in (EA)dS, which imply Cutkosky cutting rules and dispersion formulas for boundary correlators in (EA)dS. Our results are completely general and in particular apply to any interaction of (integer) spinning fields.


title: Screening the Discrepancy Function of a Computer Model

abstract: Screening traditionally refers to the problem of detecting active inputs in the computer model. In this paper, we develop methodology that applies to screening, but the main focus is on detecting active inputs not in the computer model itself but rather on the discrepancy function that is introduced to account for model inadequacy when linking the computer model with field observations. We contend this is an important problem as it informs the modeler which are the inputs that are potentially being mishandled in the model, but also along which directions it may be less recommendable to use the model for prediction. The methodology is Bayesian and is inspired by the continuous spike and slab prior popularized by the literature on Bayesian variable selection. In our approach, and in contrast with previous proposals, a single MCMC sample from the full model allows us to compute the posterior probabilities of all the competing models, resulting in a methodology that is computationally very fast. The approach hinges on the ability to obtain posterior inclusion probabilities of the inputs, which are very intuitive and easy to interpret quantities, as the basis for selecting active inputs. For that reason, we name the methodology PIPS -- posterior inclusion probability screening.


title: Hydrodynamic integrability via geometry

abstract: This paper develops a geometric approach to the theory of integrability by hydrodynamic reductions to establish an equivalence, for a large class of quasilinear systems, between hydrodynamic integrability and the existence of nets compatible with the geometry induced on the codomain of the system. This unifies and extends known results for three subclasses of such systems. The generalization is obtained by studying the algebraic geometry of the characteristic correspondence of the system, and by introducing a generalized notion of conjugate nets.


title: Heterodyned Likelihood for Rapid Gravitational Wave Parameter Inference

abstract: Inferring the source properties of a gravitational wave signal has traditionally been very computationally intensive and time consuming. In recent years, several techniques have been developed that can significantly reduce the computational cost while delivering rapid and accurate parameter inference. One of the most powerful of these techniques is the heterodyned likelihood, which uses a reference waveform to base-band the likelihood calculation. Here an efficient implementation of the heterodyned likelihood is presented that can be used for a wide range of signal types and for both ground based and space based interferometers. The computational savings relative to direct calculation of the likelihood vary between two and four orders of magnitude depending on the system. The savings are greatest for low mass systems such as neutron star binaries. The heterodyning procedure can incorporate marginalization over calibration uncertainties and the noise power spectrum.


title: Improved Upper Bound on the Linear Tur\'an Number of the Crown

abstract: A linear $3$-graph is a set of vertices along with a set of edges, which are three element subsets of the vertices, such that any two edges intersect in at most one vertex. The crown, $C$, is a specific $3$-graph consisting of three pairwise disjoint edges, called jewels, along with a fourth edge intersecting all three jewels. For a linear $3$-graph, $F$, the linear Tur\'an number, $ex(n,F)$, is the maximum number of edges in any linear $3$-graph that does not contain $F$ as a subgraph. Currently, the best known bounds on the linear Tur\'an number of the crown are \[ 6 \Big \lfloor \frac{n-3}{4}\Big \rfloor \leq ex(n, C) \leq 2n. \] In this paper, the upper bound is improved to $ex(n,C) < \frac{5n}{3}$.


title: Sorting with Teams

abstract: We fully solve a sorting problem with heterogeneous firms and multiple heterogeneous workers whose skills are imperfect substitutes. We show that optimal sorting, which we call mixed and countermonotonic, is comprised of two regions. In the first region, mediocre firms sort with mediocre workers and coworkers such that the output losses are equal across all these teams (mixing). In the second region, a high skill worker sorts with low skill coworkers and a high productivity firm (countermonotonicity). We characterize the equilibrium wages and firm values. Quantitatively, our model can generate the dispersion of earnings within and across US firms.


title: FDFB: Full Domain Functional Bootstrapping Towards Practical Fully Homomorphic Encryption

abstract: Computation on ciphertexts of all known fully homomorphic encryption (FHE) schemes induces some noise, which, if too large, will destroy the plaintext. Therefore, the bootstrapping technique that re-encrypts a ciphertext and reduces the noise level remains the only known way of building FHE schemes for arbitrary unbounded computations. The bootstrapping step is also the major efficiency bottleneck in current FHE schemes. A promising direction towards improving concrete efficiency is to exploit the bootstrapping process to perform useful computation while reducing the noise at the same time. We show a bootstrapping algorithm, which embeds a lookup table and evaluates arbitrary functions of the plaintext while reducing the noise. Depending on the choice of parameters, the resulting homomorphic encryption scheme may be either an exact FHE or homomorphic encryption for approximate arithmetic. Since we can evaluate arbitrary functions over the plaintext space, we can use the natural homomorphism of Regev encryption to compute affine functions without bootstrapping almost for free. Consequently, our algorithms are particularly suitable for circuits with many additions and scalar multiplication gates. We achieve record speeds for such circuits. For example, in the exact FHE setting, we achieve a speedup of a factor of over 3000x over state-of-the-art methods. Effectively, we bring the evaluation time from weeks or days down to a few hours or minutes. Furthermore, we note that the speedup gets more significant with the size of the affine function. We provide a tight error analysis and show several parameter sets for our bootstrapping. Finally, we implement our algorithm and provide extensive tests. We demonstrate our algorithms by evaluating different neural networks in several parameter and accuracy settings.


title: Analyzing XOR-Forrelation through stochastic calculus

abstract: In this note we present a simplified analysis of the quantum and classical complexity of the $k$-XOR Forrelation problem (introduced in the paper of Girish, Raz and Zhan) by a stochastic interpretation of the Forrelation distribution.


title: Minimum Number of Bends of Paths of Trees in a Grid Embedding

abstract: We are interested in embedding trees T with maximum degree at most four in a rectangular grid, such that the vertices of T correspond to grid points, while edges of T correspond to non-intersecting straight segments of the grid lines. Such embeddings are called straight models. While each edge is represented by a straight segment, a path of T is represented in the model by the union of the segments corresponding to its edges, which may consist of a path in the model having several bends. The aim is to determine a straight model of a given tree T minimizing the maximum number of bends over all paths of T. We provide a quadratic-time algorithm for this problem. We also show how to construct straight models that have k as its minimum number of bends and with the least number of vertices possible. As an application of our algorithm, we provide an upper bound on the number of bends of EPG models of graphs that are both VPT and EPT.


title: Detecting Inspiring Content on Social Media

abstract: Inspiration moves a person to see new possibilities and transforms the way they perceive their own potential. Inspiration has received little attention in psychology, and has not been researched before in the NLP community. To the best of our knowledge, this work is the first to study inspiration through machine learning methods. We aim to automatically detect inspiring content from social media data. To this end, we analyze social media posts to tease out what makes a post inspiring and what topics are inspiring. We release a dataset of 5,800 inspiring and 5,800 non-inspiring English-language public post unique ids collected from a dump of Reddit public posts made available by a third party and use linguistic heuristics to automatically detect which social media English-language posts are inspiring.


title: An Intelligent Material with Chemical Pathway Networks

abstract: A new type of material with embedded intelligence, namely 'intelligent plasma', is introduced. Such new material exhibits programmable chemical pathway networks resembling artificial neural networks. As a Markov process of chemistry, the chemical pathway network can be customized and thus the intelligent plasmas can be programmed to make their own decisions to react to the dynamic external and internal conditions. It finally can accomplish complex missions without any external controls from the humans while relying on its preprogrammed chemical network topology before the mission. To that end, only basic data input and readings are required without any external controls during the mission. The approach to 'if' conditions and 'while' loops of the programmable intelligent plasmas are also discussed with examples of applications including automatic workflows, and signal processing.


title: Improving Dietary Assessment Via Integrated Hierarchy Food Classification

abstract: Image-based dietary assessment refers to the process of determining what someone eats and how much energy and nutrients are consumed from visual data. Food classification is the first and most crucial step. Existing methods focus on improving accuracy measured by the rate of correct classification based on visual information alone, which is very challenging due to the high complexity and inter-class similarity of foods. Further, accuracy in food classification is conceptual as description of a food can always be improved. In this work, we introduce a new food classification framework to improve the quality of predictions by integrating the information from multiple domains while maintaining the classification accuracy. We apply a multi-task network based on a hierarchical structure that uses both visual and nutrition domain specific information to cluster similar foods. Our method is validated on the modified VIPER-FoodNet (VFN) food image dataset by including associated energy and nutrient information. We achieve comparable classification accuracy with existing methods that use visual information only, but with less error in terms of energy and nutrient values for the wrong predictions.


title: Probing neutrino decay scenarios by using the Earth matter effects on supernova neutrinos

abstract: The observation of Earth matter effects in the spectrum of neutrinos coming from a next galactic core-collapse supernova (CCSN) could, in principle, reveal if neutrino mass ordering is normal or inverted. One of the possible ways to identify the mass ordering is through the observation of the modulations that appear in the spectrum when neutrinos travel through the Earth before they arrive at the detector. These features in the neutrino spectrum depend on two factors, the average neutrino energies, and the difference between the primary neutrino fluxes of electron and other flavors produced inside the supernova. However, recent studies indicate that the Earth matter effect for CCSN neutrinos is expected to be rather small and difficult to be observed by currently operating or planned neutrino detectors mainly because of the similarity of average energies and fluxes between electron and other flavors of neutrinos, unless the distance to CCSN is significantly smaller than the typically expected one, $\sim 10$ kpc. Here, we are looking towards the possibility if the non-standard neutrino properties such as decay of neutrinos can enhance the Earth matter effect. In this work we show that invisible neutrino decay can potentially enhance significantly the Earth matter effect for both $\nu_e$ and $\bar{\nu}_e$ channels at the same time for both mass orderings, even if the neutrino spectra between electron and other flavors of neutrinos are very similar, which is a different feature not expected for CCSN neutrinos with standard oscillation without the decay effect.


title: Does BERT Learn as Humans Perceive? Understanding Linguistic Styles through Lexica

abstract: People convey their intention and attitude through linguistic styles of the text that they write. In this study, we investigate lexicon usages across styles throughout two lenses: human perception and machine word importance, since words differ in the strength of the stylistic cues that they provide. To collect labels of human perception, we curate a new dataset, Hummingbird, on top of benchmarking style datasets. We have crowd workers highlight the representative words in the text that makes them think the text has the following styles: politeness, sentiment, offensiveness, and five emotion types. We then compare these human word labels with word importance derived from a popular fine-tuned style classifier like BERT. Our results show that the BERT often finds content words not relevant to the target style as important words used in style prediction, but humans do not perceive the same way even though for some styles (e.g., positive sentiment and joy) human- and machine-identified words share significant overlap for some styles.


title: The Second Generalization of the Hausdorff Dimension Theorem for Random Fractals

abstract: In this paper, we present a second partial solution for the problem of cardinality calculation of the set of fractals for its subcategory of the random virtual ones. Consistent with the deterministic case, we show that for the given quantities of Hausdorff dimension and Lebesgue measure, there are aleph-two virtual random fractals with almost surely Hausdorff dimension of a bivariate function of them and the expected Lebesgue measure equal to the later one. The associated results for three other fractal dimensions are similar to the case given for the Hausdorff dimension. The problem remains unsolved for the case of non-Euclidean abstract fractal spaces.


title: Single-Camera 3D Head Fitting for Mixed Reality Clinical Applications

abstract: We address the problem of estimating the shape of a person's head, defined as the geometry of the complete head surface, from a video taken with a single moving camera, and determining the alignment of the fitted 3D head for all video frames, irrespective of the person's pose. 3D head reconstructions commonly tend to focus on perfecting the face reconstruction, leaving the scalp to a statistical approximation. Our goal is to reconstruct the head model of each person to enable future mixed reality applications. To do this, we recover a dense 3D reconstruction and camera information via structure-from-motion and multi-view stereo. These are then used in a new two-stage fitting process to recover the 3D head shape by iteratively fitting a 3D morphable model of the head with the dense reconstruction in canonical space and fitting it to each person's head, using both traditional facial landmarks and scalp features extracted from the head's segmentation mask. Our approach recovers consistent geometry for varying head shapes, from videos taken by different people, with different smartphones, and in a variety of environments from living rooms to outdoor spaces.


title: On some explicit integrals related to "fractal foothills"

abstract: In the previous papers, we tried to analyze the complete loop counting functions that count all the loops in an infinite random walk represented by digits of a real number. In this paper, the consideration will be restricted to the partial loop counting functions $V$ that count the returns to the origin only. This simplification allows us to find closed-form expressions for various integrals related to $V$. Some applications to the complete loop counting functions, in particular, their connections with Bernoulli polynomials, are also provided.


title: X-ray binaries in M51 I: catalog and statistics

abstract: We used archival data from the \emph{Chandra X-ray Observatory} (\emph{Chandra}) and the \emph{Hubble Space Telescope}, to identify 334 candidate X-ray binary (XRB) systems and their potential optical counterparts in the interacting galaxy pair NGC 5194/5195 (M51). We present the catalog and data analysis of X-ray and optical properties for those sources, from the deep $892$ ks \emph{Chandra} observations, along with the magnitudes of candidate optical sources as measured in the $8.16$ ks \emph{HST} observations. The X-ray luminosity function of the X-ray sources above a few times $10^{36}\, {\rm erg\,s^{-1}}$ follows a power law $N(>L_{X,b})\propto L_{X,b}^{1-\alpha}$ with $\alpha=1.65\pm0.03$. Aproximately 80\% of sources are variable over a 30 day window. Nearly half of the X-ray sources (173/334) have an optical counterparts within $0{\mbox{$.\!\!^{\prime\prime}$}}5$.


title: Constrained Synchronization for Commutative Automata and Automata with Simple Idempotents

abstract: For general input automata, there exist regular constraint languages such that asking if a given input automaton admits a synchronizing word in the constraint language is PSPACE-complete or NP-complete. Here, we investigate this problem for commutative automata over an arbitrary alphabet and automata with simple idempotents over a binary alphabet as input automata. The latter class contains, for example, the \v{C}ern\'y family of automata. We find that for commutative input automata, the problem is always solvable in polynomial time, for every constraint language. For input automata with simple idempotents over a binary alphabet and with a constraint language given by a partial automaton with up to three states, the constrained synchronization problem is also solvable in polynomial time.


title: Active Perception with Neural Networks

abstract: Active perception has been employed in many domains, particularly in the field of robotics. The idea of active perception is to utilize the input data to predict the next action that can help robots to improve their performance. The main challenge lies in understanding the input data to be coupled with the action, and gathering meaningful information of the environment in an efficient way is necessary and desired. With recent developments of neural networks, interpreting the perceived data has become possible at the semantic level, and real-time interpretation based on deep learning has enabled the efficient closing of the perception-action loop. This report highlights recent progress in employing active perception based on neural networks for single and multi-agent systems.


title: Zero-curvature point of minimal graphs

abstract: Motivated by a classical result of Finn and Osserman (1964), who proved that the Scherk surface over the square inscribed in the unit disk is extremal for the Gaussian curvature of the point $O$ (so-called \emph{centre}) of the minimal graphs above the center $0$ of unit unit disk, provided the tangent plane is horizontal, we ask and answer to the question concerned the extremal of "second derivative" of the Gaussian curvature of such graphs provided that its curvature at $O$ is zero. We prove that the extremals are certain Scherk type minimal surfaces over the regular hexagon inscribed in the unit disk, provided that the Gaussian curvature vanishes and the tangent plane is horizontal at the centre.


title: Universal quantum computing with twist-free and temporally encoded lattice surgery

abstract: Lattice surgery protocols allow for the efficient implementation of universal gate sets with two-dimensional topological codes where qubits are constrained to interact with one another locally. In this work, we first introduce a decoder capable of correcting spacelike and timelike errors during lattice surgery protocols. Afterwards, we compute logical failure rates of a lattice surgery protocol for a biased circuit-level noise model. We then provide a new protocol for performing twist-free lattice surgery, where we avoid twist defects in the bulk of the lattice. Our twist-free protocol eliminates the extra circuit components and gate scheduling complexities associated with the measurement of higher weight stabilizers when using twist defects. We also provide a protocol for temporally encoded lattice surgery that can be used to reduce both runtimes and the total space-time costs of quantum algorithms. Lastly, we propose a layout for a quantum processor that is more efficient for rectangular surface codes exploiting noise bias, and which is compatible with the other techniques mentioned above.


title: WhyAct: Identifying Action Reasons in Lifestyle Vlogs

abstract: We aim to automatically identify human action reasons in online videos. We focus on the widespread genre of lifestyle vlogs, in which people perform actions while verbally describing them. We introduce and make publicly available the WhyAct dataset, consisting of 1,077 visual actions manually annotated with their reasons. We describe a multimodal model that leverages visual and textual information to automatically infer the reasons corresponding to an action presented in the video.


title: Zero-Shot Out-of-Distribution Detection Based on the Pre-trained Model CLIP

abstract: In an out-of-distribution (OOD) detection problem, samples of known classes(also called in-distribution classes) are used to train a special classifier. In testing, the classifier can (1) classify the test samples of known classes to their respective classes and also (2) detect samples that do not belong to any of the known classes (i.e., they belong to some unknown or OOD classes). This paper studies the problem of zero-shot out-of-distribution(OOD) detection, which still performs the same two tasks in testing but has no training except using the given known class names. This paper proposes a novel yet simple method (called ZOC) to solve the problem. ZOC builds on top of the recent advances in zero-shot classification through multi-modal representation learning. It first extends the pre-trained language-vision model CLIP by training a text-based image description generator on top of CLIP. In testing, it uses the extended model to generate candidate unknown class names for each test sample and computes a confidence score based on both the known class names and candidate unknown class names for zero-shot OOD detection. Experimental results on 5 benchmark datasets for OOD detection demonstrate that ZOC outperforms the baselines by a large margin.


title: Pano3D: A Holistic Benchmark and a Solid Baseline for $360^o$ Depth Estimation

abstract: Pano3D is a new benchmark for depth estimation from spherical panoramas. It aims to assess performance across all depth estimation traits, the primary direct depth estimation performance targeting precision and accuracy, and also the secondary traits, boundary preservation, and smoothness. Moreover, Pano3D moves beyond typical intra-dataset evaluation to inter-dataset performance assessment. By disentangling the capacity to generalize to unseen data into different test splits, Pano3D represents a holistic benchmark for $360^o$ depth estimation. We use it as a basis for an extended analysis seeking to offer insights into classical choices for depth estimation. This results in a solid baseline for panoramic depth that follow-up works can build upon to steer future progress.


title: Rigorous justification for the space-split sensitivity algorithm to compute linear response in Anosov systems

abstract: Ruelle gave a formula for linear response of transitive Anosov diffeomorphisms. Recently, practically computable realizations of Ruelle's formula have emerged that potentially enable sensitivity analysis of certain high-dimensional chaotic numerical simulations encountered in the applied sciences. In this paper, we provide full mathematical justification for the convergence of one such efficient computation, the space-split sensitivity, or S3, algorithm. In S3, Ruelle's formula is computed as a sum of two terms obtained by decomposing the perturbation vector field into a coboundary and a remainder that is parallel to the unstable direction. Such a decomposition results in a splitting of Ruelle's formula that is amenable to efficient computation. We prove the existence of the S3 decomposition and the convergence of the computations of both resulting components of Ruelle's formula.


title: Synchronized Co-evolution between Supermassive Black Holes and Galaxies Over the Last Seven Billion Years as Revealed by the Hyper Suprime-Cam

abstract: We measure the evolution of the $M_{\rm BH}-M_*$ relation using 584 uniformly-selected SDSS quasars at $0.2<z<0.8$. The black-hole masses ($M_{\rm BH}$) are derived from the single-epoch virial mass estimator using the H$\beta$ emission line, and span the range $7.0<{\rm log}\,M_{\rm BH}/M_\odot<9.5$. The host-galaxy stellar masses ($M_*$), which cover the interval $10.0<{\rm log}\,M_* / M_\odot <11.5$, are determined by performing two-dimensional quasar-host decomposition of the Hyper Suprime-Cam images and spectral energy distribution fitting. To quantify sample-selection biases and measurement uncertainties on the mass terms, a mock quasar sample is constructed to jointly constrain the redshift evolution of the $M_{\rm BH}-M_*$ relation and its intrinsic scatter ($\sigma_\mu$) through forward modeling. We find that the level of evolution is degenerate with $\sigma_\mu$, such that both positive mild evolution (i.e, $M_{\rm BH}/M_*$ increases with redshift) with a small $\sigma_\mu$, and negative mild evolution with a larger $\sigma_\mu$ are consistent with our data. The posterior distribution of $\sigma_\mu$ enables us to put a strong constraint on the intrinsic scatter of the $M_{\rm BH}-M_*$ relation, which has a best inference of $0.25_{-0.04}^{+0.03}$ dex, consistent with the local value. The redshift evolution of the $M_{\rm BH}-M_*$ relation relative to the local relation is constrained to be $(1+z)^{0.12_{-0.27}^{+0.28}}$, in agreement with no significant evolution since $z\sim0.8$. The tight and non-evolving $M_{\rm BH}-M_*$ relation is suggestive of a coupling through AGN feedback or/and a common gas supply at work, thus restricting the mass ratio of galaxies and their black holes to a limited range. Given the considerable stellar disk component, the $M_{\rm BH}-M_{\rm bulge}$ relation may evolve as previously seen at higher redshifts.


title: Training Deep Networks from Zero to Hero: avoiding pitfalls and going beyond

abstract: Training deep neural networks may be challenging in real world data. Using models as black-boxes, even with transfer learning, can result in poor generalization or inconclusive results when it comes to small datasets or specific applications. This tutorial covers the basic steps as well as more recent options to improve models, in particular, but not restricted to, supervised learning. It can be particularly useful in datasets that are not as well-prepared as those in challenges, and also under scarce annotation and/or small data. We describe basic procedures: as data preparation, optimization and transfer learning, but also recent architectural choices such as use of transformer modules, alternative convolutional layers, activation functions, wide and deep networks, as well as training procedures including as curriculum, contrastive and self-supervised learning.


title: End-to-end Neural Information Status Classification

abstract: Most previous studies on information status (IS) classification and bridging anaphora recognition assume that the gold mention or syntactic tree information is given (Hou et al., 2013; Roesiger et al., 2018; Hou, 2020; Yu and Poesio, 2020). In this paper, we propose an end-to-end neural approach for information status classification. Our approach consists of a mention extraction component and an information status assignment component. During the inference time, our system takes a raw text as the input and generates mentions together with their information status. On the ISNotes corpus (Markert et al., 2012), we show that our information status assignment component achieves new state-of-the-art results on fine-grained IS classification based on gold mentions. Furthermore, our system performs significantly better than other baselines for both mention extraction and fine-grained IS classification in the end-to-end setting. Finally, we apply our system on BASHI (Roesiger, 2018) and SciCorp (Roesiger, 2016) to recognize referential bridging anaphora. We find that our end-to-end system trained on ISNotes achieves competitive results on bridging anaphora recognition compared to the previous state-of-the-art system that relies on syntactic information and is trained on the in-domain datasets (Yu and Poesio, 2020).


title: In situ visualization of regional-scale natural hazards with Galaxy and Material Point Method

abstract: Visualizing regional-scale landslides is essential to conveying the threat of natural hazards to stakeholders and policymakers. Traditional visualization techniques are restricted to post-processing a limited subset of simulation data and are not scalable to rendering regional-scale models. In situ visualization is a technique of rendering simulation data in real-time, i.e., rendering visuals in tandem while the simulation is running. This study develops a scalable N:M interface architecture to visualize regional-scale landslides. We demonstrate the scalability of the architecture by simulating the long runout of the 2014 Oso landslide using the Material Point Method coupled with the Galaxy ray tracing engine rendering 4.2 million material points as spheres. In situ visualization has an amortized runtime increase of 2% compared to non-visualized simulations. The developed approach can achieve in situ visualization of regional-scale landslides with minimal impact on the simulation process.


title: Motion Artifact Reduction In Photoplethysmography For Reliable Signal Selection

abstract: Photoplethysmography (PPG) is a non-invasive and economical technique to extract vital signs of the human body. Although it has been widely used in consumer and research grade wrist devices to track a user's physiology, the PPG signal is very sensitive to motion which can corrupt the signal's quality. Existing Motion Artifact (MA) reduction techniques have been developed and evaluated using either synthetic noisy signals or signals collected during high-intensity activities - both of which are difficult to generalize for real-life scenarios. Therefore, it is valuable to collect realistic PPG signals while performing Activities of Daily Living (ADL) to develop practical signal denoising and analysis methods. In this work, we propose an automatic pseudo clean PPG generation process for reliable PPG signal selection. For each noisy PPG segment, the corresponding pseudo clean PPG reduces the MAs and contains rich temporal details depicting cardiac features. Our experimental results show that 71% of the pseudo clean PPG collected from ADL can be considered as high quality segment where the derived MAE of heart rate and respiration rate are 1.46 BPM and 3.93 BrPM, respectively. Therefore, our proposed method can determine the reliability of the raw noisy PPG by considering quality of the corresponding pseudo clean PPG signal.


title: Proportional-Integral Projected Gradient Method for Infeasibility Detection in Conic Optimization

abstract: A constrained optimization problem is primal infeasible if its constraints cannot be satisfied, and dual infeasible if the constraints of its dual problem cannot be satisfied. We propose a novel iterative method, named proportional-integral projected gradient method (PIPG), for detecting primal and dual infeasiblity in convex optimization with quadratic objective function and conic constraints. The iterates of PIPG either asymptotically provide a proof of primal or dual infeasibility, or asymptotically satisfy a set of primal-dual optimality conditions. Unlike existing methods, PIPG does not compute matrix inverse, which makes it better suited for large-scale and real-time applications. We demonstrate the application of PIPG in quasiconvex and mixed-integer optimization using examples in constrained optimal control.


title: Analysis of Dampers in Time-Sensitive Networks with Non-ideal Clocks

abstract: Dampers are devices that reduce delay jitter in the context of time-sensitive networks, by delaying packets for the amount written in packet headers. Jitter reduction is required by some real-time applications; beyond this, dampers have the potential to solve the burstiness cascade problem of deterministic networks in a scalable way, as they can be stateless. Dampers exist in several variants: some apply only to earliest-deadline-first schedulers, whereas others can be associated with any packet schedulers; some enforce FIFO ordering whereas some others do not. Existing analyses of dampers are specific to some implementations and some network configurations; also, they assume ideal, non-realistic clocks. In this paper, we provide a taxonomy of all existing dampers in general network settings and analyze their timing properties in presence of non-ideal clocks. In particular, we give formulas for computing residual jitter bounds of networks with dampers of any kind. We show that non-FIFO dampers may cause reordering due to clock non-idealities and that the combination of FIFO dampers with non-FIFO network elements may very negatively affect the performance bounds. Our results can be used to analyze timing properties and burstiness increase in any time-sensitive network, as we illustrate on an industrial case-study.


title: The $\mathrm{Br} = \mathrm{Br}'$ question for some classifying stacks

abstract: In this paper we consider the $\mathrm{Br} = \mathrm{Br}'$ question for classifying stacks by various group schemes. These are algebraic stacks that do not necessarily admit a finite flat cover by a scheme for which $\mathrm{Br} = \mathrm{Br}'$ holds, hence are not amenable to the usual argument of pushing forward a twisted vector bundle. We provide two classes of examples satisfying $\mathrm{Br} \ne \mathrm{Br}'$ that do not "arise from" the scheme case.


title: Backward asymptotics in S-unimodal maps

abstract: While the forward trajectory of a point in a discrete dynamical system is always unique, in general a point can have infinitely many backward trajectories. The union of the limit points of all backward trajectories through $x$ was called by M.~Hero the "special $\alpha$-limit" ($s\alpha$-limit for short) of $x$. In this article we show that there is a hierarchy of $s\alpha$-limits of points under iterations of a S-unimodal map: the size of the $s\alpha$-limit of a point increases monotonically as the point gets closer and closer to the attractor. The $s\alpha$-limit of any point of the attractor is the whole non-wandering set. This hierarchy reflects the structure of the graph of a S-unimodal map recently introduced jointly by Jim Yorke and the present author.


title: Tools for Network Traffic Generation -- A Quantitative Comparison

abstract: Network traffic generators are invaluable tools that allow for applied experimentation to evaluate the performance of networks, infrastructure, and security controls, by modelling and simulating the communication packets and payloads that would be produced by machines and devices on the network. Specifically for security applications, these tools can be used to consistently simulate malicious activity on the network and test the components designed to detect and mitigate malicious activities, in a highly reliable and customisable way. However, despite the promising features, most of these tools have some problems that can undermine the correctness of experiments. The accuracy of the simulation results depends strongly on the performance and reliability of the used generator. Thus, in this paper, we investigate the performance and accuracy of three of the most reviewed network traffic generators in literature, namely Cisco TRex, Ostinato and Genesids. Mainly, the comparative experiments examine the strengths and limitations of these tools, which can help the research community to choose the most suitable one to assess the performance of their networks and security controls


title: Analysis of the feedback particle filter with diffusion map based approximation of the gain

abstract: Control-type particle filters have been receiving increasing attention over the last decade as a means of obtaining sample based approximations to the sequential Bayesian filtering problem in the nonlinear setting. Here we analyse one such type, namely the feedback particle filter and a recently proposed approximation of the associated gain function based on diffusion maps. The key purpose is to provide analytic insights on the form of the approximate gain, which are of interest in their own right. These are then used to establish a roadmap to obtaining well-posedness and convergence of the finite $N$ system to its mean field limit. A number of possible future research directions are also discussed.


title: STRIVE: Scene Text Replacement In Videos

abstract: We propose replacing scene text in videos using deep style transfer and learned photometric transformations.Building on recent progress on still image text replacement,we present extensions that alter text while preserving the appearance and motion characteristics of the original video.Compared to the problem of still image text replacement,our method addresses additional challenges introduced by video, namely effects induced by changing lighting, motion blur, diverse variations in camera-object pose over time,and preservation of temporal consistency. We parse the problem into three steps. First, the text in all frames is normalized to a frontal pose using a spatio-temporal trans-former network. Second, the text is replaced in a single reference frame using a state-of-art still-image text replacement method. Finally, the new text is transferred from the reference to remaining frames using a novel learned image transformation network that captures lighting and blur effects in a temporally consistent manner. Results on synthetic and challenging real videos show realistic text trans-fer, competitive quantitative and qualitative performance,and superior inference speed relative to alternatives. We introduce new synthetic and real-world datasets with paired text objects. To the best of our knowledge this is the first attempt at deep video text replacement.


title: Binaural SoundNet: Predicting Semantics, Depth and Motion with Binaural Sounds

abstract: Humans can robustly recognize and localize objects by using visual and/or auditory cues. While machines are able to do the same with visual data already, less work has been done with sounds. This work develops an approach for scene understanding purely based on binaural sounds. The considered tasks include predicting the semantic masks of sound-making objects, the motion of sound-making objects, and the depth map of the scene. To this aim, we propose a novel sensor setup and record a new audio-visual dataset of street scenes with eight professional binaural microphones and a 360-degree camera. The co-existence of visual and audio cues is leveraged for supervision transfer. In particular, we employ a cross-modal distillation framework that consists of multiple vision teacher methods and a sound student method -- the student method is trained to generate the same results as the teacher methods do. This way, the auditory system can be trained without using human annotations. To further boost the performance, we propose another novel auxiliary task, coined Spatial Sound Super-Resolution, to increase the directional resolution of sounds. We then formulate the four tasks into one end-to-end trainable multi-tasking network aiming to boost the overall performance. Experimental results show that 1) our method achieves good results for all four tasks, 2) the four tasks are mutually beneficial -- training them together achieves the best performance, 3) the number and orientation of microphones are both important, and 4) features learned from the standard spectrogram and features obtained by the classic signal processing pipeline are complementary for auditory perception tasks. The data and code are released.


title: Deterministic three-photon down-conversion by a passive ultrastrong cavity-QED system

abstract: In ultra- and deep-strong cavity quantum electrodynamics (QED) systems, many intriguing phenomena that do not conserve the excitation number are expected to occur. In this study, we theoretically analyze the optical response of an ultrastrong cavity-QED system in which an atom is coupled to the fundamental and third harmonic modes of a cavity, and report the possibility of deterministic three-photon down-conversion of itinerant photons upon reflection at the cavity. In the conventional parametric down-conversion, a strong input field is needed because of the smallness of the transition matrix elements of the higher order processes. However, if we use an atom-cavity system in an unprecedentedly strong-coupling region, even a weak field in the linear-response regime is sufficient to cause this rare event involving the fourth order transitions.


title: Robustness and Generalization via Generative Adversarial Training

abstract: While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness against these variations. However, current defenses can only withstand the specific attack used in training, and the models often remain vulnerable to other input variations. Moreover, these methods often degrade performance of the model on clean images and do not generalize to out-of-domain samples. In this paper we present Generative Adversarial Training, an approach to simultaneously improve the model's generalization to the test set and out-of-domain samples as well as its robustness to unseen adversarial attacks. Instead of altering a low-level pre-defined aspect of images, we generate a spectrum of low-level, mid-level and high-level changes using generative models with a disentangled latent space. Adversarial training with these examples enable the model to withstand a wide range of attacks by observing a variety of input alterations during training. We show that our approach not only improves performance of the model on clean images and out-of-domain samples but also makes it robust against unforeseen attacks and outperforms prior work. We validate effectiveness of our method by demonstrating results on various tasks such as classification, segmentation and object detection.


title: Galois Orbits of TQFTs: Symmetries and Unitarity

abstract: We study Galois actions on $2+1$D topological quantum field theories (TQFTs), characterizing their interplay with theory factorization, gauging, the structure of gapped boundaries and dualities, 0-form symmetries, 1-form symmetries, and 2-groups. In order to gain a better physical understanding of Galois actions, we prove sufficient conditions for the preservation of unitarity. We then map out the Galois orbits of various classes of unitary TQFTs. The simplest such orbits are trivial (e.g., as in various theories of physical interest like the Toric Code, Double Semion, and 3-Fermion Model), and we refer to such theories as unitary "Galois fixed point TQFTs." Starting from these fixed point theories, we study conditions for preservation of Galois invariance under gauging 0-form and 1-form symmetries (as well as under more general anyon condensation). Assuming a conjecture in the literature, we prove that all unitary Galois fixed point TQFTs can be engineered by gauging 0-form symmetries of theories built from Deligne products of certain abelian TQFTs.

categories: hep-th cond-mat.str-el math-ph math.MP math.QA quant-ph


title: A Recursive Delay Estimation Algorithm for Linear Multivariable Systems with Time-varying Delays

abstract: Time delay estimation plays a critical role in control, stabilization and state estimation of many practical system with time delay. In this paper, we propose a method to estimate delay for discrete time linear multiple-input multiple-output systems with time-varying input delays. This method is purposefully given for situations where only a limited amount of information is available for the system. Although, this approach is primarily developed in a deterministic framework, it can also be applied to noisy data under special circumstances. In addition, switched linear autoregressive models with exogenous inputs are introduced as possible applications of the presented algorithm provided that the switching frequencies are small. Finally, effectiveness of the algorithm is illustrated by two numerical examples.


title: Privacy-Preserving Database Fingerprinting

abstract: When sharing sensitive relational databases with other parties, a database owner aims to (i) have privacy guarantees for the database entries, (ii) have liability guarantees (via fingerprinting) in case of unauthorized sharing of its database by the recipients, and (iii) provide a high quality (utility) database to the recipients. We observe that sharing a relational database with privacy and liability guarantees are orthogonal objectives. The former can be achieved by injecting noise into the database to prevent inference of the original data values, whereas, the latter can be achieved by hiding unique marks inside the database to trace malicious parties (data recipients) who redistribute the data without the authorization. We achieve these two objectives simultaneously by proposing a novel entry-level differentially-private fingerprinting mechanism for relational databases. At a high level, the proposed mechanism fulfills the privacy and liability requirements by leveraging the randomization nature that is intrinsic to fingerprinting and achieves desired entry-level privacy guarantees. To be more specific, we devise a bit-level random response scheme to achieve differential privacy guarantee for arbitrary data entries when sharing the entire database, and then, based on this, we develop an $\epsilon$-entry-level differentially-private fingerprinting mechanism. Next, we theoretically analyze the relationships between privacy guarantee, fingerprint robustness, and database utility by deriving closed form expressions. The outcome of this analysis allows us to bound the privacy leakage caused by attribute inference attack and characterize the privacy-utility coupling and privacy-fingerprint robustness coupling. Furthermore, we also propose a SVT-based solution to control the cumulative privacy loss when fingerprinted copies of a database are shared with multiple recipients.


title: Two-to-two processes at an electron-muon collider

abstract: Based on a recent proposal to build an electron-muon collider, we study two-to-two production processes e^- mu^+ --> f bar-f, gamma gamma that originate from dimension 6 and 8 operators. We compare the sensitivity to those effective couplings obtained at the collider with that of low energy measurements of mu --> e gamma, mu --> e bar-e e and mu --> e conversion that have recently been reported in the literature. Whereas for the production of first family fermions the sensitivity of the collider processes is much weaker, for the second and third family fermions it is similar or stronger than that of low-energy processes. In the case of e^- mu^+ --> gamma gamma, the sensitivity to a dimension 8 contact operator turns out to be the strongest in comparison.


title: Ignorable and non-ignorable missing data in hidden Markov models

abstract: We consider missing data in the context of hidden Markov models with a focus on situations where data is missing not at random (MNAR) and missingness depends on the identity of the hidden states. In simulations, we show that including a submodel for state-dependent missingness reduces bias when data is MNAR and state-dependent, whilst not reducing accuracy when data is missing at random (MAR). When missingness depends on time but not the hidden states, a model which only allows for state-dependent missingness is biased, whilst a model that allows for both state- and time-dependent missingness is not. Overall, these results show that modelling missingness as state-dependent, and including other relevant covariates, is a useful strategy in applications of hidden Markov models to time-series with missing data. We conclude with an application of the state- and time-dependent MNAR hidden Markov model to a real dataset, involving severity of schizophrenic symptoms in a clinical trial.


title: Behavioral assessment of a humanoid robot when attracting pedestrians in a mall

abstract: Research currently being conducted on the use of robots as human labor support technology. In particular, the service industry needs to allocate more manpower, and it will be important for robots to support people. This study focuses on using a humanoid robot as a social service robot to convey information in a shopping mall, and the robot's behavioral concepts were analyzed. In order to convey the information, two processes must occur. Pedestrians must stop in front of the robot, and the robot must continue the engagement with them. For the purpose of this study, three types of autonomous behavioral concepts of the robot for the general use were analyzed and compared in these processes in the experiment: active, passive-negative, and passive-positive concepts. After interactions were attempted with 65,000+ pedestrians, this study revealed that the passive-negative concept can make pedestrians stop more and stay longer. In order to evaluate the effectiveness of the robot in a real environment, the comparative results between three behaviors and human advertisers revealed that (1) the results of the active and passive-positive concepts of the robot are comparable to those of the humans, and (2) the performance of the passive-negative concept is higher than that of all participants. These findings demonstrate that the performance of robots is comparable to that of humans in providing information tasks in a limited environment; therefore, it is expected that service robots as a labor support technology will be able to perform well in the real world.


title: An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models

abstract: Prompt-based knowledge probing for 1-hop relations has been used to measure how much world knowledge is stored in pretrained language models. Existing work uses considerable amounts of data to tune the prompts for better performance. In this work, we compare a variety of approaches under a few-shot knowledge probing setting, where only a small number (e.g., 10 or 20) of example triples are available. In addition, we create a new dataset named TREx-2p, which contains 2-hop relations. We report that few-shot examples can strongly boost the probing performance for both 1-hop and 2-hop relations. In particular, we find that a simple-yet-effective approach of finetuning the bias vectors in the model outperforms existing prompt-engineering methods. Our dataset and code are available at \url{https://github.com/cloudygoose/fewshot_lama}.


title: Complementing Handcrafted Features with Raw Waveform Using a Light-weight Auxiliary Model

abstract: An emerging trend in audio processing is capturing low-level speech representations from raw waveforms. These representations have shown promising results on a variety of tasks, such as speech recognition and speech separation. Compared to handcrafted features, learning speech features via backpropagation provides the model greater flexibility in how it represents data for different tasks theoretically. However, results from empirical study shows that, in some tasks, such as voice spoof detection, handcrafted features are more competitive than learned features. Instead of evaluating handcrafted features and raw waveforms independently, this paper proposes an Auxiliary Rawnet model to complement handcrafted features with features learned from raw waveforms. A key benefit of the approach is that it can improve accuracy at a relatively low computational cost. The proposed Auxiliary Rawnet model is tested using the ASVspoof 2019 dataset and the results from this dataset indicate that a light-weight waveform encoder can potentially boost the performance of handcrafted-features-based encoders in exchange for a small amount of additional computational work.


title: FastAudio: A Learnable Audio Front-End for Spoof Speech Detection

abstract: Voice assistants, such as smart speakers, have exploded in popularity. It is currently estimated that the smart speaker adoption rate has exceeded 35% in the US adult population. Manufacturers have integrated speaker identification technology, which attempts to determine the identity of the person speaking, to provide personalized services to different members of the same family. Speaker identification can also play an important role in controlling how the smart speaker is used. For example, it is not critical to correctly identify the user when playing music. However, when reading the user's email out loud, it is critical to correctly verify the speaker that making the request is the authorized user. Speaker verification systems, which authenticate the speaker identity, are therefore needed as a gatekeeper to protect against various spoofing attacks that aim to impersonate the enrolled user. This paper compares popular learnable front-ends which learn the representations of audio by joint training with downstream tasks (End-to-End). We categorize the front-ends by defining two generic architectures and then analyze the filtering stages of both types in terms of learning constraints. We propose replacing fixed filterbanks with a learnable layer that can better adapt to anti-spoofing tasks. The proposed FastAudio front-end is then tested with two popular back-ends to measure the performance on the LA track of the ASVspoof 2019 dataset. The FastAudio front-end achieves a relative improvement of 27% when compared with fixed front-ends, outperforming all other learnable front-ends on this task.


title: Lightweight, Multi-Stage, Compiler-Assisted Application Specialization

abstract: Program debloating aims to enhance the performance and reduce the attack surface of bloated applications. Several techniques have been recently proposed to specialize programs. These approaches are either based on unsound strategies or demanding techniques, leading to unsafe results or a high overhead debloating process. In this paper, we address these limitations by applying partial-evaluation principles to generate specialized applications. Our approach relies on a simple observation that an application typically consists of configuration logic, followed by the main logic of the program. The configuration logic specifies what functionality in the main logic should be executed. LMCAS performs partial interpretation to capture a precise program state of the configuration logic based on the supplied inputs. LMCAS then applies partial-evaluation optimizations to generate a specialized program by propagating the constants in the captured partial state, eliminating unwanted code, and preserving the desired functionalities. Our evaluation of LMCAS on commonly used benchmarks and real-world applications shows that it successfully removes unwanted features while preserving the functionality and robustness of the deblated programs, runs faster than prior tools, and reduces the attack surface of specialized programs. LMCAS runs 1500x, 4.6x, and 1.2x faster than the state-of-the-art debloating tools CHISEL, RAZOR, and OCCAM, respectively; achieves 25% reduction in the binary size; reduces the attack surface of code-reuse attacks by removing 51.7% of the total gadgets and eliminating 83% of known CVE vulnerabilities


title: Net Buying Pressure and the Information in Bitcoin Option Trades

abstract: How do supply and demand from informed traders drive market prices of bitcoin options? Deribit options tick-level data supports the limits-to-arbitrage hypothesis about the market maker's supply. The main demand-side effects are that at-the-money option prices are largely driven by volatility traders and out-of-the-money options are simultaneously driven by volatility traders and those with proprietary information about the direction of future bitcoin price movements. The demand-side trading results contrast with prior studies on established options markets in the US and Asia, but we also show that Deribit is rapidly evolving into a more efficient channel for aggregating information from informed traders.


title: Finite Element Representations of Gaussian Processes: Balancing Numerical and Statistical Accuracy

abstract: The stochastic partial differential equation approach to Gaussian processes (GPs) represents Mat\'ern GP priors in terms of $n$ finite element basis functions and Gaussian coefficients with sparse precision matrix. Such representations enhance the scalability of GP regression and classification to datasets of large size $N$ by setting $n\approx N$ and exploiting sparsity. In this paper we reconsider the standard choice $n \approx N$ through an analysis of the estimation performance. Our theory implies that, under certain smoothness assumptions, one can reduce the computation and memory cost without hindering the estimation accuracy by setting $n \ll N$ in the large $N$ asymptotics. Numerical experiments illustrate the applicability of our theory and the effect of the prior lengthscale in the pre-asymptotic regime.


title: Photoelectron Transportation Dynamics in GaAs Photocathodes

abstract: We report here a general theory describing photoelectron transportation dynamics in GaAs semiconductor photocathodes. Gradient doping is incorporated in the model through the inclusion of directional carrier drift. The time-evolution of electron concentration in the active layer upon the injection of an excitation pulse is solved both numerically and analytically. The predictions of the model are compared with experiments via carrier-induced transient reflectivity change, which is measured for gradient-doped and uniform-doped photocathodes using femtosecond pump-probe reflectometry. Excellent agreement is found between the experiments and the theory, leading to the characterization of key device parameters such as diffusion constant and electron decay rates. Comparisons are also made between uniform doping and gradient doping for their characteristics in photoelectron transportation. Doping gradient is found to be able to accelerate electron accumulation on the device surface. These results offer new insights into the dynamics of III-V photocathodes and potentially open a new avenue toward experimental characterization of device parameters.


title: Two-dimensional Cobalt Telluride as Piezo-tribogenerator

abstract: Two-dimensional (2D) materials have been shown to be efficient in energy harvesting. Here, we report utilization of waste heat to generate electricity via combined piezoelectric and triboelectric property of 2D Cobalt Telluride (CoTe2). The piezo-triboelectric nanogenerator (PTNG) produced an open-circuit voltage of ~5V under 1N force and the effect of temperature in the 305-363 K range shows a four-fold energy conversion efficiency improvement. The 2D piezo-tribogenerator shows excellent characteristics with a maximum voltage of ~10V, fast response time and high responsivity. Density functional theory was used to gain further insights and validation of the experimental results. Our results could lead to energy harvesting approaches using 2D materials from various thermal sources and dissipated waste heat from electronic devices.


title: Triplet Fusion Upconversion Nanocapsules for Volumetric 3D Printing

abstract: Two-photon photopolymerization delivers prints without support structures and minimizes layering artifacts in a broad range of materials. This volumetric printing approach scans a focused light source throughout the entire volume of a resin vat and takes advantage of the quadratic power dependence of two photon absorption to produce photopolymerization exclusively at the focal point. While this approach has advantages, the widespread adoption of two photon photopolymerization is hindered by the need for expensive ultrafast lasers and extremely slow print speeds. Here we present an analogous quadratic process, triplet-triplet-annihilation-driven 3D printing, that enables volumetric printing at a focal point driven by <4 milliwatt-power continuous wave excitation. To induce photopolymerization deep within a vat, the key advance is the nanoencapsulation of photon upconversion solution within a silica shell decorated with solubilizing polymer ligands. This scalable self-assembly approach allows for scatter-free nanocapsule dispersal in a variety of organic media without leaking the capsule contents. We further introduce an excitonic strategy to systematically control the upconversion threshold to support either monovoxel or parallelized printing schemes, printing at power densities multiple orders of magnitude lower than power densities required for two-photon-based 3D printing. The application of upconversion nanocapsules to volumetric 3D printing provides access to the benefits of volumetric printing without the current cost, power, and speed drawbacks. The materials demonstrated here open opportunities for other triplet fusion upconversion-controlled applications.


title: Magnetic Field Dependent Piezoelectricity in Atomically Thin Co$_2$Te$_3$

abstract: Two dimensional (2D) materials have received a surge in research interest due to their exciting range of properties. Here we show that 2D cobalt telluride (Co2Te3), successfully synthesized via liquid-phase exfoliation in an organic solvent, exhibits weak ferromagnetism and semiconducting behavior at room temperature. The magnetic field-dependent piezoelectric properties of 2D Co2Te3 sample show magneto-electric response of the material and a linear relationship between the output voltage and applied magnetic field. First-principles density functional theory (DFT) and ab initio molecular dynamics are used to explain these experimental results. Our work could pave the way for the development of 2D materials with coupled magnetism and piezoelectricity, leading to new applications in electromagnetics.


title: Electronic and optical properties of Si$_{x}$Ge$_{1-x-y}$Sn$_{y}$ alloys lattice-matched to Ge

abstract: We present a combined experimental and theoretical analysis of the evolution of the near-band gap electronic and optical properties of Si$_{x}$Ge$_{1-x-y}$Sn$_{y}$ alloys lattice-matched to Ge and GaAs substrates. We perform photoreflectance (PR) and photoluminescence (PL) measurements on Si$_{x}$Ge$_{1-x-y}$Sn$_{y}$ epitaxial layers grown via chemical vapour deposition, for Si (Sn) compositions up to $x =$ 9.6% ($y =$ 2.5%). Our measurements indicate the presence of an indirect fundamental band gap, with PL observed $\approx$ 200-250 meV lower in energy than the direct $E_0$ transition identified by PR measurements. The measured PL is Ge-like, suggesting that the alloy conduction band (CB) edge is primarily derived from the Ge L-point CB minimum. Interpretation of the PR and PL measurements is supported by atomistic electronic structure calculations. Effective alloy band structures calculated via density functional theory confirm the presence of an indirect fundamental band gap, and reveal the origin of the observed inhomogeneous broadening of the measured optical spectra as being alloy-induced band hybridisation occurring close in energy to the CB edge. To analyze the evolution of the band gap, semi-empirical tight-binding (TB) calculations are employed to enable calculations for large supercell sizes. TB calculations reveal that the alloy CB edge is hybridized in nature, consisting at low Si and Sn compositions of an admixture of Ge L-, $\Gamma$- and X-point CB edge states, and confirm that the alloy CB edge retains primarily Ge L-point CB edge character. Our experimental measurements and theoretical calculations confirm a direct transition energy close to 1 eV in magnitude for Si and Sn compositions $x =$ 6.8 - 9.6% and $y =$ 1.6 - 2.2%.


title: Multifold enhancement in magnetization of atomically thin Cobalt Telluride

abstract: Magnetism in semiconductor two-dimensional (2D) materials is gaining popularity due to its potential application in memory devices, sensors, spintronic and biomedical applications. Here, 2D Cobalt Telluride (CoTe) has been synthesized from its bulk crystals using a simple and scalable liquid-phase exfoliation method. The atomically thin CoTe shows over four hundred times enhancement in its magnetic saturation values compared to the bulk form. The UV-Vis absorption spectra reveal superior absorption in the high energy region, suggesting a semiconducting nature. Furthermore, we explain bandgap and origin of high magnetic behavior by density functional theory (DFT) calculations. The 2D CoTe shows a larger magnetism compared to bulk CoTe due to the reduced coordination number of the surface atoms, shape anisotropy and surface charge effect.


title: Initial energy deposition and initiation mechanism of nanosecond laser damage caused by KDP surface micro-defects

abstract: To enable an exploration of the initiation mechanism of nanosecond laser damage on a potassium dihydrogen phosphate (KDP) surface, a defect-assisted energy deposition model is developed that involves light intensity enhancement and a sub-band gap energy level structure. The simulations provide an explanation on why the laser-induced damage threshold (LIDT) of the KDP crystal is two orders of magnitude lower than the theoretical value. The model is verified by use of the transient images that appear during the laser damage. In addition, the dimensions of the "dangerous" surface defects that are the most sensitive to the laser damage are proposed. This work enables clarification on the initial energy deposition (IED) and initiation mechanism of the nanosecond laser damage caused by the KDP surface defects on micro-nano scale. It is helpful in understanding the laser-matter interactions and to improve the processing technique for high quality optical components.


title: Analysis of MRI Biomarkers for Brain Cancer Survival Prediction

abstract: Prediction of Overall Survival (OS) of brain cancer patients from multi-modal MRI is a challenging field of research. Most of the existing literature on survival prediction is based on Radiomic features, which does not consider either non-biological factors or the functional neurological status of the patient(s). Besides, the selection of an appropriate cut-off for survival and the presence of censored data create further problems. Application of deep learning models for OS prediction is also limited due to the lack of large annotated publicly available datasets. In this scenario we analyse the potential of two novel neuroimaging feature families, extracted from brain parcellation atlases and spatial habitats, along with classical radiomic and geometric features; to study their combined predictive power for analysing overall survival. A cross validation strategy with grid search is proposed to simultaneously select and evaluate the most predictive feature subset based on its predictive power. A Cox Proportional Hazard (CoxPH) model is employed for univariate feature selection, followed by the prediction of patient-specific survival functions by three multivariate parsimonious models viz. Coxnet, Random survival forests (RSF) and Survival SVM (SSVM). The brain cancer MRI data used for this research was taken from two open-access collections TCGA-GBM and TCGA-LGG available from The Cancer Imaging Archive (TCIA). Corresponding survival data for each patient was downloaded from The Cancer Genome Atlas (TCGA). A high cross validation $C-index$ score of $0.82\pm.10$ was achieved using RSF with the best $24$ selected features. Age was found to be the most important biological predictor. There were $9$, $6$, $6$ and $2$ features selected from the parcellation, habitat, radiomic and region-based feature groups respectively.


title: Deep SIMBAD: Active Landmark-based Self-localization Using Ranking -based Scene Descriptor

abstract: Landmark-based robot self-localization has recently garnered interest as a highly-compressive domain-invariant approach for performing visual place recognition (VPR) across domains (e.g., time of day, weather, and season). However, landmark-based self-localization can be an ill-posed problem for a passive observer (e.g., manual robot control), as many viewpoints may not provide an effective landmark view. In this study, we consider an active self-localization task by an active observer and present a novel reinforcement learning (RL)-based next-best-view (NBV) planner. Our contributions are as follows. (1) SIMBAD-based VPR: We formulate the problem of landmark-based compact scene description as SIMBAD (similarity-based pattern recognition) and further present its deep learning extension. (2) VPR-to-NBV knowledge transfer: We address the challenge of RL under uncertainty (i.e., active self-localization) by transferring the state recognition ability of VPR to the NBV. (3) NNQL-based NBV: We regard the available VPR as the experience database by adapting nearest-neighbor approximation of Q-learning (NNQL). The result shows an extremely compact data structure that compresses both the VPR and NBV into a single incremental inverted index. Experiments using the public NCLT dataset validated the effectiveness of the proposed approach.


title: Identifying the Main Factors of Iran's Economic Growth using Growth Accounting Framework

abstract: This paper aims to present empirical analysis of Iranian economic growth from 1950 to 2018 using data from the World Bank, Madison Data Bank, Statistical Center of Iran, and Central Bank of Iran. The results show that Gross Domestic Product (GDP) per capital increased by 2 percent annually during this time, however this indicator has had a huge fluctuation over time. In addition, the economic growth of Iran and oil revenue have close relationship with each other. In fact, whenever oil crises happen, great fluctuation in growth rate and other indicators happened subsequently. Even though the shares of other sectors like industry and services in GDP have increased over time, the oil sector still plays a key role in the economic growth of Iran. Moreover, growth accounting analysis shows contribution of capital plays a significant role in economic growth of Iran. Furthermore, based on growth accounting framework the steady state of effective capital is 4.27 for Iran's economy.


title: CIDER: An Expressive, Nonlocal Feature Set for Machine Learning Density Functionals with Exact Constraints

abstract: Machine learning (ML) has recently gained attention as a means to develop more accurate exchange-correlation (XC) functionals for density functional theory, but functionals developed thus far need to be improved on several metrics, including accuracy, numerical stability, and transferability across chemical space. In this work, we introduce a set of nonlocal features of the density called the CIDER formalism, which we use to train a Gaussian process model for the exchange energy that obeys the critical uniform scaling rule for exchange. The resulting CIDER exchange functional is significantly more accurate than any semi-local functional tested here, and it has good transferability across main-group molecules. This work therefore serves as an initial step toward more accurate exchange functionals, and it also introduces useful techniques for developing robust, physics-informed XC models via ML.


title: Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval

abstract: Pretrained contextualized representations offer great success for many downstream tasks, including document ranking. The multilingual versions of such pretrained representations provide a possibility of jointly learning many languages with the same model. Although it is expected to gain big with such joint training, in the case of cross lingual information retrieval (CLIR), the models under a multilingual setting are not achieving the same level of performance as those under a monolingual setting. We hypothesize that the performance drop is due to the translation gap between query and documents. In the monolingual retrieval task, because of the same lexical inputs, it is easier for model to identify the query terms that occurred in documents. However, in the multilingual pretrained models that the words in different languages are projected into the same hyperspace, the model tends to translate query terms into related terms, i.e., terms that appear in a similar context, in addition to or sometimes rather than synonyms in the target language. This property is creating difficulties for the model to connect terms that cooccur in both query and document. To address this issue, we propose a novel Mixed Attention Transformer (MAT) that incorporates external word level knowledge, such as a dictionary or translation table. We design a sandwich like architecture to embed MAT into the recent transformer based deep neural models. By encoding the translation knowledge into an attention matrix, the model with MAT is able to focus on the mutually translated words in the input sequence. Experimental results demonstrate the effectiveness of the external knowledge and the significant improvement of MAT embedded neural reranking model on CLIR task.


title: Taming lattice artifacts with Pauli--Villars fields

abstract: As fermions are added to a lattice gauge theory, one is driven to stronger bare coupling in order to maintain the same renormalized coupling. Stronger bare couplings are usually associated with larger gauge fluctuations, leading to larger cutoff effects and more expensive simulations. In theories with many light fermions, sometimes the desired physical region cannot be reached before encountering a phase boundary. We show that these undesired effects can be reduced by adding Pauli--Villars fields. We reach significantly larger renormalized couplings while at the same time damping short-distance fluctuations of the gauge field. This may allow for controlled continuum extrapolations from large lattice spacings.


title: Safety-Critical Learning of Robot Control with Temporal Logic Specifications

abstract: Reinforcement learning (RL) is a promising approach. However, success is limited to real-world applications, because ensuring safe exploration and facilitating adequate exploitation is a challenge for controlling robotic systems with unknown models and measurement uncertainties. The learning problem becomes even more difficult for complex tasks over continuous state-action. In this paper, we propose a learning-based robotic control framework consisting of several aspects: (1) we leverage Linear Temporal Logic (LTL) to express complex tasks over infinite horizons that are translated to a novel automaton structure; (2) we detail an innovative reward scheme for LTL satisfaction with a probabilistic guarantee. Then, by applying a reward shaping technique, we develop a modular policy-gradient architecture exploiting the benefits of the automaton structure to decompose overall tasks and enhance the performance of learned controllers; (3) by incorporating Gaussian Processes (GPs) to estimate the uncertain dynamic systems, we synthesize a model-based safe exploration during the learning process using Exponential Control Barrier Functions (ECBFs) that generalize systems with high-order relative degrees; (4) to further improve the efficiency of exploration, we utilize the properties of LTL automata and ECBFs to propose a safe guiding process. Finally, we demonstrate the effectiveness of the framework via several robotic environments. We show an ECBF-based modular deep RL algorithm that achieves near-perfect success rates and safety guarding with high probability confidence during training.


title: A second-order accurate, operator splitting scheme for reaction-diffusion systems in an energetic variational formulation

abstract: A second-order accurate in time, positivity-preserving, and unconditionally energy stable operator splitting numerical scheme is proposed and analyzed for the system of reaction-diffusion equations with detailed balance. The scheme is designed based on an energetic variational formulation, in which the reaction part is reformulated in terms of the reaction trajectory, and both the reaction and diffusion parts dissipate the same free energy. At the reaction stage, the reaction trajectory equation is approximated by a second-order Crank-Nicolson type method. The unique solvability, positivity-preserving, and energy-stability are established based on a convexity analysis. In the diffusion stage, an exact integrator is applied if the diffusion coefficients are constant, and a Crank-Nicolson type scheme is applied if the diffusion process becomes nonlinear. In either case, both the positivity-preserving property and energy stability could be theoretically established. Moreover, a combination of the numerical algorithms at both stages by the Strang splitting approach leads to a second-order accurate, structure-preserving scheme for the original reaction-diffusion system. Numerical experiments are presented, which demonstrate the accuracy of the proposed scheme.