title: Self-similar extrapolation in quantum field theory

abstract: Calculations in field theory are usually accomplished by employing some variants of perturbation theory, for instance using loop expansions. These calculations result in asymptotic series in powers of small coupling parameters, which as a rule are divergent for finite values of the parameters. In this paper, a method is described allowing for the extrapolation of such asymptotic series to finite values of the coupling parameters, and even to their infinite limits. The method is based on self-similar approximation theory. This theory approximates well a large class of functions, rational, irrational, and transcendental. A method is presented, resulting in self-similar factor approximants allowing for the extrapolation of functions to arbitrary values of coupling parameters from only the knowledge of expansions in powers of small coupling parameters. The efficiency of the method is illustrated by several problems of quantum field theory.


title: Accretion induced black hole spin up revised by numerical GR MHD simulations

abstract: We investigate the accretion induced spin up of the black hole via numerical simulations. Our method is based on general-relativistic magneto-hydrodynamics of the slowly-rotating flows in the Kerr metric, where possibly transonic shock fronts may form. We account for the changing black hole mass and spin during accretion which enforces dynamical evolution of the space-time metric. We first study non-magnetized flows with shocks, and we also include magnetic field endowed in the gas. The aim of this study is to verify whether the high mass black holes may be produced with large spins, even though at birth the collapsars might have contained slowly, or moderately spinning cores. In this way, we put constraints on the content of angular momentum in the collapsing massive stars. Our studies are also showing that shock fronts and magnetic fields may halt accretion and limit the black hole spin-up in the exploding supernovae.


title: Confidence Calibration for Domain Generalization under Covariate Shift

abstract: Existing calibration algorithms address the problem of covariate shift via unsupervised domain adaptation. However, these methods suffer from the following limitations: 1) they require unlabeled data from the target domain, which may not be available at the stage of calibration in real-world applications and 2) their performance depends heavily on the disparity between the distributions of the source and target domains. To address these two limitations, we present novel calibration solutions via domain generalization. Our core idea is to leverage multiple calibration domains to reduce the effective distribution disparity between the target and calibration domains for improved calibration transfer without needing any data from the target domain. We provide theoretical justification and empirical experimental results to demonstrate the effectiveness of our proposed algorithms. Compared against state-of-the-art calibration methods designed for domain adaptation, we observe a decrease of 8.86 percentage points in expected calibration error or, equivalently, an increase of 35 percentage points in improvement ratio for multi-class classification on the Office-Home dataset.


title: Towards General Purpose Vision Systems

abstract: Computer vision systems today are primarily N-purpose systems, designed and trained for a predefined set of tasks. Adapting such systems to new tasks is challenging and often requires non-trivial modifications to the network architecture (e.g. adding new output heads) or training process (e.g. adding new losses). To reduce the time and expertise required to develop new applications, we would like to create general purpose vision systems that can learn and perform a range of tasks without any modification to the architecture or learning process. In this paper, we propose GPV-1, a task-agnostic vision-language architecture that can learn and perform tasks that involve receiving an image and producing text and/or bounding boxes, including classification, localization, visual question answering, captioning, and more. We also propose evaluations of generality of architecture, skill-concept transfer, and learning efficiency that may inform future work on general purpose vision. Our experiments indicate GPV-1 is effective at multiple tasks, reuses some concept knowledge across tasks, can perform the Referring Expressions task zero-shot, and further improves upon the zero-shot performance using a few training samples.


title: Determination of local defect density in diamond by double electron-electron resonance

abstract: Magnetic impurities in diamond influence the relaxation properties and thus limit the sensitivity of magnetic, electric, strain, and temperature sensors based on nitrogen-vacancy color centers. Diamond samples may exhibit significant spatial variations in the impurity concentrations hindering the quantitative analysis of relaxation pathways. Here, we present a local measurement technique which can be used to determine the concentration of various species of defects by utilizing double electron-electron resonance. This method will help to improve the understanding of the physics underlying spin relaxation and guide the development of diamond samples, as well as offering protocols for optimized sensing.


title: Dimensional reduction of cavities with axial symmetry: A complete analysis of when an optical fiber is approximately one-dimensional

abstract: Intuition dictates that a very long, very thin cavity (e.g., a fiber optic cable) could perhaps be modeled as an approximately one dimensional system. In this paper we rigorously explore the validity of such intuition from the perspective of a localized probe coupling to a quantum field inside a cavity (e.g., an atom or an Unruh-DeWitt particle detector in a fiber optic cable). To do so, we introduce the notion of subfield decomposition in which a $D+1$ dimensional quantum field in an axially-symmetric cavity can be reduced to an infinite collection of uncoupled, massive $1+1$ dimensional fields. We show that the ability to approximate a higher-dimensional scenario by a $1+1$ dimensional model is equivalent to making a certain change of the probe's shape in the higher-dimensional space. The approximation is justified whenever this change of shape is "small enough". In this light, we identify the dynamically relevant norm by which the magnitude of these changes in probe shape ought to be judged. Finally, we explore this approximation in particular setups corresponding to quantum optics and superconducting circuits.


title: Drug Discovery Approaches using Quantum Machine Learning

abstract: Traditional drug discovery pipeline takes several years and cost billions of dollars. Deep generative and predictive models are widely adopted to assist in drug development. Classical machines cannot efficiently produce atypical patterns of quantum computers which might improve the training quality of learning tasks. We propose a suite of quantum machine learning techniques e.g., generative adversarial network (GAN), convolutional neural network (CNN) and variational auto-encoder (VAE) to generate small drug molecules, classify binding pockets in proteins, and generate large drug molecules, respectively.


title: Gravitational Waves from Mini-Split SUSY

abstract: We show that color-breaking vacua may develop at high temperature in the Mini-Split Supersymmetry (SUSY) scenario. This can lead to a nontrivial cosmological history of the Universe, including strong first order phase transitions and domain wall production. Given the typical PeV energy scale associated with Mini-Split SUSY models, a stochastic gravitational wave background at frequencies around 1 kHz is expected. We study the potential for detection of such a signal in future gravitational wave experiments.


title: Limiting behaviour of the generalized simplex gradient as the number of points tends to infinity on a fixed shape in R^n

abstract: This work investigates the asymptotic behaviour of the gradient approximation method called the generalized simplex gradient (GSG). This method has an error bound that at first glance seems to tend to infinity as the number of sample points increases, but with some careful construction, we show that this is not the case. For functions in finite dimensions, we present two new error bounds ad infinitum depending on the position of the reference point. The error bounds are not a function of the number of sample points and thus remain finite.


title: Anytime Dense Prediction with Confidence Adaptivity

abstract: Anytime inference requires a model to make a progression of predictions which might be halted at any time. Prior research on anytime visual recognition has mostly focused on image classification. We propose the first unified and end-to-end approach for anytime dense prediction. A cascade of "exits" is attached to the model to make multiple predictions. We redesign the exits to account for the depth and spatial resolution of the features for each exit. To reduce total computation, and make full use of prior predictions, we develop a novel spatially adaptive approach to avoid further computation on regions where early predictions are already sufficiently confident. Our full method, named anytime dense prediction with confidence (ADP-C), achieves the same level of final accuracy as the base model, and meanwhile significantly reduces total computation. We evaluate our method on Cityscapes semantic segmentation and MPII human pose estimation: ADP-C enables anytime inference without sacrificing accuracy while also reducing the total FLOPs of its base models by 44.4% and 59.1%. We compare with anytime inference by deep equilibrium networks and feature-based stochastic sampling, showing that ADP-C dominates both across the accuracy-computation curve. Our code is available at https://github.com/liuzhuang13/anytime .


title: $O(1)$ Steiner Point Removal in Series-Parallel Graphs

abstract: We study how to vertex-sparsify a graph while preserving both the graph's metric and structure. Specifically, we study the Steiner point removal (SPR) problem where we are given a weighted graph $G=(V,E,w)$ and terminal set $V' \subseteq V$ and must compute a weighted minor $G'=(V',E', w')$ of $G$ which approximates $G$'s metric on $V'$. A major open question in the area of metric embeddings is the existence of $O(1)$ multiplicative distortion SPR solutions for every (non-trivial) minor-closed family of graphs. To this end prior work has studied SPR on trees, cactus and outerplanar graphs and showed that in these graphs such a minor exists with $O(1)$ distortion. We give $O(1)$ distortion SPR solutions for series-parallel graphs, extending the frontier of this line of work. The main engine of our approach is a new metric decomposition for series-parallel graphs which we call a hammock decomposition. Roughly, a hammock decomposition is a forest-like structure that preserves certain critical parts of the metric induced by a series-parallel graph.


title: Reservoir-Based Distributed Machine Learning for Edge Operation

abstract: We introduce a novel design for in-situ training of machine learning algorithms built into smart sensors, and illustrate distributed training scenarios using radio frequency (RF) spectrum sensors. Current RF sensors at the Edge lack the computational resources to support practical, in-situ training for intelligent signal classification. We propose a solution using Deepdelay Loop Reservoir Computing (DLR), a processing architecture that supports machine learning algorithms on resource-constrained edge-devices by leveraging delayloop reservoir computing in combination with innovative hardware. DLR delivers reductions in form factor, hardware complexity and latency, compared to the State-ofthe- Art (SoA) neural nets. We demonstrate DLR for two applications: RF Specific Emitter Identification (SEI) and wireless protocol recognition. DLR enables mobile edge platforms to authenticate and then track emitters with fast SEI retraining. Once delay loops separate the data classes, traditionally complex, power-hungry classification models are no longer needed for the learning process. Yet, even with simple classifiers such as Ridge Regression (RR), the complexity grows at least quadratically with the input size. DLR with a RR classifier exceeds the SoA accuracy, while further reducing power consumption by leveraging the architecture of parallel (split) loops. To authenticate mobile devices across large regions, DLR can be trained in a distributed fashion with very little additional processing and a small communication cost, all while maintaining accuracy. We illustrate how to merge locally trained DLR classifiers in use cases of interest.


title: Correlations between the strange quark condensate, strange quark mass, and kaon PCAC relation

abstract: Correlations between the strange quark mass, strange quark condensate $\langle \bar s s\rangle$, and the kaon partially conserved axial current (PCAC) relation are developed. The key dimensionless and renormalization-group invariant quantities in these correlations are the ratio of the strange to non-strange quark mass $r_m=m_s/m_q$, the condensate ratio $r_c=\langle \bar s s\rangle/\langle \bar q q\rangle$, and the kaon PCAC deviation parameter $r_p=-m_s\langle \bar s s+\bar q q\rangle/2f_K^2m_K^2$. The correlations define a self-consistent trajectory in the $\{r_m,r_c,r_p\}$ parameter space constraining strange quark parameters that can be used to assess the compatibility of different predictions of these parameters. Combining the constraint with Particle Data Group (PDG) values of $r_m$ results in $\{r_c,r_p\}$ constraint trajectories that are used to asses the self-consistency of various theoretical determinations of $\{r_c,r_p\}$. The most precise determinations of $r_c$ and $r_p$ are shown to be mutually consistent with the constraint trajectories and provide improved bounds on $r_p$. In general, the constraint trajectories combined with $r_c$ determinations tend to provide more accurate bounds on $r_p$ than direct determinations. The $\{r_c,r_p\}$ correlations provide a natural identification of a self-consistent set of strange quark mass and strange quark condensate parameters.


title: Sampling and statistical physics via symmetry

abstract: We formulate both Markov chain Monte Carlo (MCMC) sampling algorithms and basic statistical physics in terms of elementary symmetries. This perspective on sampling yields derivations of well-known MCMC algorithms and a new parallel algorithm that appears to converge more quickly than current state of the art methods. The symmetry perspective also yields a parsimonious framework for statistical physics and a practical approach to constructing meaningful notions of effective temperature and energy directly from time series data. We apply these latter ideas to Anosov systems.

categories: cond-mat.stat-mech math-ph math.DS math.MP math.ST stat.TH


title: Thurston Geometries in Three-Dimensional New Massive Gravity

abstract: We show that the three-dimensional Thurston geometries are vacuum solutions to the 3D new massive gravity equations of motion. We analyze their Lorentzian counterparts as well.


title: Reconciling the Discrete-Continuous Divide: Towards a Mathematical Theory of Sparse Communication

abstract: Neural networks and other machine learning models compute continuous representations, while humans communicate with discrete symbols. Reconciling these two forms of communication is desirable to generate human-readable interpretations or to learn discrete latent variable models, while maintaining end-to-end differentiability. Some existing approaches (such as the Gumbel-softmax transformation) build continuous relaxations that are discrete approximations in the zero-temperature limit, while others (such as sparsemax transformations and the hard concrete distribution) produce discrete/continuous hybrids. In this paper, we build rigorous theoretical foundations for these hybrids. Our starting point is a new "direct sum" base measure defined on the face lattice of the probability simplex. From this measure, we introduce a new entropy function that includes the discrete and differential entropies as particular cases, and has an interpretation in terms of code optimality, as well as two other information-theoretic counterparts that generalize the mutual information and Kullback-Leibler divergences. Finally, we introduce "mixed languages" as strings of hybrid symbols and a new mixed weighted finite state automaton that recognizes a class of regular mixed languages, generalizing closure properties of regular languages.


title: Closing up the cluster tension?

abstract: The excellent measurements of the cosmic microwave background (CMB) fluctuations by Planck allow us to tightly constrain the amplitude of matter fluctuations at redshift $\sim 1100$ in the $\Lambda$-cold dark matter ($\Lambda$CDM) model. This amplitude can be extrapolated to the present epoch, yielding constraints on the value of the $\sigma_8$ parameter. On the other hand, the abundance of Sunyaev-Zeldovich (SZ) clusters detected by Planck, with masses inferred using a hydrostatic equilibrium assumption, leads to a significantly lower value of the same parameter. This discrepancy is often dubbed the $\sigma_8$ tension in the literature and is sometimes regarded as a possible sign of new physics. Here, we examine a direct determination of $\sigma_8$ at the present epoch in $\Lambda$CDM, and thereby the cluster mass calibrations using cosmological data at low redshift, namely the measurements of $f\sigma_8$ from the analysis of the completed Sloan Digital Sky Survey (SDSS). We combined redshift-space distortion measurements with Planck CMB constraints, X-ray, and SZ cluster counts within the $\Lambda$CDM framework, but leaving the present-day amplitude of matter fluctuations as an independent parameter (i.e. no extrapolation is made from high-redshift CMB constraints). The calibration of X-ray and SZ masses are left as free parameters throughout the whole analysis. Our study yields tight constraints on the aforementioned calibrations, with values entirely consistent with results obtained from the full combination of CMB and cluster data only. Such an agreement suggests an absence of tension in the $\Lambda$CDM model between CMB-based estimates of $\sigma_8$ and constraints from low-redshift on $f\sigma_8$; however, it also indicates tension with the standard calibration of clusters masses.


title: Highly Efficient Bilateral Doping of Single-Walled Carbon Nanotubes

abstract: A boost in the development of flexible and wearable electronics facilitates the design of new materials to be applied as transparent conducting films (TCFs). Although single-walled carbon nanotube (SWCNT) films are the most promising candidates for flexible TCFs, they still do not meet optoelectronic requirements demanded their successful industrial integration. In this study, we proposed and thoroughly investigated a new approach that comprises simultaneous bilateral (outer and inner surfaces) SWCNT doping after their opening by thermal treatment at 400 C under an ambient air atmosphere. Doping by a chloroauric acid (HAuCl$_{4}$) ethanol solution allowed us to achieve the record value of sheet resistance of 31 $\pm$ 4 $\Omega$/sq at a transmittance of 90% in the middle of visible spectra (550 nm). The strong p-doping was examined by open-circuit potential (OCP) measurements and confirmed by ab initio calculations demonstrating a downshift of Fermi level around 1 eV for the case of bilateral doping.


title: Geometric features of nonlinear resolvents in the unit disk

abstract: We study nonlinear resolvents of holomorphic generators of one-parameter semigroups acting in the open unit disk. The class of nonlinear resolvents can be studied in the framework of geometric function theory because it consists of univalent functions. In this paper we establish distortion and covering results, find order of starlikeness and of strong starlikeness of resolvents. This provides that any resolvent admits quasiconformal extension to the complex plane $\C$. In addition, we obtain some characteristics of semigroups generated by these resolvents.


title: Engineering the Quantum Scientific Computing Open User Testbed (QSCOUT): Design details and user guide

abstract: The Quantum Scientific Computing Open User Testbed (QSCOUT) at Sandia National Laboratories is a trapped-ion qubit system designed to evaluate the potential of near-term quantum hardware in scientific computing applications for the US Department of Energy (DOE) and its Advanced Scientific Computing Research (ASCR) program. Similar to commercially available platforms, most of which are based on superconducting qubits, it offers quantum hardware that researchers can use to perform quantum algorithms, investigate noise properties unique to quantum systems, and test novel ideas that will be useful for larger and more powerful systems in the future. However, unlike most other quantum computing testbeds, QSCOUT uses trapped $^{171}$Yb$^{+}$ ions as the qubits, provides full connectivity between qubits, and allows both quantum circuit and low-level pulse control access to study new modes of programming and optimization. The purpose of this manuscript is to provide users and the general community with details of the QSCOUT hardware and its interface, enabling them to take maximum advantage of its capabilities.


title: Spectral properties of periodic systems cut at an angle

abstract: We consider a semi-periodic two-dimensional Schr\"odinger operator which is cut at an angle. When the cut is commensurate with the periodic lattice, the spectrum of the operator has the band-gap Bloch structure. We prove that in the incommensurable case, there are no gaps: the gaps of the bulk operator are filled with edge spectrum.

categories: math-ph cond-mat.mtrl-sci math.MP math.SP


title: Sensitivity of electromagnetically induced transparency to light-mediated interactions

abstract: Here we present a microscopic model that describes the Electromagnetically Induced Transparency (EIT) phenomenon in the multiple scattering regime. We consider an ensemble of cold three-level atoms, in a $\Lambda$ configuration, scattering a probe and a control field to the vacuum modes of the electromagnetic field. By first considering a scalar description of the scattering, we show that the light-mediated long-range interactions that emerge between the dipoles narrow the EIT transparency window for increasing densities and sample sizes. For a vectorial description, we demonstrate that near-field interacting terms can critically affect the atomic population transfer in the Stimulated Raman Adiabatic Passage (STIRAP). This result points out that standard STIRAP-based quantum memories in cold atomic ensembles would not reach high enough efficiencies for quantum information processing applications even in dilute regimes.


title: Flexible Instruction-Set Semantics via Type Classes

abstract: Instruction sets, from families like x86 and ARM, are at the center of many ambitious formal-methods projects. Many verification, synthesis, programming, and debugging tools rely on formal semantics of instruction sets, but different tools can use semantics in rather different ways. As a result, a central challenge for that community is how semantics should be written and what techniques should be used to connect them to new use cases. The best-known work applying single semantics across quite-different tools relies on domain-specific languages like Sail, where the language and its translation tools are specialized to the realm of instruction sets. We decided to explore a different approach, with semantics written in a carefully chosen subset of Haskell. This style does not depend on any new language translators, relying instead on parameterization of semantics over type-class instances. As a result, a semantics can be a first-class object within a logic, and application of a semantics for a new kind of tool can be a first-class operation in the logic, allowing sharing of theorems across applications. Our case study is for the open RISC-V instruction-set family, and we have used a single core semantics to support testing, interactive proof, and model checking of both software and hardware. We especially highlight an application of a first-class semantics within Coq that can be instantiated in different ways within one proof: simulation between variants where multiplication is implemented in hardware or in the machine code of a particular software trap handler.


title: Herd Behavior in Crypto Asset Market and Effect of Financial Information on Herd Behavior

abstract: The initial purpose of the study is to search whether the market exhibits herd behaviour or not by examining the crypto-asset market in the context of behavioural finance. And the second purpose of the study is to measure whether the financial information stimulates the herd behaviour or not. Within this frame, the announcements of the Federal Open Market Committee (FOMC), Governing Council of European Central Bank (ECB) and Policy Board of Bank of Japan (BOJ) for interest change, and S&P 500, Nikkei 225, FTSE 100 and GOLD SPOT indices data were used. In the study, the analyses were made over 100 cryptocurrencies with the highest trading volume by the use of the 2014:5 - 2019:12 period. For the analysis, the Markov Switching approach, as well as loads of empiric models developed by Chang et al. (2000), were used. According to the results obtained, the presence of herd behaviour in the crypto-asset market was determined in the relevant period. But it was found that interest rate announcements and stock exchange performances had no effect on herd behaviour.


title: SYSML: StYlometry with Structure and Multitask Learning: Implications for Darknet Forum Migrant Analysis

abstract: Darknet market forums are frequently used to exchange illegal goods and services between parties who use encryption to conceal their identities. The Tor network is used to host these markets, which guarantees additional anonymization from IP and location tracking, making it challenging to link across malicious users using multiple accounts (sybils). Additionally, users migrate to new forums when one is closed, making it difficult to link users across multiple forums. We develop a novel stylometry-based multitask learning approach for natural language and interaction modeling using graph embeddings to construct low-dimensional representations of short episodes of user activity for authorship attribution. We provide a comprehensive evaluation of our methods across four different darknet forums demonstrating its efficacy over the state-of-the-art, with a lift of up to 2.5X on Mean Retrieval Rank and 2X on Recall@10.


title: Coalitional strategies for efficient individual prediction explanation

abstract: As Machine Learning (ML) is now widely applied in many domains, in both research and industry, an understanding of what is happening inside the black box is becoming a growing demand, especially by non-experts of these models. Several approaches had thus been developed to provide clear insights of a model prediction for a particular observation but at the cost of long computation time or restrictive hypothesis that does not fully take into account interaction between attributes. This paper provides methods based on the detection of relevant groups of attributes -- named coalitions -- influencing a prediction and compares them with the literature. Our results show that these coalitional methods are more efficient than existing ones such as SHapley Additive exPlanation (SHAP). Computation time is shortened while preserving an acceptable accuracy of individual prediction explanations. Therefore, this enables wider practical use of explanation methods to increase trust between developed ML models, end-users, and whoever impacted by any decision where these models played a role.


title: Configurable Privacy-Preserving Automatic Speech Recognition

abstract: Voice assistive technologies have given rise to far-reaching privacy and security concerns. In this paper we investigate whether modular automatic speech recognition (ASR) can improve privacy in voice assistive systems by combining independently trained separation, recognition, and discretization modules to design configurable privacy-preserving ASR systems. We evaluate privacy concerns and the effects of applying various state-of-the-art techniques at each stage of the system, and report results using task-specific metrics (i.e. WER, ABX, and accuracy). We show that overlapping speech inputs to ASR systems present further privacy concerns, and how these may be mitigated using speech separation and optimization techniques. Our discretization module is shown to minimize paralinguistics privacy leakage from ASR acoustic models to levels commensurate with random guessing. We show that voice privacy can be configurable, and argue this presents new opportunities for privacy-preserving applications incorporating ASR.


title: Canonical and Surface Morphological Segmentation for Nguni Languages

abstract: Morphological Segmentation involves decomposing words into morphemes, the smallest meaning-bearing units of language. This is an important NLP task for morphologically-rich agglutinative languages such as the Southern African Nguni language group. In this paper, we investigate supervised and unsupervised models for two variants of morphological segmentation: canonical and surface segmentation. We train sequence-to-sequence models for canonical segmentation, where the underlying morphemes may not be equal to the surface form of the word, and Conditional Random Fields (CRF) for surface segmentation. Transformers outperform LSTMs with attention on canonical segmentation, obtaining an average F1 score of 72.5% across 4 languages. Feature-based CRFs outperform bidirectional LSTM-CRFs to obtain an average of 97.1% F1 on surface segmentation. In the unsupervised setting, an entropy-based approach using a character-level LSTM language model fails to outperforms a Morfessor baseline, while on some of the languages neither approach performs much better than a random baseline. We hope that the high performance of the supervised segmentation models will help to facilitate the development of better NLP tools for Nguni languages.


title: Radar Target Detection aided by Reconfigurable Intelligent Surfaces

abstract: In this work, we consider the target detection problem in a sensing architecture where the radar is aided by a reconfigurable intelligent surface (RIS), that can be modeled as an array of sub-wavelength small reflective elements capable of imposing a tunable phase shift to the impinging waves and, ultimately, of providing the radar with an additional echo of the target. A theoretical analysis is carried out for closely- and widely-spaced (with respect to the target) radar and RIS and for different beampattern configurations, and some examples are provided to show that large gains can be achieved by the considered detection architecture.


title: Keyword Transformer: A Self-Attention Model for Keyword Spotting

abstract: The Transformer architecture has been successful across many domains, including natural language processing, computer vision and speech recognition. In keyword spotting, self-attention has primarily been used on top of convolutional or recurrent encoders. We investigate a range of ways to adapt the Transformer architecture to keyword spotting and introduce the Keyword Transformer (KWT), a fully self-attentional architecture that exceeds state-of-the-art performance across multiple tasks without any pre-training or additional data. Surprisingly, this simple architecture outperforms more complex models that mix convolutional, recurrent and attentive layers. KWT can be used as a drop-in replacement for these models, setting two new benchmark records on the Google Speech Commands dataset with 98.6% and 97.7% accuracy on the 12 and 35-command tasks respectively.


title: Dynamical-System Model Predicts When Social Learners Impair Collective Performance

abstract: A key question concerning collective decisions is whether a social system can settle on the best available option when some members learn from others instead of evaluating the options on their own. This question is challenging to study, and previous research has reached mixed conclusions, because collective decision outcomes depend on the insufficiently understood complex system of cognitive strategies, task properties, and social influence processes. This study integrates these complex interactions together in one general yet partially analytically tractable mathematical framework using a dynamical system model. In particular, it investigates how the interplay of the proportion of social learners, the relative merit of options, and the type of conformity response affect collective decision outcomes in a binary choice. The model predicts that when the proportion of social learners exceeds a critical threshold, a bi-stable state appears in which the majority can end up favoring either the higher- or lower-merit option, depending on fluctuations and initial conditions. Below this threshold, the high-merit option is chosen by the majority. The critical threshold is determined by the conformity response function and the relative merits of the two options. The study helps reconcile disagreements about the effect of social learners on collective performance and proposes a mathematical framework that can be readily adapted to extensions investigating a wider variety of dynamics.


title: Modeling the Galactic Neutron Star Population for Use in Continuous Gravitational Wave Searches

abstract: Searches for continuous gravitational waves from \textit{unknown} Galactic neutron stars provide limits on the shapes of neutron stars. A rotating neutron star will produce gravitational waves if asymmetric deformations exist in its structure that are characterized by the star's ellipticity. In this study, we use a simple model of the spatial and spin distribution of Galactic neutron stars to estimate the total number of neutron stars probed, using gravitational waves, to a given upper limit on the ellipticity. This may help optimize future searches with improved sensitivity. The improved sensitivity of third-generation gravitational wave detectors may increase the number of neutron stars probed, to a given ellipticity, by factors of 100 to 1000.


title: Low-Resource Language Modelling of South African Languages

abstract: Language models are the foundation of current neural network-based models for natural language understanding and generation. However, research on the intrinsic performance of language models on African languages has been extremely limited, which is made more challenging by the lack of large or standardised training and evaluation sets that exist for English and other high-resource languages. In this paper, we evaluate the performance of open-vocabulary language models on low-resource South African languages, using byte-pair encoding to handle the rich morphology of these languages. We evaluate different variants of n-gram models, feedforward neural networks, recurrent neural networks (RNNs), and Transformers on small-scale datasets. Overall, well-regularized RNNs give the best performance across two isiZulu and one Sepedi datasets. Multilingual training further improves performance on these datasets. We hope that this research will open new avenues for research into multilingual and low-resource language modelling for African languages.


title: MultiWOZ 2.4: A Multi-Domain Task-Oriented Dialogue Dataset with Essential Annotation Corrections to Improve State Tracking Evaluation

abstract: The MultiWOZ 2.0 dataset has greatly stimulated the research of task-oriented dialogue systems. However, its state annotations contain substantial noise, which hinders a proper evaluation of model performance. To address this issue, massive efforts were devoted to correcting the annotations. Three improved versions (i.e., MultiWOZ 2.1-2.3) have then been released. Nonetheless, there are still plenty of incorrect and inconsistent annotations. This work introduces MultiWOZ 2.4, which refines the annotations in the validation set and test set of MultiWOZ 2.1. The annotations in the training set remain unchanged (same as MultiWOZ 2.1) to elicit robust and noise-resilient model training. We benchmark eight state-of-the-art dialogue state tracking models on MultiWOZ 2.4. All of them demonstrate much higher performance than on MultiWOZ 2.1.


title: Task-Invariant Learning of Continuous Joint Kinematics during Steady-State and Transient Ambulation Using Ultrasound Sensing

abstract: Natural control of limb motion is continuous and progressively adaptive to individual intent. While intuitive interfaces have the potential to rely on the neuromuscular input by the user for continuous adaptation, continuous volitional control of assistive devices that can generalize across various tasks has not been addressed. In this study, we propose a method to use spatiotemporal ultrasound features of the rectus femoris and vastus intermedius muscles of able-bodied individuals for task-invariant learning of continuous knee kinematics during steady-state and transient ambulation. The task-invariant learning paradigm was statistically evaluated against a task-specific paradigm for the steady-state (1) level-walk, (2) incline, (3) decline, (4) stair ascent, and (5) stair descent ambulation tasks. The transitions between steady-state stair ambulation and level-ground walking were also investigated. It was observed that the continuous knee kinematics can be learned using a task-invariant learning paradigm with statistically comparable accuracy to a task-specific paradigm. Statistical analysis further revealed that incorporating the temporal ultrasound features significantly improves the accuracy of continuous estimations (p < 0.05). The average root mean square errors (RMSEs) of knee angle and angular velocity estimation were 7.06{\deg} and 53.1{\deg}/sec, respectively, for the task-invariant learning compared to 6.00{\deg} and 51.8{\deg}/sec for the task-specific models. High accuracy of continuous task-invariant paradigms overcome the barrier of task-specific control schemes and motivate the implementation of direct volitional control of lower-limb assistive devices using ultrasound sensing, which may eventually enhance the intuitiveness and functionality of these devices towards a "free form" control approach.


title: Equation of State table with hyperon and antikaon for supernova and neutron star merger

abstract: We develop a new equation of state (EoS) table involving thermal (anti)kaons, Bose-Einstein condensate of $K^{-}$ mesons and $\Lambda$-hyperons for core-collapse supernova and neutron star merger simulations. This EoS table is based on a finite temperature density-dependent relativistic hadron field theory where baryon-baryon interaction is mediated by scalar $\sigma$, vector $\omega$ and $\rho$ mesons, using the parameter set DD2 for nucleons. The repulsive hyperon-hyperon interaction is mediated by an additional strange $\phi$ meson. The EoS for the $K^-$ condensed matter is also calculated within the framework of relativistic mean field model, whereas the low-density, inhomogeneous matter is calculated in the extended Nuclear Statistical Equilibrium model (NSE). The EoS table is generated for a wide range of values of three parameters - baryon density ($10^{-12}$ to $\sim$ 1 fm$^{-3}$), positive charge fraction(0.01 to 0.60) and temperature(0.1 to 158.48 MeV).


title: Collision-Aware Target-Driven Object Grasping in Constrained Environments

abstract: Grasping a novel target object in constrained environments (e.g., walls, bins, and shelves) requires intensive reasoning about grasp pose reachability to avoid collisions with the surrounding structures. Typical 6-DoF robotic grasping systems rely on the prior knowledge about the environment and intensive planning computation, which is ungeneralizable and inefficient. In contrast, we propose a novel Collision-Aware Reachability Predictor (CARP) for 6-DoF grasping systems. The CARP learns to estimate the collision-free probabilities for grasp poses and significantly improves grasping in challenging environments. The deep neural networks in our approach are trained fully by self-supervision in simulation. The experiments in both simulation and the real world show that our approach achieves more than 75% grasping rate on novel objects in various surrounding structures. The ablation study demonstrates the effectiveness of the CARP, which improves the 6-DoF grasping rate by 95.7%.


title: Impact of climate change on West Nile virus distribution in South America

abstract: West Nile virus (WNV) is a vector-borne pathogen of global relevance and is currently the most widely distributed flavivirus of encephalitis worldwide. This virus infects birds, humans, horses, and other mammals, and its transmission cycle occurs in urban and rural areas. Climate conditions have direct and indirect impacts on vector abundance and virus dynamics within the mosquito. The significance of environmental variables as drivers in WNV epidemiology is increasing under the current climate change scenario. In this study, we used a machine learning algorithm to model WNV distributions in South America. Our model evaluated eight environmental variables (type of biome, annual temperature, seasonality of temperature, daytime temperature variation, thermal amplitude, seasonality of precipitation, annual rainfall, and elevation) for their contribution to the occurrence of WNV since its introduction in South America (2004). Our results showed that environmental variables can directly alter the occurrence of WNV, with lower precipitation and higher temperatures associated with increased virus incidence. High-risk areas may be modified in the coming years, becoming more evident with high greenhouse gas emission levels. Countries such as Bolivia and Paraguay will be greatly affected, drastically changing their current WNV distribution. Several Brazilian areas will also increase the likelihood of presenting WNV, mainly in the Northeast and Midwest regions and the Pantanal biome. The Galapagos Islands will also probably increase their geographic range suitable for WNV occurrence. It is necessary to develop preventive policies to minimize potential WNV infection in humans and enhance active epidemiological surveillance in birds, humans, and other mammals before it becomes a more significant public health problem in South America.


title: Short proofs of three results about intersecting systems

abstract: In this note, we give short proofs of three theorems about intersection problems. The first one is a determination of the maximum size of a nontrivial $k$-uniform, $d$-wise intersecting family for $n\ge \left(1+\frac{d}{2}\right)(k-d+2)$, which improves upon a recent result of O'Neill and Verstra\"{e}te. Our proof also extends to $d$-wise, $t$-intersecting families, and from this result we obtain a version of the Erd\H{o}s-Ko-Rado theorem for $d$-wise, $t$-intersecting families. The second result partially proves a conjecture of Frankl and Tokushige about $k$-uniform families with restricted pairwise intersection sizes. The third result concerns graph intersections. Answering a question of Ellis, we construct $K_{s, t}$-intersecting families of graphs which have size larger than the Erd\H{o}s-Ko-Rado-type construction whenever $t$ is sufficiently large in terms of $s$.


title: Misinformation Warning Labels: Twitter's Soft Moderation Effects on COVID-19 Vaccine Belief Echoes

abstract: Twitter, prompted by the rapid spread of alternative narratives, started actively warning users about the spread of COVID-19 misinformation. This form of soft moderation comes in two forms: as a warning cover before the Tweet is displayed to the user and as a warning tag below the Tweet. This study investigates how each of the soft moderation forms affects the perceived accuracy of COVID-19 vaccine misinformation on Twitter. The results suggest that the warning covers work, but not the tags, in reducing the perception of accuracy of COVID-19 vaccine misinformation on Twitter. "Belief echoes" do exist among Twitter users, unfettered by any warning labels, in relationship to the perceived safety and efficacy of the COVID-19 vaccine as well as the vaccination hesitancy for themselves and their children. The implications of these results are discussed in the context of usable security affordances for combating misinformation on social media.


title: An Online Projection Estimator for Nonparametric Regression in Reproducing Kernel Hilbert Spaces

abstract: The goal of nonparametric regression is to recover an underlying regression function from noisy observations, under the assumption that the regression function belongs to a pre-specified infinite dimensional function space. In the online setting, when the observations come in a stream, it is generally computationally infeasible to refit the whole model repeatedly. There are as of yet no methods that are both computationally efficient and statistically rate-optimal. In this paper, we propose an estimator for online nonparametric regression. Notably, our estimator is an empirical risk minimizer (ERM) in a deterministic linear space, which is quite different from existing methods using random features and functional stochastic gradient. Our theoretical analysis shows that this estimator obtains rate-optimal generalization error when the regression function is known to live in a reproducing kernel Hilbert space. We also show, theoretically and empirically, that the computational expense of our estimator is much lower than other rate-optimal estimators proposed for this online setting.


title: Engineering two-mode squeezed vacuum-like states by using the Bohm potential

abstract: We show that two-mode squeezed vacuum-like states may be engineered in the Bohm-Madelung formalism by adequately choosing the phase of the wavefunction. The difference between our wavefunction and the one of the squeezed vacuum states is given precisely by the phase we choose.


title: "TL;DR:" Out-of-Context Adversarial Text Summarization and Hashtag Recommendation

abstract: This paper presents Out-of-Context Summarizer, a tool that takes arbitrary public news articles out of context by summarizing them to coherently fit either a liberal- or conservative-leaning agenda. The Out-of-Context Summarizer also suggests hashtag keywords to bolster the polarization of the summary, in case one is inclined to take it to Twitter, Parler or other platforms for trolling. Out-of-Context Summarizer achieved 79% precision and 99% recall when summarizing COVID-19 articles, 93% precision and 93% recall when summarizing politically-centered articles, and 87% precision and 88% recall when taking liberally-biased articles out of context. Summarizing valid sources instead of synthesizing fake text, the Out-of-Context Summarizer could fairly pass the "adversarial disclosure" test, but we didn't take this easy route in our paper. Instead, we used the Out-of-Context Summarizer to push the debate of potential misuse of automated text generation beyond the boilerplate text of responsible disclosure of adversarial language models.


title: Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systems

abstract: Existing goal-oriented dialogue datasets focus mainly on identifying slots and values. However, customer support interactions in reality often involve agents following multi-step procedures derived from explicitly-defined company policies as well. To study customer service dialogue systems in more realistic settings, we introduce the Action-Based Conversations Dataset (ABCD), a fully-labeled dataset with over 10K human-to-human dialogues containing 55 distinct user intents requiring unique sequences of actions constrained by policies to achieve task success. We propose two additional dialog tasks, Action State Tracking and Cascading Dialogue Success, and establish a series of baselines involving large-scale, pre-trained language models on this dataset. Empirical results demonstrate that while more sophisticated networks outperform simpler models, a considerable gap (50.8% absolute accuracy) still exists to reach human-level performance on ABCD.


title: Fully Automated Noncoplanar Radiation Therapy Treatment Planning

abstract: Noncoplanar radiation therapy treatment planning has the potential to improve dosimetric quality as compared to traditional coplanar techniques. Likewise, automated treatment planning algorithms can reduce a planner's active treatment planning time and remove inter-planner variability. To address the limitations of traditional treatment planning, we have been developing a suite of algorithms called station parameter optimized radiation therapy (SPORT). Within the SPORT suite of algorithms, we propose a method called NC-POPS to produce noncoplanar (NC) plans using the fully automated Pareto Optimal Projection Search (POPS) algorithm. Our NC-POPS algorithm extends the original POPS algorithm to the noncoplanar setting with potential applications to both IMRT and VMAT. The proposed algorithm consists of two main parts: 1) noncoplanar beam angle optimization (BAO) and 2) fully automated inverse planning using the POPS algorithm. We evaluate the performance of NC-POPS by comparing between various noncoplanar and coplanar configurations. To evaluate plan quality, we compute the homogeneity index (HI), conformity index (CI), and dose-volume histogram (DVH) statistics for various organs-at-risk (OARs). As compared to the evaluated coplanar baseline methods, the proposed NC-POPS method achieves significantly better OAR sparing, comparable or better dose conformity, and similar dose homogeneity. Our proposed NC-POPS algorithm provides a modular approach for fully automated treatment planning of noncoplanar IMRT cases with the potential to substantially improve treatment planning workflow and plan quality.


title: Unitarization Through Approximate Basis

abstract: We introduce the problem of unitarization. Unitarization is the problem of taking $k$ input quantum circuits that produce orthogonal states from the all $0$ state, and create an output circuit implementing a unitary with its first $k$ columns as those states. That is, the output circuit takes the $k$th computational basis state to the state prepared by the $k$th input circuit. We allow the output circuit to use ancilla qubits initialized to $0$. But ancilla qubits must always be returned to $0$ for any input. The input circuits may use ancilla qubits, but we are only guaranteed the they return ancilla qubits to $0$ on the all $0$ input. The unitarization problem seems hard if the output states are neither orthogonal to or in the span of the computational basis states that need to map to them. In this work, we approximately solve this problem in the case where input circuits are given as black box oracles by probably finding an approximate basis for our states. This method may be more interesting than the application. This technique is a sort of quantum analogue of Gram-Schmidt orthogonalization for quantum states. Specifically, we find an approximate basis in polynomial time for the following parameters. Take any natural $n$, $k = O\left(\frac{\ln(n)}{\ln(\ln(n))}\right)$, and $\epsilon = 2^{-O(\sqrt{\ln(n)})}$. Take any $k$ input quantum states, $(|\psi_i \rangle)_{i\in [k]}$, on polynomial in $n$ qubits prepared by quantum oracles, $(V_i)_{i \in [k]}$ (that we can control call and control invert). Then there is a quantum circuit with polynomial size in $n$ with access to the oracles $(V_i)_{i \in [k]}$ that with at least $1 - \epsilon$ probability, computes at most $k$ circuits with size polynomial in $n$ and oracle access to $(V_i)_{i \in [k]}$ that $\epsilon$ approximately computes an $\epsilon$ approximate orthonormal basis for $(|\psi_i \rangle)_{i\in [k]}$.


title: Back to the roots: A discrete Kermack-McKendrick model adapted to Covid-19

abstract: A widely used tool for analysing the Covid-19 pandemic is the standard SIR model. It seems often to be used as a black box, not taking into account that this model was derived as a special case of the seminal Kermack-McKendrick theory from 1927. This is our starting point. We explain the setup of the Kermack-McKendrick theory (passing to a discrete approach) and use medical information for specializing to a model which we call {\em adapted K-McK-model}. This includes effects of vaccination, mass testing and mutants. We demonstrate the use of the model by applying it to the development in Germany. As a striking application we demonstrate that a comparatively mild intervention reducing the time until quarantine by one day leads to a drastic improvement. A similar effect can be obtained by certain mass testings as we will demonstrate. We discuss possibilities to apply the model both for predictions and as an analysis tool. We compare the adapted K-McK-model to the standard SIR model and observe condiderable differences if the contact rates are not constant. Finally we compare the model reproduction rate with the empirical reproduction rate determined by the Robert Koch-Institut.


title: Flow and Arrest in Stressed Granular Materials

abstract: Flowing granular materials often abruptly arrest if not driven by sufficient applied stresses. Such abrupt cessation of motion can be economically expensive in industrial materials handling and processing, and is significantly consequential in intermittent geophysical phenomena such as landslides and earthquakes. Using discrete element simulations, we calculate states of steady flow and arrest for granular materials under the conditions of constant applied pressure and shear stress, which are also most relevant in practice. Here the material can dilate or compact, and flow or arrest, in response to the applied stress. Our simulations highlight that under external stress, the intrinsic response of granular materials is characterized by uniquely-defined steady states of flow or arrest, which are highly sensitive to interparticle friction. While the flowing states can be equivalently characterized by volume fraction, coordination number or internal stress ratio, to characterize the states of shear arrest, one needs to also consider the structural anisotropy in the contact network. We highlight the role of dilation in the flow-arrest transition, and discuss our findings in the context of rheological transitions in granular materials.


title: The Effects of Spectral Dimensionality Reduction on Hyperspectral Pixel Classification: A Case Study

abstract: This paper presents a systematic study of the effects of hyperspectral pixel dimensionality reduction on the pixel classification task. We use five dimensionality reduction methods -- PCA, KPCA, ICA, AE, and DAE -- to compress 301-dimensional hyperspectral pixels. Compressed pixels are subsequently used to perform pixel classifications. Pixel classification accuracies together with compression method, compression rates, and reconstruction errors provide a new lens to study the suitability of a compression method for the task of pixel classification. We use three high-resolution hyperspectral image datasets, representing three common landscape types (i.e. urban, transitional suburban, and forests) collected by the Remote Sensing and Spatial Ecosystem Modeling laboratory of the University of Toronto. We found that PCA, KPCA, and ICA post greater signal reconstruction capability; however, when compression rates are more than 90\% these methods show lower classification scores. AE and DAE methods post better classification accuracy at 95\% compression rate, however their performance drops as compression rate approaches 97\%. Our results suggest that both the compression method and the compression rate are important considerations when designing a hyperspectral pixel classification pipeline.


title: Do RNN States Encode Abstract Phonological Processes?

abstract: Sequence-to-sequence models have delivered impressive results in word formation tasks such as morphological inflection, often learning to model subtle morphophonological details with limited training data. Despite the performance, the opacity of neural models makes it difficult to determine whether complex generalizations are learned, or whether a kind of separate rote memorization of each morphophonological process takes place. To investigate whether complex alternations are simply memorized or whether there is some level of generalization across related sound changes in a sequence-to-sequence model, we perform several experiments on Finnish consonant gradation -- a complex set of sound changes triggered in some words by certain suffixes. We find that our models often -- though not always -- encode 17 different consonant gradation processes in a handful of dimensions in the RNN. We also show that by scaling the activations in these dimensions we can control whether consonant gradation occurs and the direction of the gradation.


title: Molecular Nature of Thermodynamics and its Application to Nanosize Particle Systems

abstract: The origins of thermodynamics from the microscopic properties of matter have not been satisfactorily accounted for. This work presents a formulation that connects Lagrangian mechanics to thermodynamics. By using such a formulation and following similar steps to those performed in the laboratory, the heat capacities, energetic and mechanical response coefficients, absorbed and emitted heats, entropy changes, and thermodynamic energies of a prototype water system, employed as an illustrative example, are found to be close to the experimental results on water bulk. The present formulation is realistic. After connecting Lagrangian mechanics to Langevin stochastic dynamics, the first law of thermodynamics is derived. The formulation not only exhibits the transformation of time-reversible equations onto time-irreversible equations, and the molecular origins of heat as well, but also reveals new pathways to investigate the thermodynamics of systems of nanometric sizes.


title: Absence of moment fragmentation in the mixed $B$-site pyrochlore Nd$_{2}$GaSbO$_{7}$

abstract: Nd-based pyrochlore oxides of the form Nd$_{2}B_{2}$O$_{7}$ have garnered a significant amount of interest owing to the moment fragmentation physics observed in Nd$_{2}$Zr$_{2}$O$_{7}$ and speculated in Nd$_{2}$Hf$_{2}$O$_{7}$. Notably this phenomenon is not ubiquitous in this family, as it is absent in Nd$_{2}$Sn$_{2}$O$_{7}$, which features a smaller ionic radius on the $B$-site. Here, we explore the necessary conditions for moment fragmentation in the Nd pyrochlore family through a detailed study of the mixed $B$-site pyrochlore Nd$_{2}$GaSbO$_{7}$. The $B$-site of this system is characterized by significant disorder and an extremely small average ionic radius. Similarly to Nd$_{2}$Sn$_{2}$O$_{7}$, we find no evidence for moment fragmentation through our bulk characterization and neutron scattering experiments, indicating that chemical pressure (and not necessarily the $B$-site disorder) plays a key role in the presence or absence of this phenomenon in this material family. Surprisingly, the presence of significant $B$-site disorder in Nd$_{2}$GaSbO$_{7}$ does not generate a spin glass ground state and instead the same all-in-all-out magnetic order identified in other Nd pyrochlores is found here.


title: Scalable Hash Table for NUMA Systems

abstract: Hash tables are used in a plethora of applications, including database operations, DNA sequencing, string searching, and many more. As such, there are many parallelized hash tables targeting multicore, distributed, and accelerator-based systems. We present in this work a multi-GPU hash table implementation that can process keys at a throughput comparable to that of distributed hash tables. Distributed CPU hash tables have received significantly more attention than GPU-based hash tables. We show that a single node with multiple GPUs offers roughly the same performance as a 500-1,000-core CPU-based cluster. Our algorithm's key component is our use of multiple sparse-graph data structures and binning techniques to build the hash table. As has been shown individually, these components can be written with massive parallelism that is amenable to GPU acceleration. Since we focus on an individual node, we also leverage communication primitives that are typically prohibitive in distributed environments. We show that our new multi-GPU algorithm shares many of the same features of the single GPU algorithm -- thus we have efficient collision management capabilities and can deal with a large number of duplicates. We evaluate our algorithm on two multi-GPU compute nodes: 1) an NVIDIA DGX2 server with 16 GPUs and 2) an IBM Power 9 Processor with 6 NVIDIA GPUs. With 32-bit keys, our implementation processes 8B keys per second, comparable to some 500-1,000-core CPU-based clusters and 4X faster than prior single-GPU implementations.


title: Effect of Radiology Report Labeler Quality on Deep Learning Models for Chest X-Ray Interpretation

abstract: Although deep learning models for chest X-ray interpretation are commonly trained on labels generated by automatic radiology report labelers, the impact of improvements in report labeling on the performance of chest X-ray classification models has not been systematically investigated. We first compare the CheXpert, CheXbert, and VisualCheXbert labelers on the task of extracting accurate chest X-ray image labels from radiology reports, reporting that the VisualCheXbert labeler outperforms the CheXpert and CheXbert labelers. Next, after training image classification models using labels generated from the different radiology report labelers on one of the largest datasets of chest X-rays, we show that an image classification model trained on labels from the VisualCheXbert labeler outperforms image classification models trained on labels from the CheXpert and CheXbert labelers. Our work suggests that recent improvements in radiology report labeling can translate to the development of higher performing chest X-ray classification models.


title: Ultra-low memory seismic inversion with randomized trace estimation

abstract: Inspired by recent work on extended image volumes that lays the ground for randomized probing of extremely large seismic wavefield matrices, we present a memory frugal and computationally efficient inversion methodology that uses techniques from randomized linear algebra. By means of a carefully selected realistic synthetic example, we demonstrate that we are capable of achieving competitive inversion results at a fraction of the memory cost of conventional full-waveform inversion with limited computational overhead. By exchanging memory for negligible computational overhead, we open with the presented technology the door towards the use of low-memory accelerators such as GPUs.


title: No Cost Likelihood Manipulation at Test Time for Making Better Mistakes in Deep Networks

abstract: There has been increasing interest in building deep hierarchy-aware classifiers that aim to quantify and reduce the severity of mistakes, and not just reduce the number of errors. The idea is to exploit the label hierarchy (e.g., the WordNet ontology) and consider graph distances as a proxy for mistake severity. Surprisingly, on examining mistake-severity distributions of the top-1 prediction, we find that current state-of-the-art hierarchy-aware deep classifiers do not always show practical improvement over the standard cross-entropy baseline in making better mistakes. The reason for the reduction in average mistake-severity can be attributed to the increase in low-severity mistakes, which may also explain the noticeable drop in their accuracy. To this end, we use the classical Conditional Risk Minimization (CRM) framework for hierarchy-aware classification. Given a cost matrix and a reliable estimate of likelihoods (obtained from a trained network), CRM simply amends mistakes at inference time; it needs no extra hyperparameters and requires adding just a few lines of code to the standard cross-entropy baseline. It significantly outperforms the state-of-the-art and consistently obtains large reductions in the average hierarchical distance of top-$k$ predictions across datasets, with very little loss in accuracy. CRM, because of its simplicity, can be used with any off-the-shelf trained model that provides reliable likelihood estimates.


title: Recovering sparse networks: Basis adaptation and stability under extensions

abstract: We consider the problem of recovering equations of motion from multivariate time series of oscillators interacting on sparse networks. We reconstruct the network from an initial guess which can include expert knowledge about the system such as main motifs and hubs. When sparsity is taken into account the number of data points needed is drastically reduced when compared to the least-squares recovery. We show that the sparse solution is stable under basis extensions, that is, once the correct network topology is obtained, the result does not change if further motifs are considered.


title: Nonlocal pseudopotentials and time-step errors in diffusion Monte Carlo

abstract: We present a version of the T-moves approach for treating nonlocal pseudopotentials in diffusion Monte Carlo which has much smaller time-step errors than the existing T-moves approaches, while at the same time preserving desirable features such as the upper-bound property for the energy. In addition, we modify the reweighting factor of the projector used in diffusion Monte Carlo to reduce the time-step error. The latter is applicable not only to pseudopotential calculations but to all-electron calculations as well.


title: FESTA: Flow Estimation via Spatial-Temporal Attention for Scene Point Clouds

abstract: Scene flow depicts the dynamics of a 3D scene, which is critical for various applications such as autonomous driving, robot navigation, AR/VR, etc. Conventionally, scene flow is estimated from dense/regular RGB video frames. With the development of depth-sensing technologies, precise 3D measurements are available via point clouds which have sparked new research in 3D scene flow. Nevertheless, it remains challenging to extract scene flow from point clouds due to the sparsity and irregularity in typical point cloud sampling patterns. One major issue related to irregular sampling is identified as the randomness during point set abstraction/feature extraction -- an elementary process in many flow estimation scenarios. A novel Spatial Abstraction with Attention (SA^2) layer is accordingly proposed to alleviate the unstable abstraction problem. Moreover, a Temporal Abstraction with Attention (TA^2) layer is proposed to rectify attention in temporal domain, leading to benefits with motions scaled in a larger range. Extensive analysis and experiments verified the motivation and significant performance gains of our method, dubbed as Flow Estimation via Spatial-Temporal Attention (FESTA), when compared to several state-of-the-art benchmarks of scene flow estimation.


title: Modeling in Systems Engineering: Conceptual Time Representation

abstract: The increasing importance of such fields as embedded systems, pervasive computing, and hybrid systems control is increasing attention to the time-dependent aspects of system modeling. In this paper, we focus on modeling conceptual time. Conceptual time is time represented in conceptual modeling, where the notion of time does not always play a major role. Time modeling in computing is far from exhibiting a unified and comprehensive framework, and is often handled in an ad hoc manner. This paper contributes to the establishment of a broader understanding of time in conceptual modeling based on a software and system engineering model denoted thinging machine (TM). TM modeling is founded on a one-category ontology called a thimac (thing/machine) that is used to elaborate the design and analysis of ontological presumptions. The issue under study is a sample of abstract modeling domains as exemplified by time. The goal is to provide better understanding of the TM model by supplementing it with a conceptualization of time aspects. The results reveal new characteristics of time and related notions such as space, events, and system behavior.


title: SMORES-EP, a Modular Robot with Parallel Self-assembly

abstract: Self-assembly of modular robotic systems enables the construction of complex robotic configurations to adapt to different tasks. This paper presents a framework for SMORES types of modular robots to efficiently self-assemble into tree topologies. These modular robots form kinematic chains that have been shown to be capable of a large variety of manipulation and locomotion tasks, yet they can reconfigure using a mobile reconfiguration. A desired kinematic topology can be mapped onto a planar pattern with optimal module assignment based on the modules' locations, then the mobile reconfiguration assembly process can be executed in parallel. A docking controller is developed to guarantee the success of docking processes. A hybrid control architecture is designed to handle a large number of modules and complex behaviors of each individual, and achieve efficient and robust self-assembly actions. The framework is demonstrated in both hardware and simulation on the SMORES-EP platform.


title: Choice-Aware User Engagement Modeling andOptimization on Social Media

abstract: We address the problem of maximizing user engagement with content (in the form of like, reply, retweet, and retweet with comments)on the Twitter platform. We formulate the engagement forecasting task as a multi-label classification problem that captures choice behavior on an unsupervised clustering of tweet-topics. We propose a neural network architecture that incorporates user engagement history and predicts choice conditional on this context. We study the impact of recommend-ing tweets on engagement outcomes by solving an appropriately defined sweet optimization problem based on the proposed model using a large dataset obtained from Twitter.


title: Quantum Gravity Phenomenology in the Infrared

abstract: Quantum gravity effects are traditionally tied to short distances and high energies. In this essay we argue that, perhaps surprisingly, quantum gravity may have important consequences for the phenomenology of the infrared. We center our discussion around a conception of quantum gravity involving a notion of quantum spacetime that arises in metastring theory. This theory allows for an evolution of a cosmological Universe in which string-dual degrees of freedom decouple as the Universe ages. Importantly such an implementation of quantum gravity allows for the inclusion of a fundamental length scale without introducing the fundamental breaking of Lorentz symmetry. The mechanism seems to have potential for an entirely novel source for dark matter/energy. The simplest observational consequences of this scenario may very well be residual infrared modifications that emerge through the evolution of the Universe.


title: Sensitivity Analysis for Bottleneck Assignment Problems

abstract: In assignment problems, decision makers are often interested in not only the optimal assignment, but also the sensitivity of the optimal assignment to perturbations in the assignment weights. Typically, only perturbations to individual assignment weights are considered. We present a novel extension of the traditional sensitivity analysis by allowing for simultaneous variations in all assignment weights. Focusing on the bottleneck assignment problem, we provide two different methods of quantifying the sensitivity of the optimal assignment, and present algorithms for each. Numerical examples as well as a discussion of the complexity for all algorithms are provided.


title: A numerical exploration of first-order relativistic hydrodynamics

abstract: We present the first numerical solutions of the causal, stable relativistic Navier-Stokes equations as formulated by Bemfica, Disconzi, Noronha, and Kovtun (BDNK). For this initial investigation we restrict to plane-symmetric configurations of a conformal fluid in Minkowski spacetime. We consider evolution of three classes of initial data: a smooth (initially) stationary concentration of energy, a standard shock tube setup, and a smooth shockwave setup. We compare these solutions to those obtained with the Muller-Israel-Stewart (MIS) formalism, variants of which are the common tools used to model relativistic, viscous fluids. We find that for the two smooth initial data cases, simple finite difference methods are adequate to obtain stable, convergent solutions to the BDNK equations. For low viscosity, the MIS and BDNK evolutions show good agreement. At high viscosity the solutions begin to differ in regions with large gradients, and there the BDNK solutions can (as expected) exhibit violation of the weak energy condition. This behavior is transient, and the solutions evolve toward a hydrodynamic regime in a way reminiscent of an approach to a universal attractor. For the shockwave problem, we give evidence that if a hydrodynamic frame is chosen so that the maximum characteristic speed of the BDNK system is the speed of light (or larger), arbitrarily strong shockwaves are smoothly resolved. Regarding the shock tube problem, it is unclear whether discontinuous initial data is mathematically well-posed for the BDNK system, even in a weak sense. Nevertheless we attempt numerical solution, and then need to treat the perfect fluid terms using high-resolution shock-capturing methods. When such methods can successfully evolve the solution beyond the initial time, subsequent evolution agrees with corresponding MIS solutions, as well as the perfect fluid solution in the limit of zero viscosity.


title: Memorability: An image-computable measure of information utility

abstract: The pixels in an image, and the objects, scenes, and actions that they compose, determine whether an image will be memorable or forgettable. While memorability varies by image, it is largely independent of an individual observer. Observer independence is what makes memorability an image-computable measure of information, and eligible for automatic prediction. In this chapter, we zoom into memorability with a computational lens, detailing the state-of-the-art algorithms that accurately predict image memorability relative to human behavioral data, using image features at different scales from raw pixels to semantic labels. We discuss the design of algorithms and visualizations for face, object, and scene memorability, as well as algorithms that generalize beyond static scenes to actions and videos. We cover the state-of-the-art deep learning approaches that are the current front runners in the memorability prediction space. Beyond prediction, we show how recent A.I. approaches can be used to create and modify visual memorability. Finally, we preview the computational applications that memorability can power, from filtering visual streams to enhancing augmented reality interfaces.


title: Volume 78, 1 October 2014, Pages 56-64

abstract: Characterizing plasticity mechanisms below the ductile-to-brittle transition temperature is traditionally difficult to accomplish in asystematic fashion. Here, we use a new experimental setup to perform in situ cryogenic mechanical testing of pure Sn micropillars at room temperature and at 142{\deg}C. Subsequent electron microscopy characterization of the micropillars shows a clear difference in the deformation mechanisms at room temperature and at cryogenic temperatures. At room temperature, the Sn micropillars deformed through dislocation plasticity, while at142{\deg}C they exhibited both higher strength and deformation twinning. Two different orientations were tested, a symmetric (100) orientation and a non-symmetric (451) orientation. The deformation mechanisms were found to be the same for both orientations


title: A Combined Deep Learning based End-to-End Video Coding Architecture for YUV Color Space

abstract: Most of the existing deep learning based end-to-end video coding (DLEC) architectures are designed specifically for RGB color format, yet the video coding standards, including H.264/AVC, H.265/HEVC and H.266/VVC developed over past few decades, have been designed primarily for YUV 4:2:0 format, where the chrominance (U and V) components are subsampled to achieve superior compression performances considering the human visual system. While a broad number of papers on DLEC compare these two distinct coding schemes in RGB domain, it is ideal to have a common evaluation framework in YUV 4:2:0 domain for a more fair comparison. This paper introduces a new DLEC architecture for video coding to effectively support YUV 4:2:0 and compares its performance against the HEVC standard under a common evaluation framework. The experimental results on YUV 4:2:0 video sequences show that the proposed architecture can outperform HEVC in intra-frame coding, however inter-frame coding is not as efficient on contrary to the RGB coding results reported in recent papers.


title: Curriculum Graph Co-Teaching for Multi-Target Domain Adaptation

abstract: In this paper we address multi-target domain adaptation (MTDA), where given one labeled source dataset and multiple unlabeled target datasets that differ in data distributions, the task is to learn a robust predictor for all the target domains. We identify two key aspects that can help to alleviate multiple domain-shifts in the MTDA: feature aggregation and curriculum learning. To this end, we propose Curriculum Graph Co-Teaching (CGCT) that uses a dual classifier head, with one of them being a graph convolutional network (GCN) which aggregates features from similar samples across the domains. To prevent the classifiers from over-fitting on its own noisy pseudo-labels we develop a co-teaching strategy with the dual classifier head that is assisted by curriculum learning to obtain more reliable pseudo-labels. Furthermore, when the domain labels are available, we propose Domain-aware Curriculum Learning (DCL), a sequential adaptation strategy that first adapts on the easier target domains, followed by the harder ones. We experimentally demonstrate the effectiveness of our proposed frameworks on several benchmarks and advance the state-of-the-art in the MTDA by large margins (e.g. +5.6% on the DomainNet).


title: Synchronized SCUBA: D2D Communication for Out-of-Sync Devices

abstract: Device-to-device (D2D) communication is an essential component enabling connectivity for the Internet-of-Things (IoT). SCUBA, which stands for Sidelink Communication on Unlicensed Bands, is a novel medium access control protocol that facilitates D2D communications on the sidelink for IoT and machine-type communication (MTC) cellular devices. SCUBA includes support for direct peer-to-peer communication on the unlicensed bands by operating in a time division multiplexed manner to coexist with the underlying primary radio access technology, e.g., long term evolution - MTC (LTE-M). A fundamental requirement in the current version of SCUBA is that the communicating devices are to be synchronized with each other so that timing occasions of the devices can be accurately estimated by each other. However, when the devices are out of sync with each other, which may be caused due to one or more of the devices being out of cellular coverage region or are being served by different base stations, typically observed in mobile devices, operation of legacy SCUBA fails. To this end, we design synchronization methods to establish successful SCUBA links between devices that are out-of-sync with each other. Due to the inherent timing discovery embedded in our method, our solution also extends the operating range of SCUBA by eliminating its reliance on timing-agnostic communication. We analyze and compare the performance of our methods in terms of power consumption and the resultant impact on device battery life to show the potential of our solutions.


title: Chern classes of quantizable coisotropic bundles

abstract: Let $M$ be a smooth algebraic variety of dimension $2(p+q)$ with an algebraic symplectic form and a compatible deformation quantization $\mathcal{O}_h$ of the structure sheaf. Consider a smooth coisotropic subvariety $j: Y \to M$ of codimension $q$ and a vector bundle $E$ on $Y$. We show that if $j_* E$ admits a deformation quantization (as a module) then its characteristic class $\widehat{A}(M) exp(-c(\mathcal{O}_h)) ch(j_* E)$ lifts to a cohomology group associated to the null foliation of $Y$. Moreover, it can only be nonzero in degrees $2q, \ldots, 2(p+q)$. For Lagrangian $Y$ this reduces to a single degree $2q$. Similar results hold in the holomorphic category. This is a companion paper of a joint work with Victor Ginzburg on general quantizable sheaves.


title: Energy budget of plasma motions, heating, and electron acceleration in a three-loop solar flare

abstract: Non-potential magnetic energy promptly released in solar flares is converted to other forms of energy. This may include nonthermal energy of flare-accelerated particles, thermal energy of heated flaring plasma, and kinetic energy of eruptions, jets, up/down flows, and stochastic (turbulent) plasma motions. The processes or parameters governing partitioning of the released energy between these components is an open question. How these components are distributed between distinct flaring loops and what controls these spatial distributions is also unclear. Here, based on multi-wavelength data and 3D modeling, we quantify the energy partitioning and spatial distribution in the well observed SOL2014-02-16T064620 solar flare of class C1.5. Nonthermal emissions of this flare displayed a simple impulsive single-spike light curves lasting about 20\,s. In contrast, the thermal emission demonstrated at least three distinct heating episodes, only one of which was associated with the nonthermal component. The flare was accompanied by up and down flows and substantial turbulent velocities. The results of our analysis suggest that (i) the flare occurs in a multi-loop system that included at least three distinct flux tubes; (ii) the released magnetic energy is divided unevenly between the thermal and nonthermal components in these loops; (iii) only one of these three flaring loops contains an energetically important amount of nonthermal electrons, while two other loops remain thermal; (iv) the amounts of direct plasma heating and that due to nonthermal electron loss are comparable; (v) the kinetic energy in the flare footpoints constitute only a minor fraction compared with the thermal and nonthermal energies.


title: A new physical simulation tool to predict the interface of dissimilar aluminum to steel welds performed by Friction Melt Bonding

abstract: Optimization of the intermetallic layer thickness and the suppression of interfacial defects are key elements to improve the load bearing capacity of dissimilar joints. However, till date we do not have a systematic tool to investigate the dissimilar joints and the intermetallic properties produced by a welding condition. Friction Melt Bonding (FMB) is a recently developed technique for joining dissimilar metals that also does not exempt to these challenges. The FMB of DP980 and Al6061-T6 is investigated using a new physical simulation tool, based on Gleeble thermo-mechanical simulator, to understand the effect of individual parameter on the intermetallic formation. The proposed method demonstrates its capability in reproducing the intermetallic characteristics, including the thickness of intermetallic bonding layer, the morphology and texture of its constituents (Fe2Al5 and Fe4Al13), as well as their nanohardness and reduced modulus. The advantages of physical simulation tool can enable novel developing routes for the development of dissimilar metal joining processes and facilitate to reach the requiring load bearing capacity of the joints.


title: A Context Aware and Self Adaptation Strategy for Cloud Service Selection and Configuration in Run Time

abstract: Day after day, the number of mobile applications deployed on cloud computing continues in increasing because o f smartphone capabilities improvement. Cloud computing has already succeeded in the web based application, for that reason, the demand for context aware services provided by cloud computing increases. To customize a cloud service that takes into account th e consumer requirements, which depend on information change, it brings to light many recent challenges to cloud computing about environment aware, location aware, time aware. The cloud provider, moreover, has to manage personalized applications and the con straints of mobile devices in matters of interaction abilities and communication restrictions. This paper proposes a strategy for selecting automatically an appropriate cloud environment that runs out whole requirements, defines a configuration for the ass ociated cloud environment and able to easily adapt to the change of the environment on either the user or the cloud side or both. This process builds on the principles of dynamic software product lines, Agent oriented software engineering, and the MAPE k m odel to select and configure cloud environments according to the consumer needs and the context change.


title: CURIE: An Iterative Querying Approach for Reasoning About Situations

abstract: Recently, models have been shown to predict the effects of unexpected situations, e.g., would cloudy skies help or hinder plant growth? Given a context, the goal of such situational reasoning is to elicit the consequences of a new situation (st) that arises in that context. We propose a method to iteratively build a graph of relevant consequences explicitly in a structured situational graph (st-graph) using natural language queries over a finetuned language model (M). Across multiple domains, CURIE generates st-graphs that humans find relevant and meaningful in eliciting the consequences of a new situation. We show that st-graphs generated by CURIE improve a situational reasoning end task (WIQA-QA) by 3 points on accuracy by simply augmenting their input with our generated situational graphs, especially for a hard subset that requires background knowledge and multi-hop reasoning.


title: Toward Sensor and Software Product Line Based Context Aware Cloud Environment Assignment

abstract: Because of the growing interest for mobile device and pervasive applications deployed on cloud computing, the providing of intelligent and ubiquitous context-aware applications that take into account the user's context is one of the main challenges in future applications. In this article we consider how to augment applications aware context used by mobiles device and deployed on cloud computing. The behavior of these applications should depend not only on their internal state and user interactions but also on the context sensed during their execution. Indeed, our approach based on two essential mechanisms, context sensoring and context reasoning. We consider the information acquired by the context sensoring as a product line and we use feature models to represent this information received, the services provided by cloud provider, the available resources and constraints. At the context reasoning step, the context provisioning feature model (CSCAFM) algorithm permits to generate service context-aware that fulfils the requirements of use ensures a certain level of performance of resources.


title: Partition-Guided GANs

abstract: Despite the success of Generative Adversarial Networks (GANs), their training suffers from several well-known problems, including mode collapse and difficulties learning a disconnected set of manifolds. In this paper, we break down the challenging task of learning complex high dimensional distributions, supporting diverse data samples, to simpler sub-tasks. Our solution relies on designing a partitioner that breaks the space into smaller regions, each having a simpler distribution, and training a different generator for each partition. This is done in an unsupervised manner without requiring any labels. We formulate two desired criteria for the space partitioner that aid the training of our mixture of generators: 1) to produce connected partitions and 2) provide a proxy of distance between partitions and data samples, along with a direction for reducing that distance. These criteria are developed to avoid producing samples from places with non-existent data density, and also facilitate training by providing additional direction to the generators. We develop theoretical constraints for a space partitioner to satisfy the above criteria. Guided by our theoretical analysis, we design an effective neural architecture for the space partitioner that empirically assures these conditions. Experimental results on various standard benchmarks show that the proposed unsupervised model outperforms several recent methods.


title: Diverse ATPase proteins in mobilomes constitute a large potential sink for prokaryotic host ATP

abstract: Prokaryote mobilome genomes rely on host machineries for survival and replication. Given that mobile genetic elements (MGEs) derive their energy from host cells, we investigated the diversity of ATP-utilizing proteins in MGE genomes to determine whether they might be associated with proteins that could suppress related host proteins that consume host energy. A comprehensive search of 353 huge phage genomes revealed that up to 9% of the proteins have ATPase domains. For example, ATPase proteins constitute ~3% of the genomes of Lak phages with ~550 kbp genomes that occur in the microbiomes of humans and other animals. Statistical analysis shows the number of ATPase proteins increases linearly with genome length, consistent with a large sink for host ATP during replication of megaphages. Using metagenomic data from diverse environments, we found 505 mobilome proteins with ATPase domains fused to diverse functional domains. Among these composite ATPase proteins, 61.6% have known functional domains that could contribute to host energy diversion during the mobilome life cycle. As many have domains that are known to interact with nucleic acids and proteins, we infer that numerous ATPase proteins are used during replication and for protection from host immune systems. We found a set of uncharacterized ATPase proteins with nuclease and protease activities, displaying unique domain architectures that are energy intensive based on the presence of multiple ATPase domains. In many cases, these composite ATPase proteins genomically co-localize with small proteins in genomic contexts that are reminiscent of toxin-antitoxin systems. Small proteins that function as inhibitors may be a common strategy for control of cellular processes, thus could inspire the development of new nucleic acid and protein manipulation tools, with diverse biotechnological applications.


title: Deep Learning-based Codebook Design for Code-domain Non-Orthogonal Multiple Access Approaching Single-User Bit Error Rate Performance

abstract: A general form of codebook design for code-domain non-orthogonal multiple access (CD-NOMA) can be considered equivalent to an autoencoder (AE)-based constellation design for multi-user multidimensional modulation (MU-MDM). Due to a constrained design space for optimal constellation, e.g., fixed resource mapping and equal power allocation to all codebooks, however, existing AE architectures produce constellations with suboptimal bit-error-rate (BER) performance. Accordingly, we propose a new architecture for MU-MDM AE and underlying training methodology for joint optimization of resource mapping and a constellation design with bit-to-symbol mapping, aiming at approaching the BER performance of a single-user MDM (SU-MDM) AE model with the same spectral efficiency. The core design of the proposed AE architecture is dense resource mapping combined with the novel power allocation layer that normalizes the sum of user codebook power across the entire resources. This globalizes the domain of the constellation design by enabling flexible resource mapping and power allocation. Furthermore, it allows the AE-based training to approach a global optimal MU-MDM constellations for CD-NOMA. Extensive BER simulation results demonstrate that the proposed design outperforms the existing CD-NOMA designs while approaching the single-user BER performance achieved by the equivalent SU-MDM AE within 0.3 dB over the additive white Gaussian noise channel.


title: Towards Rigorous Selection and Configuration of Cloud Services: Research Methodology

abstract: Cloud computing has recently emerged as a major trend in distributed computing. We proposed a platform for selecting and configuring automatically an appropriate cloud environment that meets a set of consumer and provider requirements. It can easily adapt its behavior, either at design-time or runtime, to the change of the environment in matters of location, time, activity, interaction abilities, and communication restrictions. The platform based on the principles of dynamic software product lines (SPL), Agent-oriented software engineering, and the MAPE-k reference model. We based on the Design Science Research Methodology to conduct this work. In this article, we present the steps of our research following this methodology's guidelines.


title: LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directions

abstract: Recent research has shown that it is possible to find interpretable directions in the latent spaces of pre-trained Generative Adversarial Networks (GANs). These directions enable controllable image generation and support a wide range of semantic editing operations, such as zoom or rotation. The discovery of such directions is often done in a supervised or semi-supervised manner and requires manual annotations which limits their use in practice. In comparison, unsupervised discovery allows finding subtle directions that are difficult to detect a priori. In this work, we propose a contrastive learning-based approach to discover semantic directions in the latent space of pre-trained GANs in a self-supervised manner. Our approach finds semantically meaningful dimensions comparable with state-of-the-art methods.


title: Fluxional Behavior at the Atomic Level and its Impact on Activity: CO Oxidation over CeO$_{2}$-supported Pt Catalysts

abstract: Reducible oxides are widely used catalyst supports that can increase oxidation reaction rates by transferring their lattice oxygen at the metal-support interface. The interfacial oxidation process is typically described in terms of a Mars-van Krevelen mechanism. However, many outstanding questions remain unanswered regarding the atomic-scale structure and dynamic meta-stability (i.e., fluxional behavior) of the interface $\textit{during catalysis}$. Here, we employ aberration-corrected $\textit{operando}$ electron microscopy to visualize the structural dynamics occurring at and near Pt/CeO$_{2}$ interfaces during CO oxidation. Finite element simulations are performed to develop a reaction rate analysis wherein the atomic-level structural observations are directly correlated with the catalyst's turnover frequency for CO oxidation. We show that the increasing frequency of catalytic turnover correlates with dynamic fluxional behavior that (a) destablizes the supported Pt particle, (b) marks an enhanced rate of oxygen vacancy creation and annihilation, and (c) leads to increased strain and reduction in the surface of the CeO$_{2}$ support. Overall, the results implicate the interfacial Pt-O-Ce bonds anchoring the Pt to the support as being involved also in the catalytically-driven oxygen transfer process, and they suggest that oxygen reduction takes place on the highly reduced nearby CeO2 surface before migrating to the interfacial perimeter for reaction with CO. The $\textit{operando}$ electron microscopy approach described here should be applicable to a large number of nanoparticle catalysts. This technique will enable the identification of catalytically functional surface structures and strengthen our ability to establish (dynamic) structure-activity relationships.


title: A Formal Analysis of the MimbleWimble Cryptocurrency Protocol

abstract: MimbleWimble (MW) is a privacy-oriented cryptocurrency technology which provides security and scalability properties that distinguish it from other protocols of its kind. We present and discuss those properties and outline the basis of a model-driven verification approach to address the certification of the correctness of the protocol implementations. In particular, we propose an idealized model that is key in the described verification process, and identify and precisely state sufficient conditions for our model to ensure the verification of relevant security properties of MW. Since MW is built on top of a consensus protocol, we develop a Z specification of one such protocol and present an excerpt of the $\{log\}$ prototype generated from the Z specification. This $\{log\}$ prototype can be used as an executable model where simulations can be run. This allows us to analyze the behavior of the protocol without having to implement it in a low level programming language. Finally, we analyze the Grin and Beam implementations of MW in their current state of development.