title: S2AND: A Benchmark and Evaluation System for Author Name Disambiguation

abstract: Author Name Disambiguation (AND) is the task of resolving which author mentions in a bibliographic database refer to the same real-world person, and is a critical ingredient of digital library applications such as search and citation analysis. While many AND algorithms have been proposed, comparing them is difficult because they often employ distinct features and are evaluated on different datasets. In response to this challenge, we present S2AND, a unified benchmark dataset for AND on scholarly papers, as well as an open-source reference model implementation. Our dataset harmonizes eight disparate AND datasets into a uniform format, with a single rich feature set drawn from the Semantic Scholar (S2) database. Our evaluation suite for S2AND reports performance split by facets like publication year and number of papers, allowing researchers to track both global performance and measures of fairness across facet values. Our experiments show that because previous datasets tend to cover idiosyncratic and biased slices of the literature, algorithms trained to perform well on one on them may generalize poorly to others. By contrast, we show how training on a union of datasets in S2AND results in more robust models that perform well even on datasets unseen in training. The resulting AND model also substantially improves over the production algorithm in S2, reducing error by over 50% in terms of $B^3$ F1. We release our unified dataset, model code, trained models, and evaluation suite to the research community. https://github.com/allenai/S2AND/


title: Comparison of Validation Methods of Simulations for Final State Interactions in Hadron Production Experiments

abstract: Neutrino cross section and oscillation measurements depend critically on modeling of hadronic final state interactions (FSI). Often, this is one of the largest components of uncertainty in a measurement. This is because of the difficulty in modeling strong interactions in nuclei in a consistent quantum-mechanical framework. FSI models are most often validated using hadron-nucleus data which introduces further uncertainties. The alternative is to use transparency data where the hadron starts propagating from inside the nucleus and the probability of interaction is measured as a function of hadron energy. This work examines the relationship between the $\pi^+$ and proton total reaction cross section and transparency from a simulation viewpoint.


title: Nonlinear BSDEs in general filtration with drivers depending on the martingale part of a solution

abstract: In the present paper, we consider multidimensional nonlinear backward stochastic differential equations (BSDEs) with a driver depending on the martingale part $M$ of a solution. We assume that the nonlinear term is merely monotone continuous with respect to the state variable. As to the regularity of the driver with respect to the martingale variable, we consider a very general condition which permits path-dependence on "the future" of the process $M$ as well as a dependence of its law (McKean-Vlasov-type equations). For such driver, we prove the existence and uniqueness of a global solution (i.e. for any maturity $T>0$) to BSDE with data satisfying natural integrability conditions.


title: A Monolithic Algebraic Multigrid Framework for Multiphysics Applications with Examples from Resistive MHD

abstract: A multigrid framework is described for multiphysics applications. The framework allows one to construct, adapt, and tailor a monolithic multigrid methodology to different linear systems coming from discretized partial differential equations. The main idea centers on developing multigrid components in a blocked fashion where each block corresponds to separate sets of physical unknowns and equations within the larger discretization matrix. Once defined, these components are ultimately assembled into a monolithic multigrid solver for the entire system. We demonstrate the potential of the framework by applying it to representative linear solution sub-problems arising from resistive MHD.


title: Abolitionist Networks: Modeling Language Change in Nineteenth-Century Activist Newspapers

abstract: The abolitionist movement of the nineteenth-century United States remains among the most significant social and political movements in US history. Abolitionist newspapers played a crucial role in spreading information and shaping public opinion around a range of issues relating to the abolition of slavery. These newspapers also serve as a primary source of information about the movement for scholars today, resulting in powerful new accounts of the movement and its leaders. This paper supplements recent qualitative work on the role of women in abolition's vanguard, as well as the role of the Black press, with a quantitative text modeling approach. Using diachronic word embeddings, we identify which newspapers tended to lead lexical semantic innovations -- the introduction of new usages of specific words -- and which newspapers tended to follow. We then aggregate the evidence across hundreds of changes into a weighted network with the newspapers as nodes; directed edge weights represent the frequency with which each newspaper led the other in the adoption of a lexical semantic change. Analysis of this network reveals pathways of lexical semantic influence, distinguishing leaders from followers, as well as others who stood apart from the semantic changes that swept through this period. More specifically, we find that two newspapers edited by women -- THE PROVINCIAL FREEMAN and THE LILY -- led a large number of semantic changes in our corpus, lending additional credence to the argument that a multiracial coalition of women led the abolitionist movement in terms of both thought and action. It also contributes additional complexity to the scholarship that has sought to tease apart the relation of the abolitionist movement to the women's suffrage movement, and the vexed racial politics that characterized their relation.


title: Data-driven low-fidelity models for multi-fidelity Monte Carlo sampling in plasma micro-turbulence analysis

abstract: The linear micro-instabilities driving turbulent transport in magnetized fusion plasmas (as well as the respective nonlinear saturation mechanisms) are known to be sensitive with respect to various physical parameters characterizing the background plasma and the magnetic equilibrium. Therefore, uncertainty quantification is essential for achieving predictive numerical simulations of plasma turbulence. However, the high computational costs of the required gyrokinetic simulations and the large number of parameters render standard Monte Carlo techniques intractable. To address this problem, we propose a multi-fidelity Monte Carlo approach in which we employ data-driven low-fidelity models that exploit the structure of the underlying problem such as low intrinsic dimension and anisotropic coupling of the stochastic inputs. The low-fidelity models are efficiently constructed via sensitivity-driven dimension-adaptive sparse grid interpolation using both the full set of uncertain inputs and subsets comprising only selected, important parameters. We illustrate the power of this method by applying it to two plasma turbulence problems with up to $14$ stochastic parameters, demonstrating that it is up to four orders of magnitude more efficient than standard Monte Carlo methods measured in single-core performance, which translates into a runtime reduction from around eight days to one hour on 240 cores on parallel machines.


title: Improving Surrogate Model Accuracy for the LCLS-II Injector Frontend Using Convolutional Neural Networks and Transfer Learning

abstract: Machine learning models of accelerator systems (`surrogate models') are able to provide fast, accurate predictions of accelerator physics phenomena. However, approaches to date typically do not include measured input diagnostics, such as the initial beam distributions, which are critical for accurately representing the beam evolution through the system. In addition, these inputs often vary over time, and models that can account for these changing conditions are needed. Simulations are in some cases needed to provide sufficient training data. These typically represent the designed machine before construction; however, the behavior of the installed components may be quite different due to changes over time or static differences that were not modeled. Therefore, surrogate models that can leverage both simulation and measured data successfully are needed. We introduce an approach based on convolutional neural networks that uses the drive laser distribution and scalar settings as inputs for the Linac Coherent Light Source II injector frontend. The model is able to predict scalar beam parameters and the transverse beam distribution downstream, taking into account the impact of time-varying non-uniformities in the initial transverse laser distribution. We also introduce and evaluate a transfer learning procedure for adapting the surrogate model from the simulation domain to the measurement domain, to account for differences between the two. Applying this approach to our test case results in a model that can predict test sample outputs within a mean absolute percent error of 7.6%. This is a substantial improvement over the model trained only on simulations, which has an error of 112.7% when applied to measured data. While we focus on the LCLS-II Injector frontend, these approaches for improving ML-based online modeling of injector systems could be easily adapted to other accelerator facilities.


title: Machine Learning aided k-t SENSE for fast reconstruction of highly accelerated PCMR data

abstract: Purpose: We implemented the Machine Learning (ML) aided k-t SENSE reconstruction to enable high resolution quantitative real-time phase contrast MR (PCMR). Methods: A residual U-net and our U-net M were used to generate the high resolution x-f space estimate for k-t SENSE regularisation prior. The networks were judged on their ability to generalise to real undersampled data. The in-vivo validation was done on 20 real-time 18x prospectively undersmapled GASperturbed PCMR data. The ML aided k-t SENSE reconstruction results were compared against the free-breathing Cartesian retrospectively gated sequence and the compressed sensing (CS) reconstruction of the same data. Results: In general, the ML aided k-t SENSE generated flow curves that were visually sharper than those produced using CS. In two exceptional cases, U-net M predictions exhibited blurring which propagated to the extracted velocity curves. However, there were no statistical differences in the measured peak velocities and stroke volumes between the tested methods. The ML aided k-t SENSE was estimated to be ~3.6x faster in processing than CS. Conclusion: The ML aided k-t SENSE reconstruction enables artefact suppression on a par with CS with no significant differences in quantitative measures. The timing results suggest the on-line implementation could deliver a substantial increase in clinical throughput.


title: How to Train Your Flare Prediction Model: Revisiting Robust Sampling of Rare Events

abstract: We present a case study of solar flare forecasting by means of metadata feature time series, by treating it as a prominent class-imbalance and temporally coherent problem. Taking full advantage of pre-flare time series in solar active regions is made possible via the Space Weather Analytics for Solar Flares (SWAN-SF) benchmark dataset; a partitioned collection of multivariate time series of active region properties comprising 4075 regions and spanning over 9 years of the Solar Dynamics Observatory (SDO) period of operations. We showcase the general concept of temporal coherence triggered by the demand of continuity in time series forecasting and show that lack of proper understanding of this effect may spuriously enhance models' performance. We further address another well-known challenge in rare event prediction, namely, the class-imbalance issue. The SWAN-SF is an appropriate dataset for this, with a 60:1 imbalance ratio for GOES M- and X-class flares and a 800:1 for X-class flares against flare-quiet instances. We revisit the main remedies for these challenges and present several experiments to illustrate the exact impact that each of these remedies may have on performance. Moreover, we acknowledge that some basic data manipulation tasks such as data normalization and cross validation may also impact the performance -- we discuss these problems as well. In this framework we also review the primary advantages and disadvantages of using true skill statistic and Heidke skill score, as two widely used performance verification metrics for the flare forecasting task. In conclusion, we show and advocate for the benefits of time series vs. point-in-time forecasting, provided that the above challenges are measurably and quantitatively addressed.


title: Reasoning about the garden of forking paths

abstract: Lazy evaluation is a powerful tool for functional programmers. It enables the concise expression of on-demand computation and a form of compositionality not available under other evaluation strategies. However, the stateful nature of lazy evaluation makes it hard to analyze a program's computational cost, either informally or formally. In this work, we present a novel and simple framework for formally reasoning about lazy computation costs based on a recent model of lazy evaluation: clairvoyant call-by-value. The key feature of our framework is its simplicity, as expressed by our definition of the clairvoyance monad. This monad is both simple to define (around 20 lines of Coq) and simple to reason about. We show that this monad can be effectively used to mechanically reason about the computational cost of lazy functional programs written in Coq.


title: Meta-Modeling of Assembly Contingencies and Planning for Repair

abstract: The World Robotics Challenge (2018 & 2020) was designed to challenge teams to design systems that are easy to adapt to new tasks and to ensure robust operation in a semi-structured environment. We present a layered strategy to transform missions into tasks and actions and provide a set of strategies to address simple and complex failures. We propose a model for characterizing failures using this model and discuss repairs. Simple failures are by far the most common in our WRC system and we also present how we repaired them.


title: Chandra Observations of the Planck ESZ Sample: A Re-Examination of Masses and Mass Proxies

abstract: Using Chandra observations, we derive the $Y_{\rm X}$ proxy and associated total mass measurement, $M_{500}^{\rm Y_X}$, for 147 clusters with $z \leq 0.35$ from the Planck Early Sunyaev-Zel'dovich catalog, and for 80 clusters with $z \leq 0.30$ from an X-ray flux-limited sample. We re-extract the Planck $Y_{\rm SZ}$ measurements and obtain the corresponding mass proxy, $M_{500}^{\rm SZ}$, from the full Planck mission maps, minimizing the Malmquist bias due to observational scatter. The masses re-extracted using the more precise X-ray position and characteristic size agree with the published PSZ2 values, but yield a significant reduction in the scatter (by a factor of two) in the $M_{500}^{\rm SZ}$-$M_{500}^{\rm X}$ relation. The slope is $0.93\pm0.03$, and the median ratio, $M_{500}^{\rm SZ}/M_{500}^{\rm X}= 0.91\pm0.01$, is within the expectations from known X-ray calibration systematics. The $Y_{\rm SZ}/Y_{\rm X}$ ratio is $0.88\pm0.02$, in good agreement with predictions from cluster structure, and implying a low level of clumpiness. In agreement with the findings of the Planck Collaboration, the slope of the $Y_{\rm SZ}$-$D_{\rm A}^{-2} Y_{X}$ flux relation is significantly less than unity ($0.89\pm0.01$). Using extensive simulations, we show that this result is not due to selection effects, intrinsic scatter, or covariance between quantities. We demonstrate analytically that changing the $Y_{\rm SZ}$-$Y_{X}$ relation from apparent flux to intrinsic properties results in a best-fit slope that is closer to unity and increases the dispersion about the relation. The redistribution resulting from this transformation implies that the best fit parameters of the $M_{500}^{\rm SZ}$-$M_{500}^{\rm X}$ relation will be sample-dependent.


title: Real-space Green's function approach for x-ray spectra at finite temperature

abstract: There has been considerable interest in properties of condensed matter at finite temperature, including non-equilibrium behavior and extreme conditions up to the warm dense matter regime. Such behavior is encountered, e.g., in experimental time resolved x-ray absorption spectroscopy (XAS) in the presence of intense laser fields. In an effort to simulate such behavior, we present an approach for calculations of finite-temperature x-ray absorption spectra in arbitrary materials, using a generalization of the real-space Green's function formalism. The method is incorporated as an option in the core-level x-ray spectroscopy code FEFF10. To illustrate the approach, we present calculations for several materials together with comparisons to experiment and with other methods.


title: On the list decodability of rank-metric codes containing Gabidulin codes

abstract: Wachter-Zeh in [42], and later together with Raviv [31], proved that Gabidulin codes cannot be efficiently list decoded for any radius $\tau$, providing that $\tau$ is large enough. Also, they proved that there are infinitely many choices of the parameters for which Gabidulin codes cannot be efficiently list decoded at all. Subsequently, in [41] these results have been extended to the family of generalized Gabidulin codes and to further family of MRD-codes. In this paper, we provide bounds on the list size of rank-metric codes containing generalized Gabidulin codes in order to determine whether or not a polynomial-time list decoding algorithm exists. We detect several families of rank-metric codes containing a generalized Gabidulin code as subcode which cannot be efficiently list decoded for any radius large enough and families of rank-metric codes which cannot be efficiently list decoded. These results suggest that rank-metric codes which are $\mathbb{F}_{q^m}$-linear or that contains a (power of) generalized Gabidulin code cannot be efficiently list decoded for large values of the radius.


title: On the expressive power of Lukasiewicz's square operator

abstract: The aim of the paper is to analyze the expressive power of the square operator of Lukasiewicz logic: $\ast x=x\odot x$, where $\odot$ is the strong Lukasiewicz conjunction. In particular, we aim at understanding and characterizing those cases in which the square operator is enough to construct a finite MV-chain from a finite totally ordered set endowed with an involutive negation. The first of our main results shows that, indeed, the whole structure of MV-chain can be reconstructed from the involution and the Lukasiewicz square if and only if the obtained structure has only trivial subalgebras and, equivalently, if and only if the cardinality of the starting chain is of the form $n+1$ where $n$ belongs to a class of prime numbers that we fully characterize. Secondly, we axiomatize the algebraizable matrix logic whose semantics is given by the variety generated by a finite totally ordered set endowed with an involutive negation and Lukasiewicz's square operator. Finally, we propose an alternative way to account for Lukasiewicz square operator on involutive G\"odel chains. In this setting, we show that such an operator can be captured by a rather intuitive set of equations.


title: A Decade of NASA Strategic Astrophysics Technology Investments: Technology Maturation, Infusion, and Other Benefits

abstract: NASA Astrophysics Division funds development of cutting-edge technology to enable its missions to achieve ambitious and groundbreaking science goals. These technology development efforts are managed by the Physics of the Cosmos, Cosmic Origins, and Exoplanet Exploration Programs. The NASA Strategic Astrophysics Technology Program (SAT) was established in 2009 as a new technology maturation program to fill the gap in the Technology Readiness Level range from 3 to 6. Since program inception, 100 SAT grants have been openly competed and awarded, along with dozens of direct-funded projects, leading to a host of technologies advancing their Technology Readiness Levels and/or being infused into space and suborbital missions and ground-based projects. We present the portfolio distribution in terms of specific technology areas addressed, including optics, detectors, coatings, corona graphs, star shades, lasers, electronics, and cooling subsystems. We show an analysis of the rate of Technology Readiness Level advances, infusion success stories, and other benefits such as training the future astrophysics workforce, including students and postdoctoral fellows hired by projects. Finally, we present the Astrophysics Division current strategic technology maturation priorities for investment, enabling a range of future strategic astrophysics missions.


title: Chaotic Logistic Map Forecast using Fuzzy Time Series

abstract: This paper deals with the problem of forecast the Logistic Chaotic Map using Fuzzy Times Series (FTS). Chaotic Systems are very sensible to changes in its parameters and in the initial conditions, turning them into hard systems to model and forecast. In this case, we relay in the robustness of Fuzzy Time Series to model and forecast the logistic map. We use the Akaike Information Criterion (AIC) as an index to determine the number of sub intervals for the definition of the fuzzy set.


title: Phi-contractive parent-child infinite IFSs and orbital phi-contractive infinite IFSs

abstract: In this paper we introduce the notions of phi-contractive parent-child infinite iterated function system (pcIIFS) and orbital phi-contractive infinite iterated function system (oIIFS) and we prove that the corresponding fractal operator is weakly Picard. The corresponding notions of shift space, canonical projection and their properties are also treated.


title: Few-Shot Text Classification with Triplet Networks, Data Augmentation, and Curriculum Learning

abstract: Few-shot text classification is a fundamental NLP task in which a model aims to classify text into a large number of categories, given only a few training examples per category. This paper explores data augmentation -- a technique particularly suitable for training with limited data -- for this few-shot, highly-multiclass text classification setting. On four diverse text classification tasks, we find that common data augmentation techniques can improve the performance of triplet networks by up to 3.0% on average. To further boost performance, we present a simple training strategy called curriculum data augmentation, which leverages curriculum learning by first training on only original examples and then introducing augmented data as training progresses. We explore a two-stage and a gradual schedule, and find that, compared with standard single-stage training, curriculum data augmentation trains faster, improves performance, and remains robust to high amounts of noising from augmentation.


title: Bias Reduction in Sample-Based Optimization

abstract: We consider stochastic optimization problems which use observed data to estimate essential characteristics of the random quantities involved. Sample average approximation (SAA) or empirical (plug-in) estimation are very popular ways to use data in optimization. It is well known that sample average optimization suffers from downward bias. We propose to use smooth estimators rather than empirical ones in optimization problems. We establish consistency results for the optimal value and the set of optimal solutions of the new problem formulation. The performance of the proposed approach is compared to SAA theoretically and numerically. We analyze the bias of the new problems and identify sufficient conditions for ensuring less biased estimation of the optimal value of the true problem. At the same time, the error of the new estimator remains controlled. We show that those conditions are satisfied for many popular statistical problems such as regression models, classification problems, and optimization problems with Average (Conditional) Value-at-Risk. We have observed that smoothing the least-squares objective in a regression problem by a normal kernel leads to a ridge regression. Our numerical experience shows that the new estimators frequently exhibit also smaller variance and smaller mean-square error than those of SAA.


title: A Distributed Optimisation Framework Combining Natural Gradient with Hessian-Free for Discriminative Sequence Training

abstract: This paper presents a novel natural gradient and Hessian-free (NGHF) optimisation framework for neural network training that can operate efficiently in a distributed manner. It relies on the linear conjugate gradient (CG) algorithm to combine the natural gradient (NG) method with local curvature information from Hessian-free (HF) or other second-order methods. A solution to a numerical issue in CG allows effective parameter updates to be generated with far fewer CG iterations than usually used (e.g. 5-8 instead of 200). This work also presents a novel preconditioning approach to improve the progress made by individual CG iterations for models with shared parameters. Although applicable to other training losses and model structures, NGHF is investigated in this paper for lattice-based discriminative sequence training for hybrid hidden Markov model acoustic models using a standard recurrent neural network, long short-term memory, and time delay neural network models for output probability calculation. Automatic speech recognition experiments are reported on the multi-genre broadcast data set for a range of different acoustic model types. These experiments show that NGHF achieves larger word error rate reductions than standard stochastic gradient descent or Adam, while requiring orders of magnitude fewer parameter updates.


title: PION: Simulating bow shocks and circumstellar nebulae

abstract: Expanding nebulae are produced by mass loss from stars, especially during late stages of evolution. Multi-dimensional simulation of these nebulae requires high resolution near the star and permits resolution that decreases with distance from the star, ideally with adaptive timesteps. We report the implementation and testing of static mesh-refinement in the radiation-magnetohydrodynamics code PION, and document its performance for 2D and 3D calculations. The bow shock produced by a hot, magnetized, slowly rotating star as it moves through the magnetized ISM is simulated in 3D, highlighting differences compared with 2D calculations. Latitude-dependent, time-varying magnetized winds are modelled and compared with simulations of ring nebulae around blue supergiants from the literature. A 3D simulation of the expansion of a fast wind from a Wolf-Rayet star into the slow wind from a previous red supergiant phase of evolution is presented, with results compared with results in the literature and analytic theory. Finally the wind-wind collision from a binary star system is modelled with 3D MHD, and the results compared with previous 2D hydrodynamic calculations. A python library is provided for reading and plotting simulation snapshots, and the generation of synthetic infrared emission maps using torus is also demonstrated. It is shown that state-of-the-art 3D MHD simulations of wind-driven nebulae can be performed using PION with reasonable computational resources. The source code and user documentation is made available for the community under a BSD3 licence.


title: eQE 2.0: Subsystem DFT Beyond GGA Functionals

abstract: By adopting a divide-and-conquer strategy, subsystem-DFT (sDFT) can dramatically reduce the computational cost of large-scale electronic structure calculations. The key ingredients of sDFT are the nonadditive kinetic energy and exchange-correlation functionals which dominate it's accuracy. Even though, semilocal nonadditive functionals find a broad range of applications, their accuracy is somewhat limited especially for those systems where achieving balance between exchange-correlation interactions on one side and nonadditive kinetic energy on the other is crucial. In eQE 2.0, we improve dramatically the accuracy of sDFT simulations by (1) implementing nonlocal nonadditive kinetic energy functionals based on the LMGP family of functionals; (2) adapting Quantum ESPRESSO's implementation of rVV10 and vdW-DF nonlocal exchange-correlation functionals to be employed in sDFT simulations; (3) implementing "deorbitalized" meta GGA functionals (e.g., SCAN-L). We carefully assess the performance of the newly implemented tools on the S22-5 test set. eQE 2.0 delivers excellent interaction energies compared to conventional Kohn-Sham DFT and CCSD(T). The improved performance does not come at a loss of computational efficiency. We show that eQE 2.0 with nonlocal nonadditive functionals retains the same linear scaling behavior achieved in eQE 1.0 with semilocal nonadditive functionals.

categories: cond-mat.mtrl-sci physics.atm-clus physics.chem-ph physics.comp-ph quant-ph


title: Languages of Higher-Dimensional Automata

abstract: We introduce languages of higher-dimensional automata (HDAs) and develop some of their properties. To this end, we define a new category of precubical sets, uniquely naturally isomorphic to the standard one, and introduce a notion of event consistency. HDAs are then finite, labeled, event-consistent precubical sets with distinguished subsets of initial and accepting cells. Their languages are sets of interval orders closed under subsumption; as a major technical step we expose a bijection between interval orders and a subclass of HDAs. We show that any finite subsumption-closed set of interval orders is the language of an HDA, that languages of HDAs are closed under binary unions and parallel composition, and that bisimilarity implies language equivalence.


title: First-Order Sketch Conditions and Constraints -- A Category Independent Approach

abstract: Generalizing different variants of "graph conditions and constraints" as well as "universal constraints" and "negative universal constraints" in the Diagram Predicate Framework (DPF), we introduce for arbitrary categories $\mathbf{Cxt}$ and "statement" functors $\mathtt{Stm}:\mathbf{Cxt}\to\mathbf{Set}$ general first-order sketch conditions and constraints. Sketches are used in DPF to formalize different kinds of diagrammatic software models. We discuss the use of sketch constraints for describing the syntactic structure of sketches. We outline the use of sketch constraints to deduce knowledge implicitly given in a sketch as well as procedures to deduce sketch constraints from given sketch constraints. We use the simple but paradigmatic modeling formalism "Category Theory" as running example.


title: Imaging three phases of Iodine on Ag (111) using low-temperature scanning tunneling microscopy

abstract: We investigated the adsorption of iodine on silver (111) in ultra-high vacuum. Using low-temperature scanning tunneling microscopy (LT-STM) measurements we catalog the complex surface structures on the local scale. We identified three distinct phases with increasing iodine coverage which we tentatively associate with three phases previously reported in LEED experiments (sqrt(3)x sqrt(3)R30, "triangular", "hexagonal"). We used Fourier space and real space analysis to fully characterize each phase. While Fourier analysis most easily connects our measurements to previous LEED studies, the real space inspection reveals local variations in the superstructures of the "hexagonal" and "triangular" phase. The latter, observed here for the first time by LT-STM, stabilized by one or two adatoms sitting at the center of a rosette-like iodine reconstruction. The most stunning discovery is that variation in the adatom separation of the "triangular" phase reconstruct the Ag (111) surface lattice.


title: Causal Markov Boundaries

abstract: Feature selection is an important problem in machine learning, which aims to select variables that lead to an optimal predictive model. In this paper, we focus on feature selection for post-intervention outcome prediction from pre-intervention variables. We are motivated by healthcare settings, where the goal is often to select the treatment that will maximize a specific patient's outcome; however, we often do not have sufficient randomized control trial data to identify well the conditional treatment effect. We show how we can use observational data to improve feature selection and effect estimation in two cases: (a) using observational data when we know the causal graph, and (b) when we do not know the causal graph but have observational and limited experimental data. Our paper extends the notion of Markov boundary to treatment-outcome pairs. We provide theoretical guarantees for the methods we introduce. In simulated data, we show that combining observational and experimental data improves feature selection and effect estimation.


title: To not miss the forest for the trees -- a holistic approach for explaining missing answers over nested data (extended version)

abstract: Query-based explanations for missing answers identify which operators of a query are responsible for the failure to return a missing answer of interest. This type of explanations has proven to be useful in a variety of contexts including debugging of complex analytical queries. Such queries are frequent in big data systems such as Apache Spark. We present a novel approach for producing query-based explanations. Our approach is the first to support nested data and to consider operators that modify the schema and structure of the data (e.g., nesting and projections) as potential causes of missing answers. To efficiently compute explanations, we propose a heuristic algorithm that applies two novel techniques: (i) reasoning about multiple schema alternatives for a query and (ii) re-validating at each step whether an intermediate result can contribute to the missing answer. Using an implementation of our approach on Spark, we demonstrate that it is the first to scale to large datasets and that it often finds explanations that existing techniques fail to identify.


title: Towards Learning Food Portion From Monocular Images With Cross-Domain Feature Adaptation

abstract: We aim to estimate food portion size, a property that is strongly related to the presence of food object in 3D space, from single monocular images under real life setting. Specifically, we are interested in end-to-end estimation of food portion size, which has great potential in the field of personal health management. Unlike image segmentation or object recognition where annotation can be obtained through large scale crowd sourcing, it is much more challenging to collect datasets for portion size estimation since human cannot accurately estimate the size of an object in an arbitrary 2D image without expert knowledge. To address such challenge, we introduce a real life food image dataset collected from a nutrition study where the groundtruth food energy (calorie) is provided by registered dietitians, and will be made available to the research community. We propose a deep regression process for portion size estimation by combining features estimated from both RGB and learned energy distribution domains. Our estimates of food energy achieved state-of-the-art with a MAPE of 11.47%, significantly outperforms non-expert human estimates by 27.56%.


title: Multidimensional Generalized Quadrature Index Modulation for 5G Wireless Communications

abstract: Multidimensional generalized quadrature index modulation scheme is proposed in this paper for conveying extra digital information with the aid of the space, radio frequency (RF) mirrors, and time indices. Explicitly, this proposed scheme cleverly combines another proposed time-indexed generalized quadrature spatial modulation (TI-GQSM) system with media-based modulation (MBM) transmission principle using RF mirrors, and it is referred to as TI-GQSM-MBM scheme. This scheme is attractive because of both the high data rate and the significant performance improvements that can be achieved. The system performance of the proposed schemes in terms of the bit error rate (BER) is evaluated and compared to the performance of the conventional schemes. Simulation results showed that a significant improvement is achieved by the TI-GQSM-MBM scheme as compared to that of TI-GQSM, time-indexed media-based modulation (TI-MBM) and the conventional generalized quadrature spatial modulation (GQSM) schemes for the same rate. It is also demonstrated that the proposed schemes are robust to channel estimation errors (CEEs) as compared to multidimensional generalized spatial modulation (GSM) schemes. Therefore, the proposed schemes can be effectively used as an alternative solution for various 5G and beyond wireless networks.


title: VMAF-based Bitrate Ladder Estimation for Adaptive Streaming

abstract: In HTTP Adaptive Streaming, video content is conventionally encoded by adapting its spatial resolution and quantization level to best match the prevailing network state and display characteristics. It is well known that the traditional solution, of using a fixed bitrate ladder, does not result in the highest quality of experience for the user. Hence, in this paper, we consider a content-driven approach for estimating the bitrate ladder, based on spatio-temporal features extracted from the uncompressed content. The method implements a content-driven interpolation. It uses the extracted features to train a machine learning model to infer the curvature points of the Rate-VMAF curves in order to guide a set of initial encodings. We employ the VMAF quality metric as a means of perceptually conditioning the estimation. When compared to exhaustive encoding that produces the reference ladder, the estimated ladder is composed by 74.3% of identical Rate-VMAF points with the reference ladder. The proposed method offers a significant reduction of the number of encodes required, 77.4%, at a small average Bj{\o}ntegaard Delta Rate cost, 1.12%.


title: Integration of A-Star Search and Classic Optimal Control for Safe Planning of Continuum Deformation of a Multi-Quadcopter System

abstract: This paper offers an algorithmic approach to plan continuum deformation of a multi-quadcopter system (MQS) in an obstacle-laden environment. We treat the MQS as finite number of particles of a deformable body coordinating under a homogeneous transformation. In this context, we define the MQS homogeneous deformation coordination as a decentralized leader-follower problem, and integrate the principles of continuum mechanics, A-Star search method, and optimal control to safety and optimally plan MQS continuum deformation coordination. In particular, we apply the principles of continuum mechanics to obtain the safety constraints, use the A-Star search method to assign the intermediate configurations of the leaders by minimizing the travel distance of the MQS, and determine the leaders' optimal trajectories by solving a constrained optimal control problem. The optimal planning of the continuum deformation coordination is acquired by the quadcopter team in a decentralized fashion through local communication.


title: Data-driven subspace predictive control of adaptive optics for high-contrast imaging

abstract: The search for exoplanets is pushing adaptive optics systems on ground-based telescopes to their limits. One of the major limitations at small angular separations, exactly where exoplanets are predicted to be, is the servo-lag of the adaptive optics systems. The servo-lag error can be reduced with predictive control where the control is based on the future state of the atmospheric disturbance. We propose to use a linear data-driven integral predictive controller based on subspace methods that is updated in real time. The new controller only uses the measured wavefront errors and the changes in the deformable mirror commands, which allows for closed-loop operation without requiring pseudo-open loop reconstruction. This enables operation with non-linear wavefront sensors such as the pyramid wavefront sensor. We show that the proposed controller performs near-optimal control in simulations for both stationary and non-stationary disturbances and that we are able to gain several orders of magnitude in raw contrast. The algorithm has been demonstrated in the lab with MagAO-X, where we gain more than two orders of magnitude in contrast.


title: Privacy Regularization: Joint Privacy-Utility Optimization in Language Models

abstract: Neural language models are known to have a high capacity for memorization of training samples. This may have serious privacy implications when training models on user content such as email correspondence. Differential privacy (DP), a popular choice to train models with privacy guarantees, comes with significant costs in terms of utility degradation and disparate impact on subgroups of users. In this work, we introduce two privacy-preserving regularization methods for training language models that enable joint optimization of utility and privacy through (1) the use of a discriminator and (2) the inclusion of a triplet-loss term. We compare our methods with DP through extensive evaluation. We show the advantages of our regularizers with favorable utility-privacy trade-off, faster training with the ability to tap into existing optimization approaches, and ensuring uniform treatment of under-represented subgroups.


title: Spatiotemporal control of surface plasmon polariton wave packets with nanocavities

abstract: Modulation of the optical index by means of atomic and material resonances provides a basis for controlling light propagation in natural and artificially fabricated materials. In addition, recent advances in the tuning of spatiotemporal couplings of ultrashort laser pulses have enabled almost arbitrary control over the group velocity of light. Here, using femtosecond time-resolved microscopy and numerical calculations, we investigate the spatiotemporal dynamics of a surface plasmon polariton wave packet (SPP WP) that interacts with a plasmonic nanocavity. The nanocavity consists of metal-insulator-metal multilayer films that function as subwavelength meta-atom possessing tunable discretized eigenmodes. When a chirp-induced femtosecond SPP WP is incident on a nanocavity, only the spectral component matching the resonance energy is transmitted. This spectral clipping effect is accompanied by a spatial shift of the WP. The shift can be adjusted in either the positive or negative direction by controlling the resonance energy or the chirp. If this spatial shift is regarded as a modulation of the apparent group velocity in the nanocavity, the range of modulation includes superluminal, subluminal, and negative group velocities.


title: Weak Solutions for a Poro-elastic Plate System

abstract: We consider a recent plate model obtained as a scaled limit of the three dimensional Biot system of poro-elasticity. The result is a "2.5" dimensional linear system that couples traditional Euler-Bernoulli plate dynamics to a pressure equation in three dimensions, where diffusion acts only transversely. We alow the permeability function to be time-dependent, making the problem non-autonomous and disqualifying much of the standard abstract theory. Weak solutions are defined in the so called quasi-static case, and the problem is framed abstractly as an implicit, degenerate evolution problem. Utilizing the theory for weak solutions to implicit evolution equations, we obtain existence of solutions. Uniqueness is obtained under additional hypotheses on the regularity of the permeability. We address the inertial case in an appendix, by way of semigroup theory. The work here provides a baseline theory of weak solutions for the poro-elastic plate, and exposits a variety of interesting related models and associated analytical investigations.


title: Dilated Fully Convolutional Neural Network for Depth Estimation from a Single Image

abstract: Depth prediction plays a key role in understanding a 3D scene. Several techniques have been developed throughout the years, among which Convolutional Neural Network has recently achieved state-of-the-art performance on estimating depth from a single image. However, traditional CNNs suffer from the lower resolution and information loss caused by the pooling layers. And oversized parameters generated from fully connected layers often lead to a exploded memory usage problem. In this paper, we present an advanced Dilated Fully Convolutional Neural Network to address the deficiencies. Taking advantages of the exponential expansion of the receptive field in dilated convolutions, our model can minimize the loss of resolution. It also reduces the amount of parameters significantly by replacing the fully connected layers with the fully convolutional layers. We show experimentally on NYU Depth V2 datasets that the depth prediction obtained from our model is considerably closer to ground truth than that from traditional CNNs techniques.


title: Exact $k$-body representation of the Jaynes-Cummings interaction in the dressed basis: Insight into many-body phenomena with light

abstract: Analog quantum simulation - the technique of using one experimentally well-controlled physical system to mimic the behavior of another - has quickly emerged as one of the most promising near term strategies for studying strongly correlated quantum many-body systems. In particular, systems of interacting photons, realizable in solid-state cavity and circuit QED frameworks, for example, hold tremendous promise for the study of nonequilibrium many-body phenomena due to the capability to locally create and destroy photons. These systems are typically modeled using a Jaynes-Cummings-Hubbard (JCH) Hamiltonian, named due to similarities with the Bose-Hubbard (BH) model. Here, we present a non-perturbative procedure for transforming the JC Hamiltonian into a dressed operator representation that, in its most general form, admits an infinite sum of bosonic $k$-body terms where $k$ is bound only by the number of excitations in the system. We closely examine this result in both the dispersive and resonant coupling regimes, finding rapid convergence in the former and contributions from $k\gg1$ in the latter. Through extension to a two-site JCH system, we demonstrate that this approach facilitates close inspection of the analogy between the JCH and BH models and its breakdown for resonant light-matter coupling. Finally, we use this framework to survey the many-body character of a two-site JCH for general system parameters, identifying four unique quantum phases and the parameter regimes in which they are realized, thus highlighting phenomena realizable with finite JCH-based quantum simulators beyond the BH model. More broadly, this work is intended to serve as a clear mathematical exposition of bosonic many-body interactions underlying JC-type systems, often postulated through analogy to Kerr-like nonlinear susceptibilities or by matching coefficients to obtain the appropriate eigenvalue spectrum.


title: On factorisation systems for Ord-enriched categories and categories of partial maps

abstract: In this work we discuss a new type of factorisation systems for \textbf{Ord}-enriched categories. We start by defining the new notion of lax weak orthogonality, which involves the existence of lax diagonal morphisms for lax squares. Using the usual theory of factorisation systems as a blueprint, we introduce a lax version of weak and functorial factorisation systems. We provide a characterisation of lax functorial weak factorisation systems, namely lax weak factorisation systems such that their factorisations are lax functorial. Then, we present a particular case of such lax functorial weak factorisation systems which are equipped with additional lax monad structures. We finally explore some examples of these factorisation systems for categories of partial maps equipped with natural Ord-enrichments. We will first construct a particular lax algebraic weak factorisation system for categories of partial maps that isolates the total datum and the partial domain of a partial map. Then we will discuss the relation between factorisation systems on the base category and oplax factorisation systems on the induced category of partial maps.


title: Mining Artifacts in Mycelium SEM Micrographs

abstract: Mycelium is a promising biomaterial based on fungal mycelium, a highly porous, nanofibrous structure. Scanning electron micrographs are used to characterize its network, but the currently available tools for nanofibrous microstructures do not contemplate the particularities of biomaterials. The adoption of a software for artificial nanofibrous in mycelium characterization adds the uncertainty of imaging artifact formation to the analysis. The reported work combines supervised and unsupervised machine learning methods to automate the identification of artifacts in the mapped pores of mycelium microstructure. Keywords: Machine learning; unsupervised learning; image processing; mycelium; microstructure informatics

categories: eess.IV cond-mat.mtrl-sci cs.CV q-bio.QM


title: A reduced basis method for radiative transfer equation

abstract: Linear kinetic transport equations play a critical role in optical tomography, radiative transfer and neutron transport. The fundamental difficulty hampering their efficient and accurate numerical resolution lies in the high dimensionality of the physical and velocity/angular variables and the fact that the problem is multiscale in nature. Leveraging the existence of a hidden low-rank structure hinted by the diffusive limit, in this work, we design and test the angular-space reduced order model for the linear radiative transfer equation, the first such effort based on the celebrated reduced basis method (RBM). Our method is built upon a high-fidelity solver employing the discrete ordinates method in the angular space, an asymptotic preserving upwind discontinuous Galerkin method for the physical space, and an efficient synthetic accelerated source iteration for the resulting linear system. Addressing the challenge of the parameter values (or angular directions) being coupled through an integration operator, the first novel ingredient of our method is an iterative procedure where the macroscopic density is constructed from the RBM snapshots, treated explicitly and allowing a transport sweep, and then updated afterwards. A greedy algorithm can then proceed to adaptively select the representative samples in the angular space and form a surrogate solution space. The second novelty is a least-squares density reconstruction strategy, at each of the relevant physical locations, enabling the robust and accurate integration over an arbitrarily unstructured set of angular samples toward the macroscopic density. Numerical experiments indicate that our method is effective for computational cost reduction in a variety of regimes.


title: A Review on Semi-Supervised Relation Extraction

abstract: Relation extraction (RE) plays an important role in extracting knowledge from unstructured text but requires a large amount of labeled corpus. To reduce the expensive annotation efforts, semisupervised learning aims to leverage both labeled and unlabeled data. In this paper, we review and compare three typical methods in semi-supervised RE with deep learning or meta-learning: self-ensembling, which forces consistent under perturbations but may confront insufficient supervision; self-training, which iteratively generates pseudo labels and retrain itself with the enlarged labeled set; dual learning, which leverages a primal task and a dual task to give mutual feedback. Mean-teacher (Tarvainen and Valpola, 2017), LST (Li et al., 2019), and DualRE (Lin et al., 2019) are elaborated as the representatives to alleviate the weakness of these three methods, respectively.


title: A comparison of low-cost behavioral observation software applications and recommendations for use

abstract: In the field of animal behavior and behavioral ecology, many standardized methods to observe animal behavior were established in the last decades. While the protocols remained similar, behavioral researchers can take advantage of technological advancements to enter observations directly onto a handheld computer (phone, tablet, etc.), saving time and potentially increasing fidelity of recordings. However, we now have the choice between many different platforms for recording behavioral observations. Our challenge is choosing the most appropriate platform that fits a particular study question, research design, budget, and desired amount of preparatory time. Here, we review six low-cost software applications for handheld computers that are available for real-time entry of behavioral observations: Animal Behaviour Pro, Animal Observer, BORIS, CyberTracker, Prim8, and ZooMonitor. We discuss the preliminary decisions that have to be made about the study design, and we assess the six applications by providing the advantages and disadvantages of each platform and an overall application comparison. Our goal is to help researchers make calculated decisions about what behavioral observation platform is best for their study system and question.


title: Towards perturbative renormalization of $\phi^2(i\phi)^\varepsilon$ quantum field theory

abstract: In a previous paper it was shown how to calculate the ground-state energy density $E$ and the $p$-point Green's functions $G_p(x_1,x_2,...,x_p)$ for the $PT$-symmetric quantum field theory defined by the Hamiltonian density $H=\frac{1}{2}(\nabla\phi)^2+\frac{1}{2}\phi^2(i\phi)^\varepsilon$ in $D$-dimensional Euclidean spacetime, where $\phi$ is a pseudoscalar field. In this earlier paper $E$ and $G_p(x_1,x_2,...,x_p)$ were expressed as perturbation series in powers of $\varepsilon$ and were calculated to first order in $\varepsilon$. (The parameter $\varepsilon$ is a measure of the nonlinearity of the interaction rather than a coupling constant.) This paper extends these perturbative calculations to the Euclidean Lagrangian $L= \frac{1}{2}(\nabla\phi)^2+\frac{1}{2}\mu^2\phi^2+\frac{1}{2} g\mu_0^2\phi^2\big(i\mu_0^{1-D/2}\phi\big)^\varepsilon-iv\phi$, which now includes renormalization counterterms that are linear and quadratic in the field $\phi$. The parameter $g$ is a dimensionless coupling strength and $\mu_0$ is a scaling factor having dimensions of mass. Expressions are given for the one-, two, and three-point Green's functions, and the renormalized mass, to higher-order in powers of $\varepsilon$ in $D$ dimensions ($0\leq D\leq2$). Renormalization is performed perturbatively to second order in $\varepsilon$ and the structure of the Green's functions is analyzed in the limit $D\to 2$. A sum of the most divergent terms is performed to {\it all} orders in $\varepsilon$. Like the Cheng-Wu summation of leading logarithms in electrodynamics, it is found here that leading logarithmic divergences combine to become mildly algebraic in form. Future work that must be done to complete the perturbative renormalization procedure is discussed.


title: Efficient Randomized Subspace Embeddings for Distributed Optimization under a Communication Budget

abstract: We study first-order optimization algorithms under the constraint that the descent direction is quantized using a pre-specified budget of $R$-bits per dimension, where $R \in (0 ,\infty)$. We propose computationally efficient optimization algorithms with convergence rates matching the information-theoretic performance lower bounds for: (i) Smooth and Strongly-Convex objectives with access to an Exact Gradient oracle, as well as (ii) General Convex and Non-Smooth objectives with access to a Noisy Subgradient oracle. The crux of these algorithms is a polynomial complexity source coding scheme that embeds a vector into a random subspace before quantizing it. These embeddings are such that with high probability, their projection along any of the canonical directions of the transform space is small. As a consequence, quantizing these embeddings followed by an inverse transform to the original space yields a source coding method with optimal covering efficiency while utilizing just $R$-bits per dimension. Our algorithms guarantee optimality for arbitrary values of the bit-budget $R$, which includes both the sub-linear budget regime ($R < 1$), as well as the high-budget regime ($R \geq 1$), while requiring $O\left(n^2\right)$ multiplications, where $n$ is the dimension. We also propose an efficient relaxation of this coding scheme using Hadamard subspaces that requires a near-linear time, i.e., $O\left(n \log n\right)$ additions.Furthermore, we show that the utility of our proposed embeddings can be extended to significantly improve the performance of gradient sparsification schemes. Numerical simulations validate our theoretical claims. Our implementations are available at https://github.com/rajarshisaha95/DistOptConstrComm.


title: Revisiting ResNets: Improved Training and Scaling Strategies

abstract: Novel computer vision architectures monopolize the spotlight, but the impact of the model architecture is often conflated with simultaneous changes to training methodology and scaling strategies. Our work revisits the canonical ResNet (He et al., 2015) and studies these three aspects in an effort to disentangle them. Perhaps surprisingly, we find that training and scaling strategies may matter more than architectural changes, and further, that the resulting ResNets match recent state-of-the-art models. We show that the best performing scaling strategy depends on the training regime and offer two new scaling strategies: (1) scale model depth in regimes where overfitting can occur (width scaling is preferable otherwise); (2) increase image resolution more slowly than previously recommended (Tan & Le, 2019). Using improved training and scaling strategies, we design a family of ResNet architectures, ResNet-RS, which are 1.7x - 2.7x faster than EfficientNets on TPUs, while achieving similar accuracies on ImageNet. In a large-scale semi-supervised learning setup, ResNet-RS achieves 86.2% top-1 ImageNet accuracy, while being 4.7x faster than EfficientNet NoisyStudent. The training techniques improve transfer performance on a suite of downstream tasks (rivaling state-of-the-art self-supervised algorithms) and extend to video classification on Kinetics-400. We recommend practitioners use these simple revised ResNets as baselines for future research.


title: Optical observation of single spins in silicon

abstract: The global quantum internet will require long-lived, telecommunications band photon-matter interfaces manufactured at scale. Preliminary quantum networks based upon photon-matter interfaces which meet a subset of these demands are encouraging efforts to identify new high-performance alternatives. Silicon is an ideal host for commercial-scale solid-state quantum technologies. It is already an advanced platform within the global integrated photonics and microelectronics industries, as well as host to record-setting long-lived spin qubits. Despite the overwhelming potential of the silicon quantum platform, the optical detection of individually addressable photon-spin interfaces in silicon has remained elusive. In this work we produce tens of thousands of individually addressable `$T$ centre' photon-spin qubits in integrated silicon photonic structures, and characterize their spin-dependent telecommunications-band optical transitions. These results unlock immediate opportunities to construct silicon-integrated, telecommunications-band quantum information networks.


title: Bayesian equilibria of axisymmetric plasmas

abstract: We present a Bayesian method for inferring axisymmetric plasma equilibria from the magnetic field and plasma pressure measurements. The method calculates all possible solutions for plasma current and pressure distributions consistent with the measurements and magnetohydrodynamic (MHD) force balance. Toroidal plasma current and magnetic field coils are modelled as a set of axisymmetric current-carrying solid beams. The other parameters such as plasma pressure and poloidal current flux are given as a function of poloidal magnetic flux, which is determined given a 2D current distribution. Plasma pressure and poloidal current flux profiles are modelled as Gaussian processes whose smoothness is optimally chosen based on the principle of Occam's razor. To find equilibrium solutions, we introduce an MHD force balance constraint at every plasma current beam as a part of the prior knowledge. Given all these physical quantities, predictions calculated by the predictive (forward) models for diagnostics are compared to the observations. The high dimensional complex posterior probability distribution is explored by a new algorithm based on the Gibbs sampling scheme.


title: Bayesian modelling of multiple plasma diagnostics at Wendelstein 7-X

abstract: Consistent inference of the electron density and temperature has been carried out with multiple heterogeneous plasma diagnostic data sets at Wendelstein 7-X. The predictive models of the interferometer, Thomson scattering and helium beam emission spectroscopy systems have been developed in the Minerva framework and combined to a single joint model. The electron density and temperature profiles are modelled by Gaussian processes with their hyperparameters. The model parameters such as the calibration factor of the Thomson scattering system and the model predictive uncertainties are regarded as additional unknown parameters. The joint posterior probability distribution of the electron density and temperature profiles, hyperparameters of the Gaussian processes and model parameters is explored by Markov chain Monte Carlo algorithms. The posterior samples drawn from the joint posterior distribution are numerically marginalised over the hyperparameters and model parameters to obtain the marginal posterior distributions of the electron density and temperature profiles. The inference of these profiles is performed with different combinations of the interferometer and Thomson scattering data as well as either the empirical electron density and temperature constraints at the limiter/divertor positions introduced by \textit{virtual observations} or the edge density and temperature from the helium beam emission data. Furthermore, the addition of the X-ray imaging crystal spectrometers to the joint model for the ion temperature profiles is demonstrated. All these profiles presented in this work are inferred with the optimal hyperparameters and model parameters by exploring the full joint posterior distribution which intrinsically embodies Bayesian Occam's razor.


title: Network Environment Design for Autonomous Cyberdefense

abstract: Reinforcement learning (RL) has been demonstrated suitable to develop agents that play complex games with human-level performance. However, it is not understood how to effectively use RL to perform cybersecurity tasks. To develop such understanding, it is necessary to develop RL agents using simulation and emulation systems allowing researchers to model a broad class of realistic threats and network conditions. Demonstrating that a specific RL algorithm can be effective for defending a network under certain conditions may not necessarily give insight about the performance of the algorithm when the threats, network conditions, and security goals change. This paper introduces a novel approach for network environment design and a software framework to address the fundamental problem that network defense cannot be defined as a single game with a simple set of fixed rules. We show how our approach is necessary to facilitate the development of RL network defenders that are robust against attacks aimed at the agent's learning. Our framework enables the development and simulation of adversaries with sophisticated behavior that includes poisoning and evasion attacks on RL network defenders.


title: Free-form Design of Discrete Architectural Surfaces by use of Circle Packing

abstract: This paper presents an efficient approach for the conceptual design of architectural surfaces which are composed of triangular panels. In the free-form design of discrete architectural surfaces, the Gaussian curvature plays an important role not only aesthetically but also in terms of stiffness and constructability. However, designing a surface manually with specific Gaussian curvatures can be a time-consuming task. We propose a method to find a triangulated surface with user-specified Gaussian curvatures (not limited to constant Gaussian curvatures) and boundary vertex positions. In addition, the conformal class of the final design can be specified; that is, the user has control over the shape (the corner angles) of each triangular panel. The panels could be encouraged to form a regular tessellation or kept close to those of the initial design. The controllability of the conformal class suppresses possible distortion of the panels, resulting in higher structural performance and aesthetics. Our method relies on the idea in computational conformal geometry called circle packing. In this line of research, the discrete Ricci flow has been widely used for surface modelling. However, it is not trivial to incorporate constraints such as boundary locations and convexity of the spanned surface, which are essential to architectural applications. We propose a perturbation of the discrete Ricci energy and develop a least-squares-based optimisation scheme to address these problems with an open-source implementation available online.


title: Quantum circuit optimization with deep reinforcement learning

abstract: A central aspect for operating future quantum computers is quantum circuit optimization, i.e., the search for efficient realizations of quantum algorithms given the device capabilities. In recent years, powerful approaches have been developed which focus on optimizing the high-level circuit structure. However, these approaches do not consider and thus cannot optimize for the hardware details of the quantum architecture, which is especially important for near-term devices. To address this point, we present an approach to quantum circuit optimization based on reinforcement learning. We demonstrate how an agent, realized by a deep convolutional neural network, can autonomously learn generic strategies to optimize arbitrary circuits on a specific architecture, where the optimization target can be chosen freely by the user. We demonstrate the feasibility of this approach by training agents on 12-qubit random circuits, where we find on average a depth reduction by 27% and a gate count reduction by 15%. We examine the extrapolation to larger circuits than used for training, and envision how this approach can be utilized for near-term quantum devices.


title: Noise-resistant Landau-Zener sweeps from geometrical curves

abstract: Landau-Zener physics is often exploited to generate quantum logic gates and to perform state initialization and readout. The quality of these operations can be degraded by noise fluctuations in the energy gap at the avoided crossing. We leverage a recently discovered correspondence between qubit evolution and space curves in three dimensions to design noise-robust Landau-Zener sweeps through an avoided crossing. In the case where the avoided crossing is purely noise-induced, we prove that operations based on monotonic sweeps cannot be robust to noise. Hence, we design families of phase gates based on non-monotonic drives that are error-robust up to second order. In the general case where there is an avoided crossing even in the absence of noise, we present a general technique for designing robust driving protocols that takes advantage of a relationship between the Landau-Zener problem and space curves of constant torsion.


title: Slip-Based Autonomous ZUPT through Gaussian Process to Improve Planetary Rover Localization

abstract: The zero-velocity update (ZUPT) algorithm provides valuable state information to maintain the inertial navigation system (INS) reliability when stationary conditions are satisfied. Employing ZUPT along with leveraging non-holonomic constraints can greatly benefit wheeled mobile robot dead-reckoning localization accuracy. However, determining how often they should be employed requires consideration to balance localization accuracy and traversal rate for planetary rovers. To address this, we investigate when to autonomously initiate stops to improve wheel-inertial odometry (WIO) localization performance with ZUPT. To do this, we propose a 3D dead-reckoning approach that predicts wheel slippage while the rover is in motion and forecasts the appropriate time to stop without changing any rover hardware or major rover operations. We validate with field tests that our approach is viable on different terrain types and achieves a 3D localization accuracy of more than 97% over 650 m drives on rough terrain.


title: RLSS: Real-time Multi-Robot Trajectory Replanning using Linear Spatial Separations

abstract: Trajectory replanning is a critical problem for multi-robot teams navigating dynamic environments. We present RLSS (Replanning using Linear Spatial Separations): a real-time trajectory replanning algorithm for cooperative multi-robot teams that uses linear spatial separations to enforce safety. Our algorithm handles the dynamic limits of the robots explicitly, is completely distributed, and is robust to environment changes, robot failures, and trajectory tracking errors. It requires no communication between robots and relies instead on local relative measurements only. We demonstrate that the algorithm works in real-time both in simulations and in experiments using physical robots. We compare our algorithm to a state-of-the-art online trajectory generation algorithm based on model predictive control, and show that our algorithm results in significantly fewer collisions in highly constrained environments, and effectively avoids deadlocks.


title: Application of HL7 FHIR in a Microservice Architecture for Patient Navigation on Registration and Appointments

abstract: Electronic Health Record Systems (EHR-S) are commonly developed in monolithic architectures. This architectural style presents greater complexity and demands more effort when we think of interoperability. A solution proposal is the creation of Microservices that use HL7 FHIR as an interoperability strategy. In this sense, it is presented the development of a prototype, based on a microservices architecture, to act in a real scenario of Patient Navigation (PN). The problem was subdivided into 3 steps: definition of architecture, development and construction of an interface to simulate the role of the navigator. The Patient and Appointment microservices are capable of synchronous communication to query and record information. In general, the implemented architectural style not only isolates information domains but can receive data from multiple sources while maintaining essential functionality. This type of approach plays a crucial role in a hospital environment, specifically in PN, highlighting the importance of the standard and expanding the possibilities for further research to be conducted.


title: Quantum memories and the double-slit experiment: implications for astronomical interferometry

abstract: Thomas Young's slit experiment lies at the heart of classical interference and quantum mechanics. Over the last fifty years, it has been shown that particles (e.g. photons, electrons, large molecules), even individual particles, generate an interference pattern at a distant screen after passage through a double slit, thereby demonstrating wave-particle duality. We revisit this famous experiment by replacing both slits with single-mode fibre inputs to two independent quantum memories that are capable of storing the incident electromagnetic field's amplitude and phase as a function of time. At a later time, the action is reversed: the quantum memories are read out in synchrony and the single-mode fibre outputs are allowed to interact consistent with the original observation. In contrast to any classical memory device, the write and read processes of a quantum memory are non-destructive and hence, preserve the photonic quantum states. In principle, with sufficiently long storage times and sufficiently high photonic storage capacity, quantum memories operating at widely separated telescopes can be brought together to achieve optical interferometry over arbitrarily long baselines.


title: The entropy of quantum causal networks

abstract: Quantum networks play a key role in many scenarios of quantum information theory. Here we consider the quantum causal networks in the manner of entropy. First we present a revised smooth max-relative entropy of quantum combs, then we present a lower and upper bound of a type II error of the hypothesis testing. Next we present a lower bound of the smooth max-relative entropy for the quantum combs with asymptotic equipartition. At last, we consider the score to quantify the performance of an operator. We present a quantity equaling to the smooth asymptotic version of the performance of a quantum positive operator.


title: Flux-mediated Dark Matter

abstract: We propose a new mechanism to communicate between fermion dark matter and the Standard Model (SM) only through the four-form flux. The four-form couplings are responsible for the relaxation of the Higgs mass to the correct value and the initial displacement of the reheating pseudo-scalar field from the minimum. We show that the simultaneous presence of the pseudo-scalar coupling to fermion dark matter and the flux-induced Higgs mixing gives rise to unsuppressed annihilations of dark matter into the SM particles at present, whereas the direct detection bounds from XENON1T can be avoided. We suggest exploring the interesting bulk parameter space of the model for which dark matter annihilates dominantly into a pair of singlet-like scalars with similar mass as for dark matter.


title: Constraints on Einstein-Maxwell dilaton-axion gravity from X-ray reflection spectroscopy

abstract: Einstein-Maxwell dilaton-axion gravity is a string-inspired model arising from the low energy effective action of heterotic string theory and an important candidate as alternative to General Relativity. Recently, some authors have explored its astrophysical implications in the spectra of accreting black holes and inferred the constraint $r_2 < 0.1$, where $r_2 \ge 0$ is the black hole dilaton charge and General Relativity is recovered for $r_2 = 0$. In the present paper, we study the impact of a non-vanishing black hole dilaton charge on the reflection spectrum of the disk. From the analysis of a NuSTAR spectrum of the black hole binary EXO 1846-031, we find the constraint $r_2 < 0.011$ (90% CL), which is an order of magnitude more stringent.


title: Measurement of Neutrino's Magnetic Monopole Charge, Dark Energy and Cause of Quantum Mechanical Uncertainty

abstract: Charge conservation in the theory of elementary particle physics is one of the best-established principles in physics. As such, if there are magnetic monopoles in the universe, magnetic charge will most likely be a conserved quantity like electric charges. If neutrinos are magnetic monopoles, as physicists have reported the possibility, the Earth should show signs of having magnetic monopole charge on a macroscopic scale since neutrons must also have magnetic monopole charge if general charge conservation principle is valid. To test this hypothesis, experiments were performed to detect the collective effect of magnetic monopole charge of neutrons on the earth's equator using two balanced high strength neodymium rod magnets. We were able to identify non-zero magnetic monopole charge of the individual neutrons from the experiments. The presence of individual magnetic monopole charges in the universe prompted proposition of the new symmetric form of Maxwell's equations. Based on the theoretical investigation of these new Maxwell's equations, we concluded that magnetic monopole neutrinos are the cause of the origin of quantum mechanical uncertainty, dark energy and the medium for electromagnetic wave propagation in space.


title: Learning Defense Transformers for Counterattacking Adversarial Examples

abstract: Deep neural networks (DNNs) are vulnerable to adversarial examples with small perturbations. Adversarial defense thus has been an important means which improves the robustness of DNNs by defending against adversarial examples. Existing defense methods focus on some specific types of adversarial examples and may fail to defend well in real-world applications. In practice, we may face many types of attacks where the exact type of adversarial examples in real-world applications can be even unknown. In this paper, motivated by that adversarial examples are more likely to appear near the classification boundary, we study adversarial examples from a new perspective that whether we can defend against adversarial examples by pulling them back to the original clean distribution. We theoretically and empirically verify the existence of defense affine transformations that restore adversarial examples. Relying on this, we learn a defense transformer to counterattack the adversarial examples by parameterizing the affine transformations and exploiting the boundary information of DNNs. Extensive experiments on both toy and real-world datasets demonstrate the effectiveness and generalization of our defense transformer.


title: Metal-Insulator Transition and Emergent Gapped Phase in the Surface-Doped 2D Semiconductor 2H-MoTe$_2$

abstract: Artificially created two-dimensional (2D) interfaces or structures are ideal for seeking exotic phase transitions due to their highly tunable carrier density and interfacially enhanced many-body interactions. Here, we report the discovery of a metal-insulator transition (MIT) and an emergent gapped phase in the metal-semiconductor interface that is created in 2H-MoTe$_2$ via alkali-metal deposition. Using angle-resolved photoemission spectroscopy, we found that the electron-phonon coupling is strong at the interface as characterized by a clear observation of replica shake-off bands. Such strong electron-phonon coupling interplays with disorder scattering, leading to an Anderson localization of polarons which could explain the MIT. The domelike emergent gapped phase could then be attributed to a polaron extended state or phonon-mediated superconductivity. Our results demonstrate the capability of alkali-metal deposition as an effective method to enhance the many-body interactions in 2D semiconductors. The surface-doped 2H-MoTe$_2$ is a promising candidate for realizing polaronic insulator and high-$T_c$ superconductivity.


title: DeepGroup: Representation Learning for Group Recommendation with Implicit Feedback

abstract: Group recommender systems facilitate group decision making for a set of individuals (e.g., a group of friends, a team, a corporation, etc.). Many of these systems, however, either assume that (i) user preferences can be elicited (or inferred) and then aggregated into group preferences or (ii) group preferences are partially observed/elicited. We focus on making recommendations for a new group of users whose preferences are unknown, but we are given the decisions/choices of other groups. By formulating this problem as group recommendation from group implicit feedback, we focus on two of its practical instances: group decision prediction and reverse social choice. Given a set of groups and their observed decisions, group decision prediction intends to predict the decision of a new group of users, whereas reverse social choice aims to infer the preferences of those users involved in observed group decisions. These two problems are of interest to not only group recommendation, but also to personal privacy when the users intend to conceal their personal preferences but have participated in group decisions. To tackle these two problems, we propose and study DeepGroup -- a deep learning approach for group recommendation with group implicit data. We empirically assess the predictive power of DeepGroup on various real-world datasets, group conditions (e.g., homophily or heterophily), and group decision (or voting) rules. Our extensive experiments not only demonstrate the efficacy of DeepGroup, but also shed light on the privacy-leakage concerns of some decision making processes.


title: Internal Wasserstein Distance for Adversarial Attack and Defense

abstract: Deep neural networks (DNNs) are known to be vulnerable to adversarial attacks that would trigger misclassification of DNNs but may be imperceptible to human perception. Adversarial defense has been an important way to improve the robustness of DNNs. Existing attack methods often construct adversarial examples relying on some metrics like the $\ell_p$ distance to perturb samples. However, these metrics can be insufficient to conduct adversarial attacks due to their limited perturbations. In this paper, we propose a new internal Wasserstein distance (IWD) to capture the semantic similarity of two samples, and thus it helps to obtain larger perturbations than currently used metrics such as the $\ell_p$ distance. We then apply the internal Wasserstein distance to perform adversarial attack and defense. In particular, we develop a novel attack method relying on IWD to calculate the similarities between an image and its adversarial examples. In this way, we can generate diverse and semantically similar adversarial examples that are more difficult to defend by existing defense methods. Moreover, we devise a new defense method relying on IWD to learn robust models against unseen adversarial examples. We provide both thorough theoretical and empirical evidence to support our methods.


title: Discovery of Double-Ring Structure in the Supernova Remnant N103B: Evidence for Bipolar Winds from a Type Ia Supernova Progenitor

abstract: The geometric structure of supernova remnants (SNR) provides a clue to unveiling the pre-explosion evolution of their progenitors. Here we present an X-ray study of N103B (0509-68.7), a Type Ia SNR in the Large Magellanic Cloud, that is known to be interacting with dense circumstellar matter (CSM). Applying our novel method for feature extraction to deep Chandra observations, we have successfully resolved the CSM, Fe-rich ejecta, and intermediate-mass element (IME) ejecta components, and revealed each of their spatial distribution. Remarkably, the IME ejecta component exhibits a double-ring structure, implying that the SNR expands into an hourglass-shape cavity and thus forms bipolar bubbles of the ejecta. This interpretation is supported by more quantitative spectroscopy that reveals a clear bimodality in the distribution of the ionization state of the IME ejecta. These observational results can be naturally explained if the progenitor binary system had formed a dense CSM torus on the orbital plane prior to the explosion, providing further evidence that the SNR N103B originates from a single-degenerate progenitor.


title: Student-Teacher Learning from Clean Inputs to Noisy Inputs

abstract: Feature-based student-teacher learning, a training method that encourages the student's hidden features to mimic those of the teacher network, is empirically successful in transferring the knowledge from a pre-trained teacher network to the student network. Furthermore, recent empirical results demonstrate that, the teacher's features can boost the student network's generalization even when the student's input sample is corrupted by noise. However, there is a lack of theoretical insights into why and when this method of transferring knowledge can be successful between such heterogeneous tasks. We analyze this method theoretically using deep linear networks, and experimentally using nonlinear networks. We identify three vital factors to the success of the method: (1) whether the student is trained to zero training loss; (2) how knowledgeable the teacher is on the clean-input problem; (3) how the teacher decomposes its knowledge in its hidden features. Lack of proper control in any of the three factors leads to failure of the student-teacher learning method.


title: Approximating How Single Head Attention Learns

abstract: Why do models often attend to salient words, and how does this evolve throughout training? We approximate model training as a two stage process: early on in training when the attention weights are uniform, the model learns to translate individual input word `i` to `o` if they co-occur frequently. Later, the model learns to attend to `i` while the correct output is $o$ because it knows `i` translates to `o`. To formalize, we define a model property, Knowledge to Translate Individual Words (KTIW) (e.g. knowing that `i` translates to `o`), and claim that it drives the learning of the attention. This claim is supported by the fact that before the attention mechanism is learned, KTIW can be learned from word co-occurrence statistics, but not the other way around. Particularly, we can construct a training distribution that makes KTIW hard to learn, the learning of the attention fails, and the model cannot even learn the simple task of copying the input words to the output. Our approximation explains why models sometimes attend to salient words, and inspires a toy example where a multi-head attention model can overcome the above hard training distribution by improving learning dynamics rather than expressiveness. We end by discussing the limitation of our approximation framework and suggest future directions.


title: New Measurement of the Vertical Atmospheric Density Profile from Occultations of the Crab Nebula with X-Ray Astronomy Satellites Suzaku and Hitomi

abstract: We present new measurements of the vertical density profile of the Earth's atmosphere at altitudes between 70 and 200 km, based on Earth occultations of the Crab Nebula observed with the X-ray Imaging Spectrometer onboard Suzaku and the Hard X-ray Imager onboard Hitomi. X-ray spectral variation due to the atmospheric absorption is used to derive tangential column densities of the absorbing species, i.e., N and O including atoms and molecules, along the line of sight. The tangential column densities are then inverted to obtain the atmospheric number density. The data from 219 occultation scans at low latitudes in both hemispheres from September 15, 2005 to March 26, 2016 are analyzed to generate a single, highly-averaged (in both space and time) vertical density profile. The density profile is in good agreement with the NRLMSISE-00 model, except for the altitude range of 70-110 km, where the measured density is about 50% smaller than the model. Such a deviation is consistent with the recent measurement with the SABER aboard the TIMED satellite (Cheng et al. 2020). Given that the NRLMSISE-00 model was constructed some time ago, the density decline could be due to the radiative cooling/contracting of the upper atmosphere as a result of greenhouse warming in the troposphere. However, we cannot rule out a possibility that the NRL model is simply imperfect in this region. We also present future prospects for the upcoming Japan-US X-ray astronomy satellite, XRISM, which will allow us to measure atmospheric composition with unprecedented spectral resolution of dE ~ 5 eV in 0.3-12 keV.


title: Multi-Resolution Electron Spectrometer Array for Future Free-Electron Laser Experiments

abstract: We report the design of an angular array of electron Time-of-Flight (eToF) spectrometers intended for non-invasive spectral, temporal, and polarization characterization of single shots of high-repetition rate, quasi-continuous, short-wavelength Free-Electron Lasers (FELs) such as the LCLS-II at SLAC. This array also enables angle-resolved, high-resolution eToF spectroscopy to address a variety of scientific questions of ultrafast and nonlinear light--matter interaction at FELs. The presented device is specifically designed for the Time-resolved atomic, Molecular and Optical science end station (TMO) at LCLS-II. In its final version, it can comprise of up to 20 eToF spectrometers aligned to collect electrons from the interaction point defined by the intersection of the incoming FEL radiation and a gaseous target. There are 16 such spectrometers forming a circular equiangular array in the plane normal to x-ray propagation and 4 spectrometers at 54.7$^\circ$ angle relative to the principle linear x-ray polarization axis. The spectrometers are capable of independent and minimally chromatic electrostatic lensing and retardation in order to enable simultaneous angle-resolved photo-electron and Auger electron spectroscopy with high energy resolution. They are designed to ensure energy resolution of 0.25 eV across an energy window of up to 75 eV which can be individually centered via the adjustable retardation to cover ranges of electron kinetic energies relevant to soft x-ray methods, 0--2 keV. The full spectrometer array will enable non-invasive and online spectral-polarimetry measurements, polarization-sensitive attoclock spectroscopy for characterizing the full time--energy structure of even SASE or seeded LCLS-II pulses, and also supports emerging trends in molecular frame spectroscopy measurements.


title: Radiation Data Portal: Integration of Radiation Measurements at the Aviation Altitudes and Solar-Terrestrial Environment Observations

abstract: The impact of radiation dramatically increases at high altitudes in the Earth's atmosphere and in space. Therefore, monitoring and access to radiation environment measurements are critical for estimating the radiation exposure risks of aircraft and spacecraft crews and the impact of space weather disturbances on electronics. Addressing these needs requires convenient access to multi-source radiation environment data and enhancement of visualization and search capabilities. The Radiation Data Portal represents an interactive web-based application for search and visualization of in-flight radiation measurements. The Portal enhances the exploration capabilities of various properties of the radiation environment and provides measurements of dose rates along with information on space weather-related conditions. The Radiation Data Portal back-end is a MySQL relational database that contains the radiation measurements obtained from the Automated Radiation Measurements for Aerospace Safety (ARMAS) device and the soft X-ray and proton flux measurements from the Geostationary Operational Environmental Satellite (GOES). The implemented Application Programming Interface (API) and Python routines allow a user to retrieve the database records without interaction with the web interface. As a use case of the Radiation Data Portal, we examine ARMAS measurements during an enhancement of the Solar Proton (SP) fluxes, known as Solar Proton Events (SPEs), and compare them to measurements during SP-quiet periods.

categories: physics.space-ph astro-ph.EP astro-ph.IM astro-ph.SR


title: Interplay of anionic quasi-atom and interstitial point defects in electrides: abnormal interstice occupation and colossal charge state of point defects in dense FCC-lithium

abstract: Electrides are an emerging class of materials with highly-localized electrons in the interstices of a crystal that behave as anions. The presence of these unusual interstitial quasi-atom (ISQ) electrons leads to interesting physical and chemical properties, and wide potential applications for this new class of materials. Crystal defects often have a crucial influence on the properties of materials. Introducing impurities has been proved to be an effective approach to improve the properties of a material and to expand its applications. However, the interactions between the anionic ISQs and the crystal defects in electrides are as yet unknown. Here, dense FCC-Li was employed as an archetype to explore the interplay between anionic ISQs and interstitial impurity atoms in this electride. This work reveals a strong coupling among the interstitial impurity atoms, the ISQs, and the matrix Li atoms near to the defects. This complex interplay and interaction mainly manifest as the unexpected tetrahedral interstitial occupation of impurity atoms and the enhancement of electron localization in the interstices. Moreover, the Be impurity occupying the octahedral interstice shows the highest negative charge state (Be8-) discovered thus far. These results demonstrate the rich chemistry and physics of this emerging material, and provide a new basis for enriching their variants for a wide range of applications.


title: Designing Phononic Band Gaps with Sticky Potentials

abstract: Spectral gaps in the vibrational modes of disordered solids are key design elements in the synthesis and control of phononic metamaterials that exhibit a plethora of novel elastic and mechanical properties. However, reliably producing these gaps often require a high degree of network specificity through complex control optimization procedures. In this work, we present as an additional tool to the existing repertoire, a numerical scheme that rapidly generates sizeable spectral gaps in absence of any fine tuning of the network structure or elastic parameters. These gaps occur even in disordered polydisperse systems consisting of relatively few particles ($N \sim 10^2-10^3$). Our proposed procedure exploits sticky potentials that have recently been shown to suppress the formation of soft modes, thus effectively recovering the linear elastic regime where band structures appear, at much shorter length scales than in conventional models of disordered solids. Our approach is relevant to design and realization of gapped spectra in a variety of physical setups ranging from colloidal suspensions to 3D-printed elastic networks.


title: Solving Compositional Reinforcement Learning Problems via Task Reduction

abstract: We propose a novel learning paradigm, Self-Imitation via Reduction (SIR), for solving compositional reinforcement learning problems. SIR is based on two core ideas: task reduction and self-imitation. Task reduction tackles a hard-to-solve task by actively reducing it to an easier task whose solution is known by the RL agent. Once the original hard task is successfully solved by task reduction, the agent naturally obtains a self-generated solution trajectory to imitate. By continuously collecting and imitating such demonstrations, the agent is able to progressively expand the solved subspace in the entire task space. Experiment results show that SIR can significantly accelerate and improve learning on a variety of challenging sparse-reward continuous-control problems with compositional structures. Code and videos are available at https://sites.google.com/view/sir-compositional.


title: Renyi Entropy of Multivariate Autoregressive Moving Average Control Systems

abstract: The Renyi entropy is an important measure of the information, it is proposed by Renyi in the context of entropy theory as a generalization of Shannon entropy. We study in detail this measure of multivariate autoregressive moving average (ARMA) control systems. The characteristic function of output process is represented from the terms of its residual characteristic functions. Simple expression to compute the Renyi entropy for the output process of these systems is derived. In addition, we investigate the covariance matrix for finding the upper bound of the entropy. Finally, we present three separate examples that serve to illustrate the behavior of information in a multivariate ARMA control system where the control and noise distributed as Gaussian, Cauchy and Laplace processes.


title: Untrained networks for compressive lensless photography

abstract: Compressive lensless imagers enable novel applications in an extremely compact device, requiring only a phase or amplitude mask placed close to the sensor. They have been demonstrated for 2D and 3D microscopy, single-shot video, and single-shot hyperspectral imaging; in each of these cases, a compressive-sensing-based inverse problem is solved in order to recover a 3D data-cube from a 2D measurement. Typically, this is accomplished using convex optimization and hand-picked priors. Alternatively, deep learning-based reconstruction methods offer the promise of better priors, but require many thousands of ground truth training pairs, which can be difficult or impossible to acquire. In this work, we propose the use of untrained networks for compressive image recovery. Our approach does not require any labeled training data, but instead uses the measurement itself to update the network weights. We demonstrate our untrained approach on lensless compressive 2D imaging as well as single-shot high-speed video recovery using the camera's rolling shutter, and single-shot hyperspectral imaging. We provide simulation and experimental verification, showing that our method results in improved image quality over existing methods.


title: A combinatorial description of the LOSS Legendrian knot invariant

abstract: In this note, we observe that the hat version of the Heegaard Floer invariant of Legendrian knots in contact three-manifolds defined by Lisca-Ozsvath-Stipsicz-Szabo can be combinatorially computed. We rely on Plamenevskaya's combinatorial description of the Heegaard Floer contact invariant.


title: Spontaneous Lorentz violation and asymptotic flatness

abstract: The Standard Model Extension (SME) is a generic parametrization for Lorentz violation and the phenomenological consequences of the minimal gravity sector of the SME are usually studied using a post-Newtonian expansion that requires spacetime to be asymptotically flat. However, there is a term in this sector for which these approximations are unable to make predictions; this is known as the $t$ puzzle. The present paper studies a model of spontaneous Lorentz violation in the minimal gravity sector of the SME in a static and spherically symmetric situation, when no additional matter fields are present. It is shown that, under the above mentioned assumptions, $t$ is the only term in the minimal gravity sector for which no asymptotically flat solutions exist. This stems from the fact that the $t$ term fixes the asymptotic behavior of all the pieces of the curvature tensor.