title: Deep Learning compatible Differentiable X-ray Projections for Inverse Rendering

abstract: Many minimally invasive interventional procedures still rely on 2D fluoroscopic imaging. Generating a patient-specific 3D model from these X-ray projection data would allow to improve the procedural workflow, e.g. by providing assistance functions such as automatic positioning. To accomplish this, two things are required. First, a statistical human shape model of the human anatomy and second, a differentiable X-ray renderer. In this work, we propose a differentiable renderer by deriving the distance travelled by a ray inside mesh structures to generate a distance map. To demonstrate its functioning, we use it for simulating X-ray images from human shape models. Then we show its application by solving the inverse problem, namely reconstructing 3D models from real 2D fluoroscopy images of the pelvis, which is an ideal anatomical structure for patient registration. This is accomplished by an iterative optimization strategy using gradient descent. With the majority of the pelvis being in the fluoroscopic field of view, we achieve a mean Hausdorff distance of 30 mm between the reconstructed model and the ground truth segmentation.


title: Progressive Neural Image Compression with Nested Quantization and Latent Ordering

abstract: We present PLONQ, a progressive neural image compression scheme which pushes the boundary of variable bitrate compression by allowing quality scalable coding with a single bitstream. In contrast to existing learned variable bitrate solutions which produce separate bitstreams for each quality, it enables easier rate-control and requires less storage. Leveraging the latent scaling based variable bitrate solution, we introduce nested quantization, a method that defines multiple quantization levels with nested quantization grids, and progressively refines all latents from the coarsest to the finest quantization level. To achieve finer progressiveness in between any two quantization levels, latent elements are incrementally refined with an importance ordering defined in the rate-distortion sense. To the best of our knowledge, PLONQ is the first learning-based progressive image coding scheme and it outperforms SPIHT, a well-known wavelet-based progressive image codec.


title: MPC-Based Hierarchical Control of a Multi-Zone Commercial HVAC System

abstract: This paper presents a novel architecture for model predictive control (MPC) based indoor climate control of multi-zone buildings to provide energy efficiency. Unlike prior works we do not assume the availability of a high-resolution multi-zone building model, which is challenging to obtain. Instead, the architecture uses a low-resolution model of the building which is divided into a small number of "meta-zones" that can be easily identified using existing data-driven modeling techniques. The proposed architecture is hierarchical. At the higher level, an MPC controller uses the low-resolution model to make decisions for the air handling unit (AHU) and the meta-zones. Since the meta-zones are fictitious, a lower level controller converts the high-level MPC decisions into commands for the individual zones by solving a projection problem that strikes a trade-off between two potentially conflicting goals: the AHU-level decisions made by the MPC are respected while the climate of the individual zones is maintained within the comfort bounds. The performance of the proposed controller is assessed via simulations in a high-fidelity simulation testbed and compared to that of a rule-based controller that is used in practice. Simulations in multiple weather conditions show the effectiveness of the proposed controller in terms of energy savings, climate control, and computational tractability.


title: How to Train Your Robot with Deep Reinforcement Learning; Lessons We've Learned

abstract: Deep reinforcement learning (RL) has emerged as a promising approach for autonomously acquiring complex behaviors from low level sensor observations. Although a large portion of deep RL research has focused on applications in video games and simulated control, which does not connect with the constraints of learning in real environments, deep RL has also demonstrated promise in enabling physical robots to learn complex skills in the real world. At the same time,real world robotics provides an appealing domain for evaluating such algorithms, as it connects directly to how humans learn; as an embodied agent in the real world. Learning to perceive and move in the real world presents numerous challenges, some of which are easier to address than others, and some of which are often not considered in RL research that focuses only on simulated domains. In this review article, we present a number of case studies involving robotic deep RL. Building off of these case studies, we discuss commonly perceived challenges in deep RL and how they have been addressed in these works. We also provide an overview of other outstanding challenges, many of which are unique to the real-world robotics setting and are not often the focus of mainstream RL research. Our goal is to provide a resource both for roboticists and machine learning researchers who are interested in furthering the progress of deep RL in the real world.


title: Complexity reduction in the 3D Kuramoto model

abstract: The dynamics of large systems of coupled oscillators is a subject of increasing importance with prominent applications in several areas such as physics and biology. The Kuramoto model, where a set of oscillators move around a circle representing their phases, is a paradigm in this field, exhibiting a continuous transition between disordered and synchronous motion. Reinterpreting the oscillators as rotating unit vectors, the model was extended to allow vectors to move on the surface of D-dimensional spheres, with $D=2$ corresponding to the original model. It was shown that the transition to synchronous dynamics was discontinuous for odd D, raising a lot of interest. Inspired by results in 2D, Ott et al proposed an ansatz for density function describing the oscillators and derived equations for the ansatz parameters, effectively reducing the dimensionality of the system. Here we take a different approach for the 3D system and construct an ansatz based on spherical harmonics decomposition of the distribution function. Our result differs significantly from that proposed in Ott's work and leads to similar but simpler equations determining the dynamics of the order parameter. We derive the phase diagram of equilibrium solutions for several distributions of natural frequencies and find excellent agreement with simulations. We also compare the dynamics of the order parameter with numerical simulations and with the previously derived equations, finding good agreement in all cases. We believe our approach can be generalized to higher dimensions and help to achieve complexity reduction in other systems of equations.


title: Chord Embeddings: Analyzing What They Capture and Their Role for Next Chord Prediction and Artist Attribute Prediction

abstract: Natural language processing methods have been applied in a variety of music studies, drawing the connection between music and language. In this paper, we expand those approaches by investigating \textit{chord embeddings}, which we apply in two case studies to address two key questions: (1) what musical information do chord embeddings capture?; and (2) how might musical applications benefit from them? In our analysis, we show that they capture similarities between chords that adhere to important relationships described in music theory. In the first case study, we demonstrate that using chord embeddings in a next chord prediction task yields predictions that more closely match those by experienced musicians. In the second case study, we show the potential benefits of using the representations in tasks related to musical stylometrics.


title: All Subgraphs of a Wheel are 5-Coupled-Choosable

abstract: A wheel graph consists of a cycle along with a center vertex connected to every vertex in the cycle. In this paper we show that every subgraph of a wheel graph has list coupled chromatic number at most 5, and this coloring can be found in linear time. We further show that `5' is tight for every wheel graph with at least 5 vertices, and briefly discuss possible generalizations to planar graphs of treewidth 3.


title: Optimizing Consensus-based Multi-target Tracking with Multiagent Rollout Control Policies

abstract: This paper considers a multiagent, connected, robotic fleet where the primary functionality of the agents is sensing. A distributed multi-sensor control strategy maximizes the value of the collective sensing capability of the fleet, using an information-driven approach. Each agent individually performs sensor processing (Kalman Filtering and Joint Probabilistic Data Association) to identify trajectories (and associated distributions). Using communications with its neighbors the agents enhance the prediction of the trajectories using a Consensus of Information approach that iteratively calculates the Kullback-Leibler average of trajectory distributions, enabling the calculation of the value of the collective information for the fleet. The dynamics of the agents, the evolution of the identified trajectories for each agent, and the dynamics of individual observed objects are captured as a Partially Observable Markov Decision Process (POMDP). Using this POMDP and applying rollout with receding horizon control, an optimized non-myopic control policy that maximizes the collective fleet information value is synthesized. Simulations are performed for a scenario with three heterogeneous UAVs performing coordinated target tracking that illustrate the proposed methodology and compare the centralized approach with a contemporary sequential multiagent distributed decision technique.


title: Twenty Vertex model and domino tilings of the Aztec triangle

abstract: We show that the number of configurations of the 20 Vertex model on certain domains with domain wall type boundary conditions is equal to the number of domino tilings of Aztec-like triangles, proving a conjecture from [P. Di Francesco and E. Guitter, Twenty-Vertex Model with Domain Wall Boundaries and Domino Tilings, Elec. Jour. of Combinatorics 27 (2020), no. 2, P2.13]. The result is based on the integrability of the 20 Vertex model and uses a connection to the U-turn boundary 6 Vertex model to re-express the number of 20 Vertex configurations as a simple determinant, which is then related to a Lindstr\"om-Gessel-Viennot determinant for the domino tiling problem. The common number of configurations is conjectured to be $2^{n(n-1)/2}\prod_{j=0}^{n-1}\frac{(4j+2)!}{(n+2j+1)!}=1, 4, 60, 3328, 678912...$ The enumeration result is extended to include refinements of both numbers.

categories: math.CO cond-mat.stat-mech math-ph math.MP


title: Accelerated gradient methods with absolute and relative noise in the gradient

abstract: In this paper, we investigate accelerated first-order methods for smooth convex optimization problems under inexact information on the gradient of the objective. The noise in the gradient is considered to be additive with two possibilities: absolute noise bounded by a constant, and relative noise proportional to the norm of the gradient. We investigate the accumulation of the errors in the convex and strongly convex settings with the main difference with most of the previous works being that the feasible set can be unbounded. The key to the latter is to prove a bound on the trajectory of the algorithm. We also give a stopping criterion for the algorithm and consider extensions to the cases of stochastic optimization and composite nonsmooth problems.


title: Towards a Flexible System Architecture for Automated Knowledge Base Construction Frameworks

abstract: Although knowledge bases play an important role in many domains (including in archives, where they are sometimes used for entity extraction and semantic annotation tasks), it is challenging to build knowledge bases by hand. This is owing to a number of factors: Knowledge bases must be accurate, up-to-date, comprehensive, and as flexible and as efficient as possible. These requirements mean a large undertaking, in the form of extensive work by subject matter experts (such as scientists, programmers, archivists, and other information professionals). Even when successfully engineered, manually built knowledge bases are typically one-off, use-case-specific, non-standardized, hard-to-maintain solutions. We present a scalable, flexible, and extensible architecture for knowledge base construction frameworks. As a work in progress, we extend a specific framework to address some of its design limitations. The contributions presented in this short paper can shed a light on the suitability of using AKBC frameworks for computational use cases in this domain and provide future directions for building improved AKBC frameworks.


title: PredCoin: Defense against Query-based Hard-label Attack

abstract: Many adversarial attacks and defenses have recently been proposed for Deep Neural Networks (DNNs). While most of them are in the white-box setting, which is impractical, a new class of query-based hard-label (QBHL) black-box attacks pose a significant threat to real-world applications (e.g., Google Cloud, Tencent API). Till now, there has been no generalizable and practical approach proposed to defend against such attacks. This paper proposes and evaluates PredCoin, a practical and generalizable method for providing robustness against QBHL attacks. PredCoin poisons the gradient estimation step, an essential component of most QBHL attacks. PredCoin successfully identifies gradient estimation queries crafted by an attacker and introduces uncertainty to the output. Extensive experiments show that PredCoin successfully defends against four state-of-the-art QBHL attacks across various settings and tasks while preserving the target model's overall accuracy. PredCoin is also shown to be robust and effective against several defense-aware attacks, which may have full knowledge regarding the internal mechanisms of PredCoin.


title: Another estimation of Laplacian spectrum of the Kronecker product of graphs

abstract: The relationships between eigenvalues and eigenvectors of a product graph and those of its factor graphs have been known for the standard products, while characterization of Laplacian eigenvalues and eigenvectors of the Kronecker product of graphs using the Laplacian spectra and eigenvectors of the factors turned out to be quite challenging and has remained an open problem to date. Several approaches for the estimation of Laplacian spectrum of the Kronecker product of graphs have been proposed in recent years. However, it turns out that not all the methods are practical to apply in network science models, particularly in the context of multilayer networks. Here we develop a practical and computationally efficient method to estimate Laplacian spectra of this graph product from spectral properties of their factor graphs which is more stable than the alternatives proposed in the literature. We emphasize that a median of the percentage errors of our estimated Laplacian spectrum almost coincides with the $x$-axis, unlike the alternatives which have sudden jumps at the beginning followed by a gradual decrease for the percentage errors. The percentage errors confined (confidence of the estimations) up to $\pm$10% for all considered approximations, depending on a graph density. Moreover, we theoretically prove that the percentage errors becomes smaller when the network grows or the edge density level increases. Additionally, some novel theoretical results considering the exact formulas and lower bounds related to the certain correlation coefficients corresponding to the estimated eigenvectors are presented.


title: Generalized Zero-shot Intent Detection via Commonsense Knowledge

abstract: Identifying user intents from natural language utterances is a crucial step in conversational systems that has been extensively studied as a supervised classification problem. However, in practice, new intents emerge after deploying an intent detection model. Thus, these models should seamlessly adapt and classify utterances with both seen and unseen intents -- unseen intents emerge after deployment and they do not have training data. The few existing models that target this setting rely heavily on the scarcely available training data and overfit to seen intents data, resulting in a bias to misclassify utterances with unseen intents into seen ones. We propose RIDE: an intent detection model that leverages commonsense knowledge in an unsupervised fashion to overcome the issue of training data scarcity. RIDE computes robust and generalizable relationship meta-features that capture deep semantic relationships between utterances and intent labels; these features are computed by considering how the concepts in an utterance are linked to those in an intent label via commonsense knowledge. Our extensive experimental analysis on three widely-used intent detection benchmarks shows that relationship meta-features significantly increase the accuracy of detecting both seen and unseen intents and that RIDE outperforms the state-of-the-art model for unseen intents.


title: Alchemy: A benchmark and analysis toolkit for meta-reinforcement learning agents

abstract: There has been rapidly growing interest in meta-learning as a method for increasing the flexibility and sample efficiency of reinforcement learning. One problem in this area of research, however, has been a scarcity of adequate benchmark tasks. In general, the structure underlying past benchmarks has either been too simple to be inherently interesting, or too ill-defined to support principled analysis. In the present work, we introduce a new benchmark for meta-RL research, emphasizing transparency and potential for in-depth analysis as well as structural richness. Alchemy is a 3D video game, implemented in Unity, which involves a latent causal structure that is resampled procedurally from episode to episode, affording structure learning, online inference, hypothesis testing and action sequencing based on abstract domain knowledge. We evaluate a pair of powerful RL agents on Alchemy and present an in-depth analysis of one of these agents. Results clearly indicate a frank and specific failure of meta-learning, providing validation for Alchemy as a challenging benchmark for meta-RL. Concurrent with this report, we are releasing Alchemy as public resource, together with a suite of analysis tools and sample agent trajectories.


title: Hierarchical multiscale quantification of material uncertainty

abstract: The macroscopic behavior of many materials is complex and the end result of mechanisms that operate across a broad range of disparate scales. An imperfect knowledge of material behavior across scales is a source of epistemic uncertainty of the overall material behavior. However, assessing this uncertainty is difficult due to the complex nature of material response and the prohibitive computational cost of integral calculations. In this paper, we exploit the multiscale and hierarchical nature of material response to develop an approach to quantify the overall uncertainty of material response without the need for integral calculations. Specifically, we bound the uncertainty at each scale and then combine the partial uncertainties in a way that provides a bound on the overall or integral uncertainty. The bound provides a conservative estimate on the uncertainty. Importantly, this approach does not require integral calculations that are prohibitively expensive. We demonstrate the framework on the problem of ballistic impact of a polycrystalline magnesium plate. Magnesium and its alloys are of current interest as promising light-weight structural and protective materials. Finally, we remark that the approach can also be used to study the sensitivity of the overall response to particular mechanisms at lower scales in a materials-by-design approach.


title: Toward a Rational and Ethical Sociotechnical System of Autonomous Vehicles: A Novel Application of Multi-Criteria Decision Analysis

abstract: The expansion of artificial intelligence (AI) and autonomous systems has shown the potential to generate enormous social good while also raising serious ethical and safety concerns. AI technology is increasingly adopted in transportation. A survey of various in-vehicle technologies found that approximately 64% of the respondents used a smartphone application to assist with their travel. The top-used applications were navigation and real-time traffic information systems. Among those who used smartphones during their commutes, the top-used applications were navigation and entertainment. There is a pressing need to address relevant social concerns to allow for the development of systems of intelligent agents that are informed and cognizant of ethical standards. Doing so will facilitate the responsible integration of these systems in society. To this end, we have applied Multi-Criteria Decision Analysis (MCDA) to develop a formal Multi-Attribute Impact Assessment (MAIA) questionnaire for examining the social and ethical issues associated with the uptake of AI. We have focused on the domain of autonomous vehicles (AVs) because of their imminent expansion. However, AVs could serve as a stand-in for any domain where intelligent, autonomous agents interact with humans, either on an individual level (e.g., pedestrians, passengers) or a societal level.


title: There are only a finite number of excluded minors for the class of bicircular matroids

abstract: We show that the class of bicircular matroids has only a finite number of excluded minors. Key tools used in our proof include representations of matroids by biased graphs and the recently introduced class of quasi-graphic matroids. We show that if $N$ is an excluded minor of rank at least ten, then $N$ is quasi-graphic. Several small excluded minors are quasi-graphic. Using biased-graphic representations, we find that $N$ already contains one of these. We also provide an upper bound, in terms of rank, on the number of elements in an excluded minor, so the result follows.


title: Generalized Impurity Pinch in Partially Magnetized Multi-Ion Plasma

abstract: In a two-ion-species plasma with disparate ion masses, heavy ions tend to concentrate in the low-temperature region of collisionally magnetized plasma and in the high-temperature region of collisionally unmagnetized plasma, respectively. Moreover, collisional magnetization can be determined as the ratio of the light ion gyrofrequency to the collision frequency of light and heavy ion species, and the behavior of this effect in the intermediate regime of partially magnetized plasma is predominantly dependent on this Hall parameter. Multi-ion cross-field transport has been described before in the collisionally magnetized plasma regime, and generalized pinch relations, which describe densities of ion species in equilibrium in that plasma, are found in the literature. In this paper, the role of collisional magnetization and Larmor magnetization in multi-ion collisional transport is clarified and generalized pinch relations are extended to the partially magnetized regime, in which the ion Hall parameter may be small, as long as electrons remain collisionally magnetized. Equilibrium ion density profiles have the same dependence on external forces and on each other regardless of collisional magnetization of ions. The expansion of the range of validity of multi-ion collisional transport models makes them applicable to a wider range of laboratory plasma conditions. In particular, ion density profiles evolve sufficiently fast for radial impurity transport to be observable around stagnation on MagLIF, leading to expulsion of heavy ion impurities from the hotspot as long as plasma becomes sufficiently collisionally magnetized during the implosion.


title: Cutoff stability under distributional constraints with an application to summer internship matching

abstract: We introduce a new two-sided stable matching problem that describes the summer internship matching practice of an Australian university. The model is a case between two models of Kamada and Kojima on matchings with distributional constraints. We study three solution concepts, the strong and weak stability concepts proposed by Kamada and Kojima, and a new one in between the two, called cutoff stability. Kamada and Kojima showed that a strongly stable matching may not exist in their most restricted model with disjoint regional quotas. Our first result is that checking its existence is NP-hard. We then show that a cutoff stable matching exists not just for the summer internship problem but also for the general matching model with arbitrary heredity constraints. We present an algorithm to compute a cutoff stable matching and show that it runs in polynomial time in our special case of summer internship model. However, we also show that finding a maximum size cutoff stable matching is NP-hard, but we provide a Mixed Integer Linear Program formulation for this optimisation problem.


title: Analysing the use of graphs to represent the results of Systematic Reviews in Software Engineering

abstract: The presentation of results from Systematic Literature Reviews (SLRs) is generally done using tables. Prior research suggests that results summarized in tables are often difficult for readers to understand. One alternative to improve results' comprehensibility is to use graphical representations. The aim of this work is twofold: first, to investigate whether graph representations result is better comprehensibility than tables when presenting SLR results; second, to investigate whether interpretation using graphs impacts on performance, as measured by the time consumed to analyse and understand the data. We selected an SLR published in the literature and used two different formats to represent its results - tables and graphs, in three different combinations: (i) table format only; (ii) graph format only; and (iii) a mixture of tables and graphs. We conducted an experiment that compared the performance and capability of experts in SLR, as well as doctoral and masters students, in analysing and understanding the results of the SLR, as presented in one of the three different forms. We were interested in examining whether there is difference between the performance of participants using tables and graphs. The graphical representation of SLR data led to a reduction in the time taken for its analysis, without any loss in data comprehensibility. For our sample the analysis of graphical data proved to be faster than the analysis of tabular data. However , we found no evidence of a difference in comprehensibility whether using tables, graphical format or a combination. Overall we argue that graphs are a suitable alternative to tables when it comes to representing the results of an SLR.


title: A Baseline Model for Software Effort Estimation

abstract: Software effort estimation (SEE) is a core activity in all software processes and development lifecycles. A range of increasingly complex methods has been considered in the past 30 years for the prediction of effort, often with mixed and contradictory results. The comparative assessment of effort prediction methods has therefore become a common approach when considering how best to predict effort over a range of project types. Unfortunately, these assessments use a variety of sampling methods and error measurements, making comparison with other work difficult. This article proposes an automatically transformed linear model (ATLM) as a suitable baseline model for comparison against SEE methods. ATLM is simple yet performs well over a range of different project types. In addition, ATLM may be used with mixed numeric and categorical data and requires no parameter tuning. It is also deterministic, meaning that results obtained are amenable to replication. These and other arguments for using ATLM as a baseline model are presented, and a reference implementation described and made available. We suggest that ATLM should be used as a baseline of effort prediction quality for all future model comparisons in SEE.


title: Using Visual Text Mining to Support the Study Selection Activity in Systematic Literature Reviews

abstract: Background: A systematic literature review (SLR) is a methodology used to aggregate all relevant existing evidence to answer a research question of interest. Although crucial, the process used to select primary studies can be arduous, time consuming, and must often be conducted manually. Objective: We propose a novel approach, known as 'Systematic Literature Review based on Visual Text Mining' or simply SLR-VTM, to support the primary study selection activity using visual text mining (VTM) techniques. Method: We conducted a case study to compare the performance and effectiveness of four doctoral students in selecting primary studies manually and using the SLR-VTM approach. To enable the comparison, we also developed a VTM tool that implemented our approach. We hypothesized that students using SLR-VTM would present improved selection performance and effectiveness. Results: Our results show that incorporating VTM in the SLR study selection activity reduced the time spent in this activity and also increased the number of studies correctly included. Conclusions: Our pilot case study presents promising results suggesting that the use of VTM may indeed be beneficial during the study selection activity when performing an SLR.


title: Does Collateral Value Affect Asset Prices? Evidence from a Natural Experiment in Texas

abstract: Does the ability to pledge an asset as collateral, after purchase, affect its price? This paper identifies the impact of collateral service flows on house prices, exploiting a plausibly exogenous constitutional amendment in Texas which legalized home equity loans in 1998. The law change increased Texas house prices 4%; this is price-based evidence that households are credit-constrained and value home equity loans to facilitate consumption smoothing. Prices rose more in locations with inelastic supply, higher pre-law house prices, higher income, and lower unemployment. These estimates reveal that richer households value the option to pledge their home as collateral more strongly.


title: Characterizing Order of Convergence in the Obreshkov Method in Differential-Algebraic Equations

abstract: The Obreshkov method is a single-step multi-derivative method used in the numerical solution of differential equations and has been used in recent years in efficient circuit simulation. It has been shown that it can be made of arbitrary high local order of convergence while maintaining unconditional numerical stability. Nevertheless, the theoretical basis for the high order of convergence has been known only for the special case where the underlying system of differential equations is of the ordinary type, i.e., for ordinary differential equations (ODE). On the other hand, theoretical analysis of the order of convergence for the more general case of a system consisting of differential and algebraic equations (DAE) is still lacking in the literature. This paper presents the theoretical characterization for the local order of convergence of the Obreshkov method when used in the numerical solution of a system of DAE. The contribution presented in this paper demonstrates that, in DAE, the local order of convergence is a function of the differentiation index of the system and, under certain conditions, becomes lower than the order obtained in ODE.


title: Towards the fabrication of a morphing plasma source for biomedical applications

abstract: A new design of plasma source that merges the main features of capacitive dielectric barrier discharge (DBD) and cold atmospheric plasma jet (CAPJ) is discussed. The DBD system consists of a flexible, porous matrix consisting of silica aerogel, which is comprised between two planar-parallel electrodes. The supply of helium flow submitted to a sinusoidal voltage of 5-9 kV in amplitude and 15 kHz in frequency provides a 2D-distribution of plasma jets that propagate around 1 cm beyond the active DBD region. The plasma multi-jet system is aimed at surface treatment of 3D objects and large areas. CAPJ performance as a hypothetical morphing source in flat and bent configurations is discussed. Optical emission spectroscopy (OES) diagnostics has provided the composition of the CAPJ through the aerogel layer. This novel source is promising for situations requiring thorough adaptation of plasma parameters to delicate samples, as for example wound healing and treatment of surgical margins in plasma-based cancer surgery.


title: The Impact of Sampling and Rule Set Size on Generated Fuzzy Inference System Predictive Accuracy: Analysis of a Software Engineering Data Set

abstract: Software project management makes extensive use of predictive modeling to estimate product size, defect proneness and development effort. Although uncertainty is acknowledged in these tasks, fuzzy inference systems, designed to cope well with uncertainty, have received only limited attention in the software engineering domain. In this study we empirically investigate the impact of two choices on the predictive accuracy of generated fuzzy inference systems when applied to a software engineering data set: sampling of observations for training and testing; and the size of the rule set generated using fuzzy c-means clustering. Over ten samples we found no consistent pattern of predictive performance given certain rule set size. We did find, however, that a rule set compiled from multiple samples generally resulted in more accurate predictions than single sample rule sets. More generally, the results provide further evidence of the sensitivity of empirical analysis outcomes to specific model-building decisions.


title: Continuous [0,1]-lattices and injective [0,1]-approach spaces

abstract: In 1972, Dana Scott proved a fundamental result on the connection between order and topology which says that injective $T_0$ spaces are precisely continuous lattices endowed with Scott topology. This paper investigates whether this is true in an enriched context, where the enrichment is the quantale obtained by equipping the interval $[0,1]$ with a continuous t-norm. It is shown that for each continuous t-norm, the specialization $[0,1]$-order of a separated and injective $[0,1]$-approach space $X$ is a continuous $[0,1]$-lattice and the $[0,1]$-approach structure of $X$ coincides with the Scott $[0,1]$-approach structure of its specialization $[0,1]$-order; but, unlike in the classical situation, the converse fails in general.


title: Hypothetical bias in stated choice experiments: Part I. Integrative synthesis of empirical evidence and conceptualisation of external validity

abstract: The notion of hypothetical bias (HB) constitutes, arguably, the most fundamental issue in relation to the use of hypothetical survey methods. Whether or to what extent choices of survey participants and subsequent inferred estimates translate to real-world settings continues to be debated. While HB has been extensively studied in the broader context of contingent valuation, it is much less understood in relation to choice experiments (CE). This paper reviews the empirical evidence for HB in CE in various fields of applied economics and presents an integrative framework for how HB relates to external validity. Results suggest mixed evidence on the prevalence, extent and direction of HB as well as considerable context and measurement dependency. While HB is found to be an undeniable issue when conducting CEs, the empirical evidence on HB does not render CEs unable to represent real-world preferences. While health-related choice experiments often find negligible degrees of HB, experiments in consumer behaviour and transport domains suggest that significant degrees of HB are ubiquitous. Assessments of bias in environmental valuation studies provide mixed evidence. Also, across these disciplines many studies display HB in their total willingness to pay estimates and opt-in rates but not in their hypothetical marginal rates of substitution (subject to scale correction). Further, recent findings in psychology and brain imaging studies suggest neurocognitive mechanisms underlying HB that may explain some of the discrepancies and unexpected findings in the mainstream CE literature. The review also observes how the variety of operational definitions of HB prohibits consistent measurement of HB in CE. The paper further identifies major sources of HB and possible moderating factors. Finally, it explains how HB represents one component of the wider concept of external validity.


title: Invertible phases for mixed spatial symmetries and the fermionic crystalline equivalence principle

abstract: Freed-Hopkins give a mathematical ansatz for classifying gapped invertible phases of matter with a spatial symmetry in terms of Borel-equivariant generalized homology. We propose a slight generalization of this ansatz to account for cases where the symmetry type mixes nontrivially with the spatial symmetry, such as crystalline phases with spin-1/2 fermions. From this ansatz, we prove as a theorem a "fermionic crystalline equivalence principle," as predicted in the physics literature. Using this and the Adams spectral sequence, we compute classifications of some classes of phases with a point group symmetry; in cases where these phases have been studied by other methods, our results agree with the literature.

categories: math-ph cond-mat.str-el hep-th math.AT math.MP


title: BAXTER: Bi-modal Aerial-Terrestrial Hybrid Vehicle for Long-endurance Versatile Mobility: Preprint Version

abstract: Unmanned aerial vehicles are rapidly evolving within the field of robotics. However, their performance is often limited by payload capacity, operational time, and robustness to impact and collision. These limitations of aerial vehicles become more acute for missions in challenging environments such as subterranean structures which may require extended autonomous operation in confined spaces. While software solutions for aerial robots are developing rapidly, improvements to hardware are critical to applying advanced planners and algorithms in large and dangerous environments where the short range and high susceptibility to collisions of most modern aerial robots make applications in realistic subterranean missions infeasible. To provide such hardware capabilities, one needs to design and implement a hardware solution that takes into the account the Size, Weight, and Power (SWaP) constraints. This work focuses on providing a robust and versatile hybrid platform that improves payload capacity, operation time, endurance, and versatility. The Bi-modal Aerial and Terrestrial hybrid vehicle (BAXTER) is a solution that provides two modes of operation, aerial and terrestrial. BAXTER employs two novel hardware mechanisms: the M-Suspension and the Decoupled Transmission which together provide resilience during landing and crashes and efficient terrestrial operation. Extensive flight tests were conducted to characterize the vehicle's capabilities, including robustness and endurance. Additionally, we propose Agile Mode Transfer (AMT), a transition from aerial to terrestrial operation that seeks to minimize impulses during impact to the ground which is a quick and simple transition process that exploits BAXTER's resilience to impact.


title: Future Prospects for Solar EUV and Soft X-ray Spectroscopy Missions

abstract: Future prospects for solar spectroscopy missions operating in the extreme ultraviolet (EUV) and soft X-ray (SXR) wavelength ranges, 1.2-1600 Angstroms, are discussed. NASA is the major funder of Solar Physics missions, and brief summaries of the opportunities for mission development under NASA are given. Upcoming major solar missions from other nations are also described. The methods of observing the Sun in the two wavelength ranges are summarized with a discussion of spectrometer types, imaging techniques and detector options. The major spectral features in the EUV and SXR regions are identified, and then the upcoming instruments and concepts are summarized. The instruments range from large spectrometers on dedicated missions, to tiny, low-cost CubeSats launched through rideshare opportunities.


title: Atomtronic protocol designs for NOON states

abstract: The ability to reliably prepare non-classical states will play a major role in the realization of quantum technology. NOON states, belonging to the class of Schroedinger cat states, have emerged as a leading candidate for several applications. Starting from a model of dipolar bosons confined to a closed circuit of four sites, we show how to generate NOON states. This is achieved by designing protocols to transform initial Fock states to NOON states through use of time evolution, application of an external field, and local projective measurements. By variation of the external field strength, we demonstrate how the system can be controlled to encode a phase into a NOON state. We also discuss the physical feasibility, via an optical lattice setup. Our proposal illuminates the benefits of quantum integrable systems in the design of atomtronic protocols.


title: Hypothetical bias in stated choice experiments: Part II. Macro-scale analysis of literature and effectiveness of bias mitigation methods

abstract: This paper reviews methods of hypothetical bias (HB) mitigation in choice experiments (CEs). It presents a bibliometric analysis and summary of empirical evidence of their effectiveness. The paper follows the review of empirical evidence on the existence of HB presented in Part I of this study. While the number of CE studies has rapidly increased since 2010, the critical issue of HB has been studied in only a small fraction of CE studies. The present review includes both ex-ante and ex-post bias mitigation methods. Ex-ante bias mitigation methods include cheap talk, real talk, consequentiality scripts, solemn oath scripts, opt-out reminders, budget reminders, honesty priming, induced truth telling, indirect questioning, time to think and pivot designs. Ex-post methods include follow-up certainty calibration scales, respondent perceived consequentiality scales, and revealed-preference-assisted estimation. It is observed that the use of mitigation methods markedly varies across different sectors of applied economics. The existing empirical evidence points to their overall effectives in reducing HB, although there is some variation. The paper further discusses how each mitigation method can counter a certain subset of HB sources. Considering the prevalence of HB in CEs and the effectiveness of bias mitigation methods, it is recommended that implementation of at least one bias mitigation method (or a suitable combination where possible) becomes standard practice in conducting CEs. Mitigation method(s) suited to the particular application should be implemented to ensure that inferences and subsequent policy decisions are as much as possible free of HB.


title: Learning Rate Optimization for Federated Learning Exploiting Over-the-air Computation

abstract: Federated learning (FL) as a promising edge-learning framework can effectively address the latency and privacy issues by featuring distributed learning at the devices and model aggregation in the central server. In order to enable efficient wireless data aggregation, over-the-air computation (AirComp) has recently been proposed and attracted immediate attention. However, fading of wireless channels can produce aggregate distortions in an AirComp-based FL scheme. To combat this effect, the concept of dynamic learning rate (DLR) is proposed in this work. We begin our discussion by considering multiple-input-single-output (MISO) scenario, since the underlying optimization problem is convex and has closed-form solution. We then extend our studies to more general multiple-input-multiple-output (MIMO) case and an iterative method is derived. Extensive simulation results demonstrate the effectiveness of the proposed scheme in reducing the aggregate distortion and guaranteeing the testing accuracy using the MNIST and CIFAR10 datasets. In addition, we present the asymptotic analysis and give a near-optimal receive beamforming design solution in closed form, which is verified by numerical simulations.


title: Elementary amenable groups of cohomological dimension 3

abstract: We show that torsion-free elementary amenable groups of Hirsch length $\leq3$ are solvable, of derived length $\leq3$. This class includes all solvable groups of cohomological dimension 3. We show also that groups in the latter subclass are either polycyclic, semidirect products $BS(1,n)\rtimes\mathbb{Z}$ or properly ascending HNN extensions with base $\mathbb{Z}^2$ or $\pi_1(Kb)$.


title: Local Newton nondegenerate Weil divisors in toric varieties

abstract: We introduce and develop the theory of Newton nondegenerate local Weil divisors $(X,0)$ in toric affine varieties. We characterize in terms of the toric combinatorics of the Newton diagram different properties of such singular germs: normality, Gorenstein property, or being an Cartier divisor in the ambient space. We discuss certain properties of their (canonical) resolution $\tilde{X}\to X $ and the corresponding canonical divisor. We provide combinatorial formulae for the delta--invariant $\delta(X,0)$ and for the cohomology groups $H^i(\tilde X,\mathcal{O}_{\tilde X})$ for $i>0$. In the case $\dim(X,0)=2$, we provide the (canonical) resolution graph from the Newton diagram and we also prove that if such a Weil divisor is normal and Gorenstein, and the link is a rational homology sphere, then the geometric genus is given by the minimal path cohomology, a topological invariant of the link.


title: Bistability and nonequilibrium condensation in a driven-dissipative Josephson array: a c-field model

abstract: Developing theoretical models for nonequilibrium quantum systems poses significant challenges. Here we develop and study a multimode model of a driven-dissipative Josephson junction chain of atomic Bose-Einstein condensates, as realised in the experiment of Labouvie et al. [Phys. Rev. Lett. 116, 235302 (2016)]. The model is based on c-field theory, a beyond-mean-field approach to Bose-Einstein condensates that incorporates fluctuations due to finite temperature and dissipation. We find the c-field model is capable of capturing all key features of the nonequilibrium phase diagram, including bistability and a critical slowing down in the lower branch of the bistable region. Our model is closely related to the so-called Lugiato-Lefever equation, and thus establishes new connections between nonequilibrium dynamics of ultracold atoms with nonlinear optics, exciton-polariton superfluids, and driven damped sine-Gordon systems.


title: Adversarial Training Makes Weight Loss Landscape Sharper in Logistic Regression

abstract: Adversarial training is actively studied for learning robust models against adversarial examples. A recent study finds that adversarially trained models degenerate generalization performance on adversarial examples when their weight loss landscape, which is loss changes with respect to weights, is sharp. Unfortunately, it has been experimentally shown that adversarial training sharpens the weight loss landscape, but this phenomenon has not been theoretically clarified. Therefore, we theoretically analyze this phenomenon in this paper. As a first step, this paper proves that adversarial training with the L2 norm constraints sharpens the weight loss landscape in the linear logistic regression model. Our analysis reveals that the sharpness of the weight loss landscape is caused by the noise aligned in the direction of increasing the loss, which is used in adversarial training. We theoretically and experimentally confirm that the weight loss landscape becomes sharper as the magnitude of the noise of adversarial training increases in the linear logistic regression model. Moreover, we experimentally confirm the same phenomena in ResNet18 with softmax as a more general case.


title: Design and Calibration of an Optically Segmented Single Volume Scatter Camera for Neutron Imaging

abstract: The Optically Segmented Single Volume Scatter Camera (OS-SVSC) aims to image neutron sources for non-proliferation applications using the kinematic reconstruction of elastic double-scatter events. Our prototype system consists of 64 EJ-204 organic plastic scintillator bars, each measuring 5 mm $\times$ 5 mm $\times$ 200 mm and individually wrapped in Teflon tape. The scintillator array is optically coupled to two silicon photomultiplier ArrayJ-60035 64P-PCB arrays, each comprised of 64 individual 6 $\times$ 6 mm J-Series sensors arranged in an 8 $\times$ 8 array. We detail our calibration efforts, beginning with calibrations for the electronics, based on the IRS3D application-specific integrated circuits, and their associated timing resolutions, ranging from 30 ps to 90 ps. With electronics calibrations applied, energy and position calibrations were performed for a set of edge bars using $^{22}$Na and $^{90}$Sr, respectively, reporting an average resolution of (12.07$\pm$0.03) mm for energy depositions between 900 keVee and 1000 keVee. We further demonstrate a position calibration method for the internal bars of the matrix using cosmic-ray muons as an alternative to emission sources that cannot easily access these bars, with an average measured resolution of (14.86$\pm$0.29) mm for depositions between 900 keVee and 1000 keVee. The coincident time resolution reported between pairs of bars measured up to 400 ps from muon acquisitions. Energy and position calibration values measured with muons are consistent with those obtained using particle emission sources.


title: Robust Adaptive Filtering Based on Exponential Functional Link Network

abstract: The exponential functional link network (EFLN) has been recently investigated and applied to nonlinear filtering. This brief proposes an adaptive EFLN filtering algorithm based on a novel inverse square root (ISR) cost function, called the EFLN-ISR algorithm, whose learning capability is robust under impulsive interference. The steady-state performance of EFLN-ISR is rigorously derived and then confirmed by numerical simulations. Moreover, the validity of the proposed EFLN-ISR algorithm is justified by the actually experimental results with the application to hysteretic nonlinear system identification.


title: On Controllability and Persistency of Excitation in Data-Driven Control: Extensions of Willems' Fundamental Lemma

abstract: Willems' fundamental lemma asserts that all trajectories of a linear time-invariant system can be obtained from a finite number of measured ones, assuming that controllability and a persistency of excitation condition hold. We show that these two conditions can be relaxed. First, we prove that the controllability condition can be replaced by a condition on the controllable subspace, unobservable subspace, and a certain subspace associated with the measured trajectories. Second, we prove that the persistency of excitation requirement can be relaxed if the degree of a certain minimal polynomial is tightly bounded. Our results show that data-driven predictive control using online data is equivalent to model predictive control, even for uncontrollable systems. Moreover, our results significantly reduce the amount of data needed in identifying homogeneous multi-agent systems.


title: Superballistic and superdiffusive scaling limits of stochastic harmonic chains with long-range interactions

abstract: We consider one-dimensional infinite chains of harmonic oscillators with random exchanges of momenta and long-range interaction potentials which have polynomial decay rate $|x|^{-\theta}, x \to \infty, \theta > 1$ where $x \in \mathbb{Z}$ is the interaction range. The dynamics conserve total momentum, total length and total energy. We prove that the systems evolve macroscopically on superballistic space-time scale $(y \varepsilon^{-1}, t \varepsilon^{- \frac{\theta - 1}{2}})$ when $1 < \theta < 3$, $(y \varepsilon^{-1}, t \varepsilon^{-1} \sqrt{- \log(\varepsilon^{-1})}^{-1})$ when $\theta = 3$, and ballistic space-time scale $(y \varepsilon^{-1}, t \varepsilon^{-1})$ when $\theta > 3$. Combining our results and the results in [10], we show the existence of two different space-time scales on which the systems evolve. In addition, we prove scaling limits of recentered normal modes of superballistic wave equations, which are analogues of Riemann invariants and capture fluctuations around characteristics. The space-time scale is superdiffusive when $2 < \theta \le 4$ and diffusive when $\theta > 4$.


title: Understanding Pre-Editing for Black-Box Neural Machine Translation

abstract: Pre-editing is the process of modifying the source text (ST) so that it can be translated by machine translation (MT) in a better quality. Despite the unpredictability of black-box neural MT (NMT), pre-editing has been deployed in various practical MT use cases. Although many studies have demonstrated the effectiveness of pre-editing methods for particular settings, thus far, a deep understanding of what pre-editing is and how it works for black-box NMT is lacking. To elicit such understanding, we extensively investigated human pre-editing practices. We first implemented a protocol to incrementally record the minimum edits for each ST and collected 6,652 instances of pre-editing across three translation directions, two MT systems, and four text domains. We then analysed the instances from three perspectives: the characteristics of the pre-edited ST, the diversity of pre-editing operations, and the impact of the pre-editing operations on NMT outputs. Our findings include the following: (1) enhancing the explicitness of the meaning of an ST and its syntactic structure is more important for obtaining better translations than making the ST shorter and simpler, and (2) although the impact of pre-editing on NMT is generally unpredictable, there are some tendencies of changes in the NMT outputs depending on the editing operation types.


title: DetectorGuard: Provably Securing Object Detectors against Localized Patch Hiding Attacks

abstract: State-of-the-art object detectors are vulnerable to localized patch hiding attacks, where an adversary introduces a small adversarial patch to make detectors miss the detection of salient objects. The patch attacker can carry out a physical-world attack by printing and attaching an adversarial patch to the victim object. In this paper, we propose DetectorGuard as the first general framework for building provably robust object detectors against localized patch hiding attacks. DetectorGuard is inspired by recent advancements in robust image classification research; we ask: can we adapt robust image classifiers for robust object detection? Unfortunately, due to their task difference, an object detector naively adapted from a robust image classifier 1) may not necessarily be robust in the adversarial setting or 2) even maintain decent performance in the clean setting. To build a high-performance robust object detector, we propose an objectness explaining strategy: we adapt a robust image classifier to predict objectness for every image location and then explain each objectness using the bounding boxes predicted by a conventional object detector. If all objectness is well explained, we output the predictions made by the conventional object detector; otherwise, we issue an attack alert. Notably, 1) in the adversarial setting, we formally prove the end-to-end robustness of DetectorGuard on certified objects, i.e., it either detects the object or triggers an alert, against any patch hiding attacker within our threat model; 2) in the clean setting, we have almost the same performance as state-of-the-art object detectors. Our evaluation on the PASCAL VOC, MS COCO, and KITTI datasets further demonstrates that DetectorGuard achieves the first provable robustness against localized patch hiding attacks at a negligible cost (<1%) of clean performance.


title: Cache Blocking Technique to Large Scale Quantum Computing Simulation on Supercomputers

abstract: Classical computers require large memory resources and computational power to simulate quantum circuits with a large number of qubits. Even supercomputers that can store huge amounts of data face a scalability issue in regard to parallel quantum computing simulations because of the latency of data movements between distributed memory spaces. Here, we apply a cache blocking technique by inserting swap gates in quantum circuits to decrease data movements. We implemented this technique in the open source simulation framework Qiskit Aer. We evaluated our simulator on GPU clusters and observed good scalability.


title: Standing Wave Solutions in Twisted Multicore Fibers

abstract: In the present work, we consider the existence and spectral stability of standing wave solutions to a model for light propagation in a twisted multi-core fiber with no gain or loss of energy. Numerical parameter continuation experiments demonstrate the existence of standing wave solutions for sufficiently small values of the coupling parameter. Furthermore, standing waves exhibiting optical Aharonov-Bohm suppression, where there is a single waveguide which remains unexcited, exist when the twist parameter $\phi$ and the number of waveguides $N$ is related by $\phi = \pi/N$. Spectral computations and numerical timestepping simulations suggest that standing wave solutions where the energy is concentrated in a single site are neutrally stable. Solutions with asymmetric coupling and multi-pulse solutions are also briefly explored.


title: Multi-Label Annotation of Chest Abdomen Pelvis Computed Tomography Text Reports Using Deep Learning

abstract: Purpose: To develop high throughput multi-label annotators for body (chest, abdomen, and pelvis) Computed Tomography (CT) reports that can be applied across a variety of abnormalities, organs, and disease states. Approach: We used a dictionary approach to develop rule-based algorithms (RBA) for extraction of disease labels from radiology text reports. We targeted three organ systems (lungs/pleura, liver/gallbladder, kidneys/ureters) with four diseases per system based on their prevalence in our dataset. To expand the algorithms beyond pre-defined keywords, attention-guided recurrent neural networks (RNN) were trained using the RBA-extracted labels to classify reports as being positive for one or more diseases or normal for each organ system. Confounding effects on model performance were evaluated using random initialization or pre-trained embedding as well as different sizes of training datasets. Performance was evaluated using the receiver operating characteristic (ROC) area under the curve (AUC) against 2,158 manually obtained labels. Results: Our models extracted disease labels from 261,229 radiology reports of 112,501 unique subjects. Pre-trained models outperformed random initialization across all diseases. As the training dataset size was reduced, performance was robust except for a few diseases with relatively small number of cases. Pre-trained classification AUCs achieved > 0.95 for all five disease outcomes across all three organ systems. Conclusions: Our label-extracting pipeline was able to encompass a variety of cases and diseases by generalizing beyond strict rules with exceptional accuracy. This method can be easily adapted to enable automated labeling of hospital-scale medical data sets for training image-based disease classifiers.


title: Fast second-order evaluation for variable-order Caputo fractional derivative with applications to fractional sub-diffusion equations

abstract: In this paper, we propose a fast second-order approximation to the variable-order (VO) Caputo fractional derivative, which is developed based on $L2$-$1_\sigma$ formula and the exponential-sum-approximation technique. The fast evaluation method can achieve the second-order accuracy and further reduce the computational cost and the acting memory for the VO Caputo fractional derivative. This fast algorithm is applied to construct a relevant fast temporal second-order and spatial fourth-order scheme ($FL2$-$1_{\sigma}$ scheme) for the multi-dimensional VO time-fractional sub-diffusion equations. Theoretically, $FL2$-$1_{\sigma}$ scheme is proved to fulfill the similar properties of the coefficients as those of the well-studied $L2$-$1_\sigma$ scheme. Therefore, $FL2$-$1_{\sigma}$ scheme is strictly proved to be unconditionally stable and convergent. A sharp decrease in the computational cost and the acting memory is shown in the numerical examples to demonstrate the efficiency of the proposed method.


title: Band Structure and Effective Properties of One-Dimensional Thermoacoustic Bloch Waves

abstract: We investigate the dispersion characteristics and the effective properties of acoustic waves propagating in a one-dimensional duct equipped with periodic thermoacoustic coupling elements. Each coupling element consists in a classical thermoacoustic regenerator subject to a spatial temperature gradient. When acoustic waves pass through the regenerator, thermal-to-acoustic energy conversion takes place and can either amplify or attenuate the wave, depending on the direction of propagation of the wave. The presence of the spatial gradient naturally induces a loss of reciprocity. This study provides a comprehensive theoretical model as well as an in-depth numerical analysis of the band structure and of the propagation properties of this thermoacoustically-coupled, tunable, one-dimensional metamaterial. Among the most significant findings, it is shown that the acoustic metamaterial is capable of supporting non-reciprocal thermoacoustic Bloch waves that are associated with a particular form of unidirectional energy transport. Remarkably, the thermoacoustic coupling also allows achieving effective zero compressibility and zero refractive index that ultimately lead to the phase invariance of the propagating sound waves. This single zero effective property is also shown to have very interesting implications in the attainment of acoustic cloaking.

categories: cond-mat.mes-hall physics.app-ph physics.class-ph physics.flu-dyn


title: On non-resistive limit of 1D MHD equations with no vacuum at infinity

abstract: In this paper, we consider the Cauchy problem for the one-dimensional compressible isentropic magnetohydrodynamic (MHD) equations with no vacuum at infinity, but the initial vacuum can be permitted inside the region. By deriving a priori $\nu $ (resistivity coefficient)-independent estimates, we establish the non-resistive limit of the global strong solutions with large initial data. Moreover, as a by-product, the global well-posedness of strong solutions for both the compressible resistive MHD equations and non-resistive MHD equations are also established, respectively.


title: Commonsense Knowledge Aware Concept Selection For Diverse and Informative Visual Storytelling

abstract: Visual storytelling is a task of generating relevant and interesting stories for given image sequences. In this work we aim at increasing the diversity of the generated stories while preserving the informative content from the images. We propose to foster the diversity and informativeness of a generated story by using a concept selection module that suggests a set of concept candidates. Then, we utilize a large scale pre-trained model to convert concepts and images into full stories. To enrich the candidate concepts, a commonsense knowledge graph is created for each image sequence from which the concept candidates are proposed. To obtain appropriate concepts from the graph, we propose two novel modules that consider the correlation among candidate concepts and the image-concept correlation. Extensive automatic and human evaluation results demonstrate that our model can produce reasonable concepts. This enables our model to outperform the previous models by a large margin on the diversity and informativeness of the story, while retaining the relevance of the story to the image sequence.


title: Diversity-Robust Acoustic Feature Signatures Based on Multiscale Fractal Dimension for Similarity Search of Environmental Sounds

abstract: This paper proposes new acoustic feature signatures based on the multiscale fractal dimension (MFD), which are robust against the diversity of environmental sounds, for the content-based similarity search. The diversity of sound sources and acoustic compositions is a typical feature of environmental sounds. Several acoustic features have been proposed for environmental sounds. Among them is the widely-used Mel-Frequency Cepstral Coefficients (MFCCs), which describes frequency-domain features. However, in addition to these features in the frequency domain, environmental sounds have other important features in the time domain with various time scales. In our previous paper, we proposed enhanced multiscale fractal dimension signature (EMFD) for environmental sounds. This paper extends EMFD by using the kernel density estimation method, which results in better performance of the similarity search tasks. Furthermore, it newly proposes another acoustic feature signature based on MFD, namely very-long-range multiscale fractal dimension signature (MFD-VL). The MFD-VL signature describes several features of the time-varying envelope for long periods of time. The MFD-VL signature has stability and robustness against background noise and small fluctuations in the parameters of sound sources, which are produced in field recordings. We discuss the effectiveness of these signatures in the similarity sound search by comparing with acoustic features proposed in the DCASE 2018 challenges. Due to the unique descriptiveness of our proposed signatures, we confirmed the signatures are effective when they are used with other acoustic features.


title: A transparent radiative cooling photonic structure with a high NIR reflection

abstract: Buildings or vehicles with transparent envelope can be heated up by sunlight, causing energy consumption for cooling and in extreme cases leading to vehicular heatstroke in a hot climate. Because only visible light for illumination is essential for these applications, the NIR solar radiation should be reflected to reduce heat gain and the infrared radiation emission should be enhanced for further cooling by using the sky as a heat sink. With a high NIR reflection, a transparent radiative cooling photonic structure consisting of 2D silica gratings atop ZnO/Ag/ZnO is demonstrated for energy-saving and safety. With 81% visible light transmitted, 57% NIR solar radiation reflected and 90% thermal infrared radiation emitted, a synthetical cooling is realized by the photonic structure. Theoretically, the total power of reflected solar irradiance and radiative cooling in infrared of this structure is more than double that of a planar silica. The field test shows that with this structure, the temperature rise of a sealed chamber covered by planar silica can be cooled down by 53.7%. This work shows that the concept of daytime radiative cooling can be applied in combination with the utilization of visible light, indicating a great practical application.


title: Towards Modal Software Engineering

abstract: In this paper we introduce the notion of Modal Software Engineering: automatically turning sequential, deterministic programs into semantically equivalent programs efficiently operating on inputs coming from multiple overlapping worlds. We are drawing an analogy between modal logics, and software application domains where multiple sets of inputs (multiple worlds) need to be processed efficiently. Typically those sets highly overlap, so processing them independently would involve a lot of redundancy, resulting in lower performance, and in many cases intractability. Three application domains are presented: reasoning about feature-based variability of Software Product Lines (SPLs), probabilistic programming, and approximate programming.


title: RpBERT: A Text-image Relation Propagation-based BERT Model for Multimodal NER

abstract: Recently multimodal named entity recognition (MNER) has utilized images to improve the accuracy of NER in tweets. However, most of the multimodal methods use attention mechanisms to extract visual clues regardless of whether the text and image are relevant. Practically, the irrelevant text-image pairs account for a large proportion in tweets. The visual clues that are unrelated to the texts will exert uncertain or even negative effects on multimodal model learning. In this paper, we introduce a method of text-image relation propagation into the multimodal BERT model. We integrate soft or hard gates to select visual clues and propose a multitask algorithm to train on the MNER datasets. In the experiments, we deeply analyze the changes in visual attention before and after the use of text-image relation propagation. Our model achieves state-of-the-art performance on the MNER datasets.


title: Resource Allocation and Scheduling in Non-coherent User-centric Cell-free MIMO

abstract: We study the problem of user-scheduling and resource allocation in distributed multi-user, multiple-input multiple-output (MIMO) networks implementing user-centric clustering and non-coherent transmission. We formulate a weighted sum-rate maximization problem which can provide user proportional fairness. As in this setup, users can be served by many transmitters, user scheduling is particularly difficult. To solve this issue, we use block coordinate descent, fractional programming, and compressive sensing to construct an algorithm that performs user-scheduling and beamforming. Our results show that the proposed framework provides an 8- to 10-fold gain in the long-term user spectral efficiency compared to benchmark schemes such as round-robin scheduling. Furthermore, we quantify the performance loss due to imperfect channel state information and pilot training overhead using a defined area-based pilot-reuse factor.


title: Sign-RIP: A Robust Restricted Isometry Property for Low-rank Matrix Recovery

abstract: Restricted isometry property (RIP), essentially stating that the linear measurements are approximately norm-preserving, plays a crucial role in studying low-rank matrix recovery problem. However, RIP fails in the robust setting, when a subset of the measurements are grossly corrupted with noise. In this work, we propose a robust restricted isometry property, called Sign-RIP, and show its broad applications in robust low-rank matrix recovery. In particular, we show that Sign-RIP can guarantee the uniform convergence of the subdifferentials of the robust matrix recovery with nonsmooth loss function, even at the presence of arbitrarily dense and arbitrarily large outliers. Based on Sign-RIP, we characterize the location of the critical points in the robust rank-1 matrix recovery, and prove that they are either close to the true solution, or have small norm. Moreover, in the over-parameterized regime, where the rank of the true solution is over-estimated, we show that subgradient method converges to the true solution at a (nearly) dimension-free rate. Finally, we show that sign-RIP enjoys almost the same complexity as its classical counterparts, but provides significantly better robustness against noise.


title: Optimizing RRH Placement Under a Noise-Limited Point-to-Point Wireless Backhaul

abstract: In this paper, we study the deployment decisions and location optimization for the remote radio heads (RRHs) in coordinated distributed networks in the presence of a wireless backhaul. We implement a scheme where the RRHs use zero-forcing beamforming (ZF-BF) for the access channel to jointly serve multiple users, while on the backhaul the RRHs are connected to their central units (CUs) through point-to-point wireless links. We investigate the effect of this scheme on the deployment of the RRHs and on the resulting achievable spectral efficiency over the access channel (under a backhaul outage constraint). Our results show that even for noise-limited backhaul links, a large bandwidth must be allocated to the backhaul to allow freely distributing the RRHs in the network. Additionally, our results show that distributing the available antennas on more RRHs is favored as compared to a more co-located antenna system. This motivates further works to study the efficiency of wireless backhaul schemes and their effect on the performance of coordinated distributed networks with joint transmission.


title: Metaknowledge Extraction Based on Multi-Modal Documents

abstract: The triple-based knowledge in large-scale knowledge bases is most likely lacking in structural logic and problematic of conducting knowledge hierarchy. In this paper, we introduce the concept of metaknowledge to knowledge engineering research for the purpose of structural knowledge construction. Therefore, the Metaknowledge Extraction Framework and Document Structure Tree model are presented to extract and organize metaknowledge elements (titles, authors, abstracts, sections, paragraphs, etc.), so that it is feasible to extract the structural knowledge from multi-modal documents. Experiment results have proved the effectiveness of metaknowledge elements extraction by our framework. Meanwhile, detailed examples are given to demonstrate what exactly metaknowledge is and how to generate it. At the end of this paper, we propose and analyze the task flow of metaknowledge applications and the associations between knowledge and metaknowledge.


title: Structure-aware Person Image Generation with Pose Decomposition and Semantic Correlation

abstract: In this paper we tackle the problem of pose guided person image generation, which aims to transfer a person image from the source pose to a novel target pose while maintaining the source appearance. Given the inefficiency of standard CNNs in handling large spatial transformation, we propose a structure-aware flow based method for high-quality person image generation. Specifically, instead of learning the complex overall pose changes of human body, we decompose the human body into different semantic parts (e.g., head, torso, and legs) and apply different networks to predict the flow fields for these parts separately. Moreover, we carefully design the network modules to effectively capture the local and global semantic correlations of features within and among the human parts respectively. Extensive experimental results show that our method can generate high-quality results under large pose discrepancy and outperforms state-of-the-art methods in both qualitative and quantitative comparisons.


title: Show, Attend and Distill:Knowledge Distillation via Attention-based Feature Matching

abstract: Knowledge distillation extracts general knowledge from a pre-trained teacher network and provides guidance to a target student network. Most studies manually tie intermediate features of the teacher and student, and transfer knowledge through pre-defined links. However, manual selection often constructs ineffective links that limit the improvement from the distillation. There has been an attempt to address the problem, but it is still challenging to identify effective links under practical scenarios. In this paper, we introduce an effective and efficient feature distillation method utilizing all the feature levels of the teacher without manually selecting the links. Specifically, our method utilizes an attention-based meta-network that learns relative similarities between features, and applies identified similarities to control distillation intensities of all possible pairs. As a result, our method determines competent links more efficiently than the previous approach and provides better performance on model compression and transfer learning tasks. Further qualitative analyses and ablative studies describe how our method contributes to better distillation. The implementation code is available at github.com/clovaai/attention-feature-distillation.


title: Dyck Paths Categories And Its Relationships With Cluster Algebras

abstract: Dyck paths categories are introduced as a combinatorial model of the category of representations of quivers of Dynkin type An. In particular, it is proved that there is a bijection between some Dyck paths and perfect matchings of some snake graphs. The approach allows us to give formulas for cluster variables in cluster algebras of Dynkin type An in terms of Dyck paths.


title: Observer study-based evaluation of a stochastic and physics-based method to generate oncological PET images

abstract: Objective evaluation of new and improved methods for PET imaging requires access to images with ground truth, as can be obtained through simulation studies. However, for these studies to be clinically relevant, it is important that the simulated images are clinically realistic. In this study, we develop a stochastic and physics-based method to generate realistic oncological two-dimensional (2-D) PET images, where the ground-truth tumor properties are known. The developed method extends upon a previously proposed approach. The approach captures the observed variabilities in tumor properties from actual patient population. Further, we extend that approach to model intra-tumor heterogeneity using a lumpy object model. To quantitatively evaluate the clinical realism of the simulated images, we conducted a human-observer study. This was a two-alternative forced-choice (2AFC) study with trained readers (five PET physicians and one PET physicist). Our results showed that the readers had an average of ~ 50% accuracy in the 2AFC study. Further, the developed simulation method was able to generate wide varieties of clinically observed tumor types. These results provide evidence for the application of this method to 2-D PET imaging applications, and motivate development of this method to generate 3-D PET images.


title: Generalization Bounds for Noisy Iterative Algorithms Using Properties of Additive Noise Channels

abstract: Machine learning models trained by different optimization algorithms under different data distributions can exhibit distinct generalization behaviors. In this paper, we analyze the generalization of models trained by noisy iterative algorithms. We derive distribution-dependent generalization bounds by connecting noisy iterative algorithms to additive noise channels found in communication and information theory. Our generalization bounds shed light on several applications, including differentially private stochastic gradient descent (DP-SGD), federated learning, and stochastic gradient Langevin dynamics (SGLD). We demonstrate our bounds through numerical experiments, showing that they can help understand recent empirical observations of the generalization phenomena of neural networks.


title: GraphPlan: Story Generation by Planning with Event Graph

abstract: Story generation is a task that aims to automatically produce multiple sentences to make up a meaningful story. This task is challenging because it requires high-level understanding of semantic meaning of sentences and causality of story events. Naive sequence-to-sequence models generally fail to acquire such knowledge, as the logical correctness can hardly be guaranteed in a text generation model without the strategic planning. In this paper, we focus on planning a sequence of events assisted by event graphs, and use the events to guide the generator. Instead of using a sequence-to-sequence model to output a storyline as in some existing works, we propose to generate an event sequence by walking on an event graph. The event graphs are built automatically based on the corpus. To evaluate the proposed approach, we conduct human evaluation both on event planning and story generation. Based on large-scale human annotation results, our proposed approach is shown to produce more logically correct event sequences and stories.


title: Mutant reduction evaluation: what is there and what is missing?

abstract: Background. Many mutation reduction strategies, which aim to reduce the number of mutants, have been proposed. Problem. It is important to measure the ability of a mutation reduction strategy to maintain test suite effectiveness evaluation. However, existing evaluation indicators are unable to measure the "order-preserving ability". Objective. We aim to propose evaluation indicators to measure the "order-preserving ability" of a mutation reduction strategy, which is important but missing in our community. Method. Given a test suite on a Software Under Test (SUT) with a set of original mutants, we leverage the test suite to generate a group of test suites that have a partial order relationship in fault detecting potential. When evaluating a reduction strategy, we first construct two partial order relationships among the generated test suites in terms of mutation score, one with the original mutants and another with the reduced mutants. Then, we measure the extent to which the two partial order relationships are consistent. The more consistent the two partial order relationships are, the stronger the Order Preservation (OP) of the mutation reduction strategy is, and the more effective the reduction strategy is. Furthermore, we propose Effort-aware Relative Order Preservation (EROP) to measure how much gain a mutation reduction strategy can provide compared with a random reduction strategy. Result. The experimental results show that OP and EROP are able to efficiently measure the "order-preserving ability" of a mutation reduction strategy. As a result, they have a better ability to distinguish various mutation reduction strategies compared with the existing evaluation indicators. Conclusion. We suggest, for the researchers, that OP and EROP should be used to measure the effectiveness of a mutant reduction strategy.


title: The Fourier Discrepancy Function

abstract: In this paper, we propose the Fourier Discrepancy Function, a new discrepancy to compare discrete probability measures. We show that this discrepancy takes into account the geometry of the underlying space. We prove that the Fourier Discrepancy is convex, twice differentiable, and that its gradient has an explicit formula. We also provide a compelling statistical interpretation. Finally, we study the lower and upper tight bounds for the Fourier Discrepancy in terms of the Total Variation distance.


title: Quantifying Bounds of Model Gap for Synchronous Generators

abstract: In practice, uncertainties in parameters and model structures always cause a gap between a model and the corresponding physical entity. Hence, to evaluate the performance of a model, the bounds of this gap must be assessed. In this paper, we propose a trajectory-sensitivity--based approach to quantify the bounds of the gap. The trajectory sensitivity is expressed as a linear time-varying system. We thus first derive several bounds for a general linear time-varying system in different scenarios. The derived bounds are then applied to obtain bounds of the model gap for generator plant models with different types of structural information, e.g., models of different orders. Case studies are carried out to show the efficacy of the bounds through synchronous generator models on different accuracy levels.


title: Finite Sample Analysis of Minimax Offline Reinforcement Learning: Completeness, Fast Rates and First-Order Efficiency

abstract: We offer a theoretical characterization of off-policy evaluation (OPE) in reinforcement learning using function approximation for marginal importance weights and $q$-functions when these are estimated using recent minimax methods. Under various combinations of realizability and completeness assumptions, we show that the minimax approach enables us to achieve a fast rate of convergence for weights and quality functions, characterized by the critical inequality \citep{bartlett2005}. Based on this result, we analyze convergence rates for OPE. In particular, we introduce novel alternative completeness conditions under which OPE is feasible and we present the first finite-sample result with first-order efficiency in non-tabular environments, i.e., having the minimal coefficient in the leading term.


title: UML Modeling to TM Modeling and Back

abstract: Certainly, the success of the Unified Modeling Language (UML) as the de facto standard for modeling software systems does not imply closing the door on scientific exploration or experimentation with modeling in the field. Continuing studies in this area can produce theoretical results that strengthen UML as the leading modeling language. Recently, a new modeling technique has been proposed called thinging machine (TM) modeling. This paper utilizes TM to further understand UML, with two objectives: (a) Fine issues in UML are studied, including theoretical notions such as events, objects, actions, activities, etc. Specifically, TM can be used to solve problems related to internal cross-diagram integration. (b) TM applies a different method of conceptualization, including building a model on one-category ontology in contrast to the object-oriented paradigm. The long-term objective of this study is to explore the possibility of TM complementing certain aspects in the UML methodology to develop and design software systems. Accordingly, we alternate between UML and TM modeling. A sample UML model is redesigned in TM, and then UML diagrams are extracted from TM. The results clarify many notions in both models. Particularly, the TM behavioral specification seems to be applicable in UML.


title: Transport Induced Dimer State from Topological Corner States

abstract: Recently, a new type of second-order topological insulator has been theoretically proposed by introducing an in-plane Zeeman field into the Kane-Mele model in the two-dimensional honeycomb lattice. A pair of topological corner states arise at the corners with obtuse angles of an isolated diamond-shaped flake. To probe the corner states, we study their transport properties by attaching two leads to the system. Dressed by incoming electrons, the dynamic corner state is very different from its static counterpart. Resonant tunneling through the dressed corner state can occur by tuning the in-plane Zeeman field. At the resonance, the pair of spatially well separated and highly localized corner states can form a dimer state, whose wavefunction extends almost the entire bulk of the diamond-shaped flake. By varying the Zeeman field strength, multiple resonant tunneling events are mediated by the same dimer state. This re-entrance effect can be understood by a simple model. These findings extend our understanding of dynamic aspects of the second-order topological corner states.


title: Modelling COVID-19 Transmission Dynamics in Ghana

abstract: In late 2019, a novel coronavirus, the SARS-CoV-2 outbreak was identified in Wuhan, China and later spread to every corner of the globe. Whilst the number of infection-induced deaths in Ghana, West Africa are minimal when compared with the rest of the world, the impact on the local health service is still significant. Compartmental models are a useful framework for investigating transmission of diseases in societies. To understand how the infection will spread and how to limit the outbreak. We have developed a modified SEIR compartmental model with nine compartments (CoVCom9) to describe the dynamics of SARS-CoV-2 transmission in Ghana. We have carried out a detailed mathematical analysis of the CoVCom9, including the derivation of the basic reproduction number, $\mathcal{R}_{0}$. In particular, we have shown that the disease-free equilibrium is globally asymptotically stable when $\mathcal{R}_{0}<1$ via a candidate Lyapunov function. Using the SARS-CoV-2 reported data for confirmed-positive cases and deaths from March 13 to August 10, 2020, we have parametrised the CoVCom9 model. The results of this fit show good agreement with data. We used Latin hypercube sampling-rank correlation coefficient (LHS-PRCC) to investigate the uncertainty and sensitivity of $\mathcal{R}_{0}$ since the results derived are significant in controlling the spread of SARS-CoV-2. We estimate that over this five month period, the basic reproduction number is given by $\mathcal{R}_{0} = 3.110$, with the 95\% confidence interval being $2.042 \leq \mathcal{R}_0 \leq 3.240$, and the mean value being $\mathcal{R}_{0}=2.623$. Of the 32 parameters in the model, we find that just six have a significant influence on $\mathcal{R}_{0}$, these include the rate of testing, where an increasing testing rate contributes to the reduction of $\mathcal{R}_{0}$.


title: A visible - infrared compatible camouflage photonic crystal with enhanced emission in 5~8 {\mu}m

abstract: Because of surface structural constraint and thermal management requirement, visible - infrared compatible camouflage is still a great challenge. In this study, we introduce a 2D periodic aperture array into ZnO/Ag/ZnO film to realize visible-infrared compatible camouflage with a performance of thermal management by utilizing the extraordinary optical transmission in a dielectric/metal/dielectric (D/M/D) structure. Because of the high visible transmittance of the D/M/D structure, when applied on a visible camouflage coating, the beneath coating can be observed, realizing arbitrary visible camouflage. Due to the perforated Ag layer, both low emittances in 3~5 {\mu}m, 8~14 {\mu}m for infrared camouflage and high emittance in 5~8 {\mu}m for heat dissipation by radiation are achieved theoretically and experimentally. The fabricated photonic crystal exhibits high-temperature infrared camouflage in two atmospheric windows. With the same heating power of 0.40 W/cm2, this photonic crystal is 12.2 K cooler than a sample with a low-emittance surface. The proposed visible - infrared compatible camouflage photonic crystal with the performance of thermal management provides a guideline on coordinated control of light and heat, indicating a potential application in energy & thermal technologies.


title: Generalized scaling of spin qubit coherence in over 12,000 host materials

abstract: Spin defect centers with long quantum coherence times ($T_2$) are key solid-state platforms for a variety of quantum applications. Recently, cluster correlation expansion (CCE) techniques have emerged as a powerful tool to simulate the $T_2$ of defect electron spins in these solid-state systems with good accuracy. Here, based on CCE, we uncover an algebraic expression for $T_2$ generalized for host compounds with dilute nuclear spin baths, which enables a quantitative and comprehensive materials exploration with a near instantaneous estimate of the coherence. We investigate more than 12,000 host compounds at natural isotopic abundance, and find that silicon carbide (SiC), a prominent widegap semiconductor for quantum applications, possesses the longest coherence times among widegap non-chalcogenides. In addition, more than 700 chalcogenides are shown to possess a longer $T_2$ than SiC. We suggest new potential host compounds with promisingly long $T_2$ up to 47 ms, and pave the way to explore unprecedented functional materials for quantum applications.


title: ULA Fitting for Sparse Array Design

abstract: Sparse array (SA) geometries, such as coprime and nested arrays, can be regarded as a concatenation of two uniform linear arrays (ULAs). Such arrays lead to a significant increase of the number of degrees of freedom (DOF) when the second-order information is utilized, i.e., they provide long virtual difference coarray (DCA). Thus, the idea of this paper is based on the observation that SAs can be fitted through concatenation of sub-ULAs. A corresponding SA design principle, called ULA fitting, is then proposed. It aims to design SAs from sub-ULAs. Towards this goal, a polynomial model for arrays is used, and based on it, a DCA structure is analyzed if SA is composed of multiple sub-ULAs. SA design with low mutual coupling is considered. ULA fitting enables to transfer the SA design requirements, such as hole free, low mutual coupling and other requirements, into pseudo polynomial equation, and hence, find particular solutions. We mainly focus on designing SAs with low mutual coupling and large uniform DOF. Two examples of SAs with closed-form expressions are then developed based on ULA fitting. Numerical experiments verify the superiority of the proposed SAs in the presence of heavy mutual coupling.


title: AutoPilot: Automating SoC Design Space Exploration for SWaP Constrained Autonomous UAVs

abstract: Building domain-specific accelerators for autonomous unmanned aerial vehicles (UAVs) is challenging due to a lack of systematic methodology for designing onboard compute. Balancing a computing system for a UAV requires considering both the cyber (e.g., sensor rate, compute performance) and physical (e.g., payload weight) characteristics that affect overall performance. Iterating over the many component choices results in a combinatorial explosion of the number of possible combinations: from 10s of thousands to billions, depending on implementation details. Manually selecting combinations of these components is tedious and expensive. To navigate the {cyber-physical design space} efficiently, we introduce \emph{AutoPilot}, a framework that automates full-system UAV co-design. AutoPilot uses Bayesian optimization to navigate a large design space and automatically select a combination of autonomy algorithm and hardware accelerator while considering the cross-product effect of other cyber and physical UAV components. We show that the AutoPilot methodology consistently outperforms general-purpose hardware selections like Xavier NX and Jetson TX2, as well as dedicated hardware accelerators built for autonomous UAVs, across a range of representative scenarios (three different UAV types and three deployment environments). Designs generated by AutoPilot increase the number of missions on average by up to 2.25x, 1.62x, and 1.43x for nano, micro, and mini-UAVs respectively over baselines. Our work demonstrates the need for holistic full-UAV co-design to achieve maximum overall UAV performance and the need for automated flows to simplify the design process for autonomous cyber-physical systems.


title: Fast periodic Gaussian density fitting by range separation

abstract: We present an efficient implementation of periodic Gaussian density fitting (GDF) using the Coulomb metric. The three-center integrals are divided into two parts by range-separating the Coulomb kernel, with the short-range part evaluated in real space and the long-range part in reciprocal space. With a few algorithmic optimizations, we show that this new method -- which we call range-separated GDF (RSGDF) -- scales sublinearly to linearly with the number of $k$-points for small to medium-sized $k$-point meshes that are commonly used in periodic calculations with electron correlation. Numerical results on a few three-dimensional solids show about $10$-fold speedups over the previously developed GDF with little precision loss. The error introduced by RSGDF is about $10^{-5}~E_{\textrm{h}}$ in the converged Hartree-Fock energy with default auxiliary basis sets and can be systematically reduced by increasing the size of the auxiliary basis with little extra work. [The article has been accepted by The Journal of Chemical Physics.]


title: Structure-Constrained Process Graphs for the Process Semantics of Regular Expressions

abstract: Milner (1984) introduced a process semantics for regular expressions as process graphs. Unlike for the language semantics, where every regular (that is, DFA-accepted) language is the interpretation of some regular expression, there are finite process graphs that are not bisimilar to the process interpretation of any regular expression. For reasoning about graphs that are expressible by regular expressions modulo bisimilarity it is desirable to have structural representations of process graphs in the image of the interpretation. For '1-free' regular expressions, their process interpretations satisfy the structural property LEE (loop existence and elimination). But this is not in general the case for all regular expressions, as we show by examples. Yet as a remedy, we describe the possibility to recover the property LEE for a close variant of the process interpretation. For this purpose we refine the process semantics of regular expressions to yield process graphs with 1-transitions, similar to silent moves for finite-state automata.


title: Strongly Universal Hamiltonian Simulators

abstract: A universal family of Hamiltonians can be used to simulate any local Hamiltonian by encoding its full spectrum as the low-energy subspace of a Hamiltonian from the family. Many spin-lattice model Hamiltonians -- such as Heisenberg or XY interaction on the 2D square lattice -- are known to be universal. However, the known encodings can be very inefficient, requiring interaction energy that scales exponentially with system size if the original Hamiltonian has higher-dimensional, long-range, or even all-to-all interactions. In this work, we provide an efficient construction by which these universal families are in fact "strongly" universal. This means that the required interaction energy and all other resources in the 2D simulator scale polynomially in the size of the target Hamiltonian and precision parameters, regardless of the target's connectivity. This exponential improvement over previous constructions is achieved by combining the tools of quantum phase estimation algorithm and circuit-to-Hamiltonian transformation in a non-perturbative way that only incurs polynomial overhead. The simulator Hamiltonian also possess certain translation-invariance. Furthermore, we show that even 1D Hamiltonians with nearest-neighbor interaction of 8-dimensional particles on a line are strongly universal Hamiltonian simulators, although without any translation-invariance. Our results establish that analog quantum simulations of general systems can be made efficient, greatly increasing their potential as applications for near-future quantum technologies.