title: Optimal Coordinated Planning Amongst Self-Interested Agents with Private State

abstract: Consider a multi-agent system in a dynamic and uncertain environment. Each agent's local decision problem is modeled as a Markov decision process (MDP) and agents must coordinate on a joint action in each period, which provides a reward to each agent and causes local state transitions. A social planner knows the model of every agent's MDP and wants to implement the optimal joint policy, but agents are self-interested and have private local state. We provide an incentive-compatible mechanism for eliciting state information that achieves the optimal joint plan in a Markov perfect equilibrium of the induced stochastic game. In the special case in which local problems are Markov chains and agents compete to take a single action in each period, we leverage Gittins allocation indices to provide an efficient factored algorithm and distribute computation of the optimal policy among the agents. Distributed, optimal coordinated learning in a multi-agent variant of the multi-armed bandit problem is obtained as a special case.


title: Graphical Condition for Identification in recursive SEM

abstract: The paper concerns the problem of predicting the effect of actions or interventions on a system from a combination of (i) statistical data on a set of observed variables, and (ii) qualitative causal knowledge encoded in the form of a directed acyclic graph (DAG). The DAG represents a set of linear equations called Structural Equations Model (SEM), whose coefficients are parameters representing direct causal effects. Reliable quantitative conclusions can only be obtained from the model if the causal effects are uniquely determined by the data. That is, if there exists a unique parametrization for the model that makes it compatible with the data. If this is the case, the model is called identified. The main result of the paper is a general sufficient condition for identification of recursive SEM models.


title: Cutset Sampling with Likelihood Weighting

abstract: The paper analyzes theoretically and empirically the performance of likelihood weighting (LW) on a subset of nodes in Bayesian networks. The proposed scheme requires fewer samples to converge due to reduction in sampling variance. The method exploits the structure of the network to bound the complexity of exact inference used to compute sampling distributions, similar to Gibbs cutset sampling. Yet, the extension of the previosly proposed cutset sampling principles to likelihood weighting is non-trivial due to differences in the sampling processes of Gibbs sampler and LW. We demonstrate empirically that likelihood weighting on a cutset (LWLC) is effective time-wise and has a lower rejection rate than LW when applied to networks with many deterministic probabilities. Finally, we show that the performance of likelihood weighting on a cutset can be improved further by caching computed sampling distributions and, consequently, learning 'zeros' of the target distribution.


title: An Efficient Triplet-based Algorithm for Evidential Reasoning

abstract: Linear-time computational techniques have been developed for combining evidence which is available on a number of contending hypotheses. They offer a means of making the computation-intensive calculations involved more efficient in certain circumstances. Unfortunately, they restrict the orthogonal sum of evidential functions to the dichotomous structure applies only to elements and their complements. In this paper, we present a novel evidence structure in terms of a triplet and a set of algorithms for evidential reasoning. The merit of this structure is that it divides a set of evidence into three subsets, distinguishing trivial evidential elements from important ones focusing some particular elements. It avoids the deficits of the dichotomous structure in representing the preference of evidence and estimating the basic probability assignment of evidence. We have established a formalism for this structure and the general formulae for combining pieces of evidence in the form of the triplet, which have been theoretically justified.


title: Gene Expression Time Course Clustering with Countably Infinite Hidden Markov Models

abstract: Most existing approaches to clustering gene expression time course data treat the different time points as independent dimensions and are invariant to permutations, such as reversal, of the experimental time course. Approaches utilizing HMMs have been shown to be helpful in this regard, but are hampered by having to choose model architectures with appropriate complexities. Here we propose for a clustering application an HMM with a countably infinite state space; inference in this model is possible by recasting it in the hierarchical Dirichlet process (HDP) framework (Teh et al. 2006), and hence we call it the HDP-HMM. We show that the infinite model outperforms model selection methods over finite models, and traditional time-independent methods, as measured by a variety of external and internal indices for clustering on two large publicly available data sets. Moreover, we show that the infinite models utilize more hidden states and employ richer architectures (e.g. state-to-state transitions) without the damaging effects of overfitting.


title: Non-Minimal Triangulations for Mixed Stochastic/Deterministic Graphical Models

abstract: We observe that certain large-clique graph triangulations can be useful to reduce both computational and space requirements when making queries on mixed stochastic/deterministic graphical models. We demonstrate that many of these large-clique triangulations are non-minimal and are thus unattainable via the variable elimination algorithm. We introduce ancestral pairs as the basis for novel triangulation heuristics and prove that no more than the addition of edges between ancestral pairs need be considered when searching for state space optimal triangulations in such graphs. Empirical results on random and real world graphs show that the resulting triangulations that yield significant speedups are almost always non-minimal. We also give an algorithm and correctness proof for determining if a triangulation can be obtained via elimination, and we show that the decision problem associated with finding optimal state space triangulations in this mixed stochastic/deterministic setting is NP-complete.


title: Robust Learning Equilibrium

abstract: We introduce robust learning equilibrium. The idea of learning equilibrium is that learning algorithms in multi-agent systems should themselves be in equilibrium rather than only lead to equilibrium. That is, learning equilibrium is immune to strategic deviations: Every agent is better off using its prescribed learning algorithm, if all other agents follow their algorithms, regardless of the unknown state of the environment. However, a learning equilibrium may not be immune to non strategic mistakes. For example, if for a certain period of time there is a failure in the monitoring devices (e.g., the correct input does not reach the agents), then it may not be in equilibrium to follow the algorithm after the devices are corrected. A robust learning equilibrium is immune also to such non-strategic mistakes. The existence of (robust) learning equilibrium is especially challenging when the monitoring devices are 'weak'. That is, the information available to each agent at each stage is limited. We initiate a study of robust learning equilibrium with general monitoring structure and apply it to the context of auctions. We prove the existence of robust learning equilibrium in repeated first-price auctions, and discuss its properties.


title: Linear Algebra Approach to Separable Bayesian Networks

abstract: Separable Bayesian Networks, or the Influence Model, are dynamic Bayesian Networks in which the conditional probability distribution can be separated into a function of only the marginal distribution of a node's neighbors, instead of the joint distributions. In terms of modeling, separable networks has rendered possible siginificant reduction in complexity, as the state space is only linear in the number of variables on the network, in contrast to a typical state space which is exponential. In this work, We describe the connection between an arbitrary Conditional Probability Table (CPT) and separable systems using linear algebra. We give an alternate proof on the equivalence of sufficiency and separability. We present a computational method for testing whether a given CPT is separable.


title: Advances in exact Bayesian structure discovery in Bayesian networks

abstract: We consider a Bayesian method for learning the Bayesian network structure from complete data. Recently, Koivisto and Sood (2004) presented an algorithm that for any single edge computes its marginal posterior probability in O(n 2^n) time, where n is the number of attributes; the number of parents per attribute is bounded by a constant. In this paper we show that the posterior probabilities for all the n (n - 1) potential edges can be computed in O(n 2^n) total time. This result is achieved by a forward-backward technique and fast Moebius transform algorithms, which are of independent interest. The resulting speedup by a factor of about n^2 allows us to experimentally study the statistical power of learning moderate-size networks. We report results from a simulation study that covers data sets with 20 to 10,000 records over 5 to 25 discrete attributes


title: Inequality Constraints in Causal Models with Hidden Variables

abstract: We present a class of inequality constraints on the set of distributions induced by local interventions on variables governed by a causal Bayesian network, in which some of the variables remain unmeasured. We derive bounds on causal effects that are not directly measured in randomized experiments. We derive instrumental inequality type of constraints on nonexperimental distributions. The results have applications in testing causal models with observational or experimental data.


title: The AI&M Procedure for Learning from Incomplete Data

abstract: We investigate methods for parameter learning from incomplete data that is not missing at random. Likelihood-based methods then require the optimization of a profile likelihood that takes all possible missingness mechanisms into account. Optimzing this profile likelihood poses two main difficulties: multiple (local) maxima, and its very high-dimensional parameter space. In this paper a new method is presented for optimizing the profile likelihood that addresses the second difficulty: in the proposed AI&M (adjusting imputation and mazimization) procedure the optimization is performed by operations in the space of data completions, rather than directly in the parameter space of the profile likelihood. We apply the AI&M method to learning parameters for Bayesian networks. The method is compared against conservative inference, which takes into account each possible data completion, and against EM. The results indicate that likelihood-based inference is still feasible in the case of unknown missingness mechanisms, and that conservative inference is unnecessarily weak. On the other hand, our results also provide evidence that the EM algorithm is still quite effective when the data is not missing at random.


title: Pearl's Calculus of Intervention Is Complete

abstract: This paper is concerned with graphical criteria that can be used to solve the problem of identifying casual effects from nonexperimental data in a causal Bayesian network structure, i.e., a directed acyclic graph that represents causal relationships. We first review Pearl's work on this topic [Pearl, 1995], in which several useful graphical criteria are presented. Then we present a complete algorithm [Huang and Valtorta, 2006b] for the identifiability problem. By exploiting the completeness of this algorithm, we prove that the three basic do-calculus rules that Pearl presents are complete, in the sense that, if a causal effect is identifiable, there exists a sequence of applications of the rules of the do-calculus that transforms the causal effect formula into a formula that only includes observational quantities.


title: Convex Structure Learning for Bayesian Networks: Polynomial Feature Selection and Approximate Ordering

abstract: We present a new approach to learning the structure and parameters of a Bayesian network based on regularized estimation in an exponential family representation. Here we show that, given a fixed variable order, the optimal structure and parameters can be learned efficiently, even without restricting the size of the parent sets. We then consider the problem of optimizing the variable order for a given set of features. This is still a computationally hard problem, but we present a convex relaxation that yields an optimal 'soft' ordering in polynomial time. One novel aspect of the approach is that we do not perform a discrete search over DAG structures, nor over variable orders, but instead solve a continuous relaxation that can then be rounded to obtain a valid network structure. We conduct an experimental comparison against standard structure search procedures over standard objectives, which cope with local minima, and evaluate the advantages of using convex relaxations that reduce the effects of local minima.


title: Matrix Tile Analysis

abstract: Many tasks require finding groups of elements in a matrix of numbers, symbols or class likelihoods. One approach is to use efficient bi- or tri-linear factorization techniques including PCA, ICA, sparse matrix factorization and plaid analysis. These techniques are not appropriate when addition and multiplication of matrix elements are not sensibly defined. More directly, methods like bi-clustering can be used to classify matrix elements, but these methods make the overly-restrictive assumption that the class of each element is a function of a row class and a column class. We introduce a general computational problem, `matrix tile analysis' (MTA), which consists of decomposing a matrix into a set of non-overlapping tiles, each of which is defined by a subset of usually nonadjacent rows and columns. MTA does not require an algebra for combining tiles, but must search over discrete combinations of tile assignments. Exact MTA is a computationally intractable integer programming problem, but we describe an approximate iterative technique and a computationally efficient sum-product relaxation of the integer program. We compare the effectiveness of these methods to PCA and plaid on hundreds of randomly generated tasks. Using double-gene-knockout data, we show that MTA finds groups of interacting yeast genes that have biologically-related functions.


title: A new axiomatization for likelihood gambles

abstract: This paper studies a new and more general axiomatization than one presented previously for preference on likelihood gambles. Likelihood gambles describe actions in a situation where a decision maker knows multiple probabilistic models and a random sample generated from one of those models but does not know prior probability of models. This new axiom system is inspired by Jensen's axiomatization of probabilistic gambles. Our approach provides a new perspective to the role of data in decision making under ambiguity. It avoids one of the most controversial issue of Bayesian methodology namely the assumption of prior probability.


title: Dimension Reduction in Singularly Perturbed Continuous-Time Bayesian Networks

abstract: Continuous-time Bayesian networks (CTBNs) are graphical representations of multi-component continuous-time Markov processes as directed graphs. The edges in the network represent direct influences among components. The joint rate matrix of the multi-component process is specified by means of conditional rate matrices for each component separately. This paper addresses the situation where some of the components evolve on a time scale that is much shorter compared to the time scale of the other components. In this paper, we prove that in the limit where the separation of scales is infinite, the Markov process converges (in distribution, or weakly) to a reduced, or effective Markov process that only involves the slow components. We also demonstrate that for reasonable separation of scale (an order of magnitude) the reduced process is a good approximation of the marginal process over the slow components. We provide a simple procedure for building a reduced CTBN for this effective process, with conditional rate matrices that can be directly calculated from the original CTBN, and discuss the implications for approximate reasoning in large systems.


title: Methods for computing state similarity in Markov Decision Processes

abstract: A popular approach to solving large probabilistic systems relies on aggregating states based on a measure of similarity. Many approaches in the literature are heuristic. A number of recent methods rely instead on metrics based on the notion of bisimulation, or behavioral equivalence between states (Givan et al, 2001, 2003; Ferns et al, 2004). An integral component of such metrics is the Kantorovich metric between probability distributions. However, while this metric enables many satisfying theoretical properties, it is costly to compute in practice. In this paper, we use techniques from network optimization and statistical sampling to overcome this problem. We obtain in this manner a variety of distance functions for MDP state aggregation, which differ in the tradeoff between time and space complexity, as well as the quality of the aggregation. We provide an empirical evaluation of these trade-offs.


title: Residual Belief Propagation: Informed Scheduling for Asynchronous Message Passing

abstract: Inference for probabilistic graphical models is still very much a practical challenge in large domains. The commonly used and effective belief propagation (BP) algorithm and its generalizations often do not converge when applied to hard, real-life inference tasks. While it is widely recognized that the scheduling of messages in these algorithms may have significant consequences, this issue remains largely unexplored. In this work, we address the question of how to schedule messages for asynchronous propagation so that a fixed point is reached faster and more often. We first show that any reasonable asynchronous BP converges to a unique fixed point under conditions similar to those that guarantee convergence of synchronous BP. In addition, we show that the convergence rate of a simple round-robin schedule is at least as good as that of synchronous propagation. We then propose residual belief propagation (RBP), a novel, easy-to-implement, asynchronous propagation algorithm that schedules messages in an informed way, that pushes down a bound on the distance from the fixed point. Finally, we demonstrate the superiority of RBP over state-of-the-art methods for a variety of challenging synthetic and real-life problems: RBP converges significantly more often than other methods; and it significantly reduces running time until convergence, even when other methods converge.


title: Continuous Time Markov Networks

abstract: A central task in many applications is reasoning about processes that change in a continuous time. The mathematical framework of Continuous Time Markov Processes provides the basic foundations for modeling such systems. Recently, Nodelman et al introduced continuous time Bayesian networks (CTBNs), which allow a compact representation of continuous-time processes over a factored state space. In this paper, we introduce continuous time Markov networks (CTMNs), an alternative representation language that represents a different type of continuous-time dynamics. In many real life processes, such as biological and chemical systems, the dynamics of the process can be naturally described as an interplay between two forces - the tendency of each entity to change its state, and the overall fitness or energy function of the entire system. In our model, the first force is described by a continuous-time proposal process that suggests possible local changes to the state of the system at different rates. The second force is represented by a Markov network that encodes the fitness, or desirability, of different states; a proposed local change is then accepted with a probability that is a function of the change in the fitness distribution. We show that the fitness distribution is also the stationary distribution of the Markov process, so that this representation provides a characterization of a temporal process whose stationary distribution has a compact graphical representation. This allows us to naturally capture a different type of structure in complex dynamical processes, such as evolving biological sequences. We describe the semantics of the representation, its basic properties, and how it compares to CTBNs. We also provide algorithms for learning such models from data, and discuss its applicability to biological sequence evolution.


title: Fitting Graphical Interaction Models to Multivariate Time Series

abstract: Graphical interaction models have become an important tool for analysing multivariate time series. In these models, the interrelationships among the components of a time series are described by undirected graphs in which the vertices depict the components while the edges indictate possible dependencies between the components. Current methods for the identification of the graphical structure are based on nonparametric spectral stimation, which prevents application of common model selection strategies. In this paper, we present a parametric approach for graphical interaction modelling of multivariate stationary time series. The proposed models generalize covariance selection models to the time series setting and are formulated in terms of inverse covariances. We show that these models correspond to vector autoregressive models under conditional independence constraints encoded by undirected graphs. Furthermore, we discuss maximum likelihood estimation based on Whittle's approximation to the log-likelihood function and propose an iterative method for solving the resulting likelihood equations. The concepts are illustrated by an example.


title: Direct and Indirect Effects of Sequential Treatments

abstract: In this paper we review the notion of direct causal effect as introduced by Pearl (2001). We show how it can be formulated without counterfactuals, using intervention indicators instead. This allows to consider the natural direct effect as a special case of sequential treatments discussed by Dawid and Didelez (2005) which immediately yields conditions for identifiability as well as a graphical way of checking identifiability. The results are contrasted with the criteria given by Pearl (2001) and Robins (2003).


title: Asymmetric separation for local independence graphs

abstract: Directed possibly cyclic graphs have been proposed by Didelez (2000) and Nodelmann et al. (2002) in order to represent the dynamic dependencies among stochastic processes. These dependencies are based on a generalization of Granger-causality to continuous time, first developed by Schweder (1970) for Markov processes, who called them local dependencies. They deserve special attention as they are asymmetric unlike stochastic (in)dependence. In this paper we focus on their graphical representation and develop a suitable, i.e. asymmetric notion of separation, called delta-separation. The properties of this graph separation as well as of local independence are investigated in detail within a framework of asymmetric (semi)graphoids allowing a deeper insight into what information can be read off these graphs.


title: Chi-square Tests Driven Method for Learning the Structure of Factored MDPs

abstract: SDYNA is a general framework designed to address large stochastic reinforcement learning problems. Unlike previous model based methods in FMDPs, it incrementally learns the structure and the parameters of a RL problem using supervised learning techniques. Then, it integrates decision-theoric planning algorithms based on FMDPs to compute its policy. SPITI is an instanciation of SDYNA that exploits ITI, an incremental decision tree algorithm, to learn the reward function and the Dynamic Bayesian Networks with local structures representing the transition function of the problem. These representations are used by an incremental version of the Structured Value Iteration algorithm. In order to learn the structure, SPITI uses Chi-Square tests to detect the independence between two probability distributions. Thus, we study the relation between the threshold used in the Chi-Square test, the size of the model built and the relative error of the value function of the induced policy with respect to the optimal value. We show that, on stochastic problems, one can tune the threshold so as to generate both a compact model and an efficient policy. Then, we show that SPITI, while keeping its model compact, uses the generalization property of its learning method to perform better than a stochastic classical tabular algorithm in large RL problem with an unknown structure. We also introduce a new measure based on Chi-Square to qualify the accuracy of the model learned by SPITI. We qualitatively show that the generalization property in SPITI within the FMDP framework may prevent an exponential growth of the time required to learn the structure of large stochastic RL problems.


title: Adjacency-Faithfulness and Conservative Causal Inference

abstract: Most causal inference algorithms in the literature (e.g., Pearl (2000), Spirtes et al. (2000), Heckerman et al. (1999)) exploit an assumption usually referred to as the causal Faithfulness or Stability condition. In this paper, we highlight two components of the condition used in constraint-based algorithms, which we call "Adjacency-Faithfulness" and "Orientation-Faithfulness". We point out that assuming Adjacency-Faithfulness is true, it is in principle possible to test the validity of Orientation-Faithfulness. Based on this observation, we explore the consequence of making only the Adjacency-Faithfulness assumption. We show that the familiar PC algorithm has to be modified to be (asymptotically) correct under the weaker, Adjacency-Faithfulness assumption. Roughly the modified algorithm, called Conservative PC (CPC), checks whether Orientation-Faithfulness holds in the orientation phase, and if not, avoids drawing certain causal conclusions the PC algorithm would draw. However, if the stronger, standard causal Faithfulness condition actually obtains, the CPC algorithm is shown to output the same pattern as the PC algorithm does in the large sample limit. We also present a simulation study showing that the CPC algorithm runs almost as fast as the PC algorithm, and outputs significantly fewer false causal arrowheads than the PC algorithm does on realistic sample sizes. We end our paper by discussing how score-based algorithms such as GES perform when the Adjacency-Faithfulness but not the standard causal Faithfulness condition holds, and how to extend our work to the FCI algorithm, which allows for the possibility of latent variables.


title: From influence diagrams to multi-operator cluster DAGs

abstract: There exist several architectures to solve influence diagrams using local computations, such as the Shenoy-Shafer, the HUGIN, or the Lazy Propagation architectures. They all extend usual variable elimination algorithms thanks to the use of so-called 'potentials'. In this paper, we introduce a new architecture, called the Multi-operator Cluster DAG architecture, which can produce decompositions with an improved constrained induced-width, and therefore induce potentially exponential gains. Its principle is to benefit from the composite nature of influence diagrams, instead of using uniform potentials, in order to better analyze the problem structure.


title: Gibbs Sampling for (Coupled) Infinite Mixture Models in the Stick Breaking Representation

abstract: Nonparametric Bayesian approaches to clustering, information retrieval, language modeling and object recognition have recently shown great promise as a new paradigm for unsupervised data analysis. Most contributions have focused on the Dirichlet process mixture models or extensions thereof for which efficient Gibbs samplers exist. In this paper we explore Gibbs samplers for infinite complexity mixture models in the stick breaking representation. The advantage of this representation is improved modeling flexibility. For instance, one can design the prior distribution over cluster sizes or couple multiple infinite mixture models (e.g. over time) at the level of their parameters (i.e. the dependent Dirichlet process model). However, Gibbs samplers for infinite mixture models (as recently introduced in the statistics literature) seem to mix poorly over cluster labels. Among others issues, this can have the adverse effect that labels for the same cluster in coupled mixture models are mixed up. We introduce additional moves in these samplers to improve mixing over cluster labels and to bring clusters into correspondence. An application to modeling of storm trajectories is used to illustrate these ideas.


title: Approximate Separability for Weak Interaction in Dynamic Systems

abstract: One approach to monitoring a dynamic system relies on decomposition of the system into weakly interacting subsystems. An earlier paper introduced a notion of weak interaction called separability, and showed that it leads to exact propagation of marginals for prediction. This paper addresses two questions left open by the earlier paper: can we define a notion of approximate separability that occurs naturally in practice, and do separability and approximate separability lead to accurate monitoring? The answer to both questions is afirmative. The paper also analyzes the structure of approximately separable decompositions, and provides some explanation as to why these models perform well.


title: Identifying the Relevant Nodes Without Learning the Model

abstract: We propose a method to identify all the nodes that are relevant to compute all the conditional probability distributions for a given set of nodes. Our method is simple, effcient, consistent, and does not require learning a Bayesian network first. Therefore, our method can be applied to high-dimensional databases, e.g. gene expression databases.


title: MCMC for doubly-intractable distributions

abstract: Markov Chain Monte Carlo (MCMC) algorithms are routinely used to draw samples from distributions with intractable normalization constants. However, standard MCMC algorithms do not apply to doubly-intractable distributions in which there are additional parameter-dependent normalization terms; for example, the posterior over parameters of an undirected graphical model. An ingenious auxiliary-variable scheme (Moeller et al., 2004) offers a solution: exact sampling (Propp and Wilson, 1996) is used to sample from a Metropolis-Hastings proposal for which the acceptance probability is tractable. Unfortunately the acceptance probability of these expensive updates can be low. This paper provides a generalization of Moeller et al. (2004) and a new MCMC algorithm, which obtains better acceptance probabilities for the same amount of exact sampling, and removes the need to estimate model parameters before sampling begins.


title: General-Purpose MCMC Inference over Relational Structures

abstract: Tasks such as record linkage and multi-target tracking, which involve reconstructing the set of objects that underlie some observed data, are particularly challenging for probabilistic inference. Recent work has achieved efficient and accurate inference on such problems using Markov chain Monte Carlo (MCMC) techniques with customized proposal distributions. Currently, implementing such a system requires coding MCMC state representations and acceptance probability calculations that are specific to a particular application. An alternative approach, which we pursue in this paper, is to use a general-purpose probabilistic modeling language (such as BLOG) and a generic Metropolis-Hastings MCMC algorithm that supports user-supplied proposal distributions. Our algorithm gains flexibility by using MCMC states that are only partial descriptions of possible worlds; we provide conditions under which MCMC over partial worlds yields correct answers to queries. We also show how to use a context-specific Bayes net to identify the factors in the acceptance probability that need to be computed for a given proposed move. Experimental results on a citation matching task show that our general-purpose MCMC engine compares favorably with an application-specific system.


title: Visualization of Collaborative Data

abstract: Collaborative data consist of ratings relating two distinct sets of objects: users and items. Much of the work with such data focuses on filtering: predicting unknown ratings for pairs of users and items. In this paper we focus on the problem of visualizing the information. Given all of the ratings, our task is to embed all of the users and items as points in the same Euclidean space. We would like to place users near items that they have rated (or would rate) high, and far away from those they would give a low rating. We pose this problem as a real-valued non-linear Bayesian network and employ Markov chain Monte Carlo and expectation maximization to find an embedding. We present a metric by which to judge the quality of a visualization and compare our results to local linear embedding and Eigentaste on three real-world datasets.


title: A compact, hierarchical Q-function decomposition

abstract: Previous work in hierarchical reinforcement learning has faced a dilemma: either ignore the values of different possible exit states from a subroutine, thereby risking suboptimal behavior, or represent those values explicitly thereby incurring a possibly large representation cost because exit values refer to nonlocal aspects of the world (i.e., all subsequent rewards). This paper shows that, in many cases, one can avoid both of these problems. The solution is based on recursively decomposing the exit value function in terms of Q-functions at higher levels of the hierarchy. This leads to an intuitively appealing runtime architecture in which a parent subroutine passes to its child a value function on the exit states and the child reasons about how its choices affect the exit value. We also identify structural conditions on the value function and transition distributions that allow much more concise representations of exit state distributions, leading to further state abstraction. In essence, the only variables whose exit values need be considered are those that the parent cares about and the child affects. We demonstrate the utility of our algorithms on a series of increasingly complex environments.


title: Structured Priors for Structure Learning

abstract: Traditional approaches to Bayes net structure learning typically assume little regularity in graph structure other than sparseness. However, in many cases, we expect more systematicity: variables in real-world systems often group into classes that predict the kinds of probabilistic dependencies they participate in. Here we capture this form of prior knowledge in a hierarchical Bayesian framework, and exploit it to enable structure learning and type discovery from small datasets. Specifically, we present a nonparametric generative model for directed acyclic graphs as a prior for Bayes net structure learning. Our model assumes that variables come in one or more classes and that the prior probability of an edge existing between two variables is a function only of their classes. We derive an MCMC algorithm for simultaneous inference of the number of classes, the class assignments of variables, and the Bayes net structure over variables. For several realistic, sparse datasets, we show that the bias towards systematicity of connections provided by our model yields more accurate learned networks than a traditional, uniform prior approach, and that the classes found by our model are appropriate.


title: A theoretical study of Y structures for causal discovery

abstract: There are several existing algorithms that under appropriate assumptions can reliably identify a subset of the underlying causal relationships from observational data. This paper introduces the first computationally feasible score-based algorithm that can reliably identify causal relationships in the large sample limit for discrete models, while allowing for the possibility that there are unobserved common causes. In doing so, the algorithm does not ever need to assign scores to causal structures with unobserved common causes. The algorithm is based on the identification of so called Y substructures within Bayesian network structures that can be learned from observational data. An example of a Y substructure is A -> C, B -> C, C -> D. After providing background on causal discovery, the paper proves the conditions under which the algorithm is reliable in the large sample limit.


title: Belief Update in CLG Bayesian Networks With Lazy Propagation

abstract: In recent years Bayesian networks (BNs) with a mixture of continuous and discrete variables have received an increasing level of attention. We present an architecture for exact belief update in Conditional Linear Gaussian BNs (CLG BNs). The architecture is an extension of lazy propagation using operations of Lauritzen & Jensen [6] and Cowell [2]. By decomposing clique and separator potentials into sets of factors, the proposed architecture takes advantage of independence and irrelevance properties induced by the structure of the graph and the evidence. The resulting benefits are illustrated by examples. Results of a preliminary empirical performance evaluation indicate a significant potential of the proposed architecture.


title: An Efficient Optimal-Equilibrium Algorithm for Two-player Game Trees

abstract: Two-player complete-information game trees are perhaps the simplest possible setting for studying general-sum games and the computational problem of finding equilibria. These games admit a simple bottom-up algorithm for finding subgame perfect Nash equilibria efficiently. However, such an algorithm can fail to identify optimal equilibria, such as those that maximize social welfare. The reason is that, counterintuitively, probabilistic action choices are sometimes needed to achieve maximum payoffs. We provide a novel polynomial-time algorithm for this problem that explicitly reasons about stochastic decisions and demonstrate its use in an example card game.


title: Reasoning about Uncertainty in Metric Spaces

abstract: We set up a model for reasoning about metric spaces with belief theoretic measures. The uncertainty in these spaces stems from both probability and metric. To represent both aspect of uncertainty, we choose an expected distance function as a measure of uncertainty. A formal logical system is constructed for the reasoning about expected distance. Soundness and completeness are shown for this logic. For reasoning on product metric space with uncertainty, a new metric is defined and shown to have good properties.


title: Faster Gaussian Summation: Theory and Experiment

abstract: We provide faster algorithms for the problem of Gaussian summation, which occurs in many machine learning methods. We develop two new extensions - an O(Dp) Taylor expansion for the Gaussian kernel with rigorous error bounds and a new error control scheme integrating any arbitrary approximation method - within the best discretealgorithmic framework using adaptive hierarchical data structures. We rigorously evaluate these techniques empirically in the context of optimal bandwidth selection in kernel density estimation, revealing the strengths and weaknesses of current state-of-the-art approaches for the first time. Our results demonstrate that the new error control scheme yields improved performance, whereas the series expansion approach is only effective in low dimensions (five or less).


title: Sequential Document Representations and Simplicial Curves

abstract: The popular bag of words assumption represents a document as a histogram of word occurrences. While computationally efficient, such a representation is unable to maintain any sequential information. We present a continuous and differentiable sequential document representation that goes beyond the bag of words assumption, and yet is efficient and effective. This representation employs smooth curves in the multinomial simplex to account for sequential information. We discuss the representation and its geometric properties and demonstrate its applicability for the task of text classification.


title: Propagation of Delays in the National Airspace System

abstract: The National Airspace System (NAS) is a large and complex system with thousands of interrelated components: administration, control centers, airports, airlines, aircraft, passengers, etc. The complexity of the NAS creates many difficulties in management and control. One of the most pressing problems is flight delay. Delay creates high cost to airlines, complaints from passengers, and difficulties for airport operations. As demand on the system increases, the delay problem becomes more and more prominent. For this reason, it is essential for the Federal Aviation Administration to understand the causes of delay and to find ways to reduce delay. Major contributing factors to delay are congestion at the origin airport, weather, increasing demand, and air traffic management (ATM) decisions such as the Ground Delay Programs (GDP). Delay is an inherently stochastic phenomenon. Even if all known causal factors could be accounted for, macro-level national airspace system (NAS) delays could not be predicted with certainty from micro-level aircraft information. This paper presents a stochastic model that uses Bayesian Networks (BNs) to model the relationships among different components of aircraft delay and the causal factors that affect delays. A case study on delays of departure flights from Chicago O'Hare international airport (ORD) to Hartsfield-Jackson Atlanta International Airport (ATL) reveals how local and system level environmental and human-caused factors combine to affect components of delay, and how these components contribute to the final arrival delay at the destination airport.


title: Predicting Conditional Quantiles via Reduction to Classification

abstract: We show how to reduce the process of predicting general order statistics (and the median in particular) to solving classification. The accompanying theoretical statement shows that the regret of the classifier bounds the regret of the quantile regression under a quantile loss. We also test this reduction empirically against existing quantile regression methods on large real-world datasets and discover that it provides state-of-the-art performance.


title: Stratified Analysis of `Probabilities of Causation'

abstract: This paper proposes new formulas for the probabilities of causation difined by Pearl (2000). Tian and Pearl (2000a, 2000b) showed how to bound the quantities of the probabilities of causation from experimental and observational data, under the minimal assumptions about the data-generating process. We derive narrower bounds than Tian-Pearl bounds by making use of the covariate information measured in experimental and observational studies. In addition, we provide identifiable case under no-prevention assumption and discuss the covariate selection problem from the viewpoint of estimation accuracy. These results are helpful in providing more evidence for public policy assessment and dicision making problems.


title: On the Number of Samples Needed to Learn the Correct Structure of a Bayesian Network

abstract: Bayesian Networks (BNs) are useful tools giving a natural and compact representation of joint probability distributions. In many applications one needs to learn a Bayesian Network (BN) from data. In this context, it is important to understand the number of samples needed in order to guarantee a successful learning. Previous work have studied BNs sample complexity, yet it mainly focused on the requirement that the learned distribution will be close to the original distribution which generated the data. In this work, we study a different aspect of the learning, namely the number of samples needed in order to learn the correct structure of the network. We give both asymptotic results, valid in the large sample limit, and experimental results, demonstrating the learning behavior for feasible sample sizes. We show that structure learning is a more difficult task, compared to approximating the correct distribution, in the sense that it requires a much larger number of samples, regardless of the computational power available for the learner.


title: Bayesian Multicategory Support Vector Machines

abstract: We show that the multi-class support vector machine (MSVM) proposed by Lee et. al. (2004), can be viewed as a MAP estimation procedure under an appropriate probabilistic interpretation of the classifier. We also show that this interpretation can be extended to a hierarchical Bayesian architecture and to a fully-Bayesian inference procedure for multi-class classification based on data augmentation. We present empirical results that show that the advantages of the Bayesian formalism are obtained without a loss in classification accuracy.


title: Infinite Hidden Relational Models

abstract: In many cases it makes sense to model a relationship symmetrically, not implying any particular directionality. Consider the classical example of a recommendation system where the rating of an item by a user should symmetrically be dependent on the attributes of both the user and the item. The attributes of the (known) relationships are also relevant for predicting attributes of entities and for predicting attributes of new relations. In recommendation systems, the exploitation of relational attributes is often referred to as collaborative filtering. Again, in many applications one might prefer to model the collaborative effect in a symmetrical way. In this paper we present a relational model, which is completely symmetrical. The key innovation is that we introduce for each entity (or object) an infinite-dimensional latent variable as part of a Dirichlet process (DP) model. We discuss inference in the model, which is based on a DP Gibbs sampler, i.e., the Chinese restaurant process. We extend the Chinese restaurant process to be applicable to relational modeling. Our approach is evaluated in three applications. One is a recommendation system based on the MovieLens data set. The second application concerns the prediction of the function of yeast genes/proteins on the data set of KDD Cup 2001 using a multi-relational model. The third application involves a relational medical domain. The experimental results show that our model gives significantly improved estimates of attributes describing relationships or entities in complex relational models.


title: A Non-Parametric Bayesian Method for Inferring Hidden Causes

abstract: We present a non-parametric Bayesian approach to structure learning with hidden causes. Previous Bayesian treatments of this problem define a prior over the number of hidden causes and use algorithms such as reversible jump Markov chain Monte Carlo to move between solutions. In contrast, we assume that the number of hidden causes is unbounded, but only a finite number influence observable variables. This makes it possible to use a Gibbs sampler to approximate the distribution over causal structures. We evaluate the performance of both approaches in discovering hidden causes in simulated data, and use our non-parametric approach to discover hidden causes in a real medical dataset.


title: Stochastic Optimal Control in Continuous Space-Time Multi-Agent Systems

abstract: Recently, a theory for stochastic optimal control in non-linear dynamical systems in continuous space-time has been developed (Kappen, 2005). We apply this theory to collaborative multi-agent systems. The agents evolve according to a given non-linear dynamics with additive Wiener noise. Each agent can control its own dynamics. The goal is to minimize the accumulated joint cost, which consists of a state dependent term and a term that is quadratic in the control. We focus on systems of non-interacting agents that have to distribute themselves optimally over a number of targets, given a set of end-costs for the different possible agent-target combinations. We show that optimal control is the combinatorial sum of independent single-agent single-target optimal controls weighted by a factor proportional to the end-costs of the different combinations. Thus, multi-agent control is related to a standard graphical model inference problem. The additional computational cost compared to single-agent control is exponential in the tree-width of the graph specifying the combinatorial sum times the number of targets. We illustrate the result by simulations of systems with up to 42 agents.


title: Axiomatic Foundations for a Class of Generalized Expected Utility: Algebraic Expected Utility

abstract: Expected Utility: Algebraic Expected Utility In this paper, we provide two axiomatizations of algebraic expected utility, which is a particular generalized expected utility, in a von Neumann-Morgenstern setting, i.e. uncertainty representation is supposed to be given and here to be described by a plausibility measure valued on a semiring, which could be partially ordered. We show that axioms identical to those for expected utility entail that preferences are represented by an algebraic expected utility. This algebraic approach allows many previous propositions (expected utility, binary possibilistic utility,...) to be unified in a same general framework and proves that the obtained utility enjoys the same nice features as expected utility: linearity, dynamic consistency, autoduality of the underlying uncertainty measure, autoduality of the decision criterion and possibility of modeling decision maker's attitude toward uncertainty.


title: Bayesian Random Fields: The Bethe-Laplace Approximation

abstract: While learning the maximum likelihood value of parameters of an undirected graphical model is hard, modelling the posterior distribution over parameters given data is harder. Yet, undirected models are ubiquitous in computer vision and text modelling (e.g. conditional random fields). But where Bayesian approaches for directed models have been very successful, a proper Bayesian treatment of undirected models in still in its infant stages. We propose a new method for approximating the posterior of the parameters given data based on the Laplace approximation. This approximation requires the computation of the covariance matrix over features which we compute using the linear response approximation based in turn on loopy belief propagation. We develop the theory for conditional and 'unconditional' random fields with or without hidden variables. In the conditional setting we introduce a new variant of bagging suitable for structured domains. Here we run the loopy max-product algorithm on a 'super-graph' composed of graphs for individual models sampled from the posterior and connected by constraints. Experiments on real world data validate the proposed methods.


title: Recognizing Activities and Spatial Context Using Wearable Sensors

abstract: We introduce a new dynamic model with the capability of recognizing both activities that an individual is performing as well as where that ndividual is located. Our model is novel in that it utilizes a dynamic graphical model to jointly estimate both activity and spatial context over time based on the simultaneous use of asynchronous observations consisting of GPS measurements, and measurements from a small mountable sensor board. Joint inference is quite desirable as it has the ability to improve accuracy of the model. A key goal, however, in designing our overall system is to be able to perform accurate inference decisions while minimizing the amount of hardware an individual must wear. This minimization leads to greater comfort and flexibility, decreased power requirements and therefore increased battery life, and reduced cost. We show results indicating that our joint measurement model outperforms measurements from either the sensor board or GPS alone, using two types of probabilistic inference procedures, namely particle filtering and pruned exact inference.


title: Incremental Model-based Learners With Formal Learning-Time Guarantees

abstract: Model-based learning algorithms have been shown to use experience efficiently when learning to solve Markov Decision Processes (MDPs) with finite state and action spaces. However, their high computational cost due to repeatedly solving an internal model inhibits their use in large-scale problems. We propose a method based on real-time dynamic programming (RTDP) to speed up two model-based algorithms, RMAX and MBIE (model-based interval estimation), resulting in computationally much faster algorithms with little loss compared to existing bounds. Specifically, our two new learning algorithms, RTDP-RMAX and RTDP-IE, have considerably smaller computational demands than RMAX and MBIE. We develop a general theoretical framework that allows us to prove that both are efficient learners in a PAC (probably approximately correct) sense. We also present an experimental evaluation of these new algorithms that helps quantify the tradeoff between computational and experience demands.


title: Ranking by Dependence - A Fair Criteria

abstract: Estimating the dependences between random variables, and ranking them accordingly, is a prevalent problem in machine learning. Pursuing frequentist and information-theoretic approaches, we first show that the p-value and the mutual information can fail even in simplistic situations. We then propose two conditions for regularizing an estimator of dependence, which leads to a simple yet effective new measure. We discuss its advantages and compare it to well-established model-selection criteria. Apart from that, we derive a simple constraint for regularizing parameter estimates in a graphical model. This results in an analytical approximation for the optimal value of the equivalent sample size, which agrees very well with the more involved Bayesian approach in our experiments.


title: A Self-Supervised Terrain Roughness Estimator for Off-Road Autonomous Driving

abstract: We present a machine learning approach for estimating the second derivative of a drivable surface, its roughness. Robot perception generally focuses on the first derivative, obstacle detection. However, the second derivative is also important due to its direct relation (with speed) to the shock the vehicle experiences. Knowing the second derivative allows a vehicle to slow down in advance of rough terrain. Estimating the second derivative is challenging due to uncertainty. For example, at range, laser readings may be so sparse that significant information about the surface is missing. Also, a high degree of precision is required in projecting laser readings. This precision may be unavailable due to latency or error in the pose estimation. We model these sources of error as a multivariate polynomial. Its coefficients are learned using the shock data as ground truth -- the accelerometers are used to train the lasers. The resulting classifier operates on individual laser readings from a road surface described by a 3D point cloud. The classifier identifies sections of road where the second derivative is likely to be large. Thus, the vehicle can slow down in advance, reducing the shock it experiences. The algorithm is an evolution of one we used in the 2005 DARPA Grand Challenge. We analyze it using data from that route.


title: Variable noise and dimensionality reduction for sparse Gaussian processes

abstract: The sparse pseudo-input Gaussian process (SPGP) is a new approximation method for speeding up GP regression in the case of a large number of data points N. The approximation is controlled by the gradient optimization of a small set of M `pseudo-inputs', thereby reducing complexity from N^3 to NM^2. One limitation of the SPGP is that this optimization space becomes impractically big for high dimensional data sets. This paper addresses this limitation by performing automatic dimensionality reduction. A projection of the input space to a low dimensional space is learned in a supervised manner, alongside the pseudo-inputs, which now live in this reduced space. The paper also investigates the suitability of the SPGP for modeling data with input-dependent noise. A further extension of the model is made to make it even more powerful in this regard - we learn an uncertainty parameter for each pseudo-input. The combination of sparsity, reduced dimension, and input-dependent noise makes it possible to apply GPs to much larger and more complex data sets than was previously practical. We demonstrate the benefits of these methods on several synthetic and real world problems.


title: Bayesian Inference for Gaussian Mixed Graph Models

abstract: We introduce priors and algorithms to perform Bayesian inference in Gaussian models defined by acyclic directed mixed graphs. Such a class of graphs, composed of directed and bi-directed edges, is a representation of conditional independencies that is closed under marginalization and arises naturally from causal models which allow for unmeasured confounding. Monte Carlo methods and a variational approximation for such models are presented. Our algorithms for Bayesian inference allow the evaluation of posterior distributions for several quantities of interest, including causal effects that are not identifiable from data alone but could otherwise be inferred where informative prior knowledge about confounding is available.


title: A simple approach for finding the globally optimal Bayesian network structure

abstract: We study the problem of learning the best Bayesian network structure with respect to a decomposable score such as BDe, BIC or AIC. This problem is known to be NP-hard, which means that solving it becomes quickly infeasible as the number of variables increases. Nevertheless, in this paper we show that it is possible to learn the best Bayesian network structure with over 30 variables, which covers many practically interesting cases. Our algorithm is less complicated and more efficient than the techniques presented earlier. It can be easily parallelized, and offers a possibility for efficient exploration of the best networks consistent with different variable orderings. In the experimental part of the paper we compare the performance of the algorithm to the previous state-of-the-art algorithm. Free source-code and an online-demo can be found at http://b-course.hiit.fi/bene.


title: Identification of Conditional Interventional Distributions

abstract: The subject of this paper is the elucidation of effects of actions from causal assumptions represented as a directed graph, and statistical knowledge given as a probability distribution. In particular, we are interested in predicting conditional distributions resulting from performing an action on a set of variables and, subsequently, taking measurements of another set. We provide a necessary and sufficient graphical condition for the cases where such distributions can be uniquely computed from the available information, as well as an algorithm which performs this computation whenever the condition holds. Furthermore, we use our results to prove completeness of do-calculus [Pearl, 1995] for the same identification problem.


title: Inference in Hybrid Bayesian Networks Using Mixtures of Gaussians

abstract: The main goal of this paper is to describe a method for exact inference in general hybrid Bayesian networks (BNs) (with a mixture of discrete and continuous chance variables). Our method consists of approximating general hybrid Bayesian networks by a mixture of Gaussians (MoG) BNs. There exists a fast algorithm by Lauritzen-Jensen (LJ) for making exact inferences in MoG Bayesian networks, and there exists a commercial implementation of this algorithm. However, this algorithm can only be used for MoG BNs. Some limitations of such networks are as follows. All continuous chance variables must have conditional linear Gaussian distributions, and discrete chance nodes cannot have continuous parents. The methods described in this paper will enable us to use the LJ algorithm for a bigger class of hybrid Bayesian networks. This includes networks with continuous chance nodes with non-Gaussian distributions, networks with no restrictions on the topology of discrete and continuous variables, networks with conditionally deterministic variables that are a nonlinear function of their continuous parents, and networks with continuous chance variables whose variances are functions of their parents.


title: Efficient Selection of Disambiguating Actions for Stereo Vision

abstract: In many domains that involve the use of sensors, such as robotics or sensor networks, there are opportunities to use some form of active sensing to disambiguate data from noisy or unreliable sensors. These disambiguating actions typically take time and expend energy. One way to choose the next disambiguating action is to select the action with the greatest expected entropy reduction, or information gain. In this work, we consider active sensing in aid of stereo vision for robotics. Stereo vision is a powerful sensing technique for mobile robots, but it can fail in scenes that lack strong texture. In such cases, a structured light source, such as vertical laser line can be used for disambiguation. By treating the stereo matching problem as a specially structured HMM-like graphical model, we demonstrate that for a scan line with n columns and maximum stereo disparity d, the entropy minimizing aim point for the laser can be selected in O(nd) time - cost no greater than the stereo algorithm itself. In contrast, a typical HMM formulation would suggest at least O(nd^2) time for the entropy calculation alone.


title: Practical Linear Value-approximation Techniques for First-order MDPs

abstract: Recent work on approximate linear programming (ALP) techniques for first-order Markov Decision Processes (FOMDPs) represents the value function linearly w.r.t. a set of first-order basis functions and uses linear programming techniques to determine suitable weights. This approach offers the advantage that it does not require simplification of the first-order value function, and allows one to solve FOMDPs independent of a specific domain instantiation. In this paper, we address several questions to enhance the applicability of this work: (1) Can we extend the first-order ALP framework to approximate policy iteration to address performance deficiencies of previous approaches? (2) Can we automatically generate basis functions and evaluate their impact on value function quality? (3) How can we decompose intractable problems with universally quantified rewards into tractable subproblems? We propose answers to these questions along with a number of novel optimizations and provide a comparative empirical evaluation on logistics problems from the ICAPS 2004 Probabilistic Planning Competition.


title: Communication channel of fermionic system in accelerated frame

abstract: In this article, we investigate the communication channel of fermionic system in an accelerated frame. We observe that at the infinite acceleration, the mutual information of single rail quantum channel coincides with that of double rail quantum channel, but those of classical ones reach different values. Furthermore, we find that at the infinite acceleration, the conditional entropy of single(or double) rail quantum channel vanishes, but those of classical ones may have finite values. In addition, we see that even when considering a method beyond the single mode approximation, the dual rail entangled state seems to provide better channel capacity than the single rail entangled state, unlike the bosonic case. Moreover, we find that the single-mode approximation is not sufficient to analyze the communication channel of fermionic system in an accelerated frame.


title: Experimental achievement of the entanglement assisted capacity for the depolarizing channel

abstract: We experimentally demonstrate the achievement of the entanglement assisted capacity for classical information transmission over a depolarizing channel. The implementation is based on the generation and local manipulation of 2-qubit Bell states, which are finally measured at the receiver by a complete Bell state analysis. The depolarizing channel is realized by introducing quantum noise in a controlled way on one of the two qubits. This work demonstrates the achievement of the maximum allowed amount of information that can be shared in the presence of noise and the highest reported value in the noiseless case.


title: Interacting Cosmic Rays with Molecular Clouds: A Bremsstrahlung Origin of Diffuse High Energy Emission from the Inner 2deg by 1deg of the Galactic Center

abstract: The high energy activity in the inner few degrees of the Galactic center is traced by diffuse radio, X-ray and gamma-ray emission. The physical relationship between different components of diffuse gas emitting at multiple wavelengths is a focus of this work. We first present radio continuum observations using Green Bank Telescope and model the nonthermal spectrum in terms of a broken power-law distribution of GeV electrons emitting synchrotron radiation. We show that the emission detected by Fermi is primarily due to nonthermal bremsstrahlung produced by the population of synchrotron emitting electrons in the GeV energy range interacting with neutral gas. The extrapolation of the electron population measured from radio data to low and high energies can also explain the origin of FeI 6.4 keV line and diffuse TeV emission, as observed with Suzaku, XMM-Newton, Chandra and the H.E.S.S. observatories. The inferred physical quantities from modeling multi-wavelength emission in the context of bremsstrahlung emission from the inner 300x120 parsecs of the Galactic center are constrained to have the cosmic ray ionization rate 1-10x10^{-15} s^-1, molecular gas heating rate elevating the gas temperature to 75-200K, fractional ionization of molecular gas 10^{-6} to 10^{-5}, large scale magnetic field 10-20 micro Gauss, the density of diffuse and dense molecular gas 100 and 10^3 cm^{-3} over 300pc and 50pc pathlengths, and the variability of FeI Kalpha 6.4 keV line emission on yearly time scales. Important implications of our study are that GeV electrons emitting in radio can explain the GeV gamma-rays detected by Fermi and that the cosmic ray irradiation model, like the model of the X-ray irradiation triggered by past activity of Sgr A*, can also explain the origin of the variable 6.4 keV emission from Galactic center molecular clouds.


title: Learning Neighborhoods for Metric Learning

abstract: Metric learning methods have been shown to perform well on different learning tasks. Many of them rely on target neighborhood relationships that are computed in the original feature space and remain fixed throughout learning. As a result, the learned metric reflects the original neighborhood relations. We propose a novel formulation of the metric learning problem in which, in addition to the metric, the target neighborhood relations are also learned in a two-step iterative approach. The new formulation can be seen as a generalization of many existing metric learning methods. The formulation includes a target neighbor assignment rule that assigns different numbers of neighbors to instances according to their quality; `high quality' instances get more neighbors. We experiment with two of its instantiations that correspond to the metric learning algorithms LMNN and MCML and compare it to other metric learning methods on a number of datasets. The experimental results show state-of-the-art performance and provide evidence that learning the neighborhood relations does improve predictive performance.


title: The Chandra X-ray point source catalog in the DEEP2 Galaxy Redshift Survey fields

abstract: We present the X-ray point-source catalog produced from the Chandra Advanced CCD Imaging Spectrometer (ACIS-I) observations of the combined \sim3.2 deg2 DEEP2 (XDEEP2) survey fields, which consist of four ~0.7-1.1 deg2 fields. The combined total exposures across all four XDEEP2 fields range from ~10ks-1.1Ms. We detect X-ray point-sources in both the individual ACIS-I observations and the overlapping regions in the merged (stacked) images. We find a total of 2976 unique X-ray sources within the survey area with an expected false-source contamination of ~30 sources (~1%). We present the combined logN-logS distribution of sources detected across the XDEEP2 survey fields and find good agreement with the Extended Chandra Deep Field and Chandra-COSMOS fields to f_{X,0.5-2keV}\sim2x10^{-16} erg/cm^2/s. Given the large survey area of XDEEP2, we additionally place relatively strong constraints on the logN-logS distribution at high fluxes (f_{X,0.5-2keV}\sim3x10^{-14} erg/cm^2/s), and find a small systematic offset (a factor ~1.5) towards lower source numbers in this regime, when compared to smaller area surveys. The number counts observed in XDEEP2 are in close agreement with those predicted by X-ray background synthesis models. Additionally, we present a Bayesian-style method for associating the X-ray sources with optical photometric counterparts in the DEEP2 catalog (complete to R_AB < 25.2) and find that 2126 (~71.4\pm2.8%) of the 2976 X-ray sources presented here have a secure optical counterpart with a <6% contamination fraction. We provide the DEEP2 optical source properties (e.g., magnitude, redshift) as part of the X-ray-optical counterpart catalog.


title: 4MOST - 4-metre Multi-Object Spectroscopic Telescope

abstract: The 4MOST consortium is currently halfway through a Conceptual Design study for ESO with the aim to develop a wide-field (>3 square degree, goal >5 square degree), high-multiplex (>1500 fibres, goal 3000 fibres) spectroscopic survey facility for an ESO 4m-class telescope (VISTA). 4MOST will run permanently on the telescope to perform a 5 year public survey yielding more than 20 million spectra at resolution R~5000 ({\lambda}=390-1000 nm) and more than 2 million spectra at R~20,000 (395-456.5 nm & 587-673 nm). The 4MOST design is especially intended to complement three key all-sky, space-based observatories of prime European interest: Gaia, eROSITA and Euclid. Initial design and performance estimates for the wide-field corrector concepts are presented. We consider two fibre positioner concepts, a well-known Phi-Theta system and a new R-Theta concept with a large patrol area. The spectrographs are fixed configuration two-arm spectrographs, with dedicated spectrographs for the high- and low-resolution. A full facility simulator is being developed to guide trade-off decisions regarding the optimal field-of-view, number of fibres needed, and the relative fraction of high-to-low resolution fibres. Mock catalogues with template spectra from seven Design Reference Surveys are simulated to verify the science requirements of 4MOST. The 4MOST consortium aims to deliver the full 4MOST facility by the end of 2018 and start delivering high-level data products for both consortium and ESO community targets a year later with yearly increments.

categories: astro-ph.IM astro-ph.CO astro-ph.GA astro-ph.HE


title: Leptonic CP violation at neutrino telescopes

abstract: With the advent of the recent measurements in neutrino physics, we investigate the role of high-energy neutrino flux ratios at neutrino telescopes for the possibility of determining the leptonic CP-violating phase \delta and the underlying pattern of the leptonic mixing matrix. We find that the flux ratios show a dependence of O(10 %) on the CP-violating phase, and for optimistic uncertainties on the flux ratios less than 10 %, they can be used to distinguish between CP-conserving and CP-violating values of the phase at 2\sigma in a non-vanishing interval around the maximal value |\delta|=\pi/2.


title: 3.6 and 4.5 Micron Phase Curves and Evidence for Non-Equilibrium Chemistry in the Atmosphere of Extrasolar Planet HD 189733b

abstract: We present new, full-orbit observations of the infrared phase variations of the canonical hot Jupiter HD 189733b obtained in the 3.6 and 4.5 micron bands using the Spitzer Space Telescope. When combined with previous phase curve observations at 8.0 and 24 micron, these data allow us to characterize the exoplanet's emission spectrum as a function of planetary longitude. We utilize improved methods for removing the effects of intrapixel sensitivity variations and accounting for the presence of time-correlated noise in our data. We measure a phase curve amplitude of 0.1242% +/- 0.0061% in the 3.6 micron band and 0.0982% +/- 0.0089% in the 4.5 micron band. We find that the times of minimum and maximum flux occur several hours earlier than predicted for an atmosphere in radiative equilibrium, consistent with the eastward advection of gas by an equatorial super-rotating jet. The locations of the flux minima in our new data differ from our previous observations at 8 micron, and we present new evidence indicating that the flux minimum observed in the 8 micron is likely caused by an over-shooting effect in the 8 micron array. We obtain improved estimates for HD 189733b's dayside planet-star flux ratio of 0.1466% +/- 0.0040% at 3.6 micron and 0.1787% +/- 0.0038% at 4.5 micron; these are the most accurate secondary eclipse depths obtained to date for an extrasolar planet. We compare our new dayside and nightside spectra for HD 189733b to the predictions of models from Burrows et al. (2008) and Showman et al. (2009). We find that HD 189733b's 4.5 micron nightside flux is 3.3 sigma smaller than predicted by the Showman et al. models, which assume that the chemistry is in local thermal equilibrium. We conclude that this discrepancy is best-explained by vertical mixing, which should lead to an excess of CO and correspondingly enhanced 4.5 micron absorption in this region. [abridged]


title: Charginos Hiding In Plain Sight

abstract: Recent 7 TeV 5/fb measurements by ATLAS and CMS have measured both overall and differential WW cross sections that differ from NLO SM predictions. While these measurements aren't statistically significant enough to rule out the SM, we demonstrate that the data from both experiments can be better fit with the inclusion of electroweak gauginos with masses of O(100) GeV. We show that these new states are consistent with other experimental searches/measurements and can have ramifications for Higgs phenomenology. Additionally, we show how the first measurements of the WW cross section at 8 TeV by CMS strengthen our conclusions.


title: An HST/WFC3-IR Morphological Survey of Galaxies at z = 1.5-3.6: II. The Relation between Morphology and Gas-Phase Kinematics

abstract: We analyze rest-frame optical morphologies and gas-phase kinematics as traced by rest-frame far-UV and optical spectra for a sample of 204 star forming galaxies in the redshift range z ~ 2-3 drawn from the Keck Baryonic Structure Survey (KBSS). We find that spectroscopic properties and gas-phase kinematics are closely linked to morphology: compact galaxies with semi-major axis radii r <~ 2 kpc are substantially more likely than their larger counterparts to exhibit LyA in emission. Although LyA emission strength varies widely within galaxies of a given morphological type, all but one of 19 galaxies with LyA equivalent width W_LyA > 20 Angstroms have compact and/or multiple-component morphologies with r <= 2.5 kpc. The velocity structure of absorption lines in the galactic continuum spectra also varies as a function of morphology. Galaxies of all morphological types drive similarly strong outflows (as traced by the blue wing of interstellar absorption line features), but the outflows of larger galaxies are less highly ionized and exhibit larger optical depth at the systemic redshift that may correspond to a decreasing efficiency of feedback in evacuating gas from the galaxy. This v ~ 0 km/s gas is responsible both for shifting the mean absorption line redshift and attenuating W_LyA (via a longer resonant scattering path) in galaxies with larger rest-optical half light radii. In contrast to galaxies at lower redshifts, there is no evidence for a correlation between outflow velocity and inclination, suggesting that outflows from these puffy and irregular systems may be poorly collimated. (Abbrev.)


title: Cosmological Constraints from a Combination of Galaxy Clustering and Lensing -- I. Theoretical Framework

abstract: We present a new method that simultaneously solves for cosmology and galaxy bias on non-linear scales. The method uses the halo model to analytically describe the (non-linear) matter distribution, and the conditional luminosity function (CLF) to specify the halo occupation statistics. For a given choice of cosmological parameters, this model can be used to predict the galaxy luminosity function, as well as the two-point correlation functions of galaxies, and the galaxy-galaxy lensing signal, both as function of scale and luminosity. In this paper, the first in a series, we present the detailed, analytical model, which we test against mock galaxy redshift surveys constructed from high-resolution numerical $N$-body simulations. We demonstrate that our model, which includes scale-dependence of the halo bias and a proper treatment of halo exclusion, reproduces the 3-dimensional galaxy-galaxy correlation and the galaxy-matter cross-correlation (which can be projected to predict the observables) with an accuracy better than 10 (in most cases 5) percent. Ignoring either of these effects, as is often done, results in systematic errors that easily exceed 40 percent on scales of $\sim 1 h^{-1}\Mpc$, where the data is typically most accurate. Finally, since the projected correlation functions of galaxies are never obtained by integrating the redshift space correlation function along the line-of-sight out to infinity, simply because the data only cover a finite volume, they are still affected by residual redshift space distortions (RRSDs). Ignoring these, as done in numerous studies in the past, results in systematic errors that easily exceed 20 perent on large scales ($r_\rmp \gta 10 h^{-1}\Mpc$). We show that it is fairly straightforward to correct for these RRSDs, to an accuracy better than $\sim 2$ percent, using a mildly modified version of the linear Kaiser formalism.


title: Quantized Excitation Spectrum of the Classical Harmonic Oscillator in Zero-Point Radiation

abstract: We report that upon excitation by a single pulse, the classical harmonic oscillator immersed in classical electromagnetic zero-point radiation, as described by random electrodynamics, exhibits a quantized excitation spectrum in agreement to that of the quantum harmonic oscillator. This numerical result is interesting in view of the generally accepted idea that classical theories do not support quantized energy spectra.


title: Polarization of synchrotron emission from relativistic reconfinement shocks with ordered magnetic fields

abstract: We calculate the polarization of synchrotron radiation produced at the relativistic reconfinement shocks, taking into account globally ordered magnetic field components, in particular toroidal and helical fields. In these shocks, toroidal fields produce high parallel polarization (electric vectors parallel to the projected jet axis), while chaotic fields generate moderate perpendicular polarization. Helical fields result in a non-axisymmetric distribution of the total and polarized brightness. For a diverging downstream velocity field, the Stokes parameter U does not vanish and the average polarization is neither strictly parallel nor perpendicular. A distance at which the downstream flow is changing from diverging to converging can be easily identified on polarization maps as the turning point, at which polarization vectors switch, e.g., from clockwise to counterclockwise.


title: Understanding the Fanaroff-Riley radio galaxy classification

abstract: The simple, yet profoundly far-reaching classification scheme based on extended radio morphologies of radio galaxies, the Fanaroff-Riley classification has been a cornerstone in our understanding of radio galaxies. Over the decades since the recognition that there are two basic types of radio galaxy morphologies there have been several findings in different wavebands that have reported properties on different scales. Although it is realized that there may be intrinsic as well external causes an overarching view of how we may understand the two morphological types is missing. With the radio power-absolute magnitude relation (the Owen-Ledlow diagram) as backdrop we review and develop an understanding of the two radio galaxy types in the light of what is known about them. We have for the first time included the dust properties of the two FR classes together with the relative orientations of dust, host major axis and the radio axis to present a qualitative framework within which to understand the conditions under which they form. (Abridged).


title: Geometric Mixing, Peristalsis, and the Geometric Phase of the Stomach

abstract: Mixing fluid in a container at low Reynolds number - in an inertialess environment - is not a trivial task. Reciprocating motions merely lead to cycles of mixing and unmixing, so continuous rotation, as used in many technological applications, would appear to be necessary. However, there is another solution: movement of the walls in a cyclical fashion to introduce a geometric phase. We show using journal-bearing flow as a model that such geometric mixing is a general tool for using deformable boundaries that return to the same position to mix fluid at low Reynolds number. We then simulate a biological example: we show that mixing in the stomach functions because of the "belly phase": peristaltic movement of the walls in a cyclical fashion introduces a geometric phase that avoids unmixing.


title: An Analysis of Scheme Transformations in the Vicinity of an Infrared Fixed Point

abstract: We give a detailed analysis of the effects of scheme transformations in the vicinity of an exact or approximate infrared fixed point in an asymptotically free gauge theory with fermions. We list necessary conditions that such transformations must obey and show that, although these can easily be satisfied in the vicinity of an ultraviolet fixed point, they constitute significant restrictions on scheme transformations at an infrared fixed point. We construct acceptable scheme transformations and use these to study the scheme-dependence of an infrared fixed point, making comparison with our previous three-loop and four-loop calculations of the location of this point in the $\bar{MS}$ scheme. We also use an illustrative hypothetical exact $\beta$ function to investigate how accurately analyses of finite-order series expansions probe an infrared fixed point and the effect of a scheme transformation on these. Some implications of our work are discussed.


title: OPE of Wilson-'t Hooft operators in N=4 and N=2 SYM with gauge group G=PSU(3)

abstract: We compute the simplest non-trivial Operator Product Expansion of Wilson-'t Hooft loop operators in N=4 and N=2 Super-Yang-Mills theory with gauge group G=PSU(3). This amounts to finding the Euler characters of certain vector bundles, describing electric degrees of freedom of loop operators entering the OPE, over moduli spaces of BPS states in the presence of loop operators.


title: The Rate of Supernovae at Redshift 0.1-1.0 - the Stockholm VIMOS Supernova Survey IV

abstract: We present supernova rate measurements at redshift 0.1-1.0 from the Stockholm VIMOS Supernova Survey (SVISS). The sample contains 16 supernovae in total. The discovered supernovae have been classified as core collapse or type Ia supernovae (9 and 7, respectively) based on their light curves, colour evolution and host galaxy photometric redshift. The rates we find for the core collapse supernovae are 3.29 (-1.78,-1.45)(+3.08,+1.98) x 10^-4 yr^-1 Mpc^-3 h70^3 (with statistical and systematic errors respectively) at average redshift 0.39 and 6.40 (-3.12,-2.11)(+5.30,+3.65) x 10^-4 yr^-1 Mpc^-3 h70^3 at average redshift 0.73. For the type Ia supernovae we find a rate of 1.29 (-0.57,-0.28)(+0.88,+0.27) x 10^-4 yr^-1 Mpc^-3 h70^3 at average redshift 0.62. All of these rate estimates have been corrected for host galaxy extinction, using a method that includes supernovae missed in infrared bright galaxies at high redshift. We use Monte Carlo simulations to make a thorough study of the systematic effects from assumptions made when calculating the rates and find that the most important errors come from misclassification, the assumed mix of faint and bright supernova types and uncertainties in the extinction correction. We compare our rates to other observations and to the predicted rates for core collapse and type Ia supernovae based on the star formation history and different models of the delay time distribution. Overall, our measurements, when taking the effects of extinction into account, agree quite well with the predictions and earlier results. Our results highlight the importance of understanding the role of systematic effects, and dust extinction in particular, when trying to estimate the rates of supernovae at moderate to high redshift.


title: Can planetary instability explain the Kepler dichotomy?

abstract: The planet candidates discovered by the Kepler mission provide a rich sample to constrain the architectures and relative inclinations of planetary systems within approximately 0.5 AU of their host stars. We use the triple-transit systems from the Kepler 16-months data as templates for physical triple-planet systems and perform synthetic transit observations. We find that all the Kepler triple-transit and double-transit systems can be produced from the triple-planet templates, given a low mutual inclination of around five degrees. Our analysis shows that the Kepler data contains a population of planets larger than four Earth radii in single-transit systems that can not arise from the triple-planet templates. We explore the hypothesis that high-mass counterparts of the triple-transit systems underwent dynamical instability to produce a population of massive double-planet systems of moderately high mutual inclination. We perform N-body simulations of mass-boosted triple-planet systems and observe how the systems heat up and lose planets, most frequently by planet-planet collisions, yielding transits in agreement with the large planets in the Kepler single-transit systems. The resulting population of massive double-planet systems can nevertheless not explain the additional excess of low-mass planets among the observed single-transit systems and the lack of gas-giant planets in double-transit and triple-transit systems. Planetary instability of systems of triple gas-giant planets can be behind part of the dichotomy between systems hosting one or more small planets and those hosting a single giant planet. The main part of the dichotomy, however, is more likely to have arisen already during planet formation when the formation, migration or scattering of a massive planet, triggered above a threshold metallicity, suppressed the formation of other planets in sub-AU orbits.


title: Tandem halving problems by DCJ

abstract: This paper has been withdrawn by the author.


title: Stability of the Area Law for the Entropy of Entanglement

abstract: Recent results on the stability of the spectral gap under general perturbations for frustration-free Hamiltonians, have motivated the following question: Does the entanglement entropy of quantum states that are connected to states satisfying an area law along gapped Hamiltonian paths, also satisfy an area law? We answer this question in the affirmative, combining recent advances in quasi-adiabatic evolution and Lieb-Robinson bounds with ideas from the proof of the 1D area law.


title: Characterizing Near-Infrared Sky Brightness in the Canadian High Arctic

abstract: We present the first measurements of the near-infrared (NIR), specifically the J-band, sky background in the Canadian High Arctic. There has been considerable recent interest in the development of an astronomical observatory in Ellesmere Island; initial site testing has shown promise for a world-class site. Encouragement for our study came from sky background measurements on the high Antarctic glacial plateau in winter that showed markedly lower NIR emission when compared to good mid-latitude astronomical sites due to reduced emission from OH airglow lines. This is possibly a Polar effect and may also be present in the High Arctic. To test this hypothesis, we carried out an experiment which measured the the J-band sky brightness in the High Arctic during winter. We constructed a zenith-pointing, J-band photometer, and installed it at the Polar Environment Atmospheric Research Laboratory (PEARL) near Eureka, Nunavut (latitude: 80 degrees N). We present the design of our photometer and our results from our short PEARL observing campaign in February 2012. Taken over a period of four days, our measurements indicate that the J-band sky brightness varies between 15.5-15.9 mag arcsec^2, with a measurement uncertainty of 0.15 mag dominated entirely by systematic errors present in our radiometric calibration. On our best night, we measured a fairly consistent sky brightness of 15.8 +/- 0.15 mag arcsec^2. This is not corrected for atmospheric extinction, which is typically <0.1 mag in the J-band on a good night. The measured sky brightness is comparable to an excellent mid-latitude site, but is not as dark as claimed by the Antarctic measurements. We discuss possible explanations of why we do not see as dark skies as in the Antarctic. Future winter-long sky brightness measurements are anticipated to obtain the necessary statistics to make a proper comparison with the Antarctic measurements.


title: Non-perturbative Treatments of the Bosonic String and the Axion with Cosmological Implications

abstract: This paper is about the use of a novel, exact functional quantization method as applied to two commonly studied actions in theoretical physics. The functional method in question has its roots in the exact renormalisation group flow techniques pioneered by Wilson, but with the flow parameter not limited to the familiar momentum cutoff. Finding a configuration satisfying an expression for the exact effective action which does not vary with this parameter provides the basis for finding solutions to the physical actions we study. Firstly, the method is applied to an expression for the bare action of the pseudo-scalar axion used to explain the strong CP problem in QCD. When quantized, we find that the effective potential of the axion, when interactions are not considered, is necessarily flattened by spinodal instability effects. We regard this flattening asrepresenting the very early stage in the development of the axion potential, when the Peccei-Quinn U(1) symmetry is spontaneously broken resulting in a double-well potential. Using commonly quoted values for the parameters of such a potential, we devise an expression for the energy density of the emerging axion potential and this is compared to dark energy. We then apply the functional method to the bosonic string with time varying graviton, dilaton and antisymmetric tensor (resulting in the string-axion) background fields. We achieve a demonstration of conformal invariance in a non-perturbative manner in the beta functions, contrasting with conventional string cosmology where cancellation of a perturbative expansion is performed. We then offer some hints as to possible cosmological implications of our configuration in terms of optical anisotropy.


title: Constraining Sterile Neutrinos with AMANDA and IceCube Atmospheric Neutrino Data

abstract: We demonstrate that atmospheric neutrino data accumulated with the AMANDA and the partially deployed IceCube experiments constrain the allowed parameter space for a hypothesized fourth sterile neutrino beyond the reach of a combined analysis of all other experiments. We also illustrate the sensitivity of the completed IceCube detector, that is now taking data, to the parameter space of 3+1 model.


title: A network theory analysis of football strategies

abstract: We showcase in this paper the use of some tools from network theory to describe the strategy of football teams. Using passing data made available by FIFA during the 2010 World Cup, we construct for each team a weighted and directed network in which nodes correspond to players and arrows to passes. The resulting network or graph provides a direct visual inspection of a team's strategy, from which we can identify play pattern, determine hot-spots on the play and localize potential weaknesses. Using different centrality measures, we can also determine the relative importance of each player in the game, the `popularity' of a player, and the effect of removing players from the game.


title: Markov-Chain Monte-Carlo A Bayesian Approach to Statistical Mechanics

abstract: Since the middle of the 1940's scientists have used Monte Carlo (MC) simulations to obtain information about physical processes. This has proved a accurate and and reliable method to obtain this information. Through out resent years researchers has begone to use the slightly newer Markov Chain Monte Carlo (MCMC) simulation. This differs from the ordinary MC by using the Markov Chain. MCMC originates from Bayesian statistics. This method has given researchers a completely new tool to learn something about physical systems. One of the fields where MCMC is a good new tool, is astrophysics. Today MCMC is widely used in simulating power spectra for asteroseismic data. Hereby providing the scientists with important new information of stellar interiors. From our results we see that MCMC delivers a robust and reliable result with good error estimation. We also learn that MCMC is a power full tool which can be applied to a large verity of problems.


title: Theory of Spin Relaxation in Two-Electron Lateral Coupled Si/SiGe Quantum Dots

abstract: Highly accurate numerical results of phonon-induced two-electron spin relaxation in silicon double quantum dots are presented. The relaxation, enabled by spin-orbit coupling and the nuclei of $^{29}$Si (natural or purified abundance), are investigated for experimentally relevant parameters, the interdot coupling, the magnetic field magnitude and orientation, and the detuning. We calculate relaxation rates for zero and finite temperatures (100 mK), concluding that our findings for zero temperature remain qualitatively valid also for 100 mK. We confirm the same anisotropic switch of the axis of prolonged spin lifetime with varying detuning as recently predicted in GaAs. Conditions for possibly hyperfine-dominated relaxation are much more stringent in Si than in GaAs. For experimentally relevant regimes, the spin-orbit coupling, although weak, is the dominant contribution, yielding anisotropic relaxation rates of at least two order of magnitude lower than in GaAs.


title: K-orbit closures on G/B as universal degeneracy loci for flagged vector bundles with symmetric or skew-symmetric bilinear form

abstract: We use equivariant localization and divided difference operators to determine formulas for the torus-equivariant fundamental cohomology classes of $K$-orbit closures on the flag variety $G/B$, where $G = GL(n,\C)$, and where $K$ is one of the symmetric subgroups $O(n,\C)$ or $Sp(n,\C)$. We realize these orbit closures as universal degeneracy loci for a vector bundle over a variety equipped with a single flag of subbundles and a nondegenerate symmetric or skew-symmetric bilinear form taking values in the trivial bundle. We describe how our equivariant formulas can be interpreted as giving formulas for the classes of such loci in terms of the Chern classes of the various bundles.


title: Computing Higher Indicators for the Double of a Symmetric Group

abstract: In this paper we explicitly determine all indicators for the Drinfel'd doubles of the symmetric group acting upon up to 10 objects. We explore when distinct characters give exactly the same indicators and when the indicators have a zero value. We find that the indicators are all non-negative integers, which supports our conjecture that the indicators for the Drinfel'd double of any symmetric group will be non-negative integers, just as they are for the symmetric groups themselves.


title: Demonstration of Jarzynski's Equality in Open Quantum Systems Using a Step-Wise Pulling Protocol

abstract: We present a generalization of Jarzynski's Equality, applicable to quantum systems, relating discretized mechanical work and free-energy changes. The theory is based on a step-wise pulling protocol. We find that work distribution functions can be constructed from fluctuations of a reaction coordinate along a reaction pathway in the step-wise pulling protocol. We also propose two sets of equations to determine the two possible optimal pathways that provide the most significant contributions to free-energy changes. We find that the transitions along these most optimal pathways, satisfying both sets of equations, follow the principle of detailed balance. We then test the theory by explicitly computing the free-energy changes for a one-dimensional quantum harmonic oscillator. This approach suggests a feasible way of measuring the fluctuations to experimentally test Jarzynski's Equality in many-body systems, such as Bose-Einstein condensates.

categories: quant-ph physics.chem-ph physics.comp-ph physics.data-an


title: Basic Singular Spectrum Analysis and Forecasting with R

abstract: Singular Spectrum Analysis (SSA) as a tool for analysis and forecasting of time series is considered. The main features of the Rssa package, which implements the SSA algorithms and methodology in R, are described and examples of its use are presented. Analysis, forecasting and parameter estimation are demonstrated by means of case study with an accompanying code in R.


title: On the Nature of X(4260)

abstract: We study the property of $X(4260)$ resonance by re-analyzing all experimental data available, especially the $e^+e^- \rightarrow J/\psi\,\pi^+\pi^-,\,\,\,\omega\chi_{c0}$ cross section data. The final state interactions of the $\pi\pi$, $K\bar K$ couple channel system are also taken into account. A sizable coupling between the $X(4260)$ and $\omega\chi_{c0}$ is found. The inclusion of the $\omega\chi_{c0}$ data indicates a small value of $\Gamma_{e^+e^-}=23.30\pm 3.55$eV.