title: The Development of Supergravity Grand Unification: Circa 1982-85

abstract: The development in the early eighties of supergravity grand unified models with gravity mediated breaking of supersymmetry, has led to a remarkable progress in the study of supersymmetry at colliders, in dark matter and in a variety of other experimental searches in the intervening years since that time. The purpose of this note is to review this development and describe our construction of this theory in the period 1982-85.


title: A Schwarz lemma for K\"ahler affine metrics and the canonical potential of a proper convex cone

abstract: This is an account of some aspects of the geometry of K\"ahler affine metrics based on considering them as smooth metric measure spaces and applying the comparison geometry of Bakry-Emery Ricci tensors. Such techniques yield a version for K\"ahler affine metrics of Yau's Schwarz lemma for volume forms. By a theorem of Cheng and Yau there is a canonical K\"ahler affine Einstein metric on a proper convex domain, and the Schwarz lemma gives a direct proof of its uniqueness up to homothety. The potential for this metric is a function canonically associated to the cone, characterized by the property that its level sets are hyperbolic affine spheres foliating the cone. It is shown that for an $n$-dimensional cone a rescaling of the canonical potential is an $n$-normal barrier function in the sense of interior point methods for conic programming. It is explained also how to construct from the canonical potential Monge-Amp\`ere metrics of both Riemannian and Lorentzian signatures, and a mean curvature zero conical Lagrangian submanifold of the flat para-K\"ahler space.


title: Optimizing the eigenvector computation algorithm with diffusion approach

abstract: In this paper, we apply the ideas of the matrix column based diffusion approach to define a new eigenvector computation algorithm of a stationary probability of a Markov chain.


title: Quantum Walks on Trees with Disorder: Decay, Diffusion, and Localization

abstract: Quantum walks have been shown to have impressive transport properties compared to classical random walks. However, imperfections in the quantum walk algorithm can destroy any quantum mechanical speed-up due to Anderson localization. We numerically study the effect of static disorder on a quantum walk on the glued trees graph. For small disorder, we find that the dominant effect is a type of quantum decay, and not quantum localization. For intermediate disorder, there is a crossover to diffusive transport, while a localization transition is observed at large disorder, in agreement with Anderson localization on the Cayley tree.


title: Flip Distance Between Triangulations of a Planar Point Set is APX-Hard

abstract: In this work we consider triangulations of point sets in the Euclidean plane, i.e., maximal straight-line crossing-free graphs on a finite set of points. Given a triangulation of a point set, an edge flip is the operation of removing one edge and adding another one, such that the resulting graph is again a triangulation. Flips are a major way of locally transforming triangular meshes. We show that, given a point set $S$ in the Euclidean plane and two triangulations $T_1$ and $T_2$ of $S$, it is an APX-hard problem to minimize the number of edge flips to transform $T_1$ to $T_2$.


title: Automated Analysis of Scenario-based Specifications of Distributed Access Control Policies with Non-Mechanizable Activities (Extended Version)

abstract: The advance of web services technologies promises to have far-reaching effects on the Internet and enterprise networks allowing for greater accessibility of data. The security challenges presented by the web services approach are formidable. In particular, access control solutions should be revised to address new challenges, such as the need of using certificates for the identification of users and their attributes, human intervention in the creation or selection of the certificates, and (chains of) certificates for trust management. With all these features, it is not surprising that analyzing policies to guarantee that a sensitive resource can be accessed only by authorized users becomes very difficult. In this paper, we present an automated technique to analyze scenario-based specifications of access control policies in open and distributed systems. We illustrate our ideas on a case study arising in the e-government area.


title: Universal dynamics on the way to thermalisation

abstract: It is demonstrated how a many-body system far from thermal equilibrium can exhibit universal dynamics in passing a non-thermal fixed point. As an example, the process of Bose-Einstein (BE) condensation of a dilute cold gas is considered. If the particle flux into the low-energy modes, induced, e.g., by a cooling quench, is sufficiently strong, the Bose gas develops a characteristic power-law single-particle spectrum $n(k)\sim k^{-5}$, and critical slowing down in time occurs. The fixed point is shown to be marked by the creation and dilution of tangled vortex lines. Alternatively, for a weak cooling quench and particle flux, the condensation process runs quasi adiabatically, passing by the fixed point in far distance, and signatures of critical scaling remain absent.

categories: cond-mat.quant-gas cond-mat.stat-mech hep-ph physics.flu-dyn


title: Software Model Checking with Explicit Scheduler and Symbolic Threads

abstract: In many practical application domains, the software is organized into a set of threads, whose activation is exclusive and controlled by a cooperative scheduling policy: threads execute, without any interruption, until they either terminate or yield the control explicitly to the scheduler. The formal verification of such software poses significant challenges. On the one side, each thread may have infinite state space, and might call for abstraction. On the other side, the scheduling policy is often important for correctness, and an approach based on abstracting the scheduler may result in loss of precision and false positives. Unfortunately, the translation of the problem into a purely sequential software model checking problem turns out to be highly inefficient for the available technologies. We propose a software model checking technique that exploits the intrinsic structure of these programs. Each thread is translated into a separate sequential program and explored symbolically with lazy abstraction, while the overall verification is orchestrated by the direct execution of the scheduler. The approach is optimized by filtering the exploration of the scheduler with the integration of partial-order reduction. The technique, called ESST (Explicit Scheduler, Symbolic Threads) has been implemented and experimentally evaluated on a significant set of benchmarks. The results demonstrate that ESST technique is way more effective than software model checking applied to the sequentialized programs, and that partial-order reduction can lead to further performance improvements.


title: The enumeration of three pattern classes

abstract: The structure of three pattern classes Av(2143, 4321), Av(2143, 4312) and Av(1324, 4312) is determined using the machinery of monotone grid classes. This allows the permutations in these classes to be described in terms of simple diagrams and regular languages and, using this, the rational generating functions which enumerate these classes are determined.


title: Bayesian feedback control of a two-atom spin-state in an atom-cavity system

abstract: We experimentally demonstrate real-time feedback control of the joint spin-state of two neutral Caesium atoms inside a high finesse optical cavity. The quantum states are discriminated by their different cavity transmission levels. A Bayesian update formalism is used to estimate state occupation probabilities as well as transition rates. We stabilize the balanced two-atom mixed state, which is deterministically inaccessible, via feedback control and find very good agreement with Monte-Carlo simulations. On average, the feedback loops achieves near optimal conditions by steering the system to the target state marginally exceeding the time to retrieve information about its state.


title: Mass flow rates in and outflow rates from AGN accretion discs

abstract: We derive analytical expressions for the mass flow rates in and from accretion discs, taking into account the Eddington limit. This allows us to connect the basic properties of outflows with those of the accretion flow. As an example, we derive the radial surface density distribution in the accretion disc of Mrk 231.


title: The LS method for the classical groups in positive characteristic and the Riemann Hypothesis

abstract: We provide a definition for an extended system of $\gamma$-factors for products of generic representations $\tau$ and $\pi$ of split classical groups or general linear groups over a non-archimedean local field of characteristic $p$. We prove that our $\gamma$-factors satisfy a list of axioms (under the assumption $p \neq 2$ when both groups are classical groups) and show their uniqueness (in general). This allows us to define extended local $L$-functions and root numbers. We then obtain automorphic $L$-functions $L(s,\tau \times \pi)$, where $\tau$ and $\pi$ are globally generic cuspidal automorphic representations of split classical groups or general linear groups over a global function field. In addition to rationality and the functional equation, we prove that our automorphic $L$-functions satisfy the Riemann Hypothesis.


title: The local circular law II: the edge case

abstract: In the first part of this article, we proved a local version of the circular law up to the finest scale $N^{-1/2+ \e}$ for non-Hermitian random matrices at any point $z \in \C$ with $||z| - 1| > c $ for any $c>0$ independent of the size of the matrix. Under the main assumption that the first three moments of the matrix elements match those of a standard Gaussian random variable after proper rescaling, we extend this result to include the edge case $ |z|-1=\oo(1)$. Without the vanishing third moment assumption, we prove that the circular law is valid near the spectral edge $ |z|-1=\oo(1)$ up to scale $N^{-1/4+ \e}$.


title: Measurements of the polarisation amplitudes and triple product asymmetries in B_s^0 to phi phi

abstract: Using 1fb^{-1} of pp collision data collected at center of mass energy sqrt{s} = 7 TeV during 2011 by the LHCb detector. Measurements of the triple product asymmetries, polarisation amplitudes and strong phase difference in the decay B_s^0 to phi phi are presented.


title: A New Representation for the Symbol Error Rate

abstract: The symbol error rate of the minimum distance detector for an arbitrary multi-dimensional constellation impaired by additive white Gaussian noise is characterized as the product of a completely monotone function with a non-negative power of the signal to noise ratio. This representation is also shown to apply to cases when the impairing noise is compound Gaussian. Using this general result, it is proved that the symbol error rate is completely monotone if the rank of its constellation matrix is either one or two. Further, a necessary and sufficient condition for the complete monotonicity of the symbol error rate of a constellation of any dimension is also obtained. Applications to stochastic ordering of wireless system performance are also discussed.


title: The supersymmetric black holes of N=8 supergravity

abstract: Using the general results on the classification of timelike supersymmetric solutions of all 4-dimensional N >1 supergravity theories, we show how to construct all the supersymmetric (single- and multi-) black-hole solutions of N=8 supergravity.


title: Alchemical Inflation: inflaton turns into Higgs

abstract: We propose a new inflation model in which a gauge singlet inflaton turns into the Higgs condensate after inflation. The inflationary path is characterized by a moduli space of supersymmetric vacua spanned by the inflaton and Higgs field. The inflation energy scale is related to the soft supersymmetry breaking, and the Hubble parameter during inflation is smaller than the gravitino mass. The initial condition for the successful inflation is naturally realized by the pre-inflation in which the Higgs plays a role of the waterfall field.


title: A Three-Dimensional Treatment of the Three-Nucleon Bound State

abstract: Recently a formalism for a direct treatment of the Faddeev equation for the three-nucleon bound state in three dimensions has been proposed. It relies on an operator representation of the Faddeev component in the momentum space and leads to a finite set of coupled equations for scalar functions which depend only on three variables. In this paper we provide further elements of this formalism and show the first numerical results for chiral NNLO nuclear forces.


title: Torpid Mixing of Local Markov Chains on 3-Colorings of the Discrete Torus

abstract: We study local Markov chains for sampling 3-colorings of the discrete torus $T_{L,d}={0,..., L-1}^d$. We show that there is a constant $\rho \approx .22$ such that for all even $L \geq 4$ and $d$ sufficiently large, certain local Markov chains require exponential time to converge to equilibrium. More precisely, if $\cM$ is a Markov chain on the set of proper 3-colorings of $T_{L,d}$ that updates the color of at most $\rho L^d$ vertices at each step and whose stationary distribution is uniform, then the convergence to stationarity of $\cM$ is exponential in $L^{d-1}$. Our proof is based on a conductance argument that builds on sensitive new combinatorial enumeration techniques.


title: Overview of Deeply Virtual Compton Scattering at HERMES

abstract: Deeply Virtual Compton Scattering represents the best experimental channel through which to understand Generalised Parton Distributions. The HERMES experiment measured the most diverse set of DVCS results of any experiment; this talk discusses the most recent sets of DVCS results released by HERMES and the unique experimental conditions found at HERMES that facilitated the measurements. We also examine the various ways in which the HERMES experimental measurements are being used to constrain GPDs and how future experiments can learn from the HERMES program.


title: New tools for classifying Hamiltonian circle actions with isolated fixed points

abstract: For every compact almost complex manifold (M,J) equipped with a J-preserving circle action with isolated fixed points, a simple algebraic identity involving the first Chern class is derived. This enables us to construct an algorithm to obtain linear relations among the isotropy weights at the fixed points. Suppose that M is symplectic and the action is Hamiltonian. If the manifold satisfies an extra "positivity condition" this algorithm determines a family of vector spaces which contain the admissible lattices of weights. When the number of fixed points is minimal, this positivity condition is necessarily satisfied whenever dim(M)< 8, and, when dim(M)=8, whenever the S^1-action extends to an effective Hamiltonian T^2-action, or none of the isotropy weights is 1. Moreover there are no known examples with a minimal number of fixed points contradicting this condition, and their existence is related to interesting questions regarding fake projective spaces [Y]. We run the algorithm for dim(M)< 10, quickly obtaining all the possible families of isotropy weights. In particular, we simplify the proofs of Ahara and Tolman for dim(M)=6 [Ah,T1] and, when dim(M)=8, we prove that the equivariant cohomology ring, Chern classes and isotropy weights agree with the ones of C P^4 with the standard S^1-action (thus proving the symplectic Petrie conjecture [T1] in this setting).


title: A concentration phenomenon for semilinear elliptic equations

abstract: For a domain $\Omega\subset\dR^N$ we consider the equation $ -\Delta u + V(x)u = Q_n(x)\abs{u}^{p-2}u$ with zero Dirichlet boundary conditions and $p\in(2,2^*)$. Here $V\ge 0$ and $Q_n$ are bounded functions that are positive in a region contained in $\Omega$ and negative outside, and such that the sets $\{Q_n>0\}$ shrink to a point $x_0\in\Omega$ as $n\to\infty$. We show that if $u_n$ is a nontrivial solution corresponding to $Q_n$, then the sequence $(u_n)$ concentrates at $x_0$ with respect to the $H^1$ and certain $L^q$-norms. We also show that if the sets $\{Q_n>0\}$ shrink to two points and $u_n$ are ground state solutions, then they concentrate at one of these points.


title: Ulrich ideals and modules

abstract: In this paper we study Ulrich ideals of and Ulrich modules over Cohen--Macaulay local rings from various points of view. We determine the structure of minimal free resolutions of Ulrich modules and their associated graded modules, and classify Ulrich ideals of numerical semigroup rings and rings of finite CM-representation type.


title: Rho-0 Meson Helicity Amplitude Ratios at HERMES

abstract: The study of {\rho}0 meson helicity amplitude ratios at HERMES shows that the amplitude hierarchy expected from pQCD is confirmed. The contribution of Unnatural Parity Exchange in the production of {\rho}0 mesons is significant at HERMES kinematics and there is a large phase-difference in the leading F11 and F01 amplitudes. The kinematic dependences of the amplitude ratios only sometimes follow theory-based expectations.


title: Strong asymptotics for Cauchy biorthogonal polynomials with application to the Cauchy two--matrix model

abstract: We apply the nonlinear steepest descent method to a class of 3x3 Riemann-Hilbert problems introduced in connection with the Cauchy two-matrix random model. The general case of two equilibrium measures supported on an arbitrary number of intervals is considered. In this case, we solve the Riemann-Hilbert problem for the outer parametrix in terms of sections of a spinorial line bundle on a three-sheeted Riemann surface of arbitrary genus and establish strong asymptotic results for the Cauchy biorthogonal polynomials.


title: Bounding the partition function of spin-systems

abstract: With a graph $G=(V,E)$ we associate a collection of non-negative real weights $\cup_{v\in V}{\lambda_{i,v}:1\leq i \leq m} \cup \cup_{uv \in E} {\lambda_{ij,uv}:1\leq i \leq j \leq m}$. We consider the probability distribution on ${f:V\rightarrow{1,...,m}}$ in which each $f$ occurs with probability proportional to $\prod_{v \in V}\lambda_{f(v),v}\prod_{uv \in E}\lambda_{f(u)f(v),uv}$. Many well-known statistical physics models, including the Ising model with an external field and the hard-core model with non-uniform activities, can be framed as such a distribution. We obtain an upper bound, independent of $G$, for the partition function (the normalizing constant which turns the assignment of weights on $\{f:V\rightarrow{1,...,m\}}$ into a probability distribution) in the case when $G$ is a regular bipartite graph. This generalizes a bound obtained by Galvin and Tetali who considered the simpler weight collection $\{\lambda_i:1 \leq i \leq m\} \cup \{\lambda_{ij}:1 \leq i \leq j \leq m\}$ with each $\lambda_{ij}$ either 0 or 1 and with each $f$ chosen with probability proportional to $\prod_{v \in V}\lambda_{f(v)}\prod_{uv \in E}\lambda_{f(u)f(v)}$. Our main tools are a generalization to list homomorphisms of a result of Galvin and Tetali on graph homomorphisms and a straightforward second-moment computation.


title: Numerical renormalization group calculation of impurity internal energy and specific heat of quantum impurity models

abstract: We introduce a method to obtain the specific heat of quantum impurity models via a direct calculation of the impurity internal energy requiring only the evaluation of local quantities within a single numerical renormalization group (NRG) calculation for the total system. For the Anderson impurity model, we show that the impurity internal energy can be expressed as a sum of purely local static correlation functions and a term that involves also the impurity Green function. The temperature dependence of the latter can be neglected in many cases, thereby allowing the impurity specific heat, $C_{\rm imp}$, to be calculated accurately from local static correlation functions; specifically via $C_{\rm imp}=\frac{\partial E_{\rm ionic}}{\partial T} + 1/2\frac{\partial E_{\rm hyb}}{\partial T}$, where $E_{\rm ionic}$ and $E_{\rm hyb}$ are the energies of the (embedded) impurity and the hybridization energy, respectively. The term involving the Green function can also be evaluated in cases where its temperature dependence is non-negligible, adding an extra term to $C_{\rm imp}$. For the non-degenerate Anderson impurity model, we show by comparison with exact Bethe ansatz calculations that the results recover accurately both the Kondo induced peak in the specific heat at low temperatures as well as the high temperature peak due to the resonant level. The approach applies to multiorbital and multichannel Anderson impurity models with arbitrary local Coulomb interactions. An application to the Ohmic two state system and the anisotropic Kondo model is also given, with comparisons to Bethe ansatz calculations. The new approach could also be of interest within other impurity solvers, e.g., within quantum Monte Carlo techniques.


title: Sampling 3-colourings of regular bipartite graphs

abstract: We show that if $\gS=(V,E)$ is a regular bipartite graph for which the expansion of subsets of a single parity of $V$ is reasonably good and which satisfies a certain local condition (that the union of the neighbourhoods of adjacent vertices does not contain too many pairwise non-adjacent vertices), and if $\cM$ is a Markov chain on the set of proper 3-colourings of $\gS$ which updates the colour of at most $\rho|V|$ vertices at each step and whose stationary distribution is uniform, then for $\rho \approx .22$ and $d$ sufficiently large the convergence to stationarity of $\cM$ is (essentially) exponential in $|V|$. In particular, if $\gS$ is the $d$-dimensional hypercube $Q_d$ (the graph on vertex set $\{0,1\}^d$ in which two strings are adjacent if they differ on exactly one coordinate) then the convergence to stationarity of the well-known Glauber (single-site update) dynamics is exponentially slow in $2^d/(\sqrt{d}\log d)$. A combinatorial corollary of our main result is that in a uniform 3-colouring of $Q_d$ there is an exponentially small probability (in $2^d$) that there is a colour $i$ such the proportion of vertices of the even subcube coloured $i$ differs from the proportion of the odd subcube coloured $i$ by at most $.22$. Our proof combines a conductance argument with combinatorial enumeration methods.


title: Conductance fluctuations in quasi-two-dimensional systems: a practical view

abstract: The universal conductance fluctuations of quasi-two-dimensional systems are analyzed with experimental considerations in mind. The traditional statistical metrics of these fluctuations (such as variance) are shown to have large statistical errors in such systems. An alternative characteristic is identified, the inflection point of the correlation function in magnetic field, which is shown to be significantly more useful as an experimental metric and to give a more robust measure of phase coherence.


title: Improved Spectral-Norm Bounds for Clustering

abstract: Aiming to unify known results about clustering mixtures of distributions under separation conditions, Kumar and Kannan[2010] introduced a deterministic condition for clustering datasets. They showed that this single deterministic condition encompasses many previously studied clustering assumptions. More specifically, their proximity condition requires that in the target $k$-clustering, the projection of a point $x$ onto the line joining its cluster center $\mu$ and some other center $\mu'$, is a large additive factor closer to $\mu$ than to $\mu'$. This additive factor can be roughly described as $k$ times the spectral norm of the matrix representing the differences between the given (known) dataset and the means of the (unknown) target clustering. Clearly, the proximity condition implies center separation -- the distance between any two centers must be as large as the above mentioned bound. In this paper we improve upon the work of Kumar and Kannan along several axes. First, we weaken the center separation bound by a factor of $\sqrt{k}$, and secondly we weaken the proximity condition by a factor of $k$. Using these weaker bounds we still achieve the same guarantees when all points satisfy the proximity condition. We also achieve better guarantees when only $(1-\epsilon)$-fraction of the points satisfy the weaker proximity condition. The bulk of our analysis relies only on center separation under which one can produce a clustering which (i) has low error, (ii) has low $k$-means cost, and (iii) has centers very close to the target centers. Our improved separation condition allows us to match the results of the Planted Partition Model of McSherry[2001], improve upon the results of Ostrovsky et al[2006], and improve separation results for mixture of Gaussian models in a particular setting.


title: Resonant Excitation of Graphene K-Phonon and Intra-Landau-Level Excitons in Magneto-Optical Spectroscopy

abstract: Precise infrared magnetotransmission experiments have been performed in magnetic fields up to 32 T on a series of multilayer epitaxial graphene samples. We observe changes in the spectral features and broadening of the main cyclotron transition when the incoming photon energy is in resonance with the lowest Landau level separation and the energy of a K point optical phonon. We have developed a theory that explains and quantitatively reproduces the frequency and magnetic field dependence of the phenomenon as the absorption of a photon together with the simultaneous creation of an intervalley, intra-Landau-level exciton, and a K phonon.


title: Two problems on independent sets in graphs

abstract: Let $i_t(G)$ denote the number of independent sets of size $t$ in a graph $G$. Levit and Mandrescu have conjectured that for all bipartite $G$ the sequence $(i_t(G))_{t \geq 0}$ (the {\em independent set sequence} of $G$) is unimodal. We provide evidence for this conjecture by showing that is true for almost all equibipartite graphs. Specifically, we consider the random equibipartite graph $G(n,n,p)$, and show that for any fixed $p\in(0,1]$ its independent set sequence is almost surely unimodal, and moreover almost surely log-concave except perhaps for a vanishingly small initial segment of the sequence. We obtain similar results for $p=\tilde{\Omega}(n^{-1/2})$. We also consider the problem of estimating $i(G)=\sum_{t \geq 0} i_t(G)$ for $G$ in various families. We give a sharp upper bound on the number of independent sets in an $n$-vertex graph with minimum degree $\delta$, for all fixed $\delta$ and sufficiently large $n$. Specifically, we show that the maximum is achieved uniquely by $K_{\delta, n-\delta}$, the complete bipartite graph with $\delta$ vertices in one partition class and $n-\delta$ in the other. We also present a weighted generalization: for all fixed $x>0$ and $\delta >0$, as long as $n=n(x,\delta)$ is large enough, if $G$ is a graph on $n$ vertices with minimum degree $\delta$ then $\sum_{t \geq 0} i_t(G)x^t \leq \sum_{t \geq 0} i_t(K_{\delta, n-\delta})x^t$ with equality if and only if $G=K_{\delta, n-\delta}$.


title: Non-Gaussian statistics and extreme waves in a nonlinear optical cavity

abstract: A unidirectional optical oscillator is built by using a liquid crystal light-valve that couples a pump beam with the modes of a nearly spherical cavity. For sufficiently high pump intensity, the cavity field presents a complex spatio-temporal dynamics, accompanied by the emission of extreme waves and large deviations from the Gaussian statistics. We identify a mechanism of spatial symmetry breaking, due to a hypercycle-type amplification through the nonlocal coupling of the cavity field.


title: Subconvexity and equidistribution of Heegner points in the level aspect

abstract: Let q be a prime and -D < -4 be an odd fundamental discriminant such that q splits in Q(\sqrt{-D}). For f a weight zero Hecke-Maass newform of level q and h the weight one theta series of level D corresponding to an ideal class group character of Q(\sqrt{-D}), we establish a hybrid subconvexity bound for L(f \times h,s) at the central point when q = D^{\eta} for 0 < \eta < 1. With this circle of ideas, we show that the Heegner points of level q and discriminant D become equidistributed, in a natural sense, as q, D become large with q < D^{1/20-\varepsilon}. Our approach to these problems is connected to estimating the L^2-restriction norm of a Maass form of large level when restricted to the collection of Heegner points. We furthermore establish bounds for quadratic twists of Hecke-Maass L-functions with simultaneously large level and large quadratic twist, and hybrid bounds for quadratic Dirichlet L-functions in certain ranges.


title: Performance of first-order methods for smooth convex minimization: a novel approach

abstract: We introduce a novel approach for analyzing the performance of first-order black-box optimization methods. We focus on smooth unconstrained convex minimization over the Euclidean space $R^d$. Our approach relies on the observation that by definition, the worst case behavior of a black-box optimization method is by itself an optimization problem, which we call the Performance Estimation Problem (PEP). We formulate and analyze the PEP for two classes of first-order algorithms. We first apply this approach on the classical gradient method and derive a new and tight analytical bound on its performance. We then consider a broader class of first-order black-box methods, which among others, include the so-called heavy-ball method and the fast gradient schemes. We show that for this broader class, it is possible to derive new numerical bounds on the performance of these methods by solving an adequately relaxed convex semidefinite PEP. Finally, we show an efficient procedure for finding optimal step sizes which results in a first-order black-box method that achieves best performance.


title: A refined and unified version of the inverse scattering method for the Ablowitz-Ladik lattice and derivative NLS lattices

abstract: We refine and develop the inverse scattering theory on a lattice in such a way that the Ablowitz-Ladik lattice and derivative NLS lattices as well as their matrix analogs can be solved in a unified way. The inverse scattering method for the (matrix analog of the) Ablowitz-Ladik lattice is simplified to the same level as that for the continuous NLS system. Using the linear eigenfunctions of the Lax pair for the Ablowitz-Ladik lattice, we can construct solutions of the derivative NLS lattices such as the discrete Gerdjikov-Ivanov (also known as Ablowitz-Ramani-Segur) system and the discrete Kaup-Newell system. Thus, explicit solutions such as the multisoliton solutions for these systems can be obtained by solving linear summation equations of the Gel'fand-Levitan-Marchenko type. The derivation of the discrete Kaup-Newell system from the Ablowitz-Ladik lattice is based on a new method that allows us to generate new integrable systems from known systems in a systematic manner. In an appendix, we describe the reduction of the matrix Ablowitz-Ladik lattice to a vector analog of the modified Volterra lattice from the point of view of the inverse scattering method.

categories: nlin.SI math-ph math.AP math.CA math.MP math.SP


title: Matchings and Independent Sets of a Fixed Size in Regular Graphs

abstract: We use an entropy based method to study two graph maximization problems. We upper bound the number of matchings of fixed size $\ell$ in a $d$-regular graph on $N$ vertices. For $\frac{2\ell}{N}$ bounded away from 0 and 1, the logarithm of the bound we obtain agrees in its leading term with the logarithm of the number of matchings of size $\ell$ in the graph consisting of $\frac{N}{2d}$ disjoint copies of the complete bipartite graph $K_{d,d}$. This provides asymptotic evidence for a conjecture of S. Friedland {\it et al.}. We also obtain an analogous result for independent sets of a fixed size in regular graphs, giving asymptotic evidence for a conjecture of J. Kahn. Our bounds on the number of matchings and independent sets of a fixed size are derived from bounds on the partition function (or generating polynomial) for matchings and independent sets.


title: All noncontextuality inequalities for the n-cycle scenario

abstract: The problem of separating classical from quantum correlations is in general intractable and has been solved explicitly only in few cases. In particular, known methods cannot provide general solutions for an arbitrary number of settings. We provide the complete characterization of the classical correlations and the corresponding maximal quantum violations for the case of n >= 4 observables X_0, ...,X_{n-1}, where each consecutive pair {X_i,X_{i+1}}, sum modulo n, is jointly measurable. This generalizes both the Clauser-Horne-Shimony-Holt and the Klyachko-Can-Binicioglu-Shumovsky scenarios, which are the simplest ones for, respectively, locality and noncontextuality. In addition, we provide explicit quantum states and settings with maximal quantum violation and minimal quantum dimension.


title: Superradiant phase transitions with three-level systems

abstract: We determine the phase diagram of $N$ identical three-level systems interacting with a single photonic mode in the thermodynamical limit ($N \to \infty$) by accounting for the so-called diamagnetic term and the inequalities imposed by the Thomas-Reich-Kuhn (TRK) oscillator strength sum rule. The key role of transitions between excited levels and the occurrence of first-order phase transitions is discussed. We show that, in contrast to two-level systems, in the three-level case the TRK inequalities do not always prevent a superradiant phase transition in presence of a diamagnetic term.


title: The Multifractal Spectra of V-Statistics

abstract: Let $(X, T)$ be a topological dynamical system and let $\Phi: X^r \to \mathbb{R}$ be a continuous function on the product space $X^r= X\times ... \times X$ ($r\ge 1$). We are interested in the limit of V-statistics taking $\Phi$ as kernel: [\lim_{n\to \infty} n^{-r}\sum_{1\le i_1, ..., i_r\le n} \Phi(T^{i_1}x, ..., T^{i_r} x).] The multifractal spectrum of topological entropy of the above limit is expressed by a variational principle when the system satisfies the specification property. Unlike the classical case ($r=1$) where the spectrum is an analytic function when $\Phi$ is H\"{o}lder continuous, the spectrum of the limit of higher order V-statistics ($r\ge 2$) may be discontinuous even for very nice kernel $\Phi$.


title: Performance of FORTRAN and C GPU Extensions for a Benchmark Suite of Fourier Pseudospectral Algorithms

abstract: A comparison of PGI OpenACC, FORTRAN CUDA, and Nvidia CUDA pseudospectral methods on a single GPU and GCC FORTRAN on single and multiple CPU cores is reported. The GPU implementations use CuFFT and the CPU implementations use FFTW. Porting pre-existing FORTRAN codes to utilize a GPUs is efficient and easy to implement with OpenACC and CUDA FORTRAN. Example programs are provided.


title: Spin-Orbital Liquid on a Triangular Lattice

abstract: Using Lanczos exact diagonalization of finite clusters we demonstrate that the spin-orbital $d^1$ model for triply degenerate $t_{2g}$ orbitals on a triangular lattice provides an example of a spin-orbital liquid ground state. We also show that the spin-orbital liquid involves entangled valence bond states which violate the Goodenough-Kanamori rules, and modify effective spin exchange constants.


title: Symmetrically reduced Galileon equations and solutions

abstract: The maximally complicated arbitrary-dimensional "maximal" Galileon field equations simplify dramatically for symmetric configurations. Thus, spherical symmetry reduces the equations from the D- to the two-dimensional Monge-Ampere equation, axial symmetry to its cubic extension etc. We can then obtain explicit solutions, such as spherical or axial waves, and relate them to the (known) general, but highly implicit, lower-D solutions.


title: On the polynomial Lindenstrauss theorem

abstract: Under certain hypotheses on the Banach space $X$, we show that the set of $N$-homogeneous polynomials from $X$ to any dual space, whose Aron-Berner extensions are norm attaining, is dense in the space of all continuous $N$-homogeneous polynomials. To this end we prove an integral formula for the duality between tensor products and polynomials. We also exhibit examples of Lorentz sequence spaces for which there is no polynomial Bishop-Phelps theorem, but our results apply. Finally we address quantitative versions, in the sense of Bollob\'as, of these results.


title: Generalized Wasserstein distance and its application to transport equations with source

abstract: In this article, we generalize the Wasserstein distance to measures with different masses. We study the properties of such distance. In particular, we show that it metrizes weak convergence for tight sequences. We use this generalized Wasserstein distance to study a transport equation with source, in which both the vector field and the source depend on the measure itself. We prove existence and uniqueness of the solution to the Cauchy problem when the vector field and the source are Lipschitzian with respect to the generalized Wasserstein distance.


title: Valuation and parities for exchange options

abstract: Valuation and parity formulas for both European-style and American-style exchange options are presented in a general financial model allowing for jumps, possibility of default and "bubbles" in asset prices. The formulas are given via expectations of auxiliary probabilities using the change-of-numeraire technique. Extensive discussion is provided regarding the way that folklore results such as Merton's no-early-exercise theorem and traditional parity relations have to be altered in this more versatile framework.


title: Compositions of Integers With Bounded Parts

abstract: In this note, we consider ordered partitions of integers such that each entry is no more than a fixed portion of the sum. We give a method for constructing all such compositions as well as both an explicit formula and a generating function describing the number of $k$-tuples whose entries are bounded in this way and sum to a fixed value $g$.


title: Adaptive pupil masking for quasi-static speckle suppression

abstract: Quasi-static speckles are a current limitation to faint companion imaging of bright stars. Here we show through simulation and theory that an adaptive pupil mask can be used to reduce these speckles and increase the visibility of faint companions. This is achieved by placing an adaptive mask in the conjugate pupil plane of the telescope. The mask consists of a number of independently controllable elements which can either allow the light in the subaperture to pass or block it. This actively changes the shape of the telescope pupil and hence the diffraction pattern in the focal plane. By randomly blocking subapertures we force the quasi-static speckles to become dynamic. The long exposure PSF is then smooth, absent of quasi-static speckles. However, as the PSF will now contain a larger halo due to the blocking, the signal to noise ratio (SNR) is reduced requiring longer exposure times to detect the companion. For example, in the specific case of a faint companion at 5xlambda/D the exposure time to achieve the same SNR will be increased by a factor of 1.35. In addition, we show that the visibility of companions can be greatly enhanced in comparison to long-exposures, when the dark speckle method is applied to short exposure images taken with the adaptive pupil mask. We show that the contrast ratio between PSF peak and the halo is then increased by a factor of approximately 100 (5 magnitudes), and we detect companions 11 magnitudes fainter than the star at 5xlambda/D and up to 18 magnitudes fainter at 22.5xlambda/D.


title: A Depth-Optimal Canonical Form for Single-qubit Quantum Circuits

abstract: Given an arbitrary single-qubit operation, an important task is to efficiently decompose this operation into an (exact or approximate) sequence of fault-tolerant quantum operations. We derive a depth-optimal canonical form for single-qubit quantum circuits, and the corresponding rules for exactly reducing an arbitrary single-qubit circuit to this canonical form. We focus on the single-qubit universal H,T basis due to its role in fault-tolerant quantum computing, and show how our formalism might be extended to other universal bases. We then extend our canonical representation to the family of Solovay-Kitaev decomposition algorithms, in order to find an \epsilon-approximation to the single-qubit circuit in polylogarithmic time. For a given single-qubit operation, we find significantly lower-depth \epsilon-approximation circuits than previous state-of-the-art implementations. In addition, the implementation of our algorithm requires significantly fewer resources, in terms of computation memory, than previous approaches.


title: Baryon chiral perturbation theory transferred to hole-doped antiferromagnets on the honeycomb lattice

abstract: A systematic low-energy effective field theory for hole-doped antiferromagnets on the honeycomb lattice is constructed. The formalism is then used to investigate spiral phases in the staggered magnetization as well as the formation of two-hole bound states.


title: An energy approach to the problem of uniqueness for the Ricci flow

abstract: We revisit the problem of uniqueness for the Ricci flow and give a short, direct proof, based on the consideration of a simple energy quantity, of Hamilton/Chen-Zhu's theorem on the uniqueness of complete solutions of uniformly bounded curvature. With a variation of this quantity and technique, we further prove a uniqueness theorem for subsolutions to a general class of mixed differential inequalities which implies an extension of Chen-Zhu's result to solutions (and initial data) of potentially unbounded curvature.


title: Topological superconductivity and Majorana fermions in hybrid structures involving cuprate high-T_c superconductors

abstract: The possibility of inducing topological superconductivity with cuprate high-temperature superconductors (HTSC) is studied for various heterostructures. We first consider a ballistic planar junction between a HTSC and a metallic ferromagnet. We assume that inversion symmetry breaking at the tunnel barrier gives rise to Rashba spin-orbit coupling in the barrier and allows equal-spin triplet superconductivity to exist in the ferromagnet. Bogoliubov-de Gennes equations are obtained by explicitly modeling the barrier, and taking account of the transport anisotropy in the HTSC. By making use of the self-consistent boundary conditions and solutions for the barrier and HTSC regions, an effective equation of motion for the ferromagnet is obtained where Andreev scattering at the barrier is incorporated as a boundary condition for the ferromagnetic region. For a ferromagnet layer deposited on a (100) facet of the HTSC, triplet p-wave superconductivity is induced. For the layer deposited on a (110) facet, the induced gap does not have the p-wave orbital character, but has an even orbital symmetry and an odd dependence on energy. For the layer on the (001) facet, an exotic f-wave superconductivity is induced. We also consider the induced triplet gap in a one-dimensional half-metallic nanowire deposited on a (001) facet of a HTSC. We find that for a wire axis along the a-axis, a robust triplet p-wave gap is induced. For a wire oriented 45 degrees away from the a-axis the induced triplet p-wave gap vanishes. For the appropriately oriented wire, the induced p-wave gap should give rise to Majorana fermions at the ends of the half-metallic wire. Based on our result, topological superconductivity in a semi-conductor nanowire may also be possible given that it is oriented along the a-axis of the HTSC.


title: Proposal For Neuromorphic Hardware Using Spin Devices

abstract: We present a design-scheme for ultra-low power neuromorphic hardware using emerging spin-devices. We propose device models for 'neuron', based on lateral spin valves and domain wall magnets that can operate at ultra-low terminal voltage of ~20 mV, resulting in small computation energy. Magnetic tunnel junctions are employed for interfacing the spin-neurons with charge-based devices like CMOS, for large-scale networks. Device-circuit co-simulation-framework is used for simulating such hybrid designs, in order to evaluate system-level performance. We present the design of different classes of neuromorphic architectures using the proposed scheme that can be suitable for different applications like, analog-data-sensing, data-conversion, cognitive-computing, associative memory, programmable-logic and analog and digital signal processing. We show that the spin-based neuromorphic designs can achieve 15X-300X lower computation energy for these applications; as compared to state of art CMOS designs.


title: Novel Branches of (0,2) Theories

abstract: We show that recently proposed linear sigma models with torsion can be obtained from unconventional branches of conventional gauge theories. This observation puts models with log interactions on firm footing. If non-anomalous multiplets are integrated out, the resulting low-energy theory involves log interactions of neutral fields. For these cases, we find a sigma model geometry which is both non-toric and includes brane sources. These are heterotic sigma models with branes. Surprisingly, there are massive models with compact complex non-Kahler target spaces, which include brane/anti-brane sources. The simplest conformal models describe wrapped heterotic NS5-branes. We present examples of both types.


title: Solving the Vlasov equation for one-dimensional models with long range interactions on a GPU

abstract: We present a GPU parallel implementation of the numeric integration of the Vlasov equation in one spatial dimension based on a second order time-split algorithm with a local modified cubic-spline interpolation. We apply our approach to three different systems with long-range interactions: the Hamiltonian Mean Field, Ring and the self-gravitating sheet models. Speedups and accuracy for each model and different grid resolutions are presented.


title: On the Components of an Odd Perfect Number

abstract: If $N = {p^k}{m^2}$ is an odd perfect number with special prime factor $p$, then it is proved that ${p^k} < (2/3){m^2}$. Numerical results on the abundancy indices $\frac{\sigma(p^k)}{p^k}$ and $\frac{\sigma(m^2)}{m^2}$, and the ratios $\frac{\sigma(p^k)}{m^2}$ and $\frac{\sigma(m^2)}{p^k}$, are used. It is also showed that $m^2 > \frac{\sqrt{6}}{2}({10}^{150})$.


title: CORL: A Continuous-state Offset-dynamics Reinforcement Learner

abstract: Continuous state spaces and stochastic, switching dynamics characterize a number of rich, realworld domains, such as robot navigation across varying terrain. We describe a reinforcementlearning algorithm for learning in these domains and prove for certain environments the algorithm is probably approximately correct with a sample complexity that scales polynomially with the state-space dimension. Unfortunately, no optimal planning techniques exist in general for such problems; instead we use fitted value iteration to solve the learned MDP, and include the error due to approximate planning in our bounds. Finally, we report an experiment using a robotic car driving over varying terrain to demonstrate that these dynamics representations adequately capture real-world dynamics and that our algorithm can be used to efficiently solve such problems.


title: AND/OR Importance Sampling

abstract: The paper introduces AND/OR importance sampling for probabilistic graphical models. In contrast to importance sampling, AND/OR importance sampling caches samples in the AND/OR space and then extracts a new sample mean from the stored samples. We prove that AND/OR importance sampling may have lower variance than importance sampling; thereby providing a theoretical justification for preferring it over importance sampling. Our empirical evaluation demonstrates that AND/OR importance sampling is far more accurate than importance sampling in many cases.


title: Speeding Up Planning in Markov Decision Processes via Automatically Constructed Abstractions

abstract: In this paper, we consider planning in stochastic shortest path (SSP) problems, a subclass of Markov Decision Problems (MDP). We focus on medium-size problems whose state space can be fully enumerated. This problem has numerous important applications, such as navigation and planning under uncertainty. We propose a new approach for constructing a multi-level hierarchy of progressively simpler abstractions of the original problem. Once computed, the hierarchy can be used to speed up planning by first finding a policy for the most abstract level and then recursively refining it into a solution to the original problem. This approach is fully automated and delivers a speed-up of two orders of magnitude over a state-of-the-art MDP solver on sample problems while returning near-optimal solutions. We also prove theoretical bounds on the loss of solution optimality resulting from the use of abstractions.


title: Adaptive Inference on General Graphical Models

abstract: Many algorithms and applications involve repeatedly solving variations of the same inference problem; for example we may want to introduce new evidence to the model or perform updates to conditional dependencies. The goal of adaptive inference is to take advantage of what is preserved in the model and perform inference more rapidly than from scratch. In this paper, we describe techniques for adaptive inference on general graphs that support marginal computation and updates to the conditional probabilities and dependencies in logarithmic time. We give experimental results for an implementation of our algorithm, and demonstrate its potential performance benefit in the study of protein structure.


title: Identifying reasoning patterns in games

abstract: We present an algorithm that identifies the reasoning patterns of agents in a game, by iteratively examining the graph structure of its Multi-Agent Influence Diagram (MAID) representation. If the decision of an agent participates in no reasoning patterns, then we can effectively ignore that decision for the purpose of calculating a Nash equilibrium for the game. In some cases, this can lead to exponential time savings in the process of equilibrium calculation. Moreover, our algorithm can be used to enumerate the reasoning patterns in a game, which can be useful for constructing more effective computerized agents interacting with humans.


title: Learning Inclusion-Optimal Chordal Graphs

abstract: Chordal graphs can be used to encode dependency models that are representable by both directed acyclic and undirected graphs. This paper discusses a very simple and efficient algorithm to learn the chordal structure of a probabilistic model from data. The algorithm is a greedy hill-climbing search algorithm that uses the inclusion boundary neighborhood over chordal graphs. In the limit of a large sample size and under appropriate hypotheses on the scoring criterion, we prove that the algorithm will find a structure that is inclusion-optimal when the dependency model of the data-generating distribution can be represented exactly by an undirected graph. The algorithm is evaluated on simulated datasets.


title: Clique Matrices for Statistical Graph Decomposition and Parameterising Restricted Positive Definite Matrices

abstract: We introduce Clique Matrices as an alternative representation of undirected graphs, being a generalisation of the incidence matrix representation. Here we use clique matrices to decompose a graph into a set of possibly overlapping clusters, de ned as well-connected subsets of vertices. The decomposition is based on a statistical description which encourages clusters to be well connected and few in number. Inference is carried out using a variational approximation. Clique matrices also play a natural role in parameterising positive de nite matrices under zero constraints on elements of the matrix. We show that clique matrices can parameterise all positive de nite matrices restricted according to a decomposable graph and form a structured Factor Analysis approximation in the non-decomposable case.


title: Greedy Block Coordinate Descent for Large Scale Gaussian Process Regression

abstract: We propose a variable decomposition algorithm -greedy block coordinate descent (GBCD)- in order to make dense Gaussian process regression practical for large scale problems. GBCD breaks a large scale optimization into a series of small sub-problems. The challenge in variable decomposition algorithms is the identification of a subproblem (the active set of variables) that yields the largest improvement. We analyze the limitations of existing methods and cast the active set selection into a zero-norm constrained optimization problem that we solve using greedy methods. By directly estimating the decrease in the objective function, we obtain not only efficient approximate solutions for GBCD, but we are also able to demonstrate that the method is globally convergent. Empirical comparisons against competing dense methods like Conjugate Gradient or SMO show that GBCD is an order of magnitude faster. Comparisons against sparse GP methods show that GBCD is both accurate and capable of handling datasets of 100,000 samples or more.


title: On Identifying Total Effects in the Presence of Latent Variables and Selection bias

abstract: Assume that cause-effect relationships between variables can be described as a directed acyclic graph and the corresponding linear structural equation model.We consider the identification problem of total effects in the presence of latent variables and selection bias between a treatment variable and a response variable. Pearl and his colleagues provided the back door criterion, the front door criterion (Pearl, 2000) and the conditional instrumental variable method (Brito and Pearl, 2002) as identifiability criteria for total effects in the presence of latent variables, but not in the presence of selection bias. In order to solve this problem, we propose new graphical identifiability criteria for total effects based on the identifiable factor models. The results of this paper are useful to identify total effects in observational studies and provide a new viewpoint to the identification conditions of factor models.


title: Complexity of Inference in Graphical Models

abstract: It is well-known that inference in graphical models is hard in the worst case, but tractable for models with bounded treewidth. We ask whether treewidth is the only structural criterion of the underlying graph that enables tractable inference. In other words, is there some class of structures with unbounded treewidth in which inference is tractable? Subject to a combinatorial hypothesis due to Robertson et al. (1994), we show that low treewidth is indeed the only structural restriction that can ensure tractability. Thus, even for the "best case" graph structure, there is no inference algorithm with complexity polynomial in the treewidth.


title: Approximating the Partition Function by Deleting and then Correcting for Model Edges

abstract: We propose an approach for approximating the partition function which is based on two steps: (1) computing the partition function of a simplified model which is obtained by deleting model edges, and (2) rectifying the result by applying an edge-by-edge correction. The approach leads to an intuitive framework in which one can trade-off the quality of an approximation with the complexity of computing it. It also includes the Bethe free energy approximation as a degenerate case. We develop the approach theoretically in this paper and provide a number of empirical results that reveal its practical utility.


title: Multi-View Learning in the Presence of View Disagreement

abstract: Traditional multi-view learning approaches suffer in the presence of view disagreement,i.e., when samples in each view do not belong to the same class due to view corruption, occlusion or other noise processes. In this paper we present a multi-view learning approach that uses a conditional entropy criterion to detect view disagreement. Once detected, samples with view disagreement are filtered and standard multi-view learning methods can be successfully applied to the remaining samples. Experimental evaluation on synthetic and audio-visual databases demonstrates that the detection and filtering of view disagreement considerably increases the performance of traditional multi-view learning approaches.


title: Bounds on the Bethe Free Energy for Gaussian Networks

abstract: We address the problem of computing approximate marginals in Gaussian probabilistic models by using mean field and fractional Bethe approximations. As an extension of Welling and Teh (2001), we define the Gaussian fractional Bethe free energy in terms of the moment parameters of the approximate marginals and derive an upper and lower bound for it. We give necessary conditions for the Gaussian fractional Bethe free energies to be bounded from below. It turns out that the bounding condition is the same as the pairwise normalizability condition derived by Malioutov et al. (2006) as a sufficient condition for the convergence of the message passing algorithm. By giving a counterexample, we disprove the conjecture in Welling and Teh (2001): even when the Bethe free energy is not bounded from below, it can possess a local minimum to which the minimization algorithms can converge.


title: Bayesian network learning by compiling to weighted MAX-SAT

abstract: The problem of learning discrete Bayesian networks from data is encoded as a weighted MAX-SAT problem and the MaxWalkSat local search algorithm is used to address it. For each dataset, the per-variable summands of the (BDeu) marginal likelihood for different choices of parents ('family scores') are computed prior to applying MaxWalkSat. Each permissible choice of parents for each variable is encoded as a distinct propositional atom and the associated family score encoded as a 'soft' weighted single-literal clause. Two approaches to enforcing acyclicity are considered: either by encoding the ancestor relation or by attaching a total order to each graph and encoding that. The latter approach gives better results. Learning experiments have been conducted on 21 synthetic datasets sampled from 7 BNs. The largest dataset has 10,000 datapoints and 60 variables producing (for the 'ancestor' encoding) a weighted CNF input file with 19,932 atoms and 269,367 clauses. For most datasets, MaxWalkSat quickly finds BNs with higher BDeu score than the 'true' BN. The effect of adding prior information is assessed. It is further shown that Bayesian model averaging can be effected by collecting BNs generated during the search.


title: Identifying Optimal Sequential Decisions

abstract: We consider conditions that allow us to find an optimal strategy for sequential decisions from a given data situation. For the case where all interventions are unconditional (atomic), identifiability has been discussed by Pearl & Robins (1995). We argue here that an optimal strategy must be conditional, i.e. take the information available at each decision point into account. We show that the identification of an optimal sequential decision strategy is more restrictive, in the sense that conditional interventions might not always be identified when atomic interventions are. We further demonstrate that a simple graphical criterion for the identifiability of an optimal strategy can be given.


title: Strategy Selection in Influence Diagrams using Imprecise Probabilities

abstract: This paper describes a new algorithm to solve the decision making problem in Influence Diagrams based on algorithms for credal networks. Decision nodes are associated to imprecise probability distributions and a reformulation is introduced that finds the global maximum strategy with respect to the expected utility. We work with Limited Memory Influence Diagrams, which generalize most Influence Diagram proposals and handle simultaneous decisions. Besides the global optimum method, we explore an anytime approximate solution with a guaranteed maximum error and show that imprecise probabilities are handled in a straightforward way. Complexity issues and experiments with random diagrams and an effects-based military planning problem are discussed.


title: Learning Convex Inference of Marginals

abstract: Graphical models trained using maximum likelihood are a common tool for probabilistic inference of marginal distributions. However, this approach suffers difficulties when either the inference process or the model is approximate. In this paper, the inference process is first defined to be the minimization of a convex function, inspired by free energy approximations. Learning is then done directly in terms of the performance of the inference process at univariate marginal prediction. The main novelty is that this is a direct minimization of emperical risk, where the risk measures the accuracy of predicted marginals.


title: Knowledge Combination in Graphical Multiagent Model

abstract: A graphical multiagent model (GMM) represents a joint distribution over the behavior of a set of agents. One source of knowledge about agents' behavior may come from gametheoretic analysis, as captured by several graphical game representations developed in recent years. GMMs generalize this approach to express arbitrary distributions, based on game descriptions or other sources of knowledge bearing on beliefs about agent behavior. To illustrate the flexibility of GMMs, we exhibit game-derived models that allow probabilistic deviation from equilibrium, as well as models based on heuristic action choice. We investigate three different methods of integrating these models into a single model representing the combined knowledge sources. To evaluate the predictive performance of the combined model, we treat as actual outcome the behavior produced by a reinforcement learning process. We find that combining the two knowledge sources, using any of the methods, provides better predictions than either source alone. Among the combination methods, mixing data outperforms the opinion pool and direct update methods investigated in this empirical trial.


title: Projected Subgradient Methods for Learning Sparse Gaussians

abstract: Gaussian Markov random fields (GMRFs) are useful in a broad range of applications. In this paper we tackle the problem of learning a sparse GMRF in a high-dimensional space. Our approach uses the l1-norm as a regularization on the inverse covariance matrix. We utilize a novel projected gradient method, which is faster than previous methods in practice and equal to the best performing of these in asymptotic complexity. We also extend the l1-regularized objective to the problem of sparsifying entire blocks within the inverse covariance matrix. Our methods generalize fairly easily to this case, while other methods do not. We demonstrate that our extensions give better generalization performance on two real domains--biological network analysis and a 2D-shape modeling image task.


title: Almost Optimal Intervention Sets for Causal Discovery

abstract: We conjecture that the worst case number of experiments necessary and sufficient to discover a causal graph uniquely given its observational Markov equivalence class can be specified as a function of the largest clique in the Markov equivalence class. We provide an algorithm that computes intervention sets that we believe are optimal for the above task. The algorithm builds on insights gained from the worst case analysis in Eberhardt et al. (2005) for sequences of experiments when all possible directed acyclic graphs over N variables are considered. A simulation suggests that our conjecture is correct. We also show that a generalization of our conjecture to other classes of possible graph hypotheses cannot be given easily, and in what sense the algorithm is then no longer optimal.


title: Gibbs Sampling in Factorized Continuous-Time Markov Processes

abstract: A central task in many applications is reasoning about processes that change over continuous time. Continuous-Time Bayesian Networks is a general compact representation language for multi-component continuous-time processes. However, exact inference in such processes is exponential in the number of components, and thus infeasible for most models of interest. Here we develop a novel Gibbs sampling procedure for multi-component processes. This procedure iteratively samples a trajectory for one of the components given the remaining ones. We show how to perform exact sampling that adapts to the natural time scale of the sampled process. Moreover, we show that this sampling procedure naturally exploits the structure of the network to reduce the computational cost of each step. This procedure is the first that can provide asymptotically unbiased approximation in such processes.


title: Convex Point Estimation using Undirected Bayesian Transfer Hierarchies

abstract: When related learning tasks are naturally arranged in a hierarchy, an appealing approach for coping with scarcity of instances is that of transfer learning using a hierarchical Bayes framework. As fully Bayesian computations can be difficult and computationally demanding, it is often desirable to use posterior point estimates that facilitate (relatively) efficient prediction. However, the hierarchical Bayes framework does not always lend itself naturally to this maximum aposteriori goal. In this work we propose an undirected reformulation of hierarchical Bayes that relies on priors in the form of similarity measures. We introduce the notion of "degree of transfer" weights on components of these similarity measures, and show how they can be automatically learned within a joint probabilistic framework. Importantly, our reformulation results in a convex objective for many learning problems, thus facilitating optimal posterior point estimation using standard optimization techniques. In addition, we no longer require proper priors, allowing for flexible and straightforward specification of joint distributions over transfer hierarchies. We show that our framework is effective for learning models that are part of transfer hierarchies for two real-life tasks: object shape modeling using Gaussian density estimation and document classification.


title: Learning and Solving Many-Player Games through a Cluster-Based Representation

abstract: In addressing the challenge of exponential scaling with the number of agents we adopt a cluster-based representation to approximately solve asymmetric games of very many players. A cluster groups together agents with a similar "strategic view" of the game. We learn the clustered approximation from data consisting of strategy profiles and payoffs, which may be obtained from observations of play or access to a simulator. Using our clustering we construct a reduced "twins" game in which each cluster is associated with two players of the reduced game. This allows our representation to be individually- responsive because we align the interests of every individual agent with the strategy of its cluster. Our approach provides agents with higher payoffs and lower regret on average than model-free methods as well as previous cluster-based methods, and requires only few observations for learning to be successful. The "twins" approach is shown to be an important component of providing these low regret approximations.


title: Latent Topic Models for Hypertext

abstract: Latent topic models have been successfully applied as an unsupervised topic discovery technique in large document collections. With the proliferation of hypertext document collection such as the Internet, there has also been great interest in extending these approaches to hypertext [6, 9]. These approaches typically model links in an analogous fashion to how they model words - the document-link co-occurrence matrix is modeled in the same way that the document-word co-occurrence matrix is modeled in standard topic models. In this paper we present a probabilistic generative model for hypertext document collections that explicitly models the generation of links. Specifically, links from a word w to a document d depend directly on how frequent the topic of w is in d, in addition to the in-degree of d. We show how to perform EM learning on this model efficiently. By not modeling links as analogous to words, we end up using far fewer free parameters and obtain better link prediction results.


title: Church: a language for generative models

abstract: We introduce Church, a universal language for describing stochastic generative processes. Church is based on the Lisp model of lambda calculus, containing a pure Lisp as its deterministic subset. The semantics of Church is defined in terms of evaluation histories and conditional distributions on such histories. Church also includes a novel language construct, the stochastic memoizer, which enables simple description of many complex non-parametric models. We illustrate language features through several examples, including: a generalized Bayes net in which parameters cluster over trials, infinite PCFGs, planning by inference, and various non-parametric clustering models. Finally, we show how to implement query on any Church program, exactly and approximately, using Monte Carlo techniques.


title: Multi-View Learning over Structured and Non-Identical Outputs

abstract: In many machine learning problems, labeled training data is limited but unlabeled data is ample. Some of these problems have instances that can be factored into multiple views, each of which is nearly sufficent in determining the correct labels. In this paper we present a new algorithm for probabilistic multi-view learning which uses the idea of stochastic agreement between views as regularization. Our algorithm works on structured and unstructured problems and easily generalizes to partial agreement scenarios. For the full agreement case, our algorithm minimizes the Bhattacharyya distance between the models of each view, and performs better than CoBoosting and two-view Perceptron on several flat and structured classification problems.


title: Constrained Approximate Maximum Entropy Learning of Markov Random Fields

abstract: Parameter estimation in Markov random fields (MRFs) is a difficult task, in which inference over the network is run in the inner loop of a gradient descent procedure. Replacing exact inference with approximate methods such as loopy belief propagation (LBP) can suffer from poor convergence. In this paper, we provide a different approach for combining MRF learning and Bethe approximation. We consider the dual of maximum likelihood Markov network learning - maximizing entropy with moment matching constraints - and then approximate both the objective and the constraints in the resulting optimization problem. Unlike previous work along these lines (Teh & Welling, 2003), our formulation allows parameter sharing between features in a general log-linear model, parameter regularization and conditional training. We show that piecewise training (Sutton & McCallum, 2005) is a very restricted special case of this formulation. We study two optimization strategies: one based on a single convex approximation and one that uses repeated convex approximations. We show results on several real-world networks that demonstrate that these algorithms can significantly outperform learning with loopy and piecewise. Our results also provide a framework for analyzing the trade-offs of different relaxations of the entropy objective and of the constraints.


title: Toward Experiential Utility Elicitation for Interface Customization

abstract: User preferences for automated assistance often vary widely, depending on the situation, and quality or presentation of help. Developing effectivemodels to learn individual preferences online requires domain models that associate observations of user behavior with their utility functions, which in turn can be constructed using utility elicitation techniques. However, most elicitation methods ask for users' predicted utilities based on hypothetical scenarios rather than more realistic experienced utilities. This is especially true in interface customization, where users are asked to assess novel interface designs. We propose experiential utility elicitation methods for customization and compare these to predictivemethods. As experienced utilities have been argued to better reflect true preferences in behavioral decision making, the purpose here is to investigate accurate and efficient procedures that are suitable for software domains. Unlike conventional elicitation, our results indicate that an experiential approach helps people understand stochastic outcomes, as well as better appreciate the sequential utility of intelligent assistance.


title: Cumulative distribution networks and the derivative-sum-product algorithm

abstract: We introduce a new type of graphical model called a "cumulative distribution network" (CDN), which expresses a joint cumulative distribution as a product of local functions. Each local function can be viewed as providing evidence about possible orderings, or rankings, of variables. Interestingly, we find that the conditional independence properties of CDNs are quite different from other graphical models. We also describe a messagepassing algorithm that efficiently computes conditional cumulative distributions. Due to the unique independence properties of the CDN, these messages do not in general have a one-to-one correspondence with messages exchanged in standard algorithms, such as belief propagation. We demonstrate the application of CDNs for structured ranking learning using a previously-studied multi-player gaming dataset.


title: Causal discovery of linear acyclic models with arbitrary distributions

abstract: An important task in data analysis is the discovery of causal relationships between observed variables. For continuous-valued data, linear acyclic causal models are commonly used to model the data-generating process, and the inference of such models is a well-studied problem. However, existing methods have significant limitations. Methods based on conditional independencies (Spirtes et al. 1993; Pearl 2000) cannot distinguish between independence-equivalent models, whereas approaches purely based on Independent Component Analysis (Shimizu et al. 2006) are inapplicable to data which is partially Gaussian. In this paper, we generalize and combine the two approaches, to yield a method able to learn the model structure in many cases for which the previous methods provide answers that are either incorrect or are not as informative as possible. We give exact graphical conditions for when two distinct models represent the same family of distributions, and empirically demonstrate the power of our method through thorough simulations.


title: Learning When to Take Advice: A Statistical Test for Achieving A Correlated Equilibrium

abstract: We study a multiagent learning problem where agents can either learn via repeated interactions, or can follow the advice of a mediator who suggests possible actions to take. We present an algorithmthat each agent can use so that, with high probability, they can verify whether or not the mediator's advice is useful. In particular, if the mediator's advice is useful then agents will reach a correlated equilibrium, but if the mediator's advice is not useful, then agents are not harmed by using our test, and can fall back to their original learning algorithm. We then generalize our algorithm and show that in the limit it always correctly verifies the mediator's advice.


title: Convergent Message-Passing Algorithms for Inference over General Graphs with Convex Free Energies

abstract: Inference problems in graphical models can be represented as a constrained optimization of a free energy function. It is known that when the Bethe free energy is used, the fixedpoints of the belief propagation (BP) algorithm correspond to the local minima of the free energy. However BP fails to converge in many cases of interest. Moreover, the Bethe free energy is non-convex for graphical models with cycles thus introducing great difficulty in deriving efficient algorithms for finding local minima of the free energy for general graphs. In this paper we introduce two efficient BP-like algorithms, one sequential and the other parallel, that are guaranteed to converge to the global minimum, for any graph, over the class of energies known as "convex free energies". In addition, we propose an efficient heuristic for setting the parameters of the convex free energy based on the structure of the graph.


title: Sparse Stochastic Finite-State Controllers for POMDPs

abstract: Bounded policy iteration is an approach to solving infinite-horizon POMDPs that represents policies as stochastic finite-state controllers and iteratively improves a controller by adjusting the parameters of each node using linear programming. In the original algorithm, the size of the linear programs, and thus the complexity of policy improvement, depends on the number of parameters of each node, which grows with the size of the controller. But in practice, the number of parameters of a node with non-zero values is often very small, and does not grow with the size of the controller. Based on this observation, we develop a version of bounded policy iteration that leverages the sparse structure of a stochastic finite-state controller. In each iteration, it improves a policy by the same amount as the original algorithm, but with much better scalability.


title: Sampling First Order Logical Particles

abstract: Approximate inference in dynamic systems is the problem of estimating the state of the system given a sequence of actions and partial observations. High precision estimation is fundamental in many applications like diagnosis, natural language processing, tracking, planning, and robotics. In this paper we present an algorithm that samples possible deterministic executions of a probabilistic sequence. The algorithm takes advantage of a compact representation (using first order logic) for actions and world states to improve the precision of its estimation. Theoretical and empirical results show that the algorithm's expected error is smaller than propositional sampling and Sequential Monte Carlo (SMC) sampling techniques.


title: The Computational Complexity of Sensitivity Analysis and Parameter Tuning

abstract: While known algorithms for sensitivity analysis and parameter tuning in probabilistic networks have a running time that is exponential in the size of the network, the exact computational complexity of these problems has not been established as yet. In this paper we study several variants of the tuning problem and show that these problems are NPPP-complete in general. We further show that the problems remain NP-complete or PP-complete, for a number of restricted variants. These complexity results provide insight in whether or not recent achievements in sensitivity analysis and tuning can be extended to more general, practicable methods.


title: Partitioned Linear Programming Approximations for MDPs

abstract: Approximate linear programming (ALP) is an efficient approach to solving large factored Markov decision processes (MDPs). The main idea of the method is to approximate the optimal value function by a set of basis functions and optimize their weights by linear programming (LP). This paper proposes a new ALP approximation. Comparing to the standard ALP formulation, we decompose the constraint space into a set of low-dimensional spaces. This structure allows for solving the new LP efficiently. In particular, the constraints of the LP can be satisfied in a compact form without an exponential dependence on the treewidth of ALP constraints. We study both practical and theoretical aspects of the proposed approach. Moreover, we demonstrate its scale-up potential on an MDP with more than 2^100 states.


title: The Evaluation of Causal Effects in Studies with an Unobserved Exposure/Outcome Variable: Bounds and Identification

abstract: This paper deals with the problem of evaluating the causal effect using observational data in the presence of an unobserved exposure/ outcome variable, when cause-effect relationships between variables can be described as a directed acyclic graph and the corresponding recursive factorization of a joint distribution. First, we propose identifiability criteria for causal effects when an unobserved exposure/outcome variable is considered to contain more than two categories. Next, when unmeasured variables exist between an unobserved outcome variable and its proxy variables, we provide the tightest bounds based on the potential outcome approach. The results of this paper are helpful to evaluate causal effects in the case where it is difficult or expensive to observe an exposure/ outcome variable in many practical fields.


title: Feature Selection via Block-Regularized Regression

abstract: Identifying co-varying causal elements in very high dimensional feature space with internal structures, e.g., a space with as many as millions of linearly ordered features, as one typically encounters in problems such as whole genome association (WGA) mapping, remains an open problem in statistical learning. We propose a block-regularized regression model for sparse variable selection in a high-dimensional space where the covariates are linearly ordered, and are possibly subject to local statistical linkages (e.g., block structures) due to spacial or temporal proximity of the features. Our goal is to identify a small subset of relevant covariates that are not merely from random positions in the ordering, but grouped as contiguous blocks from large number of ordered covariates. Following a typical linear regression framework between the features and the response, our proposed model employs a sparsity-enforcing Laplacian prior for the regression coefficients, augmented by a 1st-order Markovian process along the feature sequence that "activates" the regression coefficients in a coupled fashion. We describe a sampling-based learning algorithm and demonstrate the performance of our method on simulated and biological data for marker identification under WGA.


title: Bayesian Out-Trees

abstract: A Bayesian treatment of latent directed graph structure for non-iid data is provided where each child datum is sampled with a directed conditional dependence on a single unknown parent datum. The latent graph structure is assumed to lie in the family of directed out-tree graphs which leads to efficient Bayesian inference. The latent likelihood of the data and its gradients are computable in closed form via Tutte's directed matrix tree theorem using determinants and inverses of the out-Laplacian. This novel likelihood subsumes iid likelihood, is exchangeable and yields efficient unsupervised and semi-supervised learning algorithms. In addition to handling taxonomy and phylogenetic datasets the out-tree assumption performs surprisingly well as a semi-parametric density estimator on standard iid datasets. Experiments with unsupervised and semisupervised learning are shown on various UCI and taxonomy datasets.


title: Estimation and Clustering with Infinite Rankings

abstract: This paper presents a natural extension of stagewise ranking to the the case of infinitely many items. We introduce the infinite generalized Mallows model (IGM), describe its properties and give procedures to estimate it from data. For estimation of multimodal distributions we introduce the Exponential-Blurring-Mean-Shift nonparametric clustering algorithm. The experiments highlight the properties of the new model and demonstrate that infinite models can be simple, elegant and practical.


title: Learning Arithmetic Circuits

abstract: Graphical models are usually learned without regard to the cost of doing inference with them. As a result, even if a good model is learned, it may perform poorly at prediction, because it requires approximate inference. We propose an alternative: learning models with a score function that directly penalizes the cost of inference. Specifically, we learn arithmetic circuits with a penalty on the number of edges in the circuit (in which the cost of inference is linear). Our algorithm is equivalent to learning a Bayesian network with context-specific independence by greedily splitting conditional distributions, at each step scoring the candidates by compiling the resulting network into an arithmetic circuit, and using its size as the penalty. We show how this can be done efficiently, without compiling a circuit from scratch for each candidate. Experiments on several real-world domains show that our algorithm is able to learn tractable models with very large treewidth, and yields more accurate predictions than a standard context-specific Bayesian network learner, in far less time.


title: Improving Gradient Estimation by Incorporating Sensor Data

abstract: An efficient policy search algorithm should estimate the local gradient of the objective function, with respect to the policy parameters, from as few trials as possible. Whereas most policy search methods estimate this gradient by observing the rewards obtained during policy trials, we show, both theoretically and empirically, that taking into account the sensor data as well gives better gradient estimates and hence faster learning. The reason is that rewards obtained during policy execution vary from trial to trial due to noise in the environment; sensor data, which correlates with the noise, can be used to partially correct for this variation, resulting in an estimatorwith lower variance.


title: Discovering Cyclic Causal Models by Independent Components Analysis

abstract: We generalize Shimizu et al's (2006) ICA-based approach for discovering linear non-Gaussian acyclic (LiNGAM) Structural Equation Models (SEMs) from causally sufficient, continuous-valued observational data. By relaxing the assumption that the generating SEM's graph is acyclic, we solve the more general problem of linear non-Gaussian (LiNG) SEM discovery. LiNG discovery algorithms output the distribution equivalence class of SEMs which, in the large sample limit, represents the population distribution. We apply a LiNG discovery algorithm to simulated data. Finally, we give sufficient conditions under which only one of the SEMs in the output class is 'stable'.


title: Small Sample Inference for Generalization Error in Classification Using the CUD Bound

abstract: Confidence measures for the generalization error are crucial when small training samples are used to construct classifiers. A common approach is to estimate the generalization error by resampling and then assume the resampled estimator follows a known distribution to form a confidence set [Kohavi 1995, Martin 1996,Yang 2006]. Alternatively, one might bootstrap the resampled estimator of the generalization error to form a confidence set. Unfortunately, these methods do not reliably provide sets of the desired confidence. The poor performance appears to be due to the lack of smoothness of the generalization error as a function of the learned classifier. This results in a non-normal distribution of the estimated generalization error. We construct a confidence set for the generalization error by use of a smooth upper bound on the deviation between the resampled estimate and generalization error. The confidence set is formed by bootstrapping this upper bound. In cases in which the approximation class for the classifier can be represented as a parametric additive model, we provide a computationally efficient algorithm. This method exhibits superior performance across a series of test and simulated data sets.


title: Learning Hidden Markov Models for Regression using Path Aggregation

abstract: We consider the task of learning mappings from sequential data to real-valued responses. We present and evaluate an approach to learning a type of hidden Markov model (HMM) for regression. The learning process involves inferring the structure and parameters of a conventional HMM, while simultaneously learning a regression model that maps features that characterize paths through the model to continuous responses. Our results, in both synthetic and biological domains, demonstrate the value of jointly learning the two components of our approach.


title: Explanation Trees for Causal Bayesian Networks

abstract: Bayesian networks can be used to extract explanations about the observed state of a subset of variables. In this paper, we explicate the desiderata of an explanation and confront them with the concept of explanation proposed by existing methods. The necessity of taking into account causal approaches when a causal graph is available is discussed. We then introduce causal explanation trees, based on the construction of explanation trees using the measure of causal information ow (Ay and Polani, 2006). This approach is compared to several other methods on known networks.


title: A Polynomial-time Nash Equilibrium Algorithm for Repeated Stochastic Games

abstract: We present a polynomial-time algorithm that always finds an (approximate) Nash equilibrium for repeated two-player stochastic games. The algorithm exploits the folk theorem to derive a strategy profile that forms an equilibrium by buttressing mutually beneficial behavior with threats, where possible. One component of our algorithm efficiently searches for an approximation of the egalitarian point, the fairest pareto-efficient solution. The paper concludes by applying the algorithm to a set of grid games to illustrate typical solutions the algorithm finds. These solutions compare very favorably to those found by competing algorithms, resulting in strategies with higher social welfare, as well as guaranteed computational efficiency.


title: Topic Models Conditioned on Arbitrary Features with Dirichlet-multinomial Regression

abstract: Although fully generative models have been successfully used to model the contents of text documents, they are often awkward to apply to combinations of text data and document metadata. In this paper we propose a Dirichlet-multinomial regression (DMR) topic model that includes a log-linear prior on document-topic distributions that is a function of observed features of the document, such as author, publication venue, references, and dates. We show that by selecting appropriate features, DMR topic models can meet or exceed the performance of several previously published topic models designed for specific data.


title: The Phylogenetic Indian Buffet Process: A Non-Exchangeable Nonparametric Prior for Latent Features

abstract: Nonparametric Bayesian models are often based on the assumption that the objects being modeled are exchangeable. While appropriate in some applications (e.g., bag-of-words models for documents), exchangeability is sometimes assumed simply for computational reasons; non-exchangeable models might be a better choice for applications based on subject matter. Drawing on ideas from graphical models and phylogenetics, we describe a non-exchangeable prior for a class of nonparametric latent feature models that is nearly as efficient computationally as its exchangeable counterpart. Our model is applicable to the general setting in which the dependencies between objects can be expressed using a tree, where edge lengths indicate the strength of relationships. We demonstrate an application to modeling probabilistic choice.


title: CT-NOR: Representing and Reasoning About Events in Continuous Time

abstract: We present a generative model for representing and reasoning about the relationships among events in continuous time. We apply the model to the domain of networked and distributed computing environments where we fit the parameters of the model from timestamp observations, and then use hypothesis testing to discover dependencies between the events and changes in behavior for monitoring and diagnosis. After introducing the model, we present an EM algorithm for fitting the parameters and then present the hypothesis testing approach for both dependence discovery and change-point detection. We validate the approach for both tasks using real data from a trace of network events at Microsoft Research Cambridge. Finally, we formalize the relationship between the proposed model and the noisy-or gate for cases when time can be discretized.


title: Model-Based Bayesian Reinforcement Learning in Large Structured Domains

abstract: Model-based Bayesian reinforcement learning has generated significant interest in the AI community as it provides an elegant solution to the optimal exploration-exploitation tradeoff in classical reinforcement learning. Unfortunately, the applicability of this type of approach has been limited to small domains due to the high complexity of reasoning about the joint posterior over model parameters. In this paper, we consider the use of factored representations combined with online planning techniques, to improve scalability of these methods. The main contribution of this paper is a Bayesian framework for learning the structure and parameters of a dynamical system, while also simultaneously planning a (near-)optimal sequence of actions.


title: Improving the Accuracy and Efficiency of MAP Inference for Markov Logic

abstract: In this work we present Cutting Plane Inference (CPI), a Maximum A Posteriori (MAP) inference method for Statistical Relational Learning. Framed in terms of Markov Logic and inspired by the Cutting Plane Method, it can be seen as a meta algorithm that instantiates small parts of a large and complex Markov Network and then solves these using a conventional MAP method. We evaluate CPI on two tasks, Semantic Role Labelling and Joint Entity Resolution, while plugging in two different MAP inference methods: the current method of choice for MAP inference in Markov Logic, MaxWalkSAT, and Integer Linear Programming. We observe that when used with CPI both methods are significantly faster than when used alone. In addition, CPI improves the accuracy of MaxWalkSAT and maintains the exactness of Integer Linear Programming.


title: Observation Subset Selection as Local Compilation of Performance Profiles

abstract: Deciding what to sense is a crucial task, made harder by dependencies and by a nonadditive utility function. We develop approximation algorithms for selecting an optimal set of measurements, under a dependency structure modeled by a tree-shaped Bayesian network (BN). Our approach is a generalization of composing anytime algorithm represented by conditional performance profiles. This is done by relaxing the input monotonicity assumption, and extending the local compilation technique to more general classes of performance profiles (PPs). We apply the extended scheme to selecting a subset of measurements for choosing a maximum expectation variable in a binary valued BN, and for minimizing the worst variance in a Gaussian BN.


title: Bounding Search Space Size via (Hyper)tree Decompositions

abstract: This paper develops a measure for bounding the performance of AND/OR search algorithms for solving a variety of queries over graphical models. We show how drawing a connection to the recent notion of hypertree decompositions allows to exploit determinism in the problem specification and produce tighter bounds. We demonstrate on a variety of practical problem instances that we are often able to improve upon existing bounds by several orders of magnitude.


title: Dyna-Style Planning with Linear Function Approximation and Prioritized Sweeping

abstract: We consider the problem of efficiently learning optimal control policies and value functions over large state spaces in an online setting in which estimates must be available after each interaction with the world. This paper develops an explicitly model-based approach extending the Dyna architecture to linear function approximation. Dynastyle planning proceeds by generating imaginary experience from the world model and then applying model-free reinforcement learning algorithms to the imagined state transitions. Our main results are to prove that linear Dyna-style planning converges to a unique solution independent of the generating distribution, under natural conditions. In the policy evaluation setting, we prove that the limit point is the least-squares (LSTD) solution. An implication of our results is that prioritized-sweeping can be soundly extended to the linear approximation case, backing up to preceding features rather than to preceding states. We introduce two versions of prioritized sweeping with linear Dyna and briefly illustrate their performance empirically on the Mountain Car and Boyan Chain problems.


title: New Techniques for Algorithm Portfolio Design

abstract: We present and evaluate new techniques for designing algorithm portfolios. In our view, the problem has both a scheduling aspect and a machine learning aspect. Prior work has largely addressed one of the two aspects in isolation. Building on recent work on the scheduling aspect of the problem, we present a technique that addresses both aspects simultaneously and has attractive theoretical guarantees. Experimentally, we show that this technique can be used to improve the performance of state-of-the-art algorithms for Boolean satisfiability, zero-one integer programming, and A.I. planning.


title: Learning the Bayesian Network Structure: Dirichlet Prior versus Data

abstract: In the Bayesian approach to structure learning of graphical models, the equivalent sample size (ESS) in the Dirichlet prior over the model parameters was recently shown to have an important effect on the maximum-a-posteriori estimate of the Bayesian network structure. In our first contribution, we theoretically analyze the case of large ESS-values, which complements previous work: among other results, we find that the presence of an edge in a Bayesian network is favoured over its absence even if both the Dirichlet prior and the data imply independence, as long as the conditional empirical distribution is notably different from uniform. In our second contribution, we focus on realistic ESS-values, and provide an analytical approximation to the "optimal" ESS-value in a predictive sense (its accuracy is also validated experimentally): this approximation provides an understanding as to which properties of the data have the main effect determining the "optimal" ESS-value.