title: Full-separability and bi-separability of qubits using Bell operators, partial transpose, witnesses and explicit (full/bi) separability

abstract: Using the Hilbert-Schmidt (HS) decomposition we suggest new possible choices of Bell operators and entanglement witnesses (EW ) for n (>2) qubits systems for (full/bi) separability. The latter give upper bounds for (full/bi) separability. Also using the HS decomposition, we find explicitly (full/bi) separable forms for some qubits states which give lower bounds for (full/bi) separability. When the lower bounds and upper bounds coincide it means that the EW is optimal. In the case of full separability, the positive transpose method can sometimes give optimal results. As concrete examples, we give results for the GHZ(3),W(3) , and cluster CL(4)states.


title: Path Ranking with Attention to Type Hierarchies

abstract: The objective of the knowledge base completion problem is to infer missing information from existing facts in a knowledge base. Prior work has demonstrated the effectiveness of path-ranking based methods, which solve the problem by discovering observable patterns in knowledge graphs, consisting of nodes representing entities and edges representing relations. However, these patterns either lack accuracy because they rely solely on relations or cannot easily generalize due to the direct use of specific entity information. We introduce Attentive Path Ranking, a novel path pattern representation that leverages type hierarchies of entities to both avoid ambiguity and maintain generalization. Then, we present an end-to-end trained attention-based RNN model to discover the new path patterns from data. Experiments conducted on benchmark knowledge base completion datasets WN18RR and FB15k-237 demonstrate that the proposed model outperforms existing methods on the fact prediction task by statistically significant margins of 26% and 10%, respectively. Furthermore, quantitative and qualitative analyses show that the path patterns balance between generalization and discrimination.


title: Minimal independent couplings at order $\alpha'^2$

abstract: Using field redefinitions and Bianchi identities on the general form of the effective action for metric, $B$-field and dilaton, we have found that the minimum number of independent couplings at order $\alpha'^2$ is 60. We write these couplings in two different schemes in the string frame. In the first scheme, each coupling does not include terms with more than two derivatives and it does not include structures $R,\,R_{\mu\nu},\,\nabla_\mu H^{\mu\alpha\beta}$, $ \nabla_\mu\nabla^\mu\Phi$. In this scheme, 20 couplings which are the minimum number of couplings for metric and $B$-field, include dilaton trivially as the overall factor of $e^{-2\Phi}$, and all other couplings include derivatives of dilaton. In the second scheme, the dilaton appears in all 60 coupling only as the overall factor of $e^{-2\Phi}$. In this scheme, 20 of the couplings are exactly the same as those in the previous scheme.


title: A Dark Energy Quintessence Model of the Universe

abstract: In this paper, we have presented a model of the FLRW universe filled with matter and dark energy fluids, by assuming an ansatz that deceleration parameter is a linear function of the Hubble constant. This results in a time-dependent DP having decelerating-accelerating transition phase of the universe. This is a quintessence model $\omega_{(de)}\geq -1$. The quintessence phase remains for the period $(0 \leq z \leq 0.5806)$. The model is shown to satisfy current observational constraints. Various cosmological parameters relating to the history of the universe have been investigated.


title: Hyperbolic Interaction Model For Hierarchical Multi-Label Classification

abstract: Different from the traditional classification tasks which assume mutual exclusion of labels, hierarchical multi-label classification (HMLC) aims to assign multiple labels to every instance with the labels organized under hierarchical relations. Besides the labels, since linguistic ontologies are intrinsic hierarchies, the conceptual relations between words can also form hierarchical structures. Thus it can be a challenge to learn mappings from word hierarchies to label hierarchies. We propose to model the word and label hierarchies by embedding them jointly in the hyperbolic space. The main reason is that the tree-likeness of the hyperbolic space matches the complexity of symbolic data with hierarchical structures. A new Hyperbolic Interaction Model (HyperIM) is designed to learn the label-aware document representations and make predictions for HMLC. Extensive experiments are conducted on three benchmark datasets. The results have demonstrated that the new model can realistically capture the complex data structures and further improve the performance for HMLC comparing with the state-of-the-art methods. To facilitate future research, our code is publicly available.


title: Long time behavior of solutions of degenerate parabolic equations with inhomogeneous density on manifolds

abstract: We consider the Cauchy problem for doubly non-linear degenerate parabolic equations on Riemannian manifolds of infinite volume, or in $\R^N$. The equation contains a weight function as a capacitary coefficient which we assume to decay at infinity. We connect the behavior of non-negative solutions to the interplay between such coefficient and the geometry of the manifold, obtaining, in a suitable subcritical range, estimates of the vanishing rate for long times and of the finite speed of propagation. In supercritical ranges we obtain universal bounds and prove blow up in a finite time of the (initially bounded) support of solutions.


title: Influence of field-like torque in synchronization of spin torque oscillators

abstract: The magnetization dynamics of two parallelly coupled spin torque oscillators, destabilization of steady states and removal of multistability, are investigated by taking into account the influence of field-like torque. It is shown that the existence of such torque can cancel the effect of damping and can, therefore, cause the oscillators to exhibit synchronized oscillations in response to direct current. Further, our results show that the presence of field-like torque enhances the power and Q-factor of the synchronized oscillations. The validity of the above results is confirmed by numerical and analytical studies based on the stochastic Landau-Lifshitz-Gilbert-Slonczewski equation.


title: Usage of multiple RTL features for Earthquake prediction

abstract: We construct a classification model that predicts if an earthquake with the magnitude above a threshold will take place at a given location in a time range 30-180 days from a given moment of time. A common approach is to use expert forecasts based on features like Region-Time-Length (RTL) characteristics. The proposed approach uses machine learning on top of multiple RTL features to take into account effects at various scales and to improve prediction accuracy. For historical data about Japan earthquakes 1992-2005 and predictions at locations given in this database the best model has precision up to ~ 0.95 and recall up to ~ 0.98.


title: Score-Driven Exponential Random Graphs: A New Class of Time-Varying Parameter Models for Dynamical Networks

abstract: Motivated by the increasing abundance of data describing real-world networks that exhibit dynamical features, we propose an extension of the Exponential RandomGraph Models (ERGMs) that accommodates the time variation of its parameters. Inspired by the fast growing literature on Dynamic Conditional Score-driven models each parameter evolves according to an updating rule driven by the score of the ERGM distribution. We demonstrate the flexibility of the score-driven ERGMs (SD-ERGMs), both as data generating processes and as filters, and we show the advantages of the dynamic version with respect to the static one. We discuss two applications to time-varying networks from financial and political systems. First, we consider the prediction of future links in the Italian inter-bank credit network. Second, we show that the SD-ERGM allows to discriminate between static or time-varying parameters when used to model the dynamics of the US congress co-voting network.


title: On the packing for triples

abstract: For positive integers $n\geq k\geq t$, a collection $ \mathcal{B} $ of $k$-subsets of an $n$-set $ X $ is called a $t$-packing if every $t$-subset of $ X $ appears in at most one set in $\mathcal{B}$. In this paper, we give some upper and lower bounds for the maximum size of $3$-packings when $n$ is sufficiently larger than $k$. In one case, the upper and lower bounds are equal, in some cases, they differ by at most an additive constant depending only on $k$ and in one case they differ by a linear bound in $ n $.


title: A Test for Differential Ascertainment in Case-Control Studies with Application to Child Maltreatment

abstract: We propose a method to test for the presence of differential ascertainment in case-control studies, when data are collected by multiple sources. We show that, when differential ascertainment is present, the use of only the observed cases leads to severe bias in the computation of the odds ratio. We can alleviate the effect of such bias using the estimates that our method of testing for differential ascertainment naturally provides. We apply it to a dataset obtained from the National Violent Death Reporting System, with the goal of checking for the presence of differential ascertainment by race in the count of deaths caused by child maltreatment.


title: Minimum Age TDMA Scheduling

abstract: We consider a transmission scheduling problem in which multiple systems receive update information through a shared Time Division Multiple Access (TDMA) channel. To provide timely delivery of update information, the problem asks for a schedule that minimizes the overall age of information. We call this problem the Min-Age problem. This problem is first studied by He \textit{et al.} [IEEE Trans. Inform. Theory, 2018], who identified several special cases where the problem can be solved optimally in polynomial time. Our contribution is threefold. First, we introduce a new job scheduling problem called the Min-WCS problem, and we prove that, for any constant $r \geq 1$, every $r$-approximation algorithm for the Min-WCS problem can be transformed into an $r$-approximation algorithm for the Min-Age problem. Second, we give a randomized 2.733-approximation algorithm and a dynamic-programming-based exact algorithm for the Min-WCS problem. Finally, we prove that the Min-Age problem is NP-hard.


title: Evaluation of basic modules for isolated spelling error correction in Polish texts

abstract: Spelling error correction is an important problem in natural language processing, as a prerequisite for good performance in downstream tasks as well as an important feature in user-facing applications. For texts in Polish language, there exist works on specific error correction solutions, often developed for dealing with specialized corpora, but not evaluations of many different approaches on big resources of errors. We begin to address this problem by testing some basic and promising methods on PlEWi, a corpus of annotated spelling extracted from Polish Wikipedia. These modules may be further combined with appropriate solutions for error detection and context awareness. Following our results, combining edit distance with cosine distance of semantic vectors may be suggested for interpretable systems, while an LSTM, particularly enhanced by ELMo embeddings, seems to offer the best raw performance.


title: First measurement of near-threshold J/$\psi $ exclusive photoproduction off the proton

abstract: We report on the measurement of the $\gamma p \rightarrow J/\psi p$ cross section from $E_\gamma = 11.8$ GeV down to the threshold at $8.2$ GeV using a tagged photon beam with the GlueX experiment. We find the total cross section falls toward the threshold less steeply than expected from two-gluon exchange models. The differential cross section $d\sigma /dt$ has an exponential slope of $1.67 \pm 0.39$ GeV$^{-2}$ at $10.7$ GeV average energy. The LHCb pentaquark candidates $P_c^+$ can be produced in the $s$-channel of this reaction. We see no evidence for them and set model-dependent upper limits on their branching fractions $\mathcal{B}(P_c^+ \rightarrow J/\psi p)$ and cross sections $\sigma(\gamma p \to P_c^+)\times\mathcal{B}(P_c^+ \to J/\psi p) $.


title: Regularity as Regularization: Smooth and Strongly Convex Brenier Potentials in Optimal Transport

abstract: Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensure that the distance between two empirical measures is comparable to the distance between the original densities. Therefore, optimal transport (OT) can only be used in machine learning if it is substantially regularized. On the other hand, one of the greatest achievements of the OT literature in recent years lies in regularity theory: Caffarelli showed that the OT map between two well behaved measures is Lipschitz, or equivalently when considering 2-Wasserstein distances, that Brenier convex potentials (whose gradient yields an optimal map) are smooth. We propose in this work to draw inspiration from this theory and use regularity as a regularization tool. We give algorithms operating on two discrete measures that can recover nearly optimal transport maps with small distortion, or equivalently, nearly optimal Brenier potentials that are strongly convex and smooth. The problem boils down to solving alternatively a convex QCQP and a discrete OT problem, granting access to the values and gradients of the Brenier potential not only on sampled points, but also out of sample at the cost of solving a simpler QCQP for each evaluation. We propose algorithms to estimate and evaluate transport maps with desired regularity properties, benchmark their statistical performance, apply them to domain adaptation and visualize their action on a color transfer task.


title: Proper actions on finite products of quasi-trees

abstract: We say that a finitely generated group $G$ has property (QT) if it acts isometrically on a finite product of quasi-trees so that orbit maps are quasi-isometric embeddings. A quasi-tree is a connected graph with path metric quasi-isometric to a tree, and product spaces are equipped with the $\ell^1$-metric. As an application of the projection complex techniques, we prove that residually finite hyperbolic groups and mapping class groups have (QT).


title: Operation and Imitation under Safety-Aware Shared Control

abstract: We describe a shared control methodology that can, without knowledge of the task, be used to improve a human's control of a dynamic system, be used as a training mechanism, and be used in conjunction with Imitation Learning to generate autonomous policies that recreate novel behaviors. Our algorithm introduces autonomy that assists the human partner by enforcing safety and stability constraints. The autonomous agent has no a priori knowledge of the desired task and therefore only adds control information when there is concern for the safety of the system. We evaluate the efficacy of our approach with a human subjects study consisting of 20 participants. We find that our shared control algorithm significantly improves the rate at which users are able to successfully execute novel behaviors. Experimental results suggest that the benefits of our safety-aware shared control algorithm also extend to the human partner's understanding of the system and their control skill. Finally, we demonstrate how a combination of our safety-aware shared control algorithm and Imitation Learning can be used to autonomously recreate the demonstrated behaviors.


title: Collective excitations in two-dimensional SU($N$) Fermi gases with tunable spin

abstract: We measure collective excitations of a harmonically trapped two-dimensional (2D) SU($N$) Fermi gas of $^{173}$Yb confined to a stack of layers formed by a one-dimensional optical lattice. Quadrupole and breathing modes are excited and monitored in the collisionless regime $\lvert\ln(k_F a_{2D})\rvert\gg 1$ with tunable spin. We observe that the quadrupole mode frequency decreases with increasing number of spin components due to the amplification of the interaction effect by $N$ in agreement with a theoretical prediction based on 2D kinetic equations. The breathing mode frequency, however, is measured to be twice the dipole oscillation frequency regardless of $N$. We also follow the evolution of collective excitations in the dimensional crossover from two to three dimensions and characterize the damping rate of quadrupole and breathing modes for tunable SU($N$) fermions, both of which reveal the enhanced inter-particle collisions for larger spin. Our result paves the way to investigate the collective property of 2D SU($N$) Fermi liquid with enlarged spin.


title: The complex case of MACSJ0717.5+3745 and its extended filament: intra-cluster light, galaxy luminosity function, and galaxy orientations

abstract: The properties of galaxies are known to be affected by their environment, but although galaxies in clusters and groups have been quite thoroughly investigated, little is known presently on galaxies belonging to filaments of the cosmic web, and on the properties of the filaments themselves. We investigate here the properties of the rich cluster MACSJ0717.5+3745 and its extended filament, by analyzing the distribution and fractions of intra-cluster light (ICL) in the core of this cluster and by trying to detect intra-filament light (IFL) in the filament. We analyze the galaxy luminosity function (GLF) of the cluster core and of the filament. We also study the orientations of galaxies in the filament to better constrain the filament properties. This work is based on Hubble Space Telescope archive data, both from the Hubble Frontier Fields in the F435W, F606W, F814W, and F105W bands, and from a mosaic of images in the F606W and F814W bands. The spatial distribution of the ICL is determined with our new wavelet-based software, DAWIS. The GLFs are extracted in the F606W and F814W bands, with a statistical subtraction of the background, and fit with Schechter functions. The galaxy orientations in the filaments are estimated with SExtractor after correction for the Point Spread Function. We detect a large amount of ICL in the cluster core, but no IFL in the cosmic filament. The fraction of ICL in the core peaks in the F606W filter before decreasing with wavelength. Though quite noisy, the GLFs in the filament are notably different from those of field galaxies, with a flatter faint end slope and an excess of bright galaxies. We do not detect a significant alignment of the galaxies in the filament region that was analyzed.


title: Deep Online Learning with Stochastic Constraints

abstract: Deep learning models are considered to be state-of-the-art in many offline machine learning tasks. However, many of the techniques developed are not suitable for online learning tasks. The problem of using deep learning models with sequential data becomes even harder when several loss functions need to be considered simultaneously, as in many real-world applications. In this paper, we, therefore, propose a novel online deep learning training procedure which can be used regardless of the neural network's architecture, aiming to deal with the multiple objectives case. We demonstrate and show the effectiveness of our algorithm on the Neyman-Pearson classification problem on several benchmark datasets.


title: Avoiding Scalability Collapse by Restricting Concurrency

abstract: Saturated locks often degrade the performance of a multithreaded application, leading to a so-called scalability collapse problem. This problem arises when a growing number of threads circulating through a saturated lock causes the overall application performance to fade or even drop abruptly. This problem is particularly (but not solely) acute on oversubscribed systems (systems with more threads than available hardware cores). In this paper, we introduce GCR (generic concurrency restriction), a mechanism that aims to avoid the scalability collapse. GCR, designed as a generic, lock-agnostic wrapper, intercepts lock acquisition calls, and decides when threads would be allowed to proceed with the acquisition of the underlying lock. Furthermore, we present GCR-NUMA, a non-uniform memory access (NUMA)-aware extension of GCR, that strives to ensure that threads allowed to acquire the lock are those that run on the same socket. The extensive evaluation that includes more than two dozen locks, three machines and three benchmarks shows that GCR brings substantial speedup (in many cases, up to three orders of magnitude) in case of contention and growing thread counts, while introducing nearly negligible slowdown when the underlying lock is not contended. GCR-NUMA brings even larger performance gains starting at even lighter lock contention.


title: Learning to Optimize Computational Resources: Frugal Training with Generalization Guarantees

abstract: Algorithms typically come with tunable parameters that have a considerable impact on the computational resources they consume. Too often, practitioners must hand-tune the parameters, a tedious and error-prone task. A recent line of research provides algorithms that return nearly-optimal parameters from within a finite set. These algorithms can be used when the parameter space is infinite by providing as input a random sample of parameters. This data-independent discretization, however, might miss pockets of nearly-optimal parameters: prior research has presented scenarios where the only viable parameters lie within an arbitrarily small region. We provide an algorithm that learns a finite set of promising parameters from within an infinite set. Our algorithm can help compile a configuration portfolio, or it can be used to select the input to a configuration algorithm for finite parameter spaces. Our approach applies to any configuration problem that satisfies a simple yet ubiquitous structure: the algorithm's performance is a piecewise constant function of its parameters. Prior research has exhibited this structure in domains from integer programming to clustering.


title: Geodesics in persistence diagram space

abstract: It is known that for a variety of choices of metrics, including the standard bottleneck distance, the space of persistence diagrams admits geodesics. Typically these existence results produce geodesics that have the form of a convex combination. More specifically, given two persistence diagrams and a choice of metric, one obtains a bijection realizing the distance between the diagrams, and uses this bijection to linearly interpolate from one diagram to another. We prove that for several families of metrics, every geodesic in persistence diagram space arises as such a convex combination. For certain other choices of metrics, we explicitly construct infinite families of geodesics that cannot have this form.


title: Nonparametric Online Learning Using Lipschitz Regularized Deep Neural Networks

abstract: Deep neural networks are considered to be state of the art models in many offline machine learning tasks. However, their performance and generalization abilities in online learning tasks are much less understood. Therefore, we focus on online learning and tackle the challenging problem where the underlying process is stationary and ergodic and thus removing the i.i.d. assumption and allowing observations to depend on each other arbitrarily. We prove the generalization abilities of Lipschitz regularized deep neural networks and show that by using those networks, a convergence to the best possible prediction strategy is guaranteed.


title: EgoFace: Egocentric Face Performance Capture and Videorealistic Reenactment

abstract: Face performance capture and reenactment techniques use multiple cameras and sensors, positioned at a distance from the face or mounted on heavy wearable devices. This limits their applications in mobile and outdoor environments. We present EgoFace, a radically new lightweight setup for face performance capture and front-view videorealistic reenactment using a single egocentric RGB camera. Our lightweight setup allows operations in uncontrolled environments, and lends itself to telepresence applications such as video-conferencing from dynamic environments. The input image is projected into a low dimensional latent space of the facial expression parameters. Through careful adversarial training of the parameter-space synthetic rendering, a videorealistic animation is produced. Our problem is challenging as the human visual system is sensitive to the smallest face irregularities that could occur in the final results. This sensitivity is even stronger for video results. Our solution is trained in a pre-processing stage, through a supervised manner without manual annotations. EgoFace captures a wide variety of facial expressions, including mouth movements and asymmetrical expressions. It works under varying illuminations, background, movements, handles people from different ethnicities and can operate in real time.


title: Laws of black hole thermodynamics in semiclassical gravity

abstract: The first and second laws of black hole thermodynamics are verified to emerge from a generic semiclassical theory of gravity for which a Hamiltonian can be defined. The first law is established for stationary spacetimes, and the second law is established in the here defined "piecewise stationary" spacetimes. Black hole entropy is defined in the Noether charge approach, and the entropy for the matter in its exterior is the von Neumann entropy of the quantum fields. These results strongly support the view of black hole entropy as an account of the information that is hidden behind the horizon.


title: Complexity estimates for triangular hierarchical matrix algorithms

abstract: Triangular factorizations are an important tool for solving integral equations and partial differential equations with hierarchical matrices ($\mathcal{H}$-matrices). Experiments show that using an $\mathcal{H}$-matrix LR factorization to solve a system of linear questions is superior to direct inversion both with respect to accuracy and efficiency, but so far theoretical estimates quantifying these advantages were missing. Due to a lack of symmetry in $\mathcal{H}$-matrix algorithms, we cannot hope to prove that the LR factorization takes one third of the operations of the inversion or the matrix multiplication, as in standard linear algebra. We can, however, prove that the LR factorization together with two other operations of similar complexity, i.e., the inversion and multiplication of triangular matrices, requires not more operations than the matrix multiplication. We can complete the estimates by proving an improved upper bound for the complexity of the matrix multiplication, designed for recently introduced variants of classical $\mathcal{H}$-matrices.


title: Phase Transitions in Bandits with Switching Constraints

abstract: We consider the classical stochastic multi-armed bandit problem with a constraint that limits the total cost incurred by switching between actions to be no larger than a given switching budget. For this problem, we prove matching upper and lower bounds on the optimal (i.e., minimax) regret, and provide efficient rate-optimal algorithms. Surprisingly, the optimal regret of this problem exhibits a non-conventional growth rate in terms of the time horizon and the number of arms. Consequently, we discover surprising "phase transitions" regarding how the optimal regret rate changes with respect to the switching budget: when the number of arms is fixed, there are equal-length phases, where the optimal regret rate remains (almost) the same within each phase and exhibits abrupt changes between phases; when the number of arms grows with the time horizon, such abrupt changes become subtler and may disappear, but a generalized notion of phase transitions involving certain new measurements still exists. The results enable us to fully characterize the trade-off between the regret rate and the incurred switching cost in the stochastic multi-armed bandit problem, contributing new insights to this fundamental problem. Under the general switching cost structure, the results reveal interesting connections between bandit problems and graph traversal problems, such as the shortest Hamiltonian path problem.


title: On Learning Over-parameterized Neural Networks: A Functional Approximation Perspective

abstract: We consider training over-parameterized two-layer neural networks with Rectified Linear Unit (ReLU) using gradient descent (GD) method. Inspired by a recent line of work, we study the evolutions of network prediction errors across GD iterations, which can be neatly described in a matrix form. When the network is sufficiently over-parameterized, these matrices individually approximate {\em an} integral operator which is determined by the feature vector distribution $\rho$ only. Consequently, GD method can be viewed as {\em approximately} applying the powers of this integral operator on the underlying/target function $f^*$ that generates the responses/labels. We show that if $f^*$ admits a low-rank approximation with respect to the eigenspaces of this integral operator, then the empirical risk decreases to this low-rank approximation error at a linear rate which is determined by $f^*$ and $\rho$ only, i.e., the rate is independent of the sample size $n$. Furthermore, if $f^*$ has zero low-rank approximation error, then, as long as the width of the neural network is $\Omega(n\log n)$, the empirical risk decreases to $\Theta(1/\sqrt{n})$. To the best of our knowledge, this is the first result showing the sufficiency of nearly-linear network over-parameterization. We provide an application of our general results to the setting where $\rho$ is the uniform distribution on the spheres and $f^*$ is a polynomial. Throughout this paper, we consider the scenario where the input dimension $d$ is fixed.


title: On the number of irreducible real-valued characters of a finite group

abstract: We prove that there exists an integer-valued function f on positive integers such that if a finite group G has at most k real-valued irreducible characters, then |G/Sol(G)| is at most f(k), where Sol(G) denotes the largest solvable normal subgroup of G. In the case k = 5, we further classify G/Sol(G). This partly answers a question of Iwasaki [15] on the relationship between the structure of a finite group and its number of real-valued irreducible characters.


title: An Unconditionally Stable First-Order Constraint Solver for Multibody Systems

abstract: This article describes an absolutely stable, first-order constraint solverfor multi-rigid body systems that calculates (predicts) constraint forces for typical bilateral and unilateral constraints, contact constraints with friction, and many other constraint types. Redundant constraints do not pose numerical problems or require regularization. Coulomb friction for contact is modeled using a true friction cone, rather than a linearized approximation. The computational expense of the solver is dependent upon the types of constraints present in the input. The hardest (in a computational complexity sense) inputs are reducible to solving convex optimization problems, i.e., polynomial time solvable. The simplest inputs require only solving a linear system. The solver is L-stable, which will imply that the forces due to constraints induce no computational stiffness into the multi-body dynamics differential equations. This approach is targeted to multibodies simulated with coarse accuracy, subject to computational stiffness arising from constraints, and where the number of constraint equations is not large compared to the number of multibody position and velocity state variables. For such applications, the approach should prove far faster than using other implicit integration approaches. I assess the approach on some fundamental multibody dynamics problems.


title: Subpixel Response of SOI Pixel Sensor for X-ray Astronomy with Pinned Depleted Diode: First Result from Mesh Experiment

abstract: We have been developing a monolithic active pixel sensor, ``XRPIX``, for the Japan led future X-ray astronomy mission ``FORCE`` observing the X-ray sky in the energy band of 1-80 keV with angular resolution of better than 15``. XRPIX is an upper part of a stack of two sensors of an imager system onboard FORCE, and covers the X-ray energy band lower than 20 keV. The XRPIX device consists of a fully depleted high-resistivity silicon sensor layer for X-ray detection, a low resistivity silicon layer for CMOS readout circuit, and a buried oxide layer in between, which is fabricated with 0.2 $\mu$ m CMOS silicon-on-insulator (SOI) technology. Each pixel has a trigger circuit with which we can achieve a 10 $\mu$ s time resolution, a few orders of magnitude higher than that with X-ray astronomy CCDs. We recently introduced a new type of a device structure, a pinned depleted diode (PDD), in the XRPIX device, and succeeded in improving the spectral performance, especially in a readout mode using the trigger function. In this paper, we apply a mesh experiment to the XRPIX devices for the first time in order to study the spectral response of the PDD device at the subpixel resolution. We confirmed that the PDD structure solves the significant degradation of the charge collection efficiency at the pixel boundaries and in the region under the pixel circuits, which is found in the single SOI structure, the conventional type of the device structure. On the other hand, the spectral line profiles are skewed with low energy tails and the line peaks slightly shift near the pixel boundaries, which contribute to a degradation of the energy resolution.


title: Feature Map Transform Coding for Energy-Efficient CNN Inference

abstract: Convolutional neural networks (CNNs) achieve state-of-the-art accuracy in a variety of tasks in computer vision and beyond. One of the major obstacles hindering the ubiquitous use of CNNs for inference on low-power edge devices is their high computational complexity and memory bandwidth requirements. The latter often dominates the energy footprint on modern hardware. In this paper, we introduce a lossy transform coding approach, inspired by image and video compression, designed to reduce the memory bandwidth due to the storage of intermediate activation calculation results. Our method does not require fine-tuning the network weights and halves the data transfer volumes to the main memory by compressing feature maps, which are highly correlated, with variable length coding. Our method outperform previous approach in term of the number of bits per value with minor accuracy degradation on ResNet-34 and MobileNetV2. We analyze the performance of our approach on a variety of CNN architectures and demonstrate that FPGA implementation of ResNet-18 with our approach results in a reduction of around 40% in the memory energy footprint, compared to quantized network, with negligible impact on accuracy. When allowing accuracy degradation of up to 2%, the reduction of 60% is achieved. A reference implementation is available at https://github.com/CompressTeam/TransformCodingInference


title: ABCD Neurocognitive Prediction Challenge 2019: Predicting individual fluid intelligence scores from structural MRI using probabilistic segmentation and kernel ridge regression

abstract: We applied several regression and deep learning methods to predict fluid intelligence scores from T1-weighted MRI scans as part of the ABCD Neurocognitive Prediction Challenge (ABCD-NP-Challenge) 2019. We used voxel intensities and probabilistic tissue-type labels derived from these as features to train the models. The best predictive performance (lowest mean-squared error) came from Kernel Ridge Regression (KRR; $\lambda=10$), which produced a mean-squared error of 69.7204 on the validation set and 92.1298 on the test set. This placed our group in the fifth position on the validation leader board and first place on the final (test) leader board.


title: How carbon vacancies can affect the properties of group IV color centers in diamond: A study of thermodynamics and kinetics

abstract: Recently there has been much interest in using Group IV elements from the Periodic Table to fabricate and study X$V$ color centers in diamond where X = Si, Ge, Sn, or Pb and $V$ is a carbon vacancy. These Group IV color centers have a number of interesting spin and optical properties which could potentially make them better candidates than N$V^-$ centers for important applications in quantum computing and quantum information processing. Unfortunately, the very same ion implantation process that is required to create these X$V$ color centers in diamond necessarily also produces many carbon vacancies ($V_{\rm C}$) which can form complexes with these color centers ($V_{\rm C}-$X$V$) that can dramatically affect the properties of the isolated X$V$ color centers. The main focus of this work is to use density-functional theory (DFT) to study the thermodynamics and kinetics of the formation of these $V_{\rm C}-$X$V$ complexes and to suggest experimental ways to impede this process such as varying the Fermi level of the host diamond material through chemical doping or applying an external electrical bias. We also include a discussion of how the simple presence of many $V_{\rm C}$ can negatively impact the spin coherence times ($T_2$) of Group IV color centers through the presence of acoustic phonons.


title: Improved Distributed Approximations for Minimum-Weight Two-Edge-Connected Spanning Subgraph

abstract: The minimum-weight $2$-edge-connected spanning subgraph (2-ECSS) problem is a natural generalization of the well-studied minimum-weight spanning tree (MST) problem, and it has received considerable attention in the area of network design. The latter problem asks for a minimum-weight subgraph with an edge connectivity of $1$ between each pair of vertices while the former strengthens this edge-connectivity requirement to $2$. Despite this resemblance, the 2-ECSS problem is considerably more complex than MST. While MST admits a linear-time centralized exact algorithm, 2-ECSS is NP-hard and the best known centralized approximation algorithm for it (that runs in polynomial time) gives a $2$-approximation. In this paper, we give a deterministic distributed algorithm with round complexity of $\widetilde{O}(D+\sqrt{n})$ that computes a $(5+\epsilon)$-approximation of 2-ECSS, for any constant $\epsilon>0$. Up to logarithmic factors, this complexity matches the $\widetilde{\Omega}(D+\sqrt{n})$ lower bound that can be derived from Das Sarma et al. [STOC'11], as shown by Censor-Hillel and Dory [OPODIS'17]. Our result is the first distributed constant approximation for 2-ECSS in the nearly optimal time and it improves on a recent randomized algorithm of Dory [PODC'18], which achieved an $O(\log n)$-approximation in $\widetilde{O}(D+\sqrt{n})$ rounds. We also present an alternative algorithm for $O(\log n)$-approximation, whose round complexity is linear in the low-congestion shortcut parameter of the network, following a framework introduced by Ghaffari and Haeupler [SODA'16]. This algorithm has round complexity $\widetilde{O}(D+\sqrt{n})$ in worst-case networks but it provably runs much faster in many well-behaved graph families of interest. For instance, it runs in $\widetilde{O}(D)$ time in planar networks and those with bounded genus, bounded path-width or bounded tree-width.


title: ABCD Neurocognitive Prediction Challenge 2019: Predicting individual residual fluid intelligence scores from cortical grey matter morphology

abstract: We predicted residual fluid intelligence scores from T1-weighted MRI data available as part of the ABCD NP Challenge 2019, using morphological similarity of grey-matter regions across the cortex. Individual structural covariance networks (SCN) were abstracted into graph-theory metrics averaged over nodes across the brain and in data-driven communities/modules. Metrics included degree, path length, clustering coefficient, centrality, rich club coefficient, and small-worldness. These features derived from the training set were used to build various regression models for predicting residual fluid intelligence scores, with performance evaluated both using cross-validation within the training set and using the held-out validation set. Our predictions on the test set were generated with a support vector regression model trained on the training set. We found minimal improvement over predicting a zero residual fluid intelligence score across the sample population, implying that structural covariance networks calculated from T1-weighted MR imaging data provide little information about residual fluid intelligence.


title: A multi-path 2.5 dimensional convolutional neural network system for segmenting stroke lesions in brain MRI images

abstract: Automatic identification of brain lesions from magnetic resonance imaging (MRI) scans of stroke survivors would be a useful aid in patient diagnosis and treatment planning. We propose a multi-modal multi-path convolutional neural network system for automating stroke lesion segmentation. Our system has nine end-to-end UNets that take as input 2-dimensional (2D) slices and examines all three planes with three different normalizations. Outputs from these nine total paths are concatenated into a 3D volume that is then passed to a 3D convolutional neural network to output a final lesion mask. We trained and tested our method on datasets from three sources: Medical College of Wisconsin (MCW), Kessler Foundation (KF), and the publicly available Anatomical Tracings of Lesions After Stroke (ATLAS) dataset. Cross-study validation results (with independent training and validation datasets) were obtained to compare with previous methods based on naive Bayes, random forests, and three recently published convolutional neural networks. Model performance was quantified in terms of the Dice coefficient. Training on the KF and MCW images and testing on the ATLAS images yielded a mean Dice coefficient of 0.54. This was reliably better than the next best previous model, UNet, at 0.47. Reversing the train and test datasets yields a mean Dice of 0.47 on KF and MCW images, whereas the next best UNet reaches 0.45. With all three datasets combined, the current system compared to previous methods also attained a reliably higher cross-validation accuracy. It also achieved high Dice values for many smaller lesions that existing methods have difficulty identifying. Overall, our system is a clear improvement over previous methods for automating stroke lesion segmentation, bringing us an important step closer to the inter-rater accuracy level of human experts.


title: OOGAN: Disentangling GAN with One-Hot Sampling and Orthogonal Regularization

abstract: Exploring the potential of GANs for unsupervised disentanglement learning, this paper proposes a novel GAN-based disentanglement framework with One-Hot Sampling and Orthogonal Regularization (OOGAN). While previous works mostly attempt to tackle disentanglement learning through VAE and seek to implicitly minimize the Total Correlation (TC) objective with various sorts of approximation methods, we show that GANs have a natural advantage in disentangling with an alternating latent variable (noise) sampling method that is straightforward and robust. Furthermore, we provide a brand-new perspective on designing the structure of the generator and discriminator, demonstrating that a minor structural change and an orthogonal regularization on model weights entails an improved disentanglement. Instead of experimenting on simple toy datasets, we conduct experiments on higher-resolution images and show that OOGAN greatly pushes the boundary of unsupervised disentanglement.


title: Sequential mastery of multiple visual tasks: Networks naturally learn to learn and forget to forget

abstract: We explore the behavior of a standard convolutional neural net in a continual-learning setting that introduces visual classification tasks sequentially and requires the net to master new tasks while preserving mastery of previously learned tasks. This setting corresponds to that which human learners face as they acquire domain expertise serially, for example, as an individual studies a textbook. Through simulations involving sequences of ten related visual tasks, we find reason for optimism that nets will scale well as they advance from having a single skill to becoming multi-skill domain experts. We observe two key phenomena. First, \emph{forward facilitation}---the accelerated learning of task $n+1$ having learned $n$ previous tasks---grows with $n$. Second, \emph{backward interference}---the forgetting of the $n$ previous tasks when learning task $n+1$---diminishes with $n$. Amplifying forward facilitation is the goal of research on metalearning, and attenuating backward interference is the goal of research on catastrophic forgetting. We find that both of these goals are attained simply through broader exposure to a domain.


title: Approximation of a fractional power of an elliptic operator

abstract: Some mathematical models of applied problems lead to the need of solving boundary value problems with a fractional power of an elliptic operator. In a number of works, approximations of such a nonlocal operator are constructed on the basis of an integral representation with a singular integrand. In the present paper, new and more convenient integral representations are proposed for operators with fractional powers. Approximations are based on the classical quadrature formulas. The results of numerical experiments on the accuracy of quadrature formulas are presented. The proposed approximations are used for numerical solving a model two-dimensional boundary value problem for fractional diffusion.


title: Plasmonic Light Illumination Creates a Channel to Achieve Fast Degradation of Ti3C2Tx Nanosheets

abstract: Two-dimensional (2D) material-controllable degradation under light radiation is crucial for their photonics and medical-related applications, which are yet to be investigated. In this paper, we first report the laser illumination method to regulate the degradation rate of Ti3C2Tx nanosheets in aqueous solution. Comprehensive characterization of intermediates and final products confirmed that plasmonic laser promoting the oxidation was strikingly different from heating the aqueous solution homogeneously. Laser illumination would nearly 10 times accelerate the degradation of Ti3C2Tx nanosheets in initial stage and create many smaller-sized oxidized products in a short time. Laser-induced fast degradation was principally ascribed to surface plasmonic resonance effect of Ti3C2Tx nanosheets. The degradation ability of such illumination could be controlled either by tuning the excitation wavelength or changing the excitation power. Furthermore, the laser- or thermal-induced degradation could be retarded by surface protection of Ti3C2Tx nanosheets. Our results suggest that plasmonic electron excitation of Ti3C2Tx nanosheets could build a new reaction channel and lead to the fast oxidation of nanosheets in aqueous solution, potentially enabling a series of water-based applications.


title: Mass in Lovelock Unique Vacuum gravity theories

abstract: We derive an expression for conserved charges in Lovelock AdS gravity for solutions having $k$-fold degenerate vacua, making manifest a link between the degeneracy of a given vacuum and the nonlinearity of the energy formula. We show for a black hole solution to the field equations on a branch of multiplicity $k$ that its mass comes from an expression that contains the product of $k$ Weyl tensors. We prove that all divergent contributions of the type (Weyl)$^q$, with $1\le q<k$, are suppressed. Our conserved charge definition is a natural generalization of the Conformal Mass by Ashtekar, Magnon and Das to the cases when $k>1$. Our results provide insight on the holographic properties of degenerate Lovelock theories.


title: Utilizing Automated Breast Cancer Detection to Identify Spatial Distributions of Tumor Infiltrating Lymphocytes in Invasive Breast Cancer

abstract: Quantitative assessment of Tumor-TIL spatial relationships is increasingly important in both basic science and clinical aspects of breast cancer research. We have developed and evaluated convolutional neural network (CNN) analysis pipelines to generate combined maps of cancer regions and tumor infiltrating lymphocytes (TILs) in routine diagnostic breast cancer whole slide tissue images (WSIs). We produce interactive whole slide maps that provide 1) insight about the structural patterns and spatial distribution of lymphocytic infiltrates and 2) facilitate improved quantification of TILs. We evaluated both tumor and TIL analyses using three CNN networks - Resnet-34, VGG16 and Inception v4, and demonstrated that the results compared favorably to those obtained by what believe are the best published methods. We have produced open-source tools and generated a public dataset consisting of tumor/TIL maps for 1,015 TCGA breast cancer images. We also present a customized web-based interface that enables easy visualization and interactive exploration of high-resolution combined Tumor-TIL maps for 1,015TCGA invasive breast cancer cases that can be downloaded for further downstream analyses.


title: Remarks on a mean field equation on $\mathbb{S}^{2}$

abstract: In this note, we study symmetry of solutions of the elliptic equation \begin{equation*} -\Delta _{\mathbb{S}^{2}}u+3=e^{2u}\ \ \hbox{on}\ \ \mathbb{S}^{2}, \end{equation*} that arises in the study of rigidity problem of Hawking mass in general relativity. We provide various conditions under which this equation has only constant solutions, and consequently imply the rigidity of Hawking mass for stable constant mean curvature (CMC) sphere.


title: Asymptotic learning curves of kernel methods: empirical data v.s. Teacher-Student paradigm

abstract: How many training data are needed to learn a supervised task? It is often observed that the generalization error decreases as $n^{-\beta}$ where $n$ is the number of training examples and $\beta$ an exponent that depends on both data and algorithm. In this work we measure $\beta$ when applying kernel methods to real datasets. For MNIST we find $\beta\approx 0.4$ and for CIFAR10 $\beta\approx 0.1$, for both regression and classification tasks, and for Gaussian or Laplace kernels. To rationalize the existence of non-trivial exponents that can be independent of the specific kernel used, we study the Teacher-Student framework for kernels. In this scheme, a Teacher generates data according to a Gaussian random field, and a Student learns them via kernel regression. With a simplifying assumption -- namely that the data are sampled from a regular lattice -- we derive analytically $\beta$ for translation invariant kernels, using previous results from the kriging literature. Provided that the Student is not too sensitive to high frequencies, $\beta$ depends only on the smoothness and dimension of the training data. We confirm numerically that these predictions hold when the training points are sampled at random on a hypersphere. Overall, the test error is found to be controlled by the magnitude of the projection of the true function on the kernel eigenvectors whose rank is larger than $n$. Using this idea we predict relate the exponent $\beta$ to an exponent $a$ describing how the coefficients of the true function in the eigenbasis of the kernel decay with rank. We extract $a$ from real data by performing kernel PCA, leading to $\beta\approx0.36$ for MNIST and $\beta\approx0.07$ for CIFAR10, in good agreement with observations. We argue that these rather large exponents are possible due to the small effective dimension of the data.


title: Sparse Monte Carlo method for nonlocal diffusion problems

abstract: A class of evolution equations with nonlocal diffusion is considered in this work. These are integro-differential equations arising as models of propagation phenomena in continuum media with nonlocal interactions including neural tissue, porous media flow, peridynamics, models with fractional diffusion, as well as continuum limits of interacting dynamical systems. The principal challenge of numerical integration of nonlocal systems stems from the lack of spatial regularity of the data and solutions intrinsic to nonlocal models. To overcome this problem we propose a semidiscrete numerical scheme based on the combination of sparse Monte Carlo and discontinuous Galerkin methods. An important feature of our method is sparsity. Sparse sampling of points in the Monte Carlo approximation of the nonlocal term allows to use fewer discretization points without compromising the accuracy. We prove convergence of the numerical method and estimate the rate of convergence. There are two principal ingredients in the error of the numerical method related to the use of Monte Calro and Galerkin approximations respectively. We analyze both errors. Two representative examples of discontinuous kernels are presented. The first example features a kernel with a singularity, while the kernel in the second example experiences jump discontinuity. We show how the information about the singularity in the former case and the geometry of the discontinuity set in the latter translate into the rate of convergence of the numerical procedure. In addition, we illustrate the rate of convergence estimate with a numerical example of an initial value problem, for which an explicit analytic solution is available. Numerical results are consistent with analytical estimates.


title: On Coresets for Regularized Loss Minimization

abstract: We design and mathematically analyze sampling-based algorithms for regularized loss minimization problems that are implementable in popular computational models for large data, in which the access to the data is restricted in some way. Our main result is that if the regularizer's effect does not become negligible as the norm of the hypothesis scales, and as the data scales, then a uniform sample of modest size is with high probability a coreset. In the case that the loss function is either logistic regression or soft-margin support vector machines, and the regularizer is one of the common recommended choices, this result implies that a uniform sample of size $O(d \sqrt{n})$ is with high probability a coreset of $n$ points in $\Re^d$. We contrast this upper bound with two lower bounds. The first lower bound shows that our analysis of uniform sampling is tight; that is, a smaller uniform sample will likely not be a core set. The second lower bound shows that in some sense uniform sampling is close to optimal, as significantly smaller core sets do not generally exist.


title: Simplified Algorithm for Dynamic Demand Response in Smart Homes Under Smart Grid Environment

abstract: Under Smart Grid environment, the consumers may respond to incentive--based smart energy tariffs for a particular consumption pattern. Demand Response (DR) is a portfolio of signaling schemes from the utility to the consumers for load shifting/shedding with a given deadline. The signaling schemes include Time--of--Use (ToU) pricing, Maximum Demand Limit (MDL) signals etc. This paper proposes a DR algorithm which schedules the operation of home appliances/loads through a minimization problem. The category of loads and their operational timings in a day have been considered as the operational parameters of the system. These operational parameters determine the dynamic priority of a load, which is an intermediate step of this algorithm. The ToU pricing, MDL signals, and the dynamic priority of loads are the constraints in this formulated minimization problem, which yields an optimal schedule of operation for each participating load within the consumer provided duration. The objective is to flatten the daily load curve of a smart home by distributing the operation of its appliances in possible low--price intervals without violating the MDL constraint. This proposed algorithm is simulated in MATLAB environment against various test cases. The obtained results are plotted to depict significant monetary savings and flattened load curves.


title: Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives

abstract: This paper tackles the problem of reading comprehension over long narratives where documents easily span over thousands of tokens. We propose a curriculum learning (CL) based Pointer-Generator framework for reading/sampling over large documents, enabling diverse training of the neural model based on the notion of alternating contextual difficulty. This can be interpreted as a form of domain randomization and/or generative pretraining during training. To this end, the usage of the Pointer-Generator softens the requirement of having the answer within the context, enabling us to construct diverse training samples for learning. Additionally, we propose a new Introspective Alignment Layer (IAL), which reasons over decomposed alignments using block-based self-attention. We evaluate our proposed method on the NarrativeQA reading comprehension benchmark, achieving state-of-the-art performance, improving existing baselines by $51\%$ relative improvement on BLEU-4 and $17\%$ relative improvement on Rouge-L. Extensive ablations confirm the effectiveness of our proposed IAL and CL components.


title: Learning Gaussian DAGs from Network Data

abstract: Structural learning of directed acyclic graphs (DAGs) or Bayesian networks has been studied extensively under the assumption that data are independent. We propose a new Gaussian DAG model for dependent data which assumes the observations are correlated according to an undirected network. Under this model, we develop a method to estimate the DAG structure given a topological ordering of the nodes. The proposed method jointly estimates the Bayesian network and the correlations among observations by optimizing a scoring function based on penalized likelihood. We show that under some mild conditions, the proposed method produces consistent estimators after one iteration. Extensive numerical experiments also demonstrate that by jointly estimating the DAG structure and the sample correlation, our method achieves much higher accuracy in structure learning. When the node ordering is unknown, through experiments on synthetic and real data, we show that our algorithm can be used to estimate the correlations between samples, with which we can de-correlate the dependent data to significantly improve the performance of classical DAG learning methods.


title: Holomorphic symmetric differentials and parallelizable compact complex manifolds

abstract: We provide a characterization of complex tori using holomorphic symmetric differentials. With the same method we show that compact complex manifolds of Kodaira dimension 0 having some symmetric power of the cotangent bundle globally generated are quotients of parallelizable manifolds, therefore have an infinite fundamental group.


title: Moir\'e-pattern fluctuations and electron-phason coupling in twisted bilayer graphene

abstract: In twisted bilayer graphene, long-wavelength lattice fluctuations on the scale of the moir\'e period are dominated by phason modes, i.e., acoustic branches of the incommensurate lattice resulting from coherent superpositions of optical phonons. In the limit of small twist angles, these modes describe the sliding motion of stacking domain walls separating regions of partial commensuration. The resulting soliton network is a soft elastic manifold, whose reduced rigidity arises from the competition between intralayer (elastic) and interlayer (adhesion) forces governing lattice relaxation. Shear deformations of the beating pattern dominate the electron-phason coupling to the leading order in $t_{\perp}/t$, the ratio between interlayer and intralayer hopping parameters. This coupling lifts the layer degeneracy of the Dirac cones at the corners of the Moir\'e Brillouin zone, which could explain the observed 4-fold (instead of 8-fold) Landau level degeneracy. Electron-phason scattering gives rise to a linear-in-temperature contribution to the resistivity that increases with decreasing twist angle due to the reduction of the stiffness of the soliton network. This contribution alone, however, seems to be insufficient to explain the huge enhancement of the resistivity of the normal state close to the magic angle.


title: When to reply? Context Sensitive Models to Predict Instructor Interventions in MOOC Forums

abstract: Due to time constraints, course instructors often need to selectively participate in student discussion threads, due to their limited bandwidth and lopsided student--instructor ratio on online forums. We propose the first deep learning models for this binary prediction problem. We propose novel attention based models to infer the amount of latent context necessary to predict instructor intervention. Such models also allow themselves to be tuned to instructor's preference to intervene early or late. Our three proposed attentive model variants to infer the latent context improve over the state-of-the-art by a significant, large margin of 11% in F1 and 10% in recall, on average. Further, introspection of attention help us better understand what aspects of a discussion post propagate through the discussion thread that prompts instructor intervention.


title: Taxonomization of Combinatorial Optimization Problems in Fourier Space

abstract: We propose and develop a novel framework for analyzing permutation-based combinatorial optimization problems, which could eventually be extended to other types of problems. Our approach is based on the decomposition of the objective functions via the generalized Fourier transform. We characterize the Fourier coefficients of three different problems: the Traveling Salesman Problem, the Linear Ordering Problem and the Quadratic Assignment Problem. This implies that these three problems can be viewed in a homogeneous space, such as the Fourier domain. Our final target would be to create a taxonomy of problem instances, so that functions which are treated similarly under the same search algorithms are grouped together. For this purpose, we simplify the representations of the objective functions by considering them as permutations of the elements of the search space, and study the permutations that are associated with different problems.


title: Search for vector-like leptons in multilepton final states in proton-proton collisions at $\sqrt{s}$ = 13 TeV

abstract: A search for vector-like leptons in multilepton final states is presented. The data sample corresponds to an integrated luminosity of 77.4 fb$^{-1}$ of proton-proton collisions at a center-of-mass energy of 13 TeV collected by the CMS experiment at the LHC in 2016 and 2017. Events are categorized by the multiplicity of electrons, muons, and hadronically decaying $\tau$ leptons. The missing transverse momentum and the scalar sum of the lepton transverse momenta are used to distinguish the signal from background. The observed results are consistent with the expectations from the standard model hypothesis. The existence of a vector-like lepton doublet, coupling to the third generation standard model leptons in the mass range of 120-790 GeV, is excluded at 95% confidence level. These are the most stringent limits yet on the production of a vector-like lepton doublet, coupling to the third generation standard model leptons.


title: Let's Agree to Agree: Neural Networks Share Classification Order on Real Datasets

abstract: We report a series of robust empirical observations, demonstrating that deep Neural Networks learn the examples in both the training and test sets in a similar order. This phenomenon is observed in all the commonly used benchmarks we evaluated, including many image classification benchmarks, and one text classification benchmark. While this phenomenon is strongest for models of the same architecture, it also crosses architectural boundaries -- models of different architectures start by learning the same examples, after which the more powerful model may continue to learn additional examples. We further show that this pattern of results reflects the interplay between the way neural networks learn benchmark datasets. Thus, when fixing the architecture, we show synthetic datasets where this pattern ceases to exist. When fixing the dataset, we show that other learning paradigms may learn the data in a different order. We hypothesize that our results reflect how neural networks discover structure in natural datasets.


title: Data Race Prediction for Inaccurate Traces

abstract: Happens-before based data race prediction methods infer from a trace of events a partial order to check if one event happens before another event. If two two write events are unordered, they are in a race. We observe that common tracing methods provide no guarantee that the trace order corresponds to an actual program run. The consequence of inaccurate tracing is that results (races) reported are inaccurate. We introduce diagnostic methods to examine if (1) a race is guaranteed to be correct regardless of any potential inaccuracies, (2) maybe is incorrect due to inaccurate tracing. We have fully implemented the approach and provide for an empirical comparison with state of the art happens-before based race predictors such as FastTrack and SHB.


title: Robust probabilistic modeling of photoplethysmography signals with application to the classification of premature beats

abstract: In this paper we propose a robust approach to model photoplethysmography (PPG) signals. After decomposing the signal into two components, we focus the analysis on the pulsatile part, related to cardiac information. The goal is to enable a deeper understanding of the information contained in the pulse shape, together with that derived from the rhythm. Our approach combines functional data analysis with a state space representation and guarantees fitting robustness and flexibility on stationary signals, without imposing a priori information on the waveform and heart rhythm. With a Bayesian approach, we learn the distribution of the parameters, used for understanding and monitoring PPG signals. The model can be used for data compression, for inferring medical parameters and to understand condition-related waveform characteristics. In particular, we detail a procedure for the detection of premature contractions based on the residuals of the fit. This method can handle both atrial and ventricular premature contractions, and classify the type by only using information from the model fit.


title: Causal Discovery and Forecasting in Nonstationary Environments with State-Space Models

abstract: In many scientific fields, such as economics and neuroscience, we are often faced with nonstationary time series, and concerned with both finding causal relations and forecasting the values of variables of interest, both of which are particularly challenging in such nonstationary environments. In this paper, we study causal discovery and forecasting for nonstationary time series. By exploiting a particular type of state-space model to represent the processes, we show that nonstationarity helps to identify causal structure and that forecasting naturally benefits from learned causal knowledge. Specifically, we allow changes in both causal strengths and noise variances in the nonlinear state-space models, which, interestingly, renders both the causal structure and model parameters identifiable. Given the causal model, we treat forecasting as a problem in Bayesian inference in the causal model, which exploits the time-varying property of the data and adapts to new observations in a principled manner. Experimental results on synthetic and real-world data sets demonstrate the efficacy of the proposed methods.


title: Integration of Text-maps in Convolutional Neural Networks for Region Detection among Different Textual Categories

abstract: In this work, we propose a new technique that combines appearance and text in a Convolutional Neural Network (CNN), with the aim of detecting regions of different textual categories. We define a novel visual representation of the semantic meaning of text that allows a seamless integration in a standard CNN architecture. This representation, referred to as text-map, is integrated with the actual image to provide a much richer input to the network. Text-maps are colored with different intensities depending on the relevance of the words recognized over the image. Concretely, these words are previously extracted using Optical Character Recognition (OCR) and they are colored according to the probability of belonging to a textual category of interest. In this sense, this solution is especially relevant in the context of item coding for supermarket products, where different types of textual categories must be identified, such as ingredients or nutritional facts. We evaluated our solution in the proprietary item coding dataset of Nielsen Brandbank, which contains more than 10,000 images for train and 2,000 images for test. The reported results demonstrate that our approach focused on visual and textual data outperforms state-of-the-art algorithms only based on appearance, such as standard Faster R-CNN. These enhancements are reflected in precision and recall, which are improved in 42 and 33 points respectively.


title: Variational Bayes under Model Misspecification

abstract: Variational Bayes (VB) is a scalable alternative to Markov chain Monte Carlo (MCMC) for Bayesian posterior inference. Though popular, VB comes with few theoretical guarantees, most of which focus on well-specified models. However, models are rarely well-specified in practice. In this work, we study VB under model misspecification. We prove the VB posterior is asymptotically normal and centers at the value that minimizes the Kullback-Leibler (KL) divergence to the true data-generating distribution. Moreover, the VB posterior mean centers at the same value and is also asymptotically normal. These results generalize the variational Bernstein--von Mises theorem [29] to misspecified models. As a consequence of these results, we find that the model misspecification error dominates the variational approximation error in VB posterior predictive distributions. It explains the widely observed phenomenon that VB achieves comparable predictive accuracy with MCMC even though VB uses an approximating family. As illustrations, we study VB under three forms of model misspecification, ranging from model over-/under-dispersion to latent dimensionality misspecification. We conduct two simulation studies that demonstrate the theoretical results.


title: Switching 2D Magnetic States via Pressure Tuning of Layer Stacking

abstract: The physical properties of two-dimensional van der Waals (2D vdW) crystals depend sensitively on the interlayer coupling, which is intimately connected to the stacking arrangement and the interlayer spacing. For example, simply changing the twist angle between graphene layers can induce a variety of correlated electronic phases, which can be controlled further in a continuous manner by applying hydrostatic pressure to decrease the interlayer spacing. In the recently discovered 2D magnets, theory suggests that the interlayer exchange coupling strongly depends on layer separation, while the stacking arrangement can even change the sign of the magnetic exchange, thus drastically modifying the ground state. Here, we demonstrate pressure tuning of magnetic order in the 2D magnet CrI3. We probe the magnetic states using tunneling and scanning magnetic circular dichroism microscopy measurements. We find that the interlayer magnetic coupling can be more than doubled by hydrostatic pressure. In bilayer CrI3, pressure induces a transition from layered antiferromagnetic to ferromagnetic phases. In trilayer CrI3, pressure can create coexisting domains of three phases, one ferromagnetic and two distinct antiferromagnetic. The observed changes in magnetic order can be explained by changes in the stacking arrangement. Such coupling between stacking order and magnetism provides ample opportunities for designer magnetic phases and functionalities.


title: Temporal Attentive Alignment for Video Domain Adaptation

abstract: Although various image-based domain adaptation (DA) techniques have been proposed in recent years, domain shift in videos is still not well-explored. Most previous works only evaluate performance on small-scale datasets which are saturated. Therefore, we first propose a larger-scale dataset with larger domain discrepancy: UCF-HMDB_full. Second, we investigate different DA integration methods for videos, and show that simultaneously aligning and learning temporal dynamics achieves effective alignment even without sophisticated DA methods. Finally, we propose Temporal Attentive Adversarial Adaptation Network (TA3N), which explicitly attends to the temporal dynamics using domain discrepancy for more effective domain alignment, achieving state-of-the-art performance on three video DA datasets. The code and data are released at http://github.com/cmhungsteve/TA3N.


title: Automatic Discovery of Privacy-Utility Pareto Fronts

abstract: Differential privacy is a mathematical framework for privacy-preserving data analysis. Changing the hyperparameters of a differentially private algorithm allows one to trade off privacy and utility in a principled way. Quantifying this trade-off in advance is essential to decision-makers tasked with deciding how much privacy can be provided in a particular application while maintaining acceptable utility. Analytical utility guarantees offer a rigorous tool to reason about this trade-off, but are generally only available for relatively simple problems. For more complex tasks, such as training neural networks under differential privacy, the utility achieved by a given algorithm can only be measured empirically. This paper presents a Bayesian optimization methodology for efficiently characterizing the privacy--utility trade-off of any differentially private algorithm using only empirical measurements of its utility. The versatility of our method is illustrated on a number of machine learning tasks involving multiple models, optimizers, and datasets.


title: SAI: a Sensible Artificial Intelligence that plays with handicap and targets high scores in 9x9 Go (extended version)

abstract: We develop a new model that can be applied to any perfect information two-player zero-sum game to target a high score, and thus a perfect play. We integrate this model into the Monte Carlo tree search-policy iteration learning pipeline introduced by Google DeepMind with AlphaGo. Training this model on 9x9 Go produces a superhuman Go player, thus proving that it is stable and robust. We show that this model can be used to effectively play with both positional and score handicap, and to minimize suboptimal moves. We develop a family of agents that can target high scores against any opponent, and recover from very severe disadvantage against weak opponents. To the best of our knowledge, these are the first effective achievements in this direction.


title: Generalizable Adversarial Attacks with Latent Variable Perturbation Modelling

abstract: Adversarial attacks on deep neural networks traditionally rely on a constrained optimization paradigm, where an optimization procedure is used to obtain a single adversarial perturbation for a given input example. In this work we frame the problem as learning a distribution of adversarial perturbations, enabling us to generate diverse adversarial distributions given an unperturbed input. We show that this framework is domain-agnostic in that the same framework can be employed to attack different input domains with minimal modification. Across three diverse domains---images, text, and graphs---our approach generates whitebox attacks with success rates that are competitive with or superior to existing approaches, with a new state-of-the-art achieved in the graph domain. Finally, we demonstrate that our framework can efficiently generate a diverse set of attacks for a single given input, and is even capable of attacking \textit{unseen} test instances in a zero-shot manner, exhibiting attack generalization.


title: Graded cancellation properties of graded rings and graded unit-regular Leavitt path algebras

abstract: We raise the following general question regarding a ring graded by a group: "If $P$ is a ring-theoretic property, how does one define the graded version $P_{\operatorname{gr}}$ of the property $P$ in a meaningful way?". Some properties of rings have straightforward and unambiguous generalizations to their graded versions and these generalizations satisfy all the matching properties of the nongraded case. If $P$ is either being unit-regular, having stable range 1 or being directly finite, that is not the case. The first part of the paper addresses this issue. Searching for appropriate generalizations, we consider graded versions of cancellation, internal cancellation, substitution, and module-theoretic direct finiteness. In the second part of the paper, we turn to Leavitt path algebras. If $K$ is a trivially graded field and $E$ is an oriented graph, the Leavitt path algebra $L_K(E)$ is naturally graded by the ring of integers. If $E$ is a finite graph, we present a property of $E$ which is equivalent with $L_K(E)$ being graded unit-regular. This property critically depends on the lengths of paths to cycles making it stand out from other known graph conditions which characterize algebraic properties of $L_K(E).$ It also further illustrates that graded unit-regularity is quite restrictive in comparison to the alternative generalization of unit-regularity which we consider in the first part of the paper.


title: Physics-informed Autoencoders for Lyapunov-stable Fluid Flow Prediction

abstract: In addition to providing high-profile successes in computer vision and natural language processing, neural networks also provide an emerging set of techniques for scientific problems. Such data-driven models, however, typically ignore physical insights from the scientific system under consideration. Among other things, a physics-informed model formulation should encode some degree of stability or robustness or well-conditioning (in that a small change of the input will not lead to drastic changes in the output), characteristic of the underlying scientific problem. We investigate whether it is possible to include physics-informed prior knowledge for improving the model quality (e.g., generalization performance, sensitivity to parameter tuning, or robustness in the presence of noisy data). To that extent, we focus on the stability of an equilibrium, one of the most basic properties a dynamic system can have, via the lens of Lyapunov analysis. For the prototypical problem of fluid flow prediction, we show that models preserving Lyapunov stability improve the generalization error and reduce the prediction uncertainty.


title: Regular resolution for CNFs with almost bounded one-sided treewidth

abstract: We introduce a one-sided incidence tree decomposition of a CNF $\varphi$. This is a tree decomposition of the incidence graph of $\varphi$ where the underlying tree is rooted and the set of bags containing each clause induces a directed path in the tree. The one-sided treewidth is the smallest width of a one-sided incidence tree decomposition. We consider a class of unsatisfiable CNF $\varphi$ that can be turned into one of one sided treewidth at most $k$ by removal of at most $p$ clauses. We show that the size of regular resolution for this class of CNFs is FPT parameterized by $k$ and $p$. The results contributes to understanding the complexity of resolution for CNFs of bounded incidence treewidth, an open problem well known in the areas of proof complexity and knowledge compilation. In particular, the result significantly generalizes all the restricted classes of CNFs of bounded incidence treewidth that are known to admit an FPT sized resolution. The proof includes an auxiliary result and several new notions that may be of an independent interest.


title: Legal Concerns and Challenges in Cloud Computing

abstract: Legal issues have risen with the changing landscape of computing, especially when the service, data and infrastructure is not owned by the user. With the Cloud, the question arises as to who is in the possession of the data. The Cloud provider can be considered as a legal custodian, owner or possessor of the data thereby causing complexities in legal matters around trademark infringement, privacy of users and their data, abuse and security. By introducing Cloud design focusing on privacy, legal as a service on a Cloud and service provider accountability, users can expect the service providers to be accountable for privacy and data in addition to their regular SLAs.


title: Global embeddings of BTZ and Schwarzschild-AdS type black holes in a flat space

abstract: We study the problem of construction of global isometric embedding for spherically symmetric black holes with negative cosmological constant in various dimensions. Firstly, we show that there is no such embedding for 4D RN-AdS black hole in 6D flat ambient space, completing the classification which we started earlier. Then we construct an explicit embedding of non-spinning BTZ black hole in 6D flat ambient space. Using this embedding as an anzats, we then construct a global explicit embedding of (d)-dimensional Schwarzschild-AdS black hole in a flat (d+3)-dimensional ambient space.


title: Equal Opportunity and Affirmative Action via Counterfactual Predictions

abstract: Machine learning (ML) can automate decision-making by learning to predict decisions from historical data. However, these predictors may inherit discriminatory policies from past decisions and reproduce unfair decisions. In this paper, we propose two algorithms that adjust fitted ML predictors to make them fair. We focus on two legal notions of fairness: (a) providing equal opportunity (EO) to individuals regardless of sensitive attributes and (b) repairing historical disadvantages through affirmative action (AA). More technically, we produce fair EO and AA predictors by positing a causal model and considering counterfactual decisions. We prove that the resulting predictors are theoretically optimal in predictive performance while satisfying fairness. We evaluate the algorithms, and the trade-offs between accuracy and fairness, on datasets about admissions, income, credit and recidivism.


title: Impact of Non-perturbative QCD on CP Violation in Many-Body Final States of Flavor Transitions

abstract: The title of my talk pointed out central statements: the impact of non-perturbative QCD on {\bf CP} asymmetries in many-body FS in charm \& beauty hadrons. For practical reasons one measures first {\bf CP} violation in two-body final states of heavy flavor hadrons. However, those are small parts of charm hadrons and tiny ones for beauty hadrons; therefore one has to probe {\bf CP} asymmetries in three- \& four-body final states. Thus the transitions to the many-body FS basically give information about the underlying dynamics. The impact of non-perturbative QCD on {\bf CP} asymmetries in many-body FS shows that -- in principle; it is a true challenge even in a semi-quantitative way. One needs correlations with other transitions. That is my strategy; however, I have to discuss the tactics on the same level like using consistent parameterization of the CKM matrix. Our community has entered a novel era: direct {\bf CP} violation has been found in $D^0 \to h^+h^-$ decays \cite{CHARM}. Finally I give short comments about the possible impact of New Dynamics on direct {\bf CP} violation in $K_L \to 2 \pi$ and probe {\bf CP} asymmetry in $J/\psi \to \bar \Lambda \Lambda$ transitions.


title: Inertial Extended-Lagrangian Scheme for Solving Charge Equilibration Models

abstract: The inertial extended Lagrangian/self-consistent field scheme (iEL-SCF) has been adopted for solving charge equilibration in LAMMPS as part of the reactive force field ReaxFF, which due to the charge conservation constraint requires solving two sets of linear system of equations for the new charges at each molecular dynamics time-step. Therefore, the extended Lagrangian for charge equilibration is comprised of two auxiliary variables for the intermediate charges which serve as an initial guess for the real charges. We show that the iEL-SCF is able to reduce the number of SCF cycles by 50-80% of the original conjugate gradient self-consistent field solver as tested across diverse systems including water, ferric hydroxide, nitramine RDX, and hexanitrostilbene.


title: On the role of Hermite-like polynomials in the Fock representations of Gaussian states

abstract: The expansion of quantum states and operators in terms of Fock states plays a fundamental role in the field of continuous-variable quantum mechanics. In particular, for general single-mode Gaussian operators and Gaussian noisy states, many different approaches have been used in the evaluation of their Fock representation. In this paper a natural approach has been applied using exclusively the operational properties of the Hermite and Hermite-like polynomials and showing their fundamental role in this field. Closed-form results in terms of polynomials, exponentials, and simple algebraic functions are the major contribution of the paper.


title: RSN: Randomized Subspace Newton

abstract: We develop a randomized Newton method capable of solving learning problems with huge dimensional feature spaces, which is a common setting in applications such as medical imaging, genomics and seismology. Our method leverages randomized sketching in a new way, by finding the Newton direction constrained to the space spanned by a random sketch. We develop a simple global linear convergence theory that holds for practically all sketching techniques, which gives the practitioners the freedom to design custom sketching approaches suitable for particular applications. We perform numerical experiments which demonstrate the efficiency of our method as compared to accelerated gradient descent and the full Newton method. Our method can be seen as a refinement and randomized extension of the results of Karimireddy, Stich, and Jaggi (2019).


title: Permutations of type $B$ with fixed number of descents and minus signs

abstract: We study three dimensional array of numbers $B(n,k,j)$, $0\le j,k\le n$, where $B(n,k,j)$ is the number of type $B$ permutations of order $n$ with $k$ descents and $j$ minus signs. We prove in particular, that $b(n,k,j):=B(n,k,j)/\binom{n}{j}$ is an integer and provide two combinatorial interpretations for these numbers.


title: Expressibility and entangling capability of parameterized quantum circuits for hybrid quantum-classical algorithms

abstract: Parameterized quantum circuits play an essential role in the performance of many variational hybrid quantum-classical (HQC) algorithms. One challenge in implementing such algorithms is to choose an effective circuit that well represents the solution space while maintaining a low circuit depth and number of parameters. To characterize and identify expressible, yet compact, parameterized circuits, we propose several descriptors, including measures of expressibility and entangling capability, that can be statistically estimated from classical simulations of parameterized quantum circuits. We compute these descriptors for different circuit structures, varying the qubit connectivity and selection of gates. From our simulations, we identify circuit fragments that perform well with respect to the descriptors. In particular, we quantify the substantial improvement in performance of two-qubit gates in a ring or all-to-all connected arrangement compared to that of those on a line. Furthermore, we quantify the improvement in expressibility and entangling capability achieved by sequences of controlled X-rotation gates compared to sequences of controlled Z-rotation gates. In addition, we investigate how expressibility "saturates" with increased circuit depth, finding that the rate and saturated-value appear to be distinguishing features of a parameterized quantum circuit template. While the correlation between each descriptor and performance of an algorithm remains to be investigated, methods and results from this study can be useful for both algorithm development and design of experiments for general variational HQC algorithms.


title: A closer look at Kadeishvili's theorem

abstract: We give a proof of the Homotopy Transfer Theorem following Kadeishvili's original strategy. Although Kadeishvili originally restricted himself to transferring a dg algebra structure to an $A_\infty$-structure on homology, we will see that a small modification of his argument proves the general case of transferring any kind of $\infty$-algebra structure along a quasi-isomorphism, under weaker hypotheses than existing proofs of this result.


title: Discrete Opinion Dynamics with M choices

abstract: Here, I study how to obtain an opinion dynamics model for the case where there are $M$ possible discrete choices and there is need to model how strong each agent choice is. The new model is obtained as an extension of the Continuous Opinions and Discrete Actions (CODA) model. Technical difficulties with the choice of proper variables for a simple model are solved. For the symmetrical case, a dimensionless model is found. However, when analyzing the results, a change of variables seems to be required for ease of interpretation. Extremism is observed here as well, generated by the local reinforcement of opinions inside domains of agents with the same choice.


title: Meromorphic Continuation of Koba-Nielsen String Amplitudes

abstract: In this article, we establish in a rigorous mathematical way that Koba-Nielsen amplitudes defined on any local field of characteristic zero are bona fide integrals that admit meromorphic continuations in the kinematic parameters. Our approach allows us to study in a uniform way open and closed Koba-Nielsen amplitudes over arbitrary local fields of characteristic zero. In the regularization process we use techniques of local zeta functions and embedded resolution of singularities. As an application we present the regularization of p-adic open string amplitudes with Chan-Paton factors and constant B-field. Finally, all the local zeta functions studied here are partition functions of certain 1D log-Coulomb gases, which shows an interesting connection between Koba-Nielsen amplitudes and statistical mechanics.


title: Effects of $\phi_0$-meson on the EOS of hyperon star in the relativistic mean field model

abstract: Nuclear effective interactions are considered as a vital tool to guide into the region of the high degree of isospin asymmetry and density. We take varieties of parameter sets of the RMF model to show the parametric dependence of the hyperon star properties. We add $\phi_0$-meson to $\sigma$-$\omega$-$\rho$ model. The effects of $\phi_0$-meson on the equation of state and consequently on the maximum mass of the hyperon star are discussed. Due to the inclusion of $\phi_0$-meson the threshold density of different hyperon production shift to higher density region. The effects of the hyperon-meson coupling constants on the maximum mass and radius of the hyperon stars are discussed.


title: Optimizing Generalized PageRank Methods for Seed-Expansion Community Detection

abstract: Landing probabilities (LP) of random walks (RW) over graphs encode rich information regarding graph topology. Generalized PageRanks (GPR), which represent weighted sums of LPs of RWs, utilize the discriminative power of LP features to enable many graph-based learning studies. Previous work in the area has mostly focused on evaluating suitable weights for GPRs, and only a few studies so far have attempted to derive the optimal weights of GRPs for a given application. We take a fundamental step forward in this direction by using random graph models to better our understanding of the behavior of GPRs. In this context, we provide a rigorous non-asymptotic analysis for the convergence of LPs and GPRs to their mean-field values on edge-independent random graphs. Although our theoretical results apply to many problem settings, we focus on the task of seed-expansion community detection over stochastic block models. There, we find that the predictive power of LPs decreases significantly slower than previously reported based on asymptotic findings. Given this result, we propose a new GPR, termed Inverse PR (IPR), with LP weights that increase for the initial few steps of the walks. Extensive experiments on both synthetic and real, large-scale networks illustrate the superiority of IPR compared to other GPRs for seeded community detection.


title: Decision problem for a class of univariate Pfaffian functions

abstract: We address the decision problem for sentences involving univariate functions constructed from a fixed Pfaffian function of order $1$. We present a new symbolic procedure solving this problem with a computable complexity based on the computation of suitable Sturm sequences. For a general Pfaffian function, we assume the existence of an oracle to determine the sign that a function of the class takes at a real algebraic number. For E-polynomials, we give an effective algorithm solving the problem without using oracles and apply it to solve a similar decision problem in the multivariate setting. Finally, we introduce a notion of Thom encoding for zeros of an E-polynomial and describe an algorithm for their computation.


title: Cavity-photon induced high order transitions between ground states of quantum dots

abstract: We show that quantum electromagnetic transitions to high orders are essential to describe the time-dependent path of a nanoscale electron system in a Coulomb blockage regime when coupled to external leads and placed in a three-dimensional rectangular photon cavity. The electronic system consists of two quantum dots embedded asymmetrically in a short quantum wire. The two lowest in energy spin degenerate electron states are mostly localized in each dot with only a tiny probability in the other dot. In the presence of the leads we identify a slow high order transition between the ground states of the two quantum dots. The Fourier power spectrum for photon-photon correlations in the steady state shows a Fano-type of a resonance for the frequency of the slow transition. Full account is taken of the geometry of the multi-level electronic system, and the electron-electron Coulomb interactions together with the para- and diamagnetic electron-photon interactions are treated with step wise exact numerical diagonalization and truncation of appropriate many-body Fock spaces. The matrix elements for all interactions are computed analytically or numerically exactly.


title: Bayesian Learning of Sum-Product Networks

abstract: Sum-product networks (SPNs) are flexible density estimators and have received significant attention due to their attractive inference properties. While parameter learning in SPNs is well developed, structure learning leaves something to be desired: Even though there is a plethora of SPN structure learners, most of them are somewhat ad-hoc and based on intuition rather than a clear learning principle. In this paper, we introduce a well-principled Bayesian framework for SPN structure learning. First, we decompose the problem into i) laying out a computational graph, and ii) learning the so-called scope function over the graph. The first is rather unproblematic and akin to neural network architecture validation. The second represents the effective structure of the SPN and needs to respect the usual structural constraints in SPN, i.e. completeness and decomposability. While representing and learning the scope function is somewhat involved in general, in this paper, we propose a natural parametrisation for an important and widely used special case of SPNs. These structural parameters are incorporated into a Bayesian model, such that simultaneous structure and parameter learning is cast into monolithic Bayesian posterior inference. In various experiments, our Bayesian SPNs often improve test likelihoods over greedy SPN learners. Further, since the Bayesian framework protects against overfitting, we can evaluate hyper-parameters directly on the Bayesian model score, waiving the need for a separate validation set, which is especially beneficial in low data regimes. Bayesian SPNs can be applied to heterogeneous domains and can easily be extended to nonparametric formulations. Moreover, our Bayesian approach is the first, which consistently and robustly learns SPN structures under missing data.


title: Unsupervised Domain Adaptation via Regularized Conditional Alignment

abstract: We propose a method for unsupervised domain adaptation that trains a shared embedding to align the joint distributions of inputs (domain) and outputs (classes), making any classifier agnostic to the domain. Joint alignment ensures that not only the marginal distributions of the domain are aligned, but the labels as well. We propose a novel objective function that encourages the class-conditional distributions to have disjoint support in feature space. We further exploit adversarial regularization to improve the performance of the classifier on the domain for which no annotated data is available.


title: Where's My Head? Definition, Dataset and Models for Numeric Fused-Heads Identification and Resolution

abstract: We provide the first computational treatment of fused-heads constructions (FH), focusing on the numeric fused-heads (NFH). FHs constructions are noun phrases (NPs) in which the head noun is missing and is said to be `fused' with its dependent modifier. This missing information is implicit and is important for sentence understanding. The missing references are easily filled in by humans but pose a challenge for computational models. We formulate the handling of FH as a two stages process: identification of the FH construction and resolution of the missing head. We explore the NFH phenomena in large corpora of English text and create (1) a dataset and a highly accurate method for NFH identification; (2) a 10k examples (1M tokens) crowd-sourced dataset of NFH resolution; and (3) a neural baseline for the NFH resolution task. We release our code and dataset, in hope to foster further research into this challenging problem.