title: Efficient high order accurate staggered semi-implicit discontinuous Galerkin methods for natural convection problems

abstract: We propose a new family of high order staggered semi-implicit discontinuous Galerkin (DG) methods for the simulation of natural convection problems. Assuming small temperature fluctuations, the Boussinesq approximation is valid and the flow can simply be modeled by the incompressible Navier-Stokes equations coupled with a transport equation for the temperature and a buoyancy source term in the momentum equation. Our numerical scheme is developed starting from the work presented in [TD14], in which the spatial domain is discretized using a face-based staggered unstructured mesh. For the computation of the advection and diffusion terms, two different algorithms are presented: i) a purely Eulerian explicit upwind-type scheme and ii) a semi-Lagrangian approach. The first methodology leads to a conservative scheme whose major drawback is the time step restriction imposed by the CFL stability condition. On the contrary, computational efficiency can be notably improved relying on a semi-Lagrangian approach. This method leads to an unconditionally stable scheme if the diffusive terms are discretized implicitly. Once the advection and diffusion contributions have been computed, the pressure Poisson equation is solved and the velocity is updated. As a second model for the computation of buoyancy-driven flows, we also consider the full compressible Navier-Stokes equations. The staggered semi-implicit DG method first proposed in [TD17] for all Mach number flows is properly extended to account for the gravity source terms arising in the momentum and energy conservation laws. The validity and the robustness of our novel class of staggered semi-implicit DG schemes is assessed at the aid of several classical benchmark problems, showing in all cases a good agreement with available numerical reference data. Finally, a detailed comparison between the incompressible and the compressible solver is presented.


title: Generalised linear models for prognosis and intervention: Theory, practice, and implications for machine learning

abstract: Prediction and causal explanation are fundamentally distinct tasks of data analysis. In health applications, this difference can be understood in terms of the difference between prognosis (prediction) and prevention/treatment (causal explanation). Nevertheless, these two concepts are often conflated in practice. We use the framework of generalised linear models (GLMs) to illustrate that predictive and causal queries require distinct processes for their application and subsequent interpretation of results. In particular, we identify five primary ways in which GLMs for prediction differ from GLMs for causal inference: (1) The covariates that should be considered for inclusion in (and possibly exclusion from) the model; (2) How a suitable set of covariates to include in the model is determined; (3) Which covariates are ultimately selected, and what functional form (i.e. parameterisation) they take; (4) How the model is evaluated; and (5) How the model is interpreted. We outline some of the potential consequences of failing to acknowledge and respect these differences, and additionally consider the implications for machine learning (ML) methods. We then conclude with three recommendations which we hope will help ensure that both prediction and causal modelling are used appropriately and to greatest effect in health research.


title: Experimental Measurement of the Quantum Metric Tensor and Related Topological Phase Transition with a Superconducting Qubit

abstract: Berry curvature is an imaginary component of the quantum geometric tensor (QGT) and is well studied in many branches of modern physics; however, the quantum metric as a real component of the QGT is less explored. Here, by using tunable superconducting circuits, we experimentally demonstrate two methods to directly measure the quantum metric tensor for characterizing the geometry and topology of underlying quantum states in parameter space. The first method is to probe the transition probability after a sudden quench, and the second one is to detect the excitation rate under weak periodic driving. Furthermore, based on quantum-metric and Berry-curvature measurements, we explore a topological phase transition in a simulated time-reversal-symmetric system, which is characterized by the Euler characteristic number instead of the Chern number. The work opens up a unique approach to explore the topology of quantum states with the QGT.


title: Bridging the Gap between Unit Test Generation and System Test Generation

abstract: Common test generators fall into two categories. Generating test inputs at the unit level is fast, but can lead to false alarms when a function is called with inputs that would not occur in a system context. If a generated input at the system level causes a failure, this is a true alarm, as the input could also have come from the user or a third party; but system testing is much slower. In this paper, we introduce the concept of a test generation bridge, which joins the accuracy of system testing with the speed of unit testing. A Test Generation Bridge allows to combine an arbitrary system test generator with an arbitrary unit test generator. It does so by carving parameterized unit tests from system (test) executions. These unit tests run in a context recorded from the system test, but individual parameters are left free for the unit test generator to systematically explore. This allows symbolic test generators such as KLEE to operate on individual functions in the recorded system context. If the test generator detects a failure, we lift the failure-inducing parameter back to the system input; if the failure can be reproduced at the system level, it is reported as a true alarm. Our BASILISK prototype can extract and test units out of complex systems such as a Web/Python/SQLite/C stack; in its evaluation, it achieves a higher coverage than a state-of-the-art system test generator.


title: Studies on Bone-mass Formation within a Theoretical Model

abstract: Bone-mass formation in human is looked at to understand the underlying dynamics with an eye on healing of bone-fracture and non-unions in non-invasive pathways. Three biological cells osteoblasts, osteoclasts and osteocytes are important players in creating new bone or osseous matter in which quite a few hormones, proteins and minerals have indispensable supportive role. Assuming populations of the three mentioned cells as variables, we frame a theoretical model which is represented as a set of time differential equations. These equations imitate the dynamic process of bone matter creation. High value of osteocytes with moderate level values of osteoblast and osteoclast, all at asymptotic scale, imply creation of new bone-matter in our model. The model is studied both analytically and numerically. Some important results are highlighted and relevant predictions are made which could be put to future experimental test.


title: Gap-Measure Tests with Applications to Data Integrity Verification

abstract: In this paper we propose and examine gap statistics for assessing uniform distribution hypotheses. We provide examples relevant to data integrity testing for which max-gap statistics provide greater sensitivity than chi-square ($\chi^2$), thus allowing the new test to be used in place of or as a complement to $\chi^2$ testing for purposes of distinguishing a larger class of deviations from uniformity. We establish that the proposed max-gap test has the same sequential and parallel computational complexity as $\chi^2$ and thus is applicable for Big Data analytics and integrity verification.


title: Selective Style Transfer for Text

abstract: This paper explores the possibilities of image style transfer applied to text maintaining the original transcriptions. Results on different text domains (scene text, machine printed text and handwritten text) and cross modal results demonstrate that this is feasible, and open different research lines. Furthermore, two architectures for selective style transfer, which means transferring style to only desired image pixels, are proposed. Finally, scene text selective style transfer is evaluated as a data augmentation technique to expand scene text detection datasets, resulting in a boost of text detectors performance. Our implementation of the described models is publicly available.


title: Generalizations of the Drift Laplace Equation in the Heisenberg Group and a Class of Grushin-Type Spaces

abstract: We find fundamental solutions to p-Laplace equations with drift terms in the Heisenberg group and Grushin-type planes. These solutions are natural generalizations to the fundamental solutions discovered by Beals, Gaveau, and Greiner for the Laplace equation with drift term. Our results are independent of the results of Bieske and Childers, in that Bieske and Childers consider a generalization that focuses on a p-Laplace-type equation while we primarily concentrate on a generalization of the drift term.


title: Stress Testing Network Reconstruction via Graphical Causal Model

abstract: An resilience optimal evaluation of financial portfolios implies having plausible hypotheses about the multiple interconnections between the macroeconomic variables and the risk parameters. In this paper, we propose a graphical model for the reconstruction of the causal structure that links the multiple macroeconomic variables and the assessed risk parameters, it is this structure that we call Stress Testing Network (STN). In this model, the relationships between the macroeconomic variables and the risk parameter define a "relational graph" among their time-series, where related time-series are connected by an edge. Our proposal is based on the temporal causal models, but unlike, we incorporate specific conditions in the structure which correspond to intrinsic characteristics this type of networks. Using the proposed model and given the high-dimensional nature of the problem, we used regularization methods to efficiently detect causality in the time-series and reconstruct the underlying causal structure. In addition, we illustrate the use of model in credit risk data of a portfolio. Finally, we discuss its uses and practical benefits in stress testing.


title: Unconditional reflexive polytopes

abstract: A convex body is unconditional if it is symmetric with respect to reflections in all coordinate hyperplanes. In this paper, we investigate unconditional lattice polytopes with respect to geometric, combinatorial, and algebraic properties. In particular, we characterize unconditional reflexive polytopes in terms of perfect graphs. As a prime example, we study the signed Birkhoff polytope. Moreover, we derive constructions for Gale-dual pairs of polytopes and we explicitly describe Gr\"obner bases for unconditional reflexive polytopes coming from partially ordered sets


title: Options as responses: Grounding behavioural hierarchies in multi-agent RL

abstract: This paper investigates generalisation in multi-agent games, where the generality of the agent can be evaluated by playing against opponents it hasn't seen during training. We propose two new games with concealed information and complex, non-transitive reward structure (think rock/paper/scissors). It turns out that most current deep reinforcement learning methods fail to efficiently explore the strategy space, thus learning policies that generalise poorly to unseen opponents. We then propose a novel hierarchical agent architecture, where the hierarchy is grounded in the game-theoretic structure of the game -- the top level chooses strategic responses to opponents, while the low level implements them into policy over primitive actions. This grounding facilitates credit assignment across the levels of hierarchy. Our experiments show that the proposed hierarchical agent is capable of generalisation to unseen opponents, while conventional baselines fail to generalise whatsoever.


title: Depth, relaxation and temperature dependence of defect complexes in scanning transmission electron microscopy

abstract: We propose a new analysis approach for scanning transmission electron microscopy (STEM) based on the Voronoi-cell integration method to determine the three-dimensional position of the InZn and VZn defect complex in ZnO. Using state of the art simulation software and hardware, we propose using a method of calculating Michelson Contrast on simulated images to determine the optimal acceptance angles to use in an experimental setting. The effect of defect position, DFT-relaxation and cooling the sample to liquid nitrogen temperatures is investigated. DFT-relaxation is shown to be of consequence to accurately determine the three-dimensional position of the defect. Relaxation is also shown to have a significant impact on neighbouring columns at liquid nitrogen temperatures.


title: Evaluating Discourse in Structured Text Representations

abstract: Discourse structure is integral to understanding a text and is helpful in many NLP tasks. Learning latent representations of discourse is an attractive alternative to acquiring expensive labeled discourse data. Liu and Lapata (2018) propose a structured attention mechanism for text classification that derives a tree over a text, akin to an RST discourse tree. We examine this model in detail, and evaluate on additional discourse-relevant tasks and datasets, in order to assess whether the structured attention improves performance on the end task and whether it captures a text's discourse structure. We find the learned latent trees have little to no structure and instead focus on lexical cues; even after obtaining more structured trees with proposed model modifications, the trees are still far from capturing discourse structure when compared to discourse dependency trees from an existing discourse parser. Finally, ablation studies show the structured attention provides little benefit, sometimes even hurting performance.


title: Asymptotic behavior of solutions of the dispersive generalized Benjamin-Ono equation

abstract: We show that for any uniformly bounded in time $H^1\cap L^1$ solution of the dispersive generalized Benjamin-Ono equation, the limit infimum, as time $t$ goes to infinity, converges to zero locally in an increasing-in-time region of space of order $t/\log t$. This result is in accordance with the one established by Mu\~noz and Ponce \cite{MP1} for solutions of the Benjamin-Ono equation. Similar to solutions of the Benjamin-Ono equation, for a solution of the dispersive generalized Benjamin-Ono equation, with a mild $L^1$-norm growth in time, its limit infimum must converge to zero, as time goes to infinity, locally in an increasing on time region of space of order depending on the rate of growth of its $L^1$-norm. As a consequence, the existence of breathers or any other solution for the dispersive generalized Benjamin-Ono equation moving with a speed "slower" than a soliton is discarded. In our analysis the use of commutators expansions is essential.


title: MISO is Making a Comeback With Better Proofs and Rates

abstract: MISO, also known as Finito, was one of the first stochastic variance reduced methods discovered, yet its popularity is fairly low. Its initial analysis was significantly limited by the so-called Big Data assumption. Although the assumption was lifted in subsequent work using negative momentum, this introduced a new parameter and required knowledge of strong convexity and smoothness constants, which is rarely possible in practice. We rehabilitate the method by introducing a new variant that needs only smoothness constant and does not have any extra parameters. Furthermore, when removing the strong convexity constant from the stepsize, we present a new analysis of the method, which no longer uses the assumption that every component is strongly convex. This allows us to also obtain so far unknown nonconvex convergence of MISO. To make the proposed method efficient in practice, we derive minibatching bounds with arbitrary uniform sampling that lead to linear speedup when the expected minibatch size is in a certain range. Our numerical experiments show that MISO is a serious competitor to SAGA and SVRG and sometimes outperforms them on real datasets.


title: Introduction of water-vapor broadening coefficients and their temperature dependence exponents into the HITRAN database, Part I: CO2, N2O, CO, CH4, O2, NH3, and H2S

abstract: The amount of water vapor in the terrestrial atmosphere is highly variable both spatially and temporally. In the tropics it sometimes constitutes 4-5% of the atmosphere. At the same time collisional broadening of spectral lines by water vapor is much larger than that by nitrogen and oxygen. Therefore, in order to accurately characterize and model spectra of the atmospheres with significant amounts of water vapor, the line-shape parameters for spectral lines broadened by water vapor are required. In this work, the line-broadening coefficients (and their temperature dependence exponents) due to the pressure of water vapor for lines of CO2, N2O, CO, CH4, O2, NH3, and H2S from both experimental and theoretical studies were collected and carefully reviewed. A set of semi-empirical models based on these collected data was created and then used to estimate water broadening and its temperature dependence for all transitions of selected molecules in the HITRAN2016 database.


title: Scenario approach for minmax optimization with emphasis on the nonconvex case: positive results and caveats

abstract: We treat the so-called scenario approach, a popular probabilistic approximation method for robust minmax optimization problems via independent and indentically distributed (i.i.d) sampling from the uncertainty set, from various perspectives. The scenario approach is well-studied in the important case of convex robust optimization problems, and here we examine how the phenomenon of concentration of measures affects the i.i.d sampling aspect of the scenario approach in high dimensions and its relation with the optimal values. Moreover, we perform a detailed study of both the asymptotic behaviour (consistency) and finite time behaviour of the scenario approach in the more general setting of nonconvex minmax optimization problems. In the direction of the asymptotic behaviour of the scenario approach, we present an obstruction to consistency that arises when the decision set is noncompact. In the direction of finite sample guarantees, we establish a general methodology for extracting `probably approximately correct' type estimates for the finite sample behaviour of the scenario approach for a large class of nonconvex problems.


title: Growing Extra Dimensions in AdS/CFT

abstract: What is the dimension of spacetime? We address this question in the context of the AdS/CFT Correspondence. We give a prescription for computing the number of large bulk dimensions, $D$, from strongly-coupled CFT$_d$ data, where "large" means parametrically of order the AdS scale. The idea is that unitarity of 1-loop AdS amplitudes, dual to non-planar CFT correlators, fixes $D$ in terms of tree-level data. We make this observation rigorous by deriving a positive-definite sum rule for the 1-loop double-discontinuity in the flat space/bulk-point limit. This enables us to prove an array of AdS/CFT folklore, and to infer new properties of large $N$ CFTs at strong coupling that ensure consistency of emergent large extra dimensions with string/M-theory. We discover an OPE universality at the string scale: to leading order in large $N$, heavy-heavy-light three-point functions, with heavy operators that are parametrically lighter than a power of $N$, are linear in the heavy conformal dimension. We explore its consequences for supersymmetric CFTs and explain how emergent large extra dimensions relate to a Sublattice Weak Gravity Conjecture for CFTs. Lastly, we conjecture, building on a claim of arXiv:0908.0756, that any CFT with large higher-spin gap and no global symmetries has a holographic hierarchy: $D=d+1$


title: What do AI algorithms actually learn? - On false structures in deep learning

abstract: There are two big unsolved mathematical questions in artificial intelligence (AI): (1) Why is deep learning so successful in classification problems and (2) why are neural nets based on deep learning at the same time universally unstable, where the instabilities make the networks vulnerable to adversarial attacks. We present a solution to these questions that can be summed up in two words; false structures. Indeed, deep learning does not learn the original structures that humans use when recognising images (cats have whiskers, paws, fur, pointy ears, etc), but rather different false structures that correlate with the original structure and hence yield the success. However, the false structure, unlike the original structure, is unstable. The false structure is simpler than the original structure, hence easier to learn with less data and the numerical algorithm used in the training will more easily converge to the neural network that captures the false structure. We formally define the concept of false structures and formulate the solution as a conjecture. Given that trained neural networks always are computed with approximations, this conjecture can only be established through a combination of theoretical and computational results similar to how one establishes a postulate in theoretical physics (e.g. the speed of light is constant). Establishing the conjecture fully will require a vast research program characterising the false structures. We provide the foundations for such a program establishing the existence of the false structures in practice. Finally, we discuss the far reaching consequences the existence of the false structures has on state-of-the-art AI and Smale's 18th problem.


title: Construction of high precision numerical single and binary black hole initial data

abstract: We present a novel implicit numerical implementation of the parabolic-hyperbolic formulation of the constraints of general relativity. The proposed method is unconditionally stable, has the advantage of not requiring the imposition of any boundary conditions in the strong field regime, and offers a holistic (all inclusive) approach to the construction of single and binary black hole initial data. The new implicit solver is extensively tested against known exact black hole solutions and is used to construct initial data for several single and binary black hole configurations.


title: Automatic Health Problem Detection from Gait Videos Using Deep Neural Networks

abstract: The aim of this study is developing an automatic system for detection of gait-related health problems using Deep Neural Networks (DNNs). The proposed system takes a video of patients as the input and estimates their 3D body pose using a DNN based method. Our code is publicly available at https://github.com/rmehrizi/multi-view-pose-estimation. The resulting 3D body pose time series are then analyzed in a classifier, which classifies input gait videos into four different groups including Healthy, with Parkinsons disease, Post Stroke patient, and with orthopedic problems. The proposed system removes the requirement of complex and heavy equipment and large laboratory space, and makes the system practical for home use. Moreover, it does not need domain knowledge for feature engineering since it is capable of extracting semantic and high level features from the input data. The experimental results showed the classification accuracy of 56% to 96% for different groups. Furthermore, only 1 out of 25 healthy subjects were misclassified (False positive), and only 1 out of 70 patients were classified as a healthy subject (False negative). This study presents a starting point toward a powerful tool for automatic classification of gait disorders and can be used as a basis for future applications of Deep Learning in clinical gait analysis. Since the system uses digital cameras as the only required equipment, it can be employed in domestic environment of patients and elderly people for consistent gait monitoring and early detection of gait alterations.


title: L-SVRG and L-Katyusha with Arbitrary Sampling

abstract: We develop and analyze a new family of {\em nonaccelerated and accelerated loopless variance-reduced methods} for finite sum optimization problems. Our convergence analysis relies on a novel expected smoothness condition which upper bounds the variance of the stochastic gradient estimation by a constant times a distance-like function. This allows us to handle with ease {\em arbitrary sampling schemes} as well as the nonconvex case. We perform an in-depth estimation of these expected smoothness parameters and propose new importance samplings which allow {\em linear speedup} when the expected minibatch size is in a certain range. Furthermore, a connection between these expected smoothness parameters and expected separable overapproximation (ESO) is established, which allows us to exploit data sparsity as well. Our results recover as special cases the recently proposed loopless SVRG and loopless Katyusha.


title: The $\Lambda$-invariant and topological pathways to influence sub-micron strength and crystal plasticity

abstract: In small volumes, sample dimensions are known to strongly influence mechanical behavior, especially strength and crystal plasticity. This correlation fades away at the so-called mesoscale, loosely defined at several micrometers in both experiments and simulations. However, this picture depends on the entanglement of the initial defect configuration. In this paper, we study the effect of sample dimensions with a full control on dislocation topology, through the use of a novel observable for dislocation ensembles, the $\Lambda$-invariant, that depends only on mutual dislocation linking: It is built on the natural vortex character of dislocations and it has a continuum/discrete correspondence that may assist multiscale modeling descriptions. We investigate arbitrarily complex initial dislocation microstructures in sub-micron-sized pillars, using three-dimensional discrete dislocation dynamics simulations for finite volumes. We demonstrate how to engineer nanoscale dislocation ensembles that appear virtually independent from sample dimensions, either by biased-random dislocation loop deposition or by sequential mechanical loads of compression and torsion.


title: Development of a blood oxygenation phantom for photoacoustic tomography combined with online pO2 detection and flow spectrometry

abstract: Photoacoustic tomography (PAT) is intrinsically sensitive to blood oxygen saturation (sO2) in vivo. However, making accurate sO2 measurements without knowledge of tissue- and instrumentation-related correction factors is extremely challenging. We have developed a low-cost flow phantom system to facilitate validation of photoacoustic tomography systems. The phantom is composed of a flow circuit, which is partially embedded within a tissue mimicking phantom, with independent sensors providing online monitoring of the optical absorption spectrum and partial pressure of oxygen in the tube. We first establish the flow phantom using two small molecule dyes that are frequently used for photoacoustic imaging: methylene blue (MB) and indocyanine green (ICG). We then demonstrate the potential of the phantom for evaluating sO2 using chemical oxygenation and deoxygenation of blood in the phantom. Using this dynamic assessment of the photoacoustic sO2 measurement in phantoms in relation to a ground truth, we explore the influence of multispectral processing and spectral coloring on accurate assessment of sO2. Future studies could exploit this low-cost dynamic flow phantom to validate fluence correction algorithms and explore additional blood parameters such as pH, and also absorptive and other properties of different fluids.


title: Partial and semi-partial measures of spatial associations for multivariate lattice data

abstract: This paper concerns the development of partial and semi-partial measures of spatial associations in the context of multivariate spatial lattice data which describe global or local associations among spatially aggregated measurements for pairs of different components conditional on all remaining components. The new measures are illustrated using aggregated data on crime counts at ward level.


title: Dynamics and symmetries in chiral $SU(N)$ gauge theories

abstract: Dynamics and symmetry realization in various chiral gauge theories in four dimensions are investigated, generalizing a recent work by M. Shifman and the present authors, by relying on the standard 't Hooft anomaly matching conditions and on some other general ideas. These requirements are so strong that the dynamics of the systems are severely constrained. Color-flavor or color-flavor-flavor locking, dynamical Abelianization, and combinations of these, are powerful ideas which often leads to solutions of the anomaly matching conditions. Moreover, a conjecture is made on generation of a mass hierarchy associated with symmetry breaking in chiral gauge theories, which has no analogues in vector-like gauge theories such as QCD.


title: Two accreting protoplanets around the young star PDS 70

abstract: Newly forming proto-planets are expected to create cavities and substructures in young, gas-rich proto-planetary disks, but they are difficult to detect as they could be confused with disk features affected by advanced image-analysis techniques. Recently, a planet was discovered inside the gap of the transitional disk of the T-Tauri star PDS 70. Here we report on the detection of strong H-alpha emission from two distinct locations in the PDS 70 system, one corresponding to the previously discovered planet PDS 70 b, which confirms the earlier H$\alpha$ detection, and another located close to the outer-edge of the gap, coinciding with a previously identified bright dust spot in the disk and with a small opening in a ring of molecular emission. We identify this second H$\alpha$ peak as a second proto-planet in the PDS 70 system. The H$\alpha$ emission spectra of both proto-planets indicate ongoing accretion onto the proto-planets, which appear to be near a 2:1 mean motion resonance. Our observations show that adaptive-optics-assisted, medium-resolution, integral-field spectroscopy with MUSE targeting accretion signatures will be a powerful way to trace ongoing planet formation in transitional disks at different stages of their evolution. Finding more young planetary systems in mean motion resonance would give credibility to the Grand Tack hypothesis in which Jupiter and Saturn migrated in a resonance orbit during the early formation period of our Solar System.


title: Gradient bounds for radial maximal functions

abstract: In this paper we study the regularity properties of certain maximal operators of convolution type at the endpoint $p=1$, when acting on radial data. In particular, for the heat flow maximal operator and the Poisson maximal operator, when the initial datum $u_0 \in W^{1,1}( \mathbb{R}^d)$ is a radial function, we show that the associated maximal function $u^*$ is weakly differentiable and $$\|\nabla u^*\|_{L^1(\mathbb{R}^d)} \lesssim_d \|\nabla u_0\|_{L^1(\mathbb{R}^d)}.$$ This establishes the analogue of a recent result of H. Luiro for the uncentered Hardy-Littlewood maximal operator, now in a centered setting with smooth kernels. In a second part of the paper, we establish similar gradient bounds for maximal operators on the sphere $\mathbb{S}^d$, when acting on polar functions. Our study includes the uncentered Hardy-Littlewood maximal operator, the heat flow maximal operator and the Poisson maximal operator on $\mathbb{S}^d$.


title: Dispersion forces in inhomogeneous planarly layered media: A one-dimensional model for effective polarisabilities

abstract: Dispersion forces such as van der Waals forces between two microscopic particles, the Casimir--Polder forces between a particle and a macroscopic object or the Casimir force between two dielectric objects are well studied in vacuum. However, in realistic situations the interacting objects are often embedded in an environmental medium. Such a solvent influences the induced dipole interaction. With the framework of macroscopic quantum electrodynamics, these interactions are mediated via an exchange of virtual photons. Via this method the impact of a homogeneous solvent medium can be expressed as local-field corrections leading to excess polarisabilities which have previously been derived for hard boundary conditions. In order to develop a more realistic description, we investigate on a one-dimensional analog system illustrating the influence of a continuous dielectric profile.


title: Equivalence between the planar Dirac oscillator and a spin-1/2 fermion embedded in a transverse homogeneous magnetic field

abstract: It is shown that a spin-1/2 fermion coupled to the axially symmetric electromagnetic vector potential has the same matrix structure as that one for the planar Dirac oscillator. In particular, the planar Dirac oscillator can be interpreted as a charged particle minimally coupled to a transverse homogeneous magnetic field.


title: Self-planting: digging holes in rough landscapes

abstract: Motivated by a potential application in economics, we investigate a simple dynamical scheme to produce planted solutions in optimization problems with continuous variables. We consider the perceptron model as a prototypical model. Starting from random input patterns and perceptron weights, we find a locally optimal assignment of weights by gradient descent; we then remove misclassified patterns (if any), and replace them by new, randomly extracted patterns. This "remove and replace" procedure is iterated until perfect classification is achieved. We call this procedure "self-planting" because the "planted" state is not pre-assigned but results from a co-evolution of weights and patterns. We find an algorithmic phase transition separating a region in which self-planting is efficiently achieved from a region in which it takes exponential time in the system size. We conjecture that this transition might exist in a broad class of similar problems.


title: Models of Martin-L\"of type theory from algebraic weak factorisation systems

abstract: We introduce type-theoretic algebraic weak factorisation systems and show how they give rise to homotopy-theoretic models of Martin-L\"of type theory. This is done by showing that the comprehension category associated to a type-theoretic algebraic weak factorisation system satisfies the assumptions necessary to apply a right adjoint method for splitting comprehension categories. We then provide methods for constructing several examples of type-theoretic algebraic weak factorisation systems, encompassing the existing groupoid model and cubical sets models, as well as some models based on normal fibrations


title: Efficient Broadband Terahertz Generation from Organic Crystal BNA Using Near Infrared Pump

abstract: We are reporting on terahertz generation from organic crystal BNA using a 1.15 to 1.55 um near infrared pump. We observed a very large emission spectrum extending up to 7 THz, compared to 2.5 THz from Ti:Sa pump in previous reports. The maximum optical-to-THz conversion efficiency in our experiment was 0.8% at 1 kHz repetition rate and without saturation leading to a peak electric field of 1 GV/m. Our results show pronounced phase matching privilege for intense terahertz generation using a pump in the 1.15 to 1.25 um range where high energy near infrared pump sources operate.


title: Constructing Energy-efficient Mixed-precision Neural Networks through Principal Component Analysis for Edge Intelligence

abstract: The `Internet of Things' has brought increased demand for AI-based edge computing in applications ranging from healthcare monitoring systems to autonomous vehicles. Quantization is a powerful tool to address the growing computational cost of such applications, and yields significant compression over full-precision networks. However, quantization can result in substantial loss of performance for complex image classification tasks. To address this, we propose a Principal Component Analysis (PCA) driven methodology to identify the important layers of a binary network, and design mixed-precision networks. The proposed Hybrid-Net achieves a more than 10% improvement in classification accuracy over binary networks such as XNOR-Net for ResNet and VGG architectures on CIFAR-100 and ImageNet datasets while still achieving up to 94% of the energy-efficiency of XNOR-Nets. This work furthers the feasibility of using highly compressed neural networks for energy-efficient neural computing in edge devices.


title: Extrapolation Methods for fixed-point Multilinear PageRank computations

abstract: Nonnegative tensors arise very naturally in many applications that involve large and complex data flows. Due to the relatively small requirement in terms of memory storage and number of operations per step, the (shifted) higher-order power method is one of the most commonly used technique for the computation of positive Z-eigenvectors of this type of tensors. However, unlike the matrix case, the method may fail to converge even for irreducible tensors. Moreover, when it converges, its convergence rate can be very slow. These two drawbacks often make the computation of the eigenvectors demanding or unfeasible for large problems. In this work we consider a particular class of nonnegative tensors associated to the multilinear PageRank modification of higher-order Markov chains. Based on the simplified topological ${\epsilon}$-algorithm in its restarted form, we introduce an extrapolation-based acceleration of power method type algorithms, namely the shifted fixed-point method and the inner-outer method. The accelerated methods show remarkably better performance, with faster convergence rates and reduced overall computational time. Extensive numerical experiments on synthetic and real-world datasets demonstrate the advantages of the introduced extrapolation techniques.


title: Trisection diagrams and twists of 4-manifolds

abstract: A theorem of Katanaga, Saeki, Teragaito, and Yamada relates Gluck and Price twists of 4-manifolds. Using trisection diagrams, we give a purely diagrammatic proof of this theorem, and answer a question of Kim and Miller.


title: Regularization Advantages of Multilingual Neural Language Models for Low Resource Domains

abstract: Neural language modeling (LM) has led to significant improvements in several applications, including Automatic Speech Recognition. However, they typically require large amounts of training data, which is not available for many domains and languages. In this study, we propose a multilingual neural language model architecture, trained jointly on the domain-specific data of several low-resource languages. The proposed multilingual LM consists of language specific word embeddings in the encoder and decoder, and one language specific LSTM layer, plus two LSTM layers with shared parameters across the languages. This multilingual LM model facilitates transfer learning across the languages, acting as an extra regularizer in very low-resource scenarios. We integrate our proposed multilingual approach with a state-of-the-art highly-regularized neural LM, and evaluate on the conversational data domain for four languages over a range of training data sizes. Compared to monolingual LMs, the results show significant improvements of our proposed multilingual LM when the amount of available training data is limited, indicating the advantages of cross-lingual parameter sharing in very low-resource language modeling.


title: New Global Potential Energy Surfaces of the ground 3A' and 3A' states of the H2O system

abstract: This paper presents two new adiabatic, global potential energy surfaces (PESs) for the two lowest $^3A'$ and $^3A''$ electronic states of the O($^3P$)+H$_2$ system. For each of these states, ab initio electronic energies were calculated for more than 5000 geometries using internally contracted multireference configuration interaction methods. The calculated points were then fitted using the ansatz by Aguado et al. [Comput. Phys. Commun. 108, 259 (1998)] leading to very accurate analytical potentials well adapted to perform reaction dynamics studies. Overall, the topographies of both PESs are in good agreement with the benchmark potentials of Rogers et al., but those presented in this work reproduce better the height and degeneracy of the two states at the saddle point. Moreover, the long range potential in the entrance channel does not require any cutoff. These features makes the new PESs particularly suitable for a comparison of the dynamics on each of them. The new set of PESs were then used to perform quantum mechanics and quasiclassical trajectory calculations to determine integral and differential cross sections, which are compared to the experimental measurements by Garton et al. [J. Chem. Phys., 118, 1585 (2003)].


title: Multimodal Ensemble Approach to Incorporate Various Types of Clinical Notes for Predicting Readmission

abstract: Electronic Health Records (EHRs) have been heavily used to predict various downstream clinical tasks such as readmission or mortality. One of the modalities in EHRs, clinical notes, has not been fully explored for these tasks due to its unstructured and inexplicable nature. Although recent advances in deep learning (DL) enables models to extract interpretable features from unstructured data, they often require a large amount of training data. However, many tasks in medical domains inherently consist of small sample data with lengthy documents; for a kidney transplant as an example, data from only a few thousand of patients are available and each patient's document consists of a couple of millions of words in major hospitals. Thus, complex DL methods cannot be applied to these kinds of domains. In this paper, we present a comprehensive ensemble model using vector space modeling and topic modeling. Our proposed model is evaluated on the readmission task of kidney transplant patients and improves 0.0211 in terms of c-statistics from the previous state-of-the-art approach using structured data, while typical DL methods fail to beat this approach. The proposed architecture provides the interpretable score for each feature from both modalities, structured and unstructured data, which is shown to be meaningful through a physician's evaluation.


title: Diffusion of charm quarks in jets in high-energy heavy-ion collisions

abstract: The radial distribution of $D^0$ mesons in jets probes the diffusion of charm quark relative to the jet axis and provides a new perspective to study the interaction mechanisms between heavy quarks and the medium in the nucleus-nucleus collisions. The in-medium parton propagations are described by a Monte Carlo transport model which uses the next-to-leading order (NLO) plus parton shower (PS) event generator SHERPA as input and includes elastic (collisional) and inelastic (radiative) interaction for heavy quarks as well as light partons. At low $D^0$ meson $p_T$, the radial distribution significantly shifts to larger radius indicating a strong diffusion effect which is consistent with the recent experimental data. We demonstrate that the angular deviation of charm quarks declines with $p_T$ and is very sensitive to the collisional more than radiative interaction at $p_T<5$~GeV. As predictions, we present the $D^0$ meson radial distribution in jets in p+p and $0-10\%$ Au+Au collisions at $\sqrt{s_{NN}}=200$~GeV at the RHIC, and also estimate the nuclear modification factor of charm jet in central Au+Au collisions at 200~GeV at the RHIC and central Pb+Pb collisions at $5.02$~TeV at the LHC.


title: Photoinduced hidden CDW state and relaxation dynamics of 1T-TaS_2 probed by time-resolved terahertz spectroscopy

abstract: The dynamical properties of single crystal 1T-TaS$_{2}$ are investigated both in commensurate charge density wave state (CCDW state) and hidden charge density wave state (HCDW state). We develop a useful criterion in time-domain transmission terahertz measurement to judge whether the compound is driven into a metastable state or still in its virgin state. An increase of terahertz conductivity by two orders of magnitude from CCDW state to HCDW state is obtained by taking account of the penetration depth mismatch, which is in agreement with reported \emph{dc} transport measurement. Upon weak pumping, only transient processes with rapid decay dynamics are triggered in both CCDW and HCDW states. We compare the conductivity increases in terahertz frequency range between transient and HCDW states and suggest that fluctuated metallic domain walls may develop in the transient states.


title: Effective Field Theory of Loop Quantum Cosmology

abstract: Quantum cosmology is traditionally formulated in a minisuperspace setting, implicitly averaging fields over space to obtain homogeneous models. For universal reasons related to the uncertainty principle, quantum corrections then depend on the size of the averaging volume. In minisuperspace truncations, the value of this volume remains an arbitrary parameter devoid of physical meaning, but in an effective field theory it is identified with the infrared scale of inhomogeneous modes. Moreover, the infrared scale is running during gravitational collapse, when regions in which homogeneity remains approximately valid shrink to increasingly smaller co-moving sizes. Conceptual implications of this infrared renormalization for perturbative inhomogeneity in quantum cosmology are presented here, mainly for the example of loop quantum cosmology. Several claims made in this framework are altered by infrared renormalization.


title: How multilingual is Multilingual BERT?

abstract: In this paper, we show that Multilingual BERT (M-BERT), released by Devlin et al. (2018) as a single language model pre-trained from monolingual corpora in 104 languages, is surprisingly good at zero-shot cross-lingual model transfer, in which task-specific annotations in one language are used to fine-tune the model for evaluation in another language. To understand why, we present a large number of probing experiments, showing that transfer is possible even to languages in different scripts, that transfer works best between typologically similar languages, that monolingual corpora can train models for code-switching, and that the model can find translation pairs. From these results, we can conclude that M-BERT does create multilingual representations, but that these representations exhibit systematic deficiencies affecting certain language pairs.


title: Performance Requirements of Advanced Healthcare Services over Future Cellular Systems

abstract: The fifth generation (5G) of communication systems has ambitious targets of data rate, end-to-end latency, and connection availability, while the deployment of a new flexible network architecture will spur new applications. E-health and mobile health (m-health) solutions will meet the increasing demand of new, sustainable, and more accessible services beneficial to both practitioners and the rapidly aging population. This paper aims at defining the technical requirements of future cellular networks to support a variety of advanced healthcare services (e.g., smart hospital, telesurgery, connected ambulances, and monitoring). While 5G will be able to satisfy these requirements, it will also pave the way for future e- and m-health in the sixth-generation (6G) cellular networks.


title: Embedded hyper-parameter tuning by Simulated Annealing

abstract: We propose a new metaheuristic training scheme that combines Stochastic Gradient Descent (SGD) and Discrete Optimization in an unconventional way. Our idea is to define a discrete neighborhood of the current SGD point containing a number of "potentially good moves" that exploit gradient information, and to search this neighborhood by using a classical metaheuristic scheme borrowed from Discrete Optimization. In the present paper we investigate the use of a simple Simulated Annealing (SA) metaheuristic that accepts/rejects a candidate new solution in the neighborhood with a probability that depends both on the new solution quality and on a parameter (the temperature) which is modified over time to lower the probability of accepting worsening moves. We use this scheme as an automatic way to perform hyper-parameter tuning, hence the title of the paper. A distinctive feature of our scheme is that hyper-parameters are modified within a single SGD execution (and not in an external loop, as customary) and evaluated on the fly on the current minibatch, i.e., their tuning is fully embedded within the SGD algorithm. The use of SA for training is not new, but previous proposals were mainly intended for non-differentiable objective functions for which SGD is not applied due to the lack of gradients. On the contrary, our SA method requires differentiability of (a proxy of) the loss function, and leverages on the availability of a gradient direction to define local moves that have a large probability to improve the current solution. Computational results on image classification (CIFAR-10) are reported, showing that the proposed approach leads to an improvement of the final validation accuracy for modern Deep Neural Networks such as ResNet34 and VGG16.


title: Convergence of the solutions of the MFG discounted Hamilton-Jacobi equation

abstract: We consider the solution $\mathcal V_\delta$ of the discounted Hamilton-Jacobi equation in the Wasserstein space arising from potential MFG and we prove its full convergence to a corrector function $\chi_0$. We follow the structure of the proof of the analogue result in the finite dimensional setting provided by Davini, Fathi, Iturriaga, Zavidovique in 2017. We characterize the limit $\chi_0$ through a particular set of smooth Mather measures. A major point that distinguishes the techniques deployed in the standard setting from the ones that we use here is the lack of mollification in the Wasserstain space.


title: The Alon-Tarsi number of subgraphs of a planar graph

abstract: This paper constructs a planar graph $G_1$ such that for any subgraph $H$ of $G_1$ with maximum degree $\Delta(H) \le 3$, $G_1-E(H)$ is not $3$-choosable, and a planar graph $G_2$ such that for any star forest $F$ in $G_2$, $G_2-E(F)$ contains a copy of $K_4$ and hence $G_2-E(F)$ is not $3$-colourable. On the other hand, we prove that every planar graph $G$ contains a forest $F$ such that the Alon-Tarsi number of $G - E(F)$ is at most $3$, and hence $G - E(F)$ is 3-paintable and 3-choosable.


title: A numerical measure of the instability of Mapper-type algorithms

abstract: Mapper is an unsupervised machine learning algorithm generalising the notion of clustering to obtain a geometric description of a dataset. The procedure splits the data into possibly overlapping bins which are then clustered. The output of the algorithm is a graph where nodes represent clusters and edges represent the sharing of data points between two clusters. However, several parameters must be selected before applying Mapper and the resulting graph may vary dramatically with the choice of parameters. We define an intrinsic notion of Mapper instability that measures the variability of the output as a function of the choice of parameters required to construct a Mapper output. Our results and discussion are general and apply to all Mapper-type algorithms. We derive theoretical results that provide estimates for the instability and suggest practical ways to control it. We provide also experiments to illustrate our results and in particular we demonstrate that a reliable candidate Mapper output can be identified as a local minimum of instability regarded as a function of Mapper input parameters.


title: The Role of Pressure in Inverse Design for Assembly

abstract: Isotropic pairwise interactions that promote the self assembly of complex particle morphologies have been discovered by inverse design strategies derived from the molecular coarse-graining literature. While such approaches provide an avenue to reproduce structural correlations, thermodynamic quantities such as the pressure have typically not been considered in self-assembly applications. In this work, we demonstrate that relative entropy optimization can be used to discover potentials that self-assemble into targeted cluster morphologies with a prescribed pressure when the iterative simulations are performed in the isothermal-isobaric ensemble. By tuning the pressure in the optimization, we generate a family of simple pair potentials that all self-assemble the same structure. Selecting an appropriate simulation ensemble to control the thermodynamic properties of interest is a general design strategy that could also be used to discover interaction potentials that self-assemble structures having, for example, a specified chemical potential.


title: High-order Moment Portfolio Optimization via An Accelerated Difference-of-Convex Programming Approach and Sums-of-Squares

abstract: The Mean-Variance-Skewness-Kurtosis (MVSK) portfolio optimization model is a quartic nonconvex polynomial minimization problem over a polytope, which can be formulated as a Difference-of-Convex (DC) program. In this manuscript, we investigate four DC programming approaches for solving the MVSK model. First, two DC formulations based on the projective DC decomposition and the Difference-of-Convex-Sums-of-Squares (DC-SOS) decomposition are established, where the second one is novel. Then, DCA is applied to solve these DC formulations. The convergence analysis of DCA for the MVSK model is established. Second, we propose an accelerated DCA (Boosted-DCA) for solving a general convex constrained DC program involving both smooth and nonsmooth functions. The acceleration is realized by an inexact line search of the Armijo-type along the DC descent direction generated by two consecutive iterates of DCA. The convergence analysis of the Boosted-DCA is established. Numerical simulations of the proposed four DC algorithms on both synthetic and real portfolio datasets are reported. Comparisons with KNITRO, FILTERSD, IPOPT and MATLAB fmincon optimization solvers demonstrate good performance of our methods. Particularly, two DC algorithms with DC-SOS decomposition require less number of iterations, which demonstrates that DC-SOS decomposition can provide better convex over-approximations for polynomials. Moreover, the accelerated versions indeed reduce the number of iterations and achieve the best numerical results.


title: Accelerating Physics-Based Simulations Using Neural Network Proxies: An Application in Oil Reservoir Modeling

abstract: We develop a proxy model based on deep learning methods to accelerate the simulations of oil reservoirs--by three orders of magnitude--compared to industry-strength physics-based PDE solvers. This paper describes a new architectural approach to this task, accompanied by a thorough experimental evaluation on a publicly available reservoir model. We demonstrate that in a practical setting a speedup of more than 2000X can be achieved with an average sequence error of about 10\% relative to the oil-field simulator. The proxy model is contrasted with a high-quality physics-based acceleration baseline and is shown to outperform it by several orders of magnitude. We believe the outcomes presented here are extremely promising and offer a valuable benchmark for continuing research in oil field development optimization. Due to its domain-agnostic architecture, the presented approach can be extended to many applications beyond the field of oil and gas exploration.


title: Neural Review Rating Prediction with Hierarchical Attentions and Latent Factors

abstract: Text reviews can provide rich useful semantic information for modeling users and items, which can benefit rating prediction in recommendation. Different words and reviews may have different informativeness for users or items. Besides, different users and items should be personalized. Most existing works regard all reviews equally or utilize a general attention mechanism. In this paper, we propose a hierarchical attention model fusing latent factor model for rating prediction with reviews, which can focus on important words and informative reviews. Specially, we use the factor vectors of Latent Factor Model to guide the attention network and combine the factor vectors with feature representation learned from reviews to predict the final ratings. Experiments on real-world datasets validate the effectiveness of our approach.


title: LeafNATS: An Open-Source Toolkit and Live Demo System for Neural Abstractive Text Summarization

abstract: Neural abstractive text summarization (NATS) has received a lot of attention in the past few years from both industry and academia. In this paper, we introduce an open-source toolkit, namely LeafNATS, for training and evaluation of different sequence-to-sequence based models for the NATS task, and for deploying the pre-trained models to real-world applications. The toolkit is modularized and extensible in addition to maintaining competitive performance in the NATS task. A live news blogging system has also been implemented to demonstrate how these models can aid blog/news editors by providing them suggestions of headlines and summaries of their articles.


title: Custom Edge-Element FEM Solver and its Application to Eddy-Current Simulation of Realistic 2M-Element Human Brain Phantom

abstract: Extensive research papers of three-dimensional computational techniques are widely used for the investigation of human brain pathophysiology. Eddy current analyzing could provide an indication of conductivity change within a biological body. A significant obstacle to current trend analyses is the development of a numerically stable and efficiency-finite element scheme that performs well at low frequency and does not require a large number of degrees of freedom. Here, a custom finite element method (FEM) solver based on edge elements is proposed using the weakly coupled theory, which separates the solution into two steps. First, the background field (the magnetic vector potential on each edge) is calculated and stored. Then, the electric scalar potential on each node is obtained by FEM based on Galerkin formulations. Consequently, the electric field and eddy current distribution in the object can be obtained. This solver is more efficient than typical commercial solvers since it reduces the vector eddy current equation to a scalar one, and reduces the meshing domain to just the eddy current region. It can therefore tackle complex eddy current calculations for models with much larger numbers of elements, such as those encountered in eddy current computation in biological tissues. An example is presented with a realistic human brain mesh of 2 million elements. In addition, with this solver, the equivalent magnetic field induced from the excitation coil is applied, and therefore there is no need to mesh the excitation coil. In combination, these significantly increase the efficiency of the solver.

categories: physics.med-ph eess.SP physics.bio-ph physics.comp-ph q-bio.QM


title: Adaptive Region Embedding for Text Classification

abstract: Deep learning models such as convolutional neural networks and recurrent networks are widely applied in text classification. In spite of their great success, most deep learning models neglect the importance of modeling context information, which is crucial to understanding texts. In this work, we propose the Adaptive Region Embedding to learn context representation to improve text classification. Specifically, a metanetwork is learned to generate a context matrix for each region, and each word interacts with its corresponding context matrix to produce the regional representation for further classification. Compared to previous models that are designed to capture context information, our model contains less parameters and is more flexible. We extensively evaluate our method on 8 benchmark datasets for text classification. The experimental results prove that our method achieves state-of-the-art performances and effectively avoids word ambiguity.


title: TMLab SRPOL at SemEval-2019 Task 8: Fact Checking in Community Question Answering Forums

abstract: The article describes our submission to SemEval 2019 Task 8 on Fact-Checking in Community Forums. The systems under discussion participated in Subtask A: decide whether a question asks for factual information, opinion/advice or is just socializing. Our primary submission was ranked as the second one among all participants in the official evaluation phase. The article presents our primary solution: Deeply Regularized Residual Neural Network (DRR NN) with Universal Sentence Encoder embeddings. This is followed by a description of two contrastive solutions based on ensemble methods.


title: Randomized Channel Sparsifying Hybrid Precoding for FDD Massive MIMO Systems

abstract: We propose a novel randomized channel sparsifying hybrid precoding (RCSHP) design to reduce the signaling overhead of channel estimation and the hardware cost and power consumption at the base station (BS), in order to fully harvest benefits of frequency division duplex (FDD) massive multiple-input multiple-output (MIMO) systems. RCSHP allows time-sharing among multiple analog precoders, each serving a compatible user group. The analog precoder is adapted to the channel statistics to properly sparsify the channel for the associated user group, such that the resulting effective channel (product of channel and analog precoder) not only has enough spatial degrees of freedom (DoF) to serve this group of users, but also can be accurately estimated under the limited pilot budget. The digital precoder is adapted to the effective channel based on the duality theory to facilitate the power allocation and exploit the spatial multiplexing gain. We formulate the joint optimization of the time-sharing factors and the associated sets of analog precoders and power allocations as a general utility optimization problem, which considers the impact of effective channel estimation error on the system performance. Then we propose an efficient stochastic successive convex approximation algorithm to provably obtain Karush-Kuhn-Tucker (KKT) points of this problem.


title: Spectroscopy and Differential Emission Measure diagnostics of a coronal dimming associated with a fast halo CME

abstract: We study the coronal dimming caused by the fast halo CME (deprojected speed v =1250 km s $^{-1})$ associated with the C3.7 two-ribbon flare on 2012 September 27, using Hinode/EIS spectroscopy and SDO/AIA Differential Emission Measure (DEM) analysis. The event reveals bipolar core dimmings encompassed by hook-shaped flare ribbons located at the ends of the flare-related polarity inversion line, and marking the footpoints of the erupting filament. In coronal emission lines of $\log T \, [{\rm K}] = 5.8-6.3$, distinct double component spectra indicative of the superposition of a stationary and a fast up-flowing plasma component with velocities up to 130 km s$^{-1}$ are observed at regions, which were mapped by the scanning EIS slit close in time of their impulsive dimming onset. The outflowing plasma component is found to be of the same order and even dominant over the stationary one, with electron densities in the upflowing component of $2\times 10^{9}$cm$^{-3}$ at $\log T \, [{\rm K}] = 6.2$. The density evolution in core dimming regions derived from SDO/AIA DEM analysis reveals impulsive reductions by $40 - 50\%$ within $\lesssim$10 min, and remains at these reduced levels for hours. The mass loss rate derived from the EIS spectroscopy in the dimming regions is of the same order than the mass increase rate observed in the associated white light CME ($1 \times 10^{12} {\rm \; g \; s}^{-1}$), indicative that the CME mass increase in the coronagraphic field-of-view results from plasma flows from below and not from material piled-up ahead of the outward moving and expanding CME front.


title: Automorphism-invariant positive definite functions on free groups

abstract: In this article we raise some new questions about positive definite functions on free groups, and explain how these are related to more well-known questions. The article is intended as a survey of known results that also offers some new perspectives and interesting observations; therefore the style is expository.


title: Bialgebraic Semantics for String Diagrams

abstract: Turi and Plotkin's bialgebraic semantics is an abstract approach to specifying the operational semantics of a system, by means of a distributive law between its syntax (encoded as a monad) and its dynamics (an endofunctor). This setup is instrumental in showing that a semantic specification (a coalgebra) satisfies desirable properties: in particular, that it is compositional. In this work, we use the bialgebraic approach to derive well-behaved structural operational semantics of string diagrams, a graphical syntax that is increasingly used in the study of interacting systems across different disciplines. Our analysis relies on representing the two-dimensional operations underlying string diagrams in various categories as a monad, and their bialgebraic semantics in terms of a distributive law over that monad. As a proof of concept, we provide bialgebraic compositional semantics for a versatile string diagrammatic language which has been used to model both signal flow graphs (control theory) and Petri nets (concurrency theory). Moreover, our approach reveals a correspondence between two different interpretations of the Frobenius equations on string diagrams and two synchronisation mechanisms for processes, \`a la Hoare and \`a la Milner.


title: Multimessenger Probes of High-energy Sources

abstract: Multimessenger observations may hold the key to learn about the most energetic sources in the universe. The recent construction of large scale observatories opened new possibilities in testing non thermal cosmic processes with alternative probes, such as high energy neutrinos and gravitational waves. We propose to combine information from gravitational wave detections, neutrino observations and electromagnetic signals to obtain a comprehensive picture of some of the most extreme cosmic processes. Gravitational waves are indicative of source dynamics, such as the formation, evolution and interaction of compact objects. These compact objects can play an important role in astrophysical particle acceleration, and are interesting candidates for neutrino and in general high-energy astroparticle studies. In particular we will concentrate on the most promising gravitational wave emitter sources: compact stellar remnants. The merger of binary black holes, binary neutron stars or black hole-neutron star binaries are abundant gravitational wave sources and will likely make up the majority of detections. However, stellar core collapse with rapidly rotating core may also be significant gravitational wave emitter, while slower rotating cores may be detectable only at closer distances. The joint detection of gravitational waves and neutrinos from these sources will probe the physics of the sources and will be a smoking gun of the presence of hadrons in these objects which is still an open question. Conversely, the non-detection of neutrinos or gravitational waves from these sources will be fundamental to constrain the hadronic content.


title: Quasi-automatic groups are asynchronously automatic

abstract: A quasi-automatic semigroup is a finitely generated semigroup with a rational set of representatives such that the graph of right multiplication by any generator is a rational relation. A asynchronously automatic semigroup is a quasi-automatic semigroup for which these rational relations are also recognisable by two-tape automata. We show that when such a semigroup happens to be a group, the converse actually holds, meaning quasi-automatic groups are asynchronously automatic.


title: Eigenstate thermalization and rotational invariance in ergodic quantum systems

abstract: Generic rotationally invariant random matrix models satisfy a simple relation: the probability distribution of off-diagonal elements and the one of half the difference between any two diagonal elements coincide. In the spirit of the Eigenstate Thermalization Hypothesis (ETH), we test the hypothesis that the same relation holds in quantum systems that are non-localized, when one considers small energy differences. The relation provides a stringent test of ETH beyond the Gaussian ensemble. We apply it to a disordered spin chain, the SYK model and a Floquet system.


title: On the core entropy of Newton maps

abstract: In this paper, we define the core entropy for postcritically-finite Newton maps and study its continuity within this family. We show that the entropy function is not continuous in this family, which is different from the polynomial case studied by Thurston, Gao, Dudko- Schleicher, Tiozzo [Th+, GT, DS, Ti2], and describe completely the continuity of the entropy function at generic parameters.


title: Text-based Editing of Talking-head Video

abstract: Editing talking-head video to change the speech content or to remove filler words is challenging. We propose a novel method to edit talking-head video based on its transcript to produce a realistic output video in which the dialogue of the speaker has been modified, while maintaining a seamless audio-visual flow (i.e. no jump cuts). Our method automatically annotates an input talking-head video with phonemes, visemes, 3D face pose and geometry, reflectance, expression and scene illumination per frame. To edit a video, the user has to only edit the transcript, and an optimization strategy then chooses segments of the input corpus as base material. The annotated parameters corresponding to the selected segments are seamlessly stitched together and used to produce an intermediate video representation in which the lower half of the face is rendered with a parametric face model. Finally, a recurrent video generation network transforms this representation to a photorealistic video that matches the edited transcript. We demonstrate a large variety of edits, such as the addition, removal, and alteration of words, as well as convincing language translation and full sentence synthesis.


title: Nanopatterned electron beams for temporal coherence and deterministic phase control of x-ray free-electron lasers

abstract: We demonstrate the ability to create electron beams with high-contrast, nanometer-scale density modulations as a first step toward developing full control of the phase fronts of an x-ray free-electron laser. The nanopatterned electron beams are produced by diffracting electrons through thin single-crystal silicon membranes that are lithographically patterned to different thicknesses. For transform-limited x-ray production the desired pattern is a series of regularly spaced lines (i.e. a grating) that generate uniformly spaced nanobunches of electrons, however nearly any pattern can be etched in the silicon, such as frequency-chirps or multiple patterns of different colors or line spacings. When these patterns are transferred from the spatial to the temporal dimension by accelerator electromagnetic optics they will control the phase fronts of coherent x-rays, giving unprecedented deterministic control over the phase of ultrashort x-ray pulses. In short, this method allows the time-structure for a fully coherent x-ray beam to be generated from a pattern written on a semiconductor wafer by lithography.


title: Cross-Domain Cascaded Deep Feature Translation

abstract: In recent years we have witnessed tremendous progress in unpaired image-to-image translation methods, propelled by the emergence of DNNs and adversarial training strategies. However, most existing methods focus on transfer of style and appearance, rather than on shape translation. The latter task is challenging, due to its intricate non-local nature, which calls for additional supervision. We mitigate this by descending the deep layers of a pre-trained network, where the deep features contain more semantics, and applying the translation from and between these deep features. Specifically, we leverage VGG, which is a classification network, pre-trained with large-scale semantic supervision. Our translation is performed in a cascaded, deep-to-shallow, fashion, along the deep feature hierarchy: we first translate between the deepest layers that encode the higher-level semantic content of the image, proceeding to translate the shallower layers, conditioned on the deeper ones. We show that our method is able to translate between different domains, which exhibit significantly different shapes. We evaluate our method both qualitatively and quantitatively and compare it to state-of-the-art image-to-image translation methods. Our code and trained models will be made available.


title: Adversarial Training is a Form of Data-dependent Operator Norm Regularization

abstract: We establish a theoretical link between adversarial training and operator norm regularization for deep neural networks. Specifically, we prove that $\ell_p$-norm constrained projected gradient ascent based adversarial training with an $\ell_q$-norm loss on the logits of clean and perturbed inputs is equivalent to data-dependent (p, q) operator norm regularization. This fundamental connection confirms the long-standing argument that a network's sensitivity to adversarial examples is tied to its spectral properties and hints at novel ways to robustify and defend against adversarial attacks. We provide extensive empirical evidence on state-of-the-art network architectures to support our theoretical results.


title: The Intrinsic Robustness of Stochastic Bandits to Strategic Manipulation

abstract: Motivated by economic applications such as recommender systems, we study the behavior of stochastic bandits algorithms under \emph{strategic behavior} conducted by rational actors, i.e., the arms. Each arm is a \emph{self-interested} strategic player who can modify its own reward whenever pulled, subject to a cross-period budget constraint, in order to maximize its own expected number of times of being pulled. We analyze the robustness of three popular bandit algorithms: UCB, $\varepsilon$-Greedy, and Thompson Sampling. We prove that all three algorithms achieve a regret upper bound $\mathcal{O}(\max \{ B, K\ln T\})$ where $B$ is the total budget across arms, $K$ is the total number of arms and $T$ is length of the time horizon. This regret guarantee holds under \emph{arbitrary adaptive} manipulation strategy of arms. Our second set of main results shows that this regret bound is \emph{tight} -- in fact for UCB it is tight even when we restrict the arms' manipulation strategies to form a \emph{Nash equilibrium}. The lower bound makes use of a simple manipulation strategy, the same for all three algorithms, yielding a bound of $\Omega(\max \{ B, K\ln T\})$. Our results illustrate the robustness of classic bandits algorithms against strategic manipulations as long as $B=o(T)$.


title: Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy

abstract: Generative adversarial networks (GANs) have been extensively studied in the past few years. Arguably their most significant impact has been in the area of computer vision where great advances have been made in challenges such as plausible image generation, image-to-image translation, facial attribute manipulation and similar domains. Despite the significant successes achieved to date, applying GANs to real-world problems still poses significant challenges, three of which we focus on here. These are: (1) the generation of high quality images, (2) diversity of image generation, and (3) stable training. Focusing on the degree to which popular GAN technologies have made progress against these challenges, we provide a detailed review of the state of the art in GAN-related research in the published scientific literature. We further structure this review through a convenient taxonomy we have adopted based on variations in GAN architectures and loss functions. While several reviews for GANs have been presented to date, none have considered the status of this field based on their progress towards addressing practical challenges relevant to computer vision. Accordingly, we review and critically discuss the most popular architecture-variant, and loss-variant GANs, for tackling these challenges. Our objective is to provide an overview as well as a critical analysis of the status of GAN research in terms of relevant progress towards important computer vision application requirements. As we do this we also discuss the most compelling applications in computer vision in which GANs have demonstrated considerable success along with some suggestions for future research directions. Code related to GAN-variants studied in this work is summarized on https://github.com/sheqi/GAN_Review.


title: The PhotoBook Dataset: Building Common Ground through Visually-Grounded Dialogue

abstract: This paper introduces the PhotoBook dataset, a large-scale collection of visually-grounded, task-oriented dialogues in English designed to investigate shared dialogue history accumulating during conversation. Taking inspiration from seminal work on dialogue analysis, we propose a data-collection task formulated as a collaborative game prompting two online participants to refer to images utilising both their visual context as well as previously established referring expressions. We provide a detailed description of the task setup and a thorough analysis of the 2,500 dialogues collected. To further illustrate the novel features of the dataset, we propose a baseline model for reference resolution which uses a simple method to take into account shared information accumulated in a reference chain. Our results show that this information is particularly important to resolve later descriptions and underline the need to develop more sophisticated models of common ground in dialogue interaction.


title: Trading in Complex Networks

abstract: Global supply networks in agriculture, manufacturing, and services are a defining feature of the modern world. The efficiency and the distribution of surpluses across different parts of these networks depend on choices of intermediaries. This paper conducts price formation experiments with human subjects located in large complex networks to develop a better understanding of the principles governing behavior. Our first finding is that prices are larger and that trade is significantly less efficient in small-world networks as compared to random networks. Our second finding is that location within a network is not an important determinant of pricing. An examination of the price dynamics suggests that traders on cheapest -- and hence active -- paths raise prices while those off these paths lower them. We construct an agent-based model (ABM) that embodies this rule of thumb. Simulations of this ABM yield macroscopic patterns consistent with the experimental findings. Finally, we extrapolate the ABM on to significantly larger random and small world networks and find that network topology remains a key determinant of pricing and efficiency.


title: Closed-Loop Control of a Delta-Wing Unmanned Aerial-Aquatic Vehicle

abstract: We present a closed-loop control strategy for a delta-wing unmanned aerial aquatic-vehicle (UAAV) that enables autonomous swim, fly, and water-to-air transition. Our control system consists of a hybrid state estimator and a closed-loop feedback policy which is capable of trajectory following through the water, air and transition domains. To test our estimator and control approach in hardware, we instrument the vehicle with a minimalistic set of commercial off-the-shelf sensors. Finally, we demonstrate a successful autonomous water-to-air transition with our prototype UAAV system and discuss the implications of these results with regards to robustness.


title: Successive minimum spanning trees

abstract: In a complete graph $K_n$ with edge weights drawn independently from a uniform distribution $U(0,1)$ (or alternatively an exponential distribution $\operatorname{Exp}(1)$), let $T_1$ be the MST (the spanning tree of minimum weight) and let $T_k$ be the MST after deletion of the edges of all previous trees $T_i$, $i<k$. We show that each tree's weight $w(T_k)$ converges in probability to a constant $\gamma_k$ with $2k-2\sqrt k <\gamma_k<2k+2\sqrt k$, and we conjecture that $\gamma_k = 2k-1+o(1)$. The problem is distinct from that of Frieze and Johansson (2018), finding $k$ MSTs of combined minimum weight, and for $k=2$ ours has strictly larger cost. Our results also hold (and mostly are derived) in a multigraph model where edge weights for each vertex pair follow a Poisson process; here we additionally have $\mathbb E(w(T_k)) \to \gamma_k$. Thinking of an edge of weight $w$ as arriving at time $t=n w$, Kruskal's algorithm defines forests $F_k(t)$, each initially empty and eventually equal to $T_k$, with each arriving edge added to the first $F_k(t)$ where it does not create a cycle. Using tools of inhomogeneous random graphs we obtain structural results including that $C_1(F_k(t))/n$, the fraction of vertices in the largest component of $F_k(t)$, converges in probability to a function $\rho_k(t)$, uniformly for all $t$, and that a giant component appears in $F_k(t)$ at a time $t=\sigma_k$. We conjecture that the functions $\rho_k$ tend to time translations of a single function, $\rho_k(2k+x)\to\rho_\infty(x)$ as $k \to \infty$, uniformly in $x\in \mathbb R$. Simulations and numerical computations give estimated values of $\gamma_k$ for small $k$, and support the conjectures just stated.


title: Quarkonium Production in the QGP

abstract: We report on recent theory progress in understanding the production of heavy quarkonium in heavy-ion collisions based on the in-medium heavy-quark potential extracted from lattice QCD simulations. On the one hand, the proper in-medium potential allows us to study the spectral properties of heavy quarkonium in thermal equilibrium, from which we estimate the $\psi^\prime$ to $J/\psi$ ratio in heavy-ion collisions. On the other hand, the potential provides a central ingredient in the description of the real-time evolution of heavy-quarkonium formulated in the open-quantum-systems framework.


title: Crust Cooling Models are Insensitive to the Crust-Core Transition Pressure for Realistic Equations of State

abstract: Neutron stars cooling after sustained accretion outbursts provide unique information about the neutron star crust and underlying dense matter. Comparisons between astronomical observations of these cooling transients and model calculations of neutron star crust cooling have frequently been used to constrain neutron star properties such as the mass, radius, crust composition, and presence of nuclear pasta. These calculations often use a fixed pressure at which the crust-core transition happens, though this quantity depends on the dense matter equation of state. We demonstrate that varying the crust-core transition pressure in a manner consistent with adopting various equations of state results in modest changes to the crust cooling light curve. This validates the approach adopted in most crust cooling studies to date, where the neutron star mass and radius are varied while leaving the crust-core transition pressure constant.


title: Visual Tree Convolutional Neural Network in Image Classification

abstract: In image classification, Convolutional Neural Network(CNN) models have achieved high performance with the rapid development in deep learning. However, some categories in the image datasets are more difficult to distinguished than others. Improving the classification accuracy on these confused categories is benefit to the overall performance. In this paper, we build a Confusion Visual Tree(CVT) based on the confused semantic level information to identify the confused categories. With the information provided by the CVT, we can lead the CNN training procedure to pay more attention on these confused categories. Therefore, we propose Visual Tree Convolutional Neural Networks(VT-CNN) based on the original deep CNN embedded with our CVT. We evaluate our VT-CNN model on the benchmark datasets CIFAR-10 and CIFAR-100. In our experiments, we build up 3 different VT-CNN models and they obtain improvement over their based CNN models by 1.36%, 0.89% and 0.64%, respectively.


title: Bayesian Optimization of Composite Functions

abstract: We consider optimization of composite objective functions, i.e., of the form $f(x)=g(h(x))$, where $h$ is a black-box derivative-free expensive-to-evaluate function with vector-valued outputs, and $g$ is a cheap-to-evaluate real-valued function. While these problems can be solved with standard Bayesian optimization, we propose a novel approach that exploits the composite structure of the objective function to substantially improve sampling efficiency. Our approach models $h$ using a multi-output Gaussian process and chooses where to sample using the expected improvement evaluated on the implied non-Gaussian posterior on $f$, which we call expected improvement for composite functions (\ei). Although \ei\ cannot be computed in closed form, we provide a novel stochastic gradient estimator that allows its efficient maximization. We also show that our approach is asymptotically consistent, i.e., that it recovers a globally optimal solution as sampling effort grows to infinity, generalizing previous convergence results for classical expected improvement. Numerical experiments show that our approach dramatically outperforms standard Bayesian optimization benchmarks, reducing simple regret by several orders of magnitude.


title: $Q_{\textrm{EC}}$-value determination for $^{21}$Na$\rightarrow^{21}$Ne and $^{23}$Mg$\rightarrow^{23}$Na mirror-nuclei decays using high-precision mass spectrometry with ISOLTRAP at ISOLDE/CERN

abstract: We report on high-precision $Q_{\textrm{EC}}$ values of the $^{21}$Na$\rightarrow^{21}$Ne and $^{23}$Mg$\rightarrow^{23}$Na mirror $\beta$-transitions from mass measurements with ISOLTRAP at ISOLDE/CERN. A precision of $\delta m/m = 9 \cdot 10^{-10}$ and $\delta m/m = 1.5 \cdot 10^{-9}$ was reached for the masses of $^{21}$Na and $^{23}$Mg, respectively. We reduce the uncertainty of the $Q_{\textrm{EC}}$ values by a factor five, making them the most precise experimental input data for the calculation of the corrected $\mathcal{F} t$-value of these mixed Fermi/Gamow-Teller transitions. For the $^{21}$Na$\rightarrow^{21}$Ne $Q_{\textrm{EC}}$ value, a $2.3 \sigma$ deviation from the literature $Q_{\textrm{EC}}$-value was found.


title: Blackbox meets blackbox: Representational Similarity and Stability Analysis of Neural Language Models and Brains

abstract: In this paper, we define and apply representational stability analysis (ReStA), an intuitive way of analyzing neural language models. ReStA is a variant of the popular representational similarity analysis (RSA) in cognitive neuroscience. While RSA can be used to compare representations in models, model components, and human brains, ReStA compares instances of the same model, while systematically varying single model parameter. Using ReStA, we study four recent and successful neural language models, and evaluate how sensitive their internal representations are to the amount of prior context. Using RSA, we perform a systematic study of how similar the representational spaces in the first and second (or higher) layers of these models are to each other and to patterns of activation in the human brain. Our results reveal surprisingly strong differences between language models, and give insights into where the deep linguistic processing, that integrates information over multiple sentences, is happening in these models. The combination of ReStA and RSA on models and brains allows us to start addressing the important question of what kind of linguistic processes we can hope to observe in fMRI brain imaging data. In particular, our results suggest that the data on story reading from Wehbe et al. (2014) contains a signal of shallow linguistic processing, but show no evidence on the more interesting deep linguistic processing.


title: Localization in Aerial Imagery with Grid Maps using LocGAN

abstract: In this work, we present LocGAN, our localization approach based on a geo-referenced aerial imagery and LiDAR grid maps. Currently, most self-localization approaches relate the current sensor observations to a map generated from previously acquired data. Unfortunately, this data is not always available and the generated maps are usually sensor setup specific. Global Navigation Satellite Systems (GNSS) can overcome this problem. However, they are not always reliable especially in urban areas due to multi-path and shadowing effects. Since aerial imagery is usually available, we can use it as prior information. To match aerial images with grid maps, we use conditional Generative Adversarial Networks (cGANs) which transform aerial images to the grid map domain. The transformation between the predicted and measured grid map is estimated using a localization network (LocNet). Given the geo-referenced aerial image transformation the vehicle pose can be estimated. Evaluations performed on the data recorded in region Karlsruhe, Germany show that our LocGAN approach provides reliable global localization results.


title: Enumeration of planar Tangles

abstract: A planar Tangle is a smooth simple closed curve piecewise defined by quadrants of circles with constant curvature. We can enumerate Tangles by counting their dual graphs, which consist of a certain family of polysticks. The number of Tangles with a given length or area grows exponentially, and we show the existence of their growth constants by comparing Tangles to two families of polyominoes.


title: Natural Vocabulary Emerges from Free-Form Annotations

abstract: We propose an approach for annotating object classes using free-form text written by undirected and untrained annotators. Free-form labeling is natural for annotators, they intuitively provide very specific and exhaustive labels, and no training stage is necessary. We first collect 729 labels on 15k images using 124 different annotators. Then we automatically enrich the structure of these free-form annotations by discovering a natural vocabulary of 4020 classes within them. This vocabulary represents the natural distribution of objects well and is learned directly from data, instead of being an educated guess done before collecting any labels. Hence, the natural vocabulary emerges from a large mass of free-form annotations. To do so, we (i) map the raw input strings to entities in an ontology of physical objects (which gives them an unambiguous meaning); and (ii) leverage inter-annotator co-occurrences, as well as biases and knowledge specific to individual annotators. Finally, we also automatically extract natural vocabularies of reduced size that have high object coverage while remaining specific. These reduced vocabularies represent the natural distribution of objects much better than commonly used predefined vocabularies. Moreover, they feature more uniform sample distribution over classes.


title: Training Neural Response Selection for Task-Oriented Dialogue Systems

abstract: Despite their popularity in the chatbot literature, retrieval-based models have had modest impact on task-oriented dialogue systems, with the main obstacle to their application being the low-data regime of most task-oriented dialogue tasks. Inspired by the recent success of pretraining in language modelling, we propose an effective method for deploying response selection in task-oriented dialogue. To train response selection models for task-oriented dialogue tasks, we propose a novel method which: 1) pretrains the response selection model on large general-domain conversational corpora; and then 2) fine-tunes the pretrained model for the target dialogue domain, relying only on the small in-domain dataset to capture the nuances of the given dialogue domain. Our evaluation on six diverse application domains, ranging from e-commerce to banking, demonstrates the effectiveness of the proposed training method.


title: A Novel Three-Level Time-Split MacCormack Method for Solving Two-Dimensional Viscous Coupled Burgers Equations

abstract: In this paper, we analyze the three-level explicit time-split MacCormack procedure in the numerical solutions of two-dimensional viscous coupled Burgers' equations subject to initial and boundary conditions. The differential operators split the two-dimensional problem into two pieces so that the two-step explicit MacCormack scheme can be easily applied to each subproblem. This reduces the computational cost of the algorithm. For low Reynolds numbers, the proposed method is second order accurate in time and fourth convergent in space, while it is second order convergent in both time and space for high Reynolds numbers problems. This shows the efficiency and effectiveness of the considered method compared to a large set of numerical schemes widely studied in the literature for solving the two-dimensional time dependent nonlinear coupled Burgers' equations. Numerical examples which confirm the theoretical results are presented and discussed.


title: Optimal coding and the origins of Zipfian laws

abstract: The problem of compression in standard information theory consists of assigning codes as short as possible to numbers. Here we consider the problem of optimal coding -- under an arbitrary coding scheme -- and show that it predicts Zipf's law of abbreviation, namely a tendency in natural languages for more frequent words to be shorter. We apply this result to investigate optimal coding also under so-called non-singular coding, a scheme where unique segmentation is not warranted but codes stand for a distinct number. Optimal non-singular coding predicts that the length of a word should grow approximately as the logarithm of its frequency rank, which is again consistent with Zipf's law of abbreviation. Optimal non-singular coding in combination with the maximum entropy principle also predicts Zipf's rank-frequency distribution. Furthermore, our findings on optimal non-singular coding challenge common beliefs about random typing. It turns out that random typing is in fact an optimal coding process, in stark contrast with the common assumption that it is detached from cost cutting considerations. Finally, we discuss the implications of optimal coding for the construction of a compact theory of Zipfian laws and other linguistic laws.


title: Task-Guided Pair Embedding in Heterogeneous Network

abstract: Many real-world tasks solved by heterogeneous network embedding methods can be cast as modeling the likelihood of pairwise relationship between two nodes. For example, the goal of author identification task is to model the likelihood of a paper being written by an author (paper-author pairwise relationship). Existing task-guided embedding methods are node-centric in that they simply measure the similarity between the node embeddings to compute the likelihood of a pairwise relationship between two nodes. However, we claim that for task-guided embeddings, it is crucial to focus on directly modeling the pairwise relationship. In this paper, we propose a novel task-guided pair embedding framework in heterogeneous network, called TaPEm, that directly models the relationship between a pair of nodes that are related to a specific task (e.g., paper-author relationship in author identification). To this end, we 1) propose to learn a pair embedding under the guidance of its associated context path, i.e., a sequence of nodes between the pair, and 2) devise the pair validity classifier to distinguish whether the pair is valid with respect to the specific task at hand. By introducing pair embeddings that capture the semantics behind the pairwise relationships, we are able to learn the fine-grained pairwise relationship between two nodes, which is paramount for task-guided embedding methods. Extensive experiments on author identification task demonstrate that TaPEm outperforms the state-of-the-art methods, especially for authors with few publication records.


title: Mixture of hidden Markov models for accelerometer data

abstract: Motivated by the analysis of accelerometer data, we introduce a specific finite mixture of hidden Markov models with particular characteristics that adapt well to the specific nature of this type of data. Our model allows for the computation of statistics that characterize the physical activity of a subject (\emph{e.g.}, the mean time spent at different activity levels and the probability of the transition between two activity levels) without specifying the activity levels in advance but by estimating them from the data. In addition, this approach allows the heterogeneity of the population to be taken into account and subpopulations with homogeneous physical activity behavior to be defined. We prove that, under mild assumptions, this model implies that the probability of misclassifying a subject decreases at an exponential decay with the length of its measurement sequence. Model identifiability is also investigated. We also report a comprehensive suite of numerical simulations to support our theoretical findings. Method is motivated by and applied to the PAT study.


title: In-memory hyperdimensional computing

abstract: Hyperdimensional computing (HDC) is an emerging computational framework that takes inspiration from attributes of neuronal circuits such as hyperdimensionality, fully distributed holographic representation, and (pseudo)randomness. When employed for machine learning tasks such as learning and classification, HDC involves manipulation and comparison of large patterns within memory. Moreover, a key attribute of HDC is its robustness to the imperfections associated with the computational substrates on which it is implemented. It is therefore particularly amenable to emerging non-von Neumann paradigms such as in-memory computing, where the physical attributes of nanoscale memristive devices are exploited to perform computation in place. Here, we present a complete in-memory HDC system that achieves a near optimum trade-off between design complexity and classification accuracy based on three prototypical HDC related learning tasks, namely, language classification, news classification, and hand gesture recognition from electromyography signals. Comparable accuracies to software implementations are demonstrated, experimentally, using 760,000 phase-change memory devices performing analog in-memory computing.