title: Deep Reasoning Networks: Thinking Fast and Slow

abstract: We introduce Deep Reasoning Networks (DRNets), an end-to-end framework that combines deep learning with reasoning for solving complex tasks, typically in an unsupervised or weakly-supervised setting. DRNets exploit problem structure and prior knowledge by tightly combining logic and constraint reasoning with stochastic-gradient-based neural network optimization. We illustrate the power of DRNets on de-mixing overlapping hand-written Sudokus (Multi-MNIST-Sudoku) and on a substantially more complex task in scientific discovery that concerns inferring crystal structures of materials from X-ray diffraction data under thermodynamic rules (Crystal-Structure-Phase-Mapping). At a high level, DRNets encode a structured latent space of the input data, which is constrained to adhere to prior knowledge by a reasoning module. The structured latent encoding is used by a generative decoder to generate the targeted output. Finally, an overall objective combines responses from the generative decoder (thinking fast) and the reasoning module (thinking slow), which is optimized using constraint-aware stochastic gradient descent. We show how to encode different tasks as DRNets and demonstrate DRNets' effectiveness with detailed experiments: DRNets significantly outperform the state of the art and experts' capabilities on Crystal-Structure-Phase-Mapping, recovering more precise and physically meaningful crystal structures. On Multi-MNIST-Sudoku, DRNets perfectly recovered the mixed Sudokus' digits, with 100% digit accuracy, outperforming the supervised state-of-the-art MNIST de-mixing models. Finally, as a proof of concept, we also show how DRNets can solve standard combinatorial problems -- 9-by-9 Sudoku puzzles and Boolean satisfiability problems (SAT), outperforming other specialized deep learning models. DRNets are general and can be adapted and expanded to tackle other tasks.


title: An ergodic theorem for the weighted ensemble method

abstract: We study weighted ensemble, an interacting particle method for sampling distributions of Markov chains that has been used in computational chemistry since the 1990s. Many important applications of weighted ensemble require the computation of long time averages. We establish the consistency of weighted ensemble in this setting by proving an ergodic theorem for time averages. As part of the proof, we derive explicit variance formulas that could be useful for optimizing the method.


title: Alternating quotients of right-angled Coxeter groups

abstract: Let $W$ be a right-angled Coxeter group corresponding to a finite non-discrete graph $\mathcal{G}$ with at least $3$ vertices. Our main theorem says that $\mathcal{G}^c$ is connected if and only if for any infinite index quasiconvex subgroup $H$ of $W$ and any finite subset $\{ \gamma_1, \ldots , \gamma_n \} \subset W \setminus H$ there is a surjection $f$ from $W$ to a finite alternating group such that $f (\gamma_i) \notin f (H)$. A corollary is that a right-angled Artin group splits as a direct product of cyclic groups and groups with many alternating quotients in the above sense. Similarly, finitely generated subgroups of closed, orientable, hyperbolic surface groups can be separated from finitely many elements in an alternating quotient, answering positively a conjecture of Wilton.


title: An Algorithm for Computing Invariant Projectors in Representations of Wreath Products

abstract: We describe an algorithm for computing the complete set of primitive orthogonal idempotents in the centralizer ring of the permutation representation of a wreath product. This set of idempotents determines the decomposition of the representation into irreducible components. In the formalism of quantum mechanics, these idempotents are projection operators into irreducible invariant subspaces of the Hilbert space of a multipartite quantum system. The C implementation of the algorithm constructs irreducible decompositions of high-dimensional representations of wreath products. Examples of computations are given.


title: Separable Layers Enable Structured Efficient Linear Substitutions

abstract: In response to the development of recent efficient dense layers, this paper shows that something as simple as replacing linear components in pointwise convolutions with structured linear decompositions also produces substantial gains in the efficiency/accuracy tradeoff. Pointwise convolutions are fully connected layers and are thus prepared for replacement by structured transforms. Networks using such layers are able to learn the same tasks as those using standard convolutions, and provide Pareto-optimal benefits in efficiency/accuracy, both in terms of computation (mult-adds) and parameter count (and hence memory). Code is available at https://github.com/BayesWatch/deficient-efficient.


title: Linear stability of slowly rotating Kerr black holes

abstract: We prove the linear stability of slowly rotating Kerr black holes as solutions of the Einstein vacuum equation: linearized perturbations of a Kerr metric decay at an inverse polynomial rate to a linearized Kerr metric plus a pure gauge term. We work in a natural wave map/DeTurck gauge and show that the pure gauge term can be taken to lie in a fixed 7-dimensional space with a simple geometric interpretation. Our proof rests on a robust general framework, based on recent advances in microlocal analysis and non-elliptic Fredholm theory, for the analysis of resolvents of operators on asymptotically flat spaces. With the mode stability of the Schwarzschild metric as well as of certain scalar and 1-form wave operators on the Schwarzschild spacetime as an input, we establish the linear stability of slowly rotating Kerr black holes using perturbative arguments; in particular, our proof does not make any use of special algebraic properties of the Kerr metric. The heart of the paper is a detailed description of the resolvent of the linearization of a suitable hyperbolic gauge-fixed Einstein operator at low energies. As in previous work by the second and third authors on the nonlinear stability of cosmological black holes, constraint damping plays an important role. Here, it eliminates certain pathological generalized zero energy states; it also ensures that solutions of our hyperbolic formulation of the linearized Einstein equation have the stated asymptotics and decay for general initial data and forcing terms, which is a useful feature in nonlinear and numerical applications.


title: Mind the Gap: Trade-Offs between Distributed Ledger Technology Characteristics

abstract: When developing peer-to-peer applications on Distributed Ledger Technology (DLT), a crucial decision is the selection of a suitable DLT design (e.g., Ethereum) because it is hard to change the underlying DLT design post hoc. To facilitate the selection of suitable DLT designs, we review DLT characteristics and identify trade-offs between them. Furthermore, we assess how DLT designs account for these trade-offs and we develop archetypes for DLT designs that cater to specific quality requirements. The main purpose of our article is to introduce scientific and practical audiences to the intricacies of DLT designs and to support development of viable applications on DLT.


title: Immunopathogenesis in Psoriasis through a Density-type Mathematical Model

abstract: Disease psoriasis occurs as chronic inflammation of skin and appears as scaly red lesions on skin surface. Advent of several immunosuppressive drugs established that the disease stems from immuno-pathogenic disorder in human blood. Cell biological as well as clinical research on the disease reveals that the helper T-cells and other Leucocytes, responsible for human immunity, may lead to psoriasis pathogenesis if produced in plenty at locations close to the dermal region. Research findings also showed that a complex, self-sustaining (cytokine and related) proteins network play important role in disease maturation by actually leading to a huge proliferation of epidermal keratinocytes. Disease pathogenesis is identified with such hyperproliferation leading to flaking of skin surface (psoriatic plaques). An excessive generation of nitric oxide by proliferated keratinocytes, through a complex chain of bio-chemical events, is causal to the scaliness of psoriatic plaques. Considering these immunopathogenic mechanisms, we propose and analyse a mathematical time differential model for the disease psoriasis. Outcomes of analysis are consistent with existing cell biological and clinical findings with some new predictions which could be tested further.


title: Detecting network anomalies using machine learning and SNMP-MIB dataset with IP group

abstract: SNMP-MIB is a widely used approach that uses machine learning to classify data and obtain results, but using SNMP-MIB huge dataset is not efficient and it is also time and resources consuming. In this paper, a REP Tree, J48(Decision Tree) and Random Forest classifiers were used to train a model that can detect the anomalies and predict the network attacks that my affect the Internet Protocol(IP) group. This trained model can be used in the devices that are used to detect the anomalies such as intrusion detection systems.


title: A Proactive Design to Detect Denial of Service Attacks Using SNMP-MIB ICMP Variables

abstract: Denial of Service (DOS) attack is one of the most attack that attract the cyber criminals which aims to reduce the network performance from doing its intended functions. Moreover, DOS Attacks can cause a huge damage on the data Confidentiality, Integrity and Availability. This paper introduced a system that detects the network traffic and varies the DOS attacks from normal traffic based on an adopted dataset. The results had shown that the adopted algorithms with the ICMP variables achieved a high accuracy percentage with approximately 99.6 in detecting ICMP Echo attack, HTTP Flood Attack, and Slowloris attack. Moreover, the designed model succeeded with a rate of 100 in varying normal traffic from various DOS attacks.


title: Network Attacks Anomaly Detection Using SNMP MIB Interface Parameters

abstract: Many approaches have evolved to enhance network attacks detection anomaly using SNMP-MIBs. Most of these approaches focus on machine learning algorithms with a lot of SNMP-MIB database parameters, which may consume most of hardware resources (CPU, memory, and bandwidth). In this paper we introduce an efficient detection model to detect network attacks anomaly using Lazy.IBk as a machine learning classifier and Correlation, and ReliefF as attribute evaluators on SNMP-MIB interface parameters. This model achieved accurate results (100%) with minimal hardware resources consumption. Thus, this model can be adopted in intrusion detection system (IDS) to increase its performance and efficiency.


title: Wide-band Rotation Measure Synthesis

abstract: Rotation measure synthesis allows the estimation of Faraday dispersion via a Fourier transform and is the primary tool to probe cosmic magnetic fields. We show this can be considered mathematically equivalent to the one dimensional interferometric intensity measurement equation, albeit in a different Fourier space. As a result, familiar concepts in two dimensional intensity interferometry designed to correctly account for a range of instrumental conditions can be translated to the analysis of Faraday dispersion. In particular, we show how to model the effect of channel averaging during Faraday reconstruction, which has to date limited the progress of polarimetic science using wide-band measurements. Further, we simulate 1d sparse reconstruction with channel averaging for realistic frequency coverages, and show that it is possible to recover signals with large rotation measure values that were previously excluded from possible detection. This is especially important for low-frequency and wide-band polarimetry. We extended these ideas to introduce mosaicking in Faraday depth into the channel averaging process. This work, thus provides the first framework for correctly undertaking wide-band rotation measure synthesis, including the provision to add data from multiple telescopes, a prospect that should vastly improve the quality and quantity of polarimetric science. This is of particular importance for extreme environments which generate high magnetic fields such as those associated with pulsars and Fast Radio Bursts (FRBs), and will allow such sources to be accurately used as probes of cosmological fields.


title: A note on spectrum and quantum dynamics

abstract: We show, in the same vein of Simon's Wonderland Theorem, that, typically in Baire's sense, the rates with whom the solutions of the Schr\"odinger equation escape, in time average, from every finite-dimensional subspace, depend on subsequences of time going to infinite.


title: How does active participation effect consensus: Adaptive network model of opinion dynamics and influence maximizing rewiring

abstract: In this paper we study the impact of active participation -- or deliberately seeking out other agents with an aim to convince them -- on the dynamics of consensus formation. For this purpose, we propose an adaptive network model in which two processes shape opinion dynamics at interwoven time-scales: (i) agents adapt their opinions subject to influence from social network neighbours who hold opinions within a tolerance interval $\delta$ and (ii) agents rewire network connections with an aim to maximize their own influence on overall system opinion. We study this system in both an endogenous setting in which all agents are subject to influence and also attempt to maximize influence, and in a setting of exogenous control, in which external agents not subject to influence adaptively attempt to maximize their influence. In both settings we find three regimes of stationary opinion configurations: (i) for low $\delta$ a regime of two evenly balanced radicalized opinion clusters at the extremes of the opinion space, (ii) for intermediate $\delta$ a 'winner-takes-most' regime of two unevenly sized radicalized opinion clusters, and (iii) for large $\delta$ a regime in which very low spread compromise consensus states can be reached. Comparing to adaptive processes of random and deliberately spread-reducing rewiring, we demonstrate that in regime (iii) competitive influence maximization can achieve near-minimal opinion spread within near-optimal times. Further, we also show that competitive influence maximizing rewiring can reduce the impact of small influential minorities on consensus states.


title: Exciton Dissociation and Charge Separation at Donor-Acceptor Interfaces from Quantum-Classical Dynamics Simulations

abstract: In organic photovoltaic (OPV) systems, exciton dissociation and ultrafast charge separation at donor-acceptor heterojunctions both play a key role in controlling the efficiency of the conversion of excitation energy into free charge carriers. In this work, nonadiabatic dynamics simulations based on the quantum-classical Liouville equation, are employed to study the real-time dynamics of exciton dissociation and charge separation at a model donor-acceptor interface. Benchmark comparisons for a variety of low dimensional donor-acceptor chain models are performed to assess the accuracy of the quantum classical dynamics technique referred to as the forward-backward trajectory solution (FBTS). Although not always quantitative, the FBTS approach offers a reasonable balance between accuracy and computational cost. The short-time dynamics of exciton dissociation in related higher-dimensional lattice models for the interface are also investigated to assess the effect of the dimensionality on the first steps in the mechanism of charge carrier generation.


title: Standard Lattices of Compatibly Embedded Finite Fields

abstract: Lattices of compatibly embedded finite fields are useful in computer algebra systems for managing many extensions of a finite field $\mathbb{F}_p$ at once. They can also be used to represent the algebraic closure $\bar{\mathbb{F}}_p$, and to represent all finite fields in a standard manner. The most well known constructions are Conway polynomials, and the Bosma-Cannon-Steel framework used in Magma. In this work, leveraging the theory of the Lenstra-Allombert isomorphism algorithm, we generalize both at the same time. Compared to Conway polynomials, our construction defines a much larger set of field extensions from a small pre-computed table; however it is provably as inefficient as Conway polynomials if one wants to represent all field extensions, and thus yields no asymptotic improvement for representing $\bar{\mathbb{F}}_p$. Compared to Bosma-Cannon-Steel lattices, it is considerably more efficient both in computation time and storage: all algorithms have at worst quadratic complexity, and storage is linear in the number of represented field extensions and their degrees. Our implementation written in C/Flint/Julia/Nemo shows that our construction in indeed practical.


title: Influence of Initial Residual Stress on Growth and Pattern Creation for a Layered Aorta

abstract: Residual stress is ubiquitous and indispensable in most biological and artificial materials, where it sustains and optimizes many biological and functional mechanisms. The theory of volume growth, starting from a stress-free initial state, is widely used to explain the creation and evolution of growth-induced residual stress and the resulting changes in shape, and to model how growing bio-tissues such as arteries and solid tumors develop a strategy of pattern creation according to geometrical and material parameters. This modelling provides promising avenues for designing and directing some appropriate morphology of a given tissue or organ and achieve some targeted biomedical function. In this paper, we rely on a modified, augmented theory to reveal how we can obtain growth-induced residual stress and pattern evolution of a layered artery by starting from an existing, non-zero initial residual stress state. We use experimentally determined residual stress distributions of aged bi-layered human aortas and quantify their influence by a magnitude factor. Our results show that initial residual stress has a more significant impact on residual stress accumulation and the subsequent evolution of patterns than geometry and material parameters. Additionally, we provide an essential explanation for growth-induced patterns driven by differential growth coupled to an initial residual stress. Finally, we show that initial residual stress is a readily available way to control growth-induced pattern creation for tissues and thus may provide a promising inspiration for biomedical engineering.


title: From Words to Sentences: A Progressive Learning Approach for Zero-resource Machine Translation with Visual Pivots

abstract: The neural machine translation model has suffered from the lack of large-scale parallel corpora. In contrast, we humans can learn multi-lingual translations even without parallel texts by referring our languages to the external world. To mimic such human learning behavior, we employ images as pivots to enable zero-resource translation learning. However, a picture tells a thousand words, which makes multi-lingual sentences pivoted by the same image noisy as mutual translations and thus hinders the translation model learning. In this work, we propose a progressive learning approach for image-pivoted zero-resource machine translation. Since words are less diverse when grounded in the image, we first learn word-level translation with image pivots, and then progress to learn the sentence-level translation by utilizing the learned word translation to suppress noises in image-pivoted multi-lingual sentences. Experimental results on two widely used image-pivot translation datasets, IAPR-TC12 and Multi30k, show that the proposed approach significantly outperforms other state-of-the-art methods.


title: Black Hole Shadows, Photon Rings, and Lensing Rings

abstract: The presence of a bright "photon ring" surrounding a dark "black hole shadow" has been discussed as an important feature of the observational appearance of emission originating near a black hole. We clarify the meaning and relevance of these heuristics with analytic calculations and numerical toy models. The standard usage of the term "shadow" describes the appearance of a black hole illuminated from all directions, including from behind the observer. A backlit black hole casts a somewhat larger shadow. Neither shadow heuristic is particularly relevant to understanding the appearance of emission originating near the black hole, where the emission profile and gravitational redshift play the dominant roles in determining the observed size of the central dark area. A photon ring results from light rays that orbit near the black hole before escaping to infinity, where they arrive near a ring-shaped "critical curve" on the image plane. Although the brightness can become arbitrarily large near this critical curve in the case of optically thin emitting matter, we show that the enhancement is only logarithmic, and hence is of no relevance to present observations. For optically thin emission from a geometrically thin or thick disk, photons that make only a fraction of an orbit will generically give rise to a much wider "lensing ring," which is a demagnified image of the back of the disk, superimposed on top of the direct emission. The lensing ring is centered at a radius ~5% larger than the photon ring and its width is ~0.5-1M. It can be relatively brighter by a factor of 2-3 and thus could provide a significant feature in high resolution images. Nevertheless, the characteristic features of the observed image are dominated by the location and properties of the emitting matter near the black hole. We comment on the recent M87* Event Horizon Telescope observations and mass measurement.


title: Exploiting nested task-parallelism in the $\mathcal{H}-LU$ factorization

abstract: We address the parallelization of the LU factorization of hierarchical matrices ($\mathcal{H}$-matrices) arising from boundary element methods. Our approach exploits task-parallelism via the OmpSs programming model and runtime, which discovers the data-flow parallelism intrinsic to the operation at execution time, via the analysis of data dependencies based on the memory addresses of the tasks' operands. This is especially challenging for $\mathcal{H}$-matrices, as the structures containing the data vary in dimension during the execution. We tackle this issue by decoupling the data structure from that used to detect dependencies. Furthermore, we leverage the support for weak operands and early release of dependencies, recently introduced in OmpSs-2, to accelerate the execution of parallel codes with nested task-parallelism and fine-grain tasks.


title: Asymptotic Properties of Neural Network Sieve Estimators

abstract: Neural networks are one of the most popularly used methods in machine learning and artificial intelligence nowadays. Due to the universal approximation theorem (Hornik et al. (1989)), a neural network with one hidden layer can approximate any continuous function on a compact support as long as the number of hidden units is sufficiently large. Statistically, a neural network can be classified into a nonlinear regression framework. However, if we consider it parametrically, due to the unidentifiability of the parameters, it is difficult to derive its asymptotic properties. Instead, we considered the estimation problem in a nonparametric regression framework and use the results from sieve estimation to establish the consistency, the rates of convergence and the asymptotic normality of the neural network estimators. We also illustrate the validity of the theories via simulations.


title: Using Dust Shed from Asteroids as Microsamples to Link Remote Measurements with Meteorite Classes

abstract: Given the compositional diversity of asteroids, and their distribution in space, it is impossible to consider returning samples from each one to establish their origin. However, the velocity and molecular composition of primary minerals, hydrated silicates, and organic materials can be determined by in situ dust detector instruments. Such instruments could sample the cloud of micrometer-scale particles shed by asteroids to provide direct links to known meteorite groups without returning the samples to terrestrial laboratories. We extend models of the measured lunar dust cloud from LADEE to show that the abundance of detectable impact-generated microsamples around asteroids is a function of the parent body radius, heliocentric distance, flyby distance, and speed. We use monte carlo modeling to show that several tens to hundreds of particles, if randomly ejected and detected during a flyby, would be a sufficient number to classify the parent body as an ordinary chondrite, basaltic achondrite, or other class of meteorite. Encountering and measuring microsamples shed from near-earth and main-belt asteroids, coupled with complementary imaging and multispectral measurements, could accomplish a thorough characterization of small, airless bodies.


title: Pangloss: a novel Markov chain prefetcher

abstract: We present Pangloss, an efficient high-performance data prefetcher that approximates a Markov chain on delta transitions. With a limited information scope and space/logic complexity, it is able to reconstruct a variety of both simple and complex access patterns. This is achieved by a highly-efficient representation of the Markov chain to provide accurate values for transition probabilities. In addition, we have added a mechanism to reconstruct delta transitions originally obfuscated by the out-of-order execution or page transitions, such as when streaming data from multiple sources. Our single-level (L2) prefetcher achieves a geometric speedup of 1.7% and 3.2% over selected state-of-the-art baselines (KPCP and BOP). When combined with an equivalent for the L1 cache (L1 & L2), the speedups rise to 6.8% and 8.4%, and 40.4% over non-prefetch. In the multi-core evaluation, there seems to be a considerable performance improvement as well.


title: Stein's method and duality of Markov processes

abstract: One of the key ingredients to successfully apply Stein's method for distributional approximation are solutions to the Stein equations and their derivatives. Using Barbour's generator approach, one can solve for the solutions to the Stein equation in terms of the semi-group of a Markov process, which is typically a diffusion process if it is a continuous distribution. For an arbitrary diffusion it can a difficult task to evaluate the semi-group and its derivatives. In this paper, for polynomial test functions, instead of calculating the semi-group of a diffusion, via a duality argument, we instead utilise the semi-group of a much simpler Markov jump process. This approach yields a new method for explicitly solving for the solutions of Stein equations for diffusion processes. We present both the general idea of the approach and examples for both univariate and multivariate distributions.


title: A Posteriori Error Estimates with Boundary Correction for a Cut Finite Element Method

abstract: In this work we study a residual based a posteriori error estimation for the CutFEM method applied to an elliptic model problem. We consider the problem with non-polygonal boundary and the analysis takes into account the geometry and data approximation on the boundary. The reliability and efficiency are theoretically proved. Moreover, constants are robust with respect to how the domain boundary cuts the mesh.


title: Symmetric Improved Estimators for Continuous-time Quantum Monte Carlo

abstract: We derive equations of motion for Green's functions of the multi-orbital Anderson impurity model by differentiating symmetrically with respect to all time arguments. The resulting equations relate the one- and two-particle Green's function to correlators of up to six particles at four times. As an application we consider continuous-time quantum Monte Carlo simulations in the hybridization expansion, which hitherto suffered from notoriously high noise levels at large Matsubara frequencies. Employing the derived symmetric improved estimators overcomes this problem.


title: $g$-factor of Boronlike Argon $^{40}\textrm{Ar}^{13+}$

abstract: We have measured the ground-state $g$-factor of boronlike argon $^{40}\textrm{Ar}^{13+}$ with a fractional uncertainty of \SI{1.4e-9}{} with a single ion in the newly developed ALPHATRAP double Penning-trap setup. The here obtained value of $g=0.663\,648\,455\,32(93)$ is in agreement with our theoretical prediction of $0.663\,648\,12(58)$. The latter is obtained accounting for quantum electrodynamics, electron correlation, and nuclear effects within the state-of-the-art theoretical methods. Our experimental result distinguishes between existing predictions that are in disagreement, and lays the foundations for an independent determination of the fine-structure constant.


title: A new nonlocal forward model for diffuse optical tomography

abstract: The forward model in diffuse optical tomography (DOT) describes how light propagates through a turbid medium. It is often approximated by a diffusion equation (DE) that is numerically discretized by the classical finite element method (FEM). We propose a nonlocal diffusion equation (NDE) as a new forward model for DOT, the discretization of which is carried out with an efficient graph-based numerical method (GNM). To quantitatively evaluate the new forward model, we first conduct experiments on a homogeneous slab, where the numerical accuracy of both NDE and DE is compared against the existing analytical solution. We further evaluate NDE by comparing its image reconstruction performance (inverse problem) to that of DE. Our experiments show that NDE is quantitatively comparable to DE and is up to 64% faster due to the efficient graph-based representation that can be implemented identically for geometries in different dimensions.


title: 4D spinless topological insulator in a periodic electric circuit

abstract: According to the mathematical classification of topological band structures, there exist a number of fascinating topological states in dimensions larger than three with exotic boundary phenomena and interesting topological responses. While these topological states are not accessible in condensed matter systems, recent works have shown that synthetic systems, such as photonic crystals or electric circuits, can realize higher-dimensional band structures. Here, we argue that the 4D spinless topological insulator, due to its symmetry properties, is particularly well suited to be implemented in these synthetic systems. We explicitly construct a 2D electric circuit lattice, whose resonance frequency spectrum simulate the 4D spinless topological insulator. We perform detailed numerical calculations of the circuit lattice and show that the resonance frequency spectrum exhibit pairs of 3D Weyl boundary states, a hallmark of the nontrivial topology. These pairs of 3D Weyl states with the same chirality are protected by classical time-reversal symmetry that squares to $+1$, which is inherent in the proposed circuit lattice. We also discuss how the simulated 4D topological band structure can be observed in experiments.


title: Fashion Editing with Adversarial Parsing Learning

abstract: Interactive fashion image manipulation, which enables users to edit images with sketches and color strokes, is an interesting research problem with great application value. Existing works often treat it as a general inpainting task and do not fully leverage the semantic structural information in fashion images. Moreover, they directly utilize conventional convolution and normalization layers to restore the incomplete image, which tends to wash away the sketch and color information. In this paper, we propose a novel Fashion Editing Generative Adversarial Network (FE-GAN), which is capable of manipulating fashion images by free-form sketches and sparse color strokes. FE-GAN consists of two modules: 1) a free-form parsing network that learns to control the human parsing generation by manipulating sketch and color; 2) a parsing-aware inpainting network that renders detailed textures with semantic guidance from the human parsing map. A new attention normalization layer is further applied at multiple scales in the decoder of the inpainting network to enhance the quality of the synthesized image. Extensive experiments on high-resolution fashion image datasets demonstrate that the proposed method significantly outperforms the state-of-the-art methods on image manipulation.


title: A Stabilized Hybrid Mixed Finite Element Method for Poroelasticity

abstract: In this work, we consider a hybrid mixed finite element method for Biot's model. The hybrid P1-RT0-P0 discretization of the displacement-pressure-Darcy's velocity system of Biot's model presented in \cite{C. Niu} is not uniformly stable with respect to the physical parameters, resulting in some issues in numerical simulations. To alleviate such problems, following \cite{V. Girault}, we stabilize the hybrid scheme with face bubble functions and show the well-posedness with respect to physical and discretization parameters, which provide optimal error estimates of the stabilized method. We introduce a perturbation of the bilinear form of the displacement which allows for the elimination of the bubble functions. Together with eliminating Darcy's velocity by hybridization, we obtain an eliminated system whose size is the same as the classical P1-RT0-P0 discretization. Based on the well-posedness of the eliminated system, we design block preconditioners that are parameter-robust. Numerical experiments are presented to confirm the theoretical results of the stabilized scheme as well as the block preconditioners.


title: Coherent structures and secondary flow in turbulent square duct

abstract: The aim of the present work is to investigate the role of coherent structures in the generation of the secondary flow in a turbulent square duct. The coherent structures are defined as connected regions of flow where the product of the instantaneous fluctuations of two velocity components is higher than a threshold based on the long-time turbulence statistics, in the spirit of the three-dimensional quadrant analysis proposed by Lozano-Dur\'an et al. (J. Fluid Mech., vol. 694, 2012, pp. 100-130). We consider both the direct contribution of the structures to the mean in-plane velocity components and their geometrical properties. The instantaneous phenomena taking place in the turbulent duct are compared with turbulent channel flow at Reynolds numbers of $Re_\tau=180$ and $360$, based on friction velocity at the center-plane and channel half height. In the core region of the duct, the fractional contribution of intense events to the wall-normal component of the mean velocity is in very good agreement with that in the channel, despite the presence of the secondary flow in the former. Additionally, the shapes of the three-dimensional objects do not differ significantly in both flows. On the other hand, in the corner region of the duct, the proximity of the walls affects both the geometrical properties of the coherent structures and the contribution to the mean component of the vertical velocity, which is less relevant than that of the complementary portion of the flow not included in such objects. Our results show however that strong Reynolds shear-stress events, despite the differences observed between channel and duct, do not contribute directly to the secondary motion, and thus other phenomena need to be considered instead.


title: Secure Distributed On-Device Learning Networks With Byzantine Adversaries

abstract: The privacy concern exists when the central server has the copies of datasets. Hence, there is a paradigm shift for the learning networks to change from centralized in-cloud learning to distributed \mbox{on-device} learning. Benefit from the parallel computing, the on-device learning networks have a lower bandwidth requirement than the in-cloud learning networks. Moreover, the on-device learning networks also have several desirable characteristics such as privacy preserving and flexibility. However, the \mbox{on-device} learning networks are vulnerable to the malfunctioning terminals across the networks. The worst-case malfunctioning terminals are the Byzantine adversaries, that can perform arbitrary harmful operations to compromise the learned model based on the full knowledge of the networks. Hence, the design of secure learning algorithms becomes an emerging topic in the on-device learning networks with Byzantine adversaries. In this article, we present a comprehensive overview of the prevalent secure learning algorithms for the two promising on-device learning networks: Federated-Learning networks and decentralized-learning networks. We also review several future research directions in the \mbox{Federated-Learning} and decentralized-learning networks.


title: Using bottomonium production as a tomographic probe of the quark-gluon plasma

abstract: The suppression of bottomonia in ultrarelativistic heavy-ion collisions is a smoking gun for the production of a strongly interacting final state in ultrarelativistic heavy-ion collisions. Furthermore, these final state interactions are consistent with the production of a hot hydrodynamically expanding quark-gluon plasma with initial temperatures on the order of 600-700 MeV at LHC collision energies. Models which incorporate plasma screening and bound-state breakup based on high-temperature quantum chromodynamics are in good agreement with the centrality, transverse-momentum, and rapidity dependence of the suppression seen in the highest energy LHC Pb-Pb collisions. The models of heavy-quark bound state breakup/formation are coupled to the soft dynamics of the quark-gluon plasma using 3+1d relativistic anisotropic hydrodynamics. At later times, excited state feed-down is taken into account using independently constrained excited state feed down fractions. Comparisons with LHC experimental data are consistent with primordial suppression of all bottomonium states, with states having the lowest binding energies being the ones which suffer the most suppression. In this proceedings contribution, I will review recent work to (a) include the effects of regeneration on bottomonium production and (b) to assess the effects of a rapidly changing in-medium potential on bottomonium production in the quark-gluon plasma.


title: Learning to solve the credit assignment problem

abstract: Backpropagation is driving today's artificial neural networks (ANNs). However, despite extensive research, it remains unclear if the brain implements this algorithm. Among neuroscientists, reinforcement learning (RL) algorithms are often seen as a realistic alternative: neurons can randomly introduce change, and use unspecific feedback signals to observe their effect on the cost and thus approximate their gradient. However, the convergence rate of such learning scales poorly with the number of involved neurons. Here we propose a hybrid learning approach. Each neuron uses an RL-type strategy to learn how to approximate the gradients that backpropagation would provide. We provide proof that our approach converges to the true gradient for certain classes of networks. In both feedforward and convolutional networks, we empirically show that our approach learns to approximate the gradient, and can match or the performance of exact gradient-based learning. Learning feedback weights provides a biologically plausible mechanism of achieving good performance, without the need for precise, pre-specified learning rules.


title: Stability of Open Multi-Agent Systems and Applications to Dynamic Consensus

abstract: In this technical note we consider a class of multi-agent network systems that we refer to as Open Multi-Agent Systems (OMAS): in these multi-agent systems, an indefinite number of agents may join or leave the network at any time. Focusing on discrete-time evolutions of scalar agents, we provide a novel theoretical framework to study the dynamical properties of OMAS: specifically, we propose a suitable notion of stability and derive sufficient conditions to ensure stability in this sense. These sufficient conditions regard the arrival/departure of an agent as a disturbance: consistently, they require the effect of arrivals/departures to be bounded (in a precise sense) and the OMAS to be contractive in the absence of arrivals/departures. In order to provide an example of application for this theory, we re-formulate the well-known Proportional Dynamic Consensus for Open Multi-Agent Systems and we characterize the stability properties of the resulting Open Proportional Dynamic Consensus algorithm.


title: Automated Steel Bar Counting and Center Localization with Convolutional Neural Networks

abstract: Automated steel bar counting and center localization plays an important role in the factory automation of steel bars. Traditional methods only focus on steel bar counting and their performances are often limited by complex industrial environments. Convolutional neural network (CNN), which has great capability to deal with complex tasks in challenging environments, is applied in this work. A framework called CNN-DC is proposed to achieve automated steel bar counting and center localization simultaneously. The proposed framework CNN-DC first detects the candidate center points with a deep CNN. Then an effective clustering algorithm named as Distance Clustering(DC) is proposed to cluster the candidate center points and locate the true centers of steel bars. The proposed CNN-DC can achieve 99.26% accuracy for steel bar counting and 4.1% center offset for center localization on the established steel bar dataset, which demonstrates that the proposed CNN-DC can perform well on automated steel bar counting and center localization. Code is made publicly available at: https://github.com/BenzhangQiu/Steel-bar-Detection.


title: In-flight photometry extraction of PLATO targets: Optimal apertures for detecting extrasolar planets

abstract: The ESA PLATO space mission is devoted to unveiling and characterizing new extrasolar planets and their host stars. This mission will encompass a very large field of view, granting it the potential to survey up to one million stars depending on the final observation strategy. The telemetry budget of the spacecraft cannot handle transmitting individual images for such a huge stellar sample at the right cadence, so the development of an appropriate strategy to perform on-board data reduction is mandatory. We employ aperture photometry to produce stellar light curves in flight. Our aim is thus to find the mask model that optimizes the scientific performance of the reduced data. We considered three distinct aperture models: binary mask, weighted Gaussian mask, and weighted gradient mask giving lowest noise-to-signal ratio, computed through a novel direct method. An innovative criterion was adopted for choosing between different mask models. We designated as optimal the model providing the best compromise between sensitivity to detect true and false planet transits. We determined the optimal model based on simulated noise-to-signal ratio and frequency of threshold crossing events. Our results show that, although the binary mask statistically presents a few percent higher noise-to-signal ratio compared to weighted masks, both strategies have very similar efficiency in detecting legitimate planet transits. When it comes to avoiding spurious signals from contaminant stars however the binary mask statistically collects considerably less contaminant flux than weighted masks, thereby allowing the former to deliver up to $\sim$30\% less false transit signatures at $7.1\sigma$. Our proposed approach for choosing apertures has been proven to be decisive for the determination of a mask model capable to provide near maximum planet yield and substantially reduced occurrence of false positives.


title: Photo Switching of Protein Dynamical Collectivity

abstract: We examine changes in the picosecond structural dynamics with irreversible photobleaching of red fluorescent proteins mCherry, mOrange2 and TagRFP-T. Measurements of the protein dynamical transition using terahertz time-domain spectroscopy show in all cases an increase in the turn-on temperature in the bleached state. The result is surprising given that there is little change in the protein surface, and thus the solvent dynamics held responsible for the transition should not change. A spectral analysis of the measurements guided by quasiharmonic calculations of the protein absorbance reveals that indeed the solvent dynamical turn-on temperature is independent of the thermal stability and photostate however the protein dynamical turn-on temperature shifts to higher temperatures. This is the first demonstration of switching the protein dynamical turn-on temperature with protein functional state. The observed shift in protein dynamical turn-on temperature relative to the solvent indicates an increase in the required mobile waters necessary for the protein picosecond motions: that is these motions are more collective. Melting-point measurements reveal that the photobleached state is more thermally stable and structural analysis of related RFPs shows that there is an increase in internal water channels as well as a more uniform atomic root mean squared displacement. These observations are consistent with previous suggestions that water channels form with extended light excitation providing O2 access to the chromophore and subsequent fluorescence loss. We report that these same channels increase internal coupling enhancing thermal stability and collectivity of the picosecond protein motions. The terahertz spectroscopic characterization of the protein and solvent dynamical onsets can be applied generally to measure changes in collectivity of protein motions.


title: Near threshold $J/\psi$ and $\Upsilon$ photo-production at JLab and RHIC

abstract: We update our previous calculation of $J/\psi$ photo-production near threshold \cite{Hatta:2018ina} by incorporating the recent developments in theory and the new experimental data from the GlueX collaboration at Jefferson Lab \cite{Ali:2019lzf}. We then propose to study the near threshold production of $\Upsilon$ and $J/\psi$ in ultraperipheral $pA$ collisions at RHIC. These processes are sensitive to the gluon condensate in the proton which is related to the QCD trace anomaly. Our result emphasizes the role of gluons as the origin of the proton mass.


title: Understanding the Silence of Sexual Harassment Victims Through the #WhyIDidntReport Movement

abstract: Sexual violence is a serious problem across the globe. A lot of victims, particularly women, go through this experience. Unfortunately, not all of these violent incidents come to public. A large portion of victims don't disclose their experience. On the September of 2018, people started revealing in Twitter why they didn't report a sexual violence experience using a hashtag #WhyIDidntReport. We collect about 40K such tweets and conduct a large-scale supervised analysis of why victims don't report. Our study finds the extent to which people shared their reasons as well as categorizes the reasons into finer reasons. We also analyze user engaged with the victims and compare our findings with existing literature.


title: Can Women Break the Glass Ceiling?: An Analysis of #MeToo Hashtagged Posts on Twitter

abstract: In October 2017, there happened the uprising of an unprecedented online movement on social media by women across the world who started publicly sharing their untold stories of being sexually harassed along with the hashtag #MeToo (or some variants of it). Those stories did not only strike the silence that had long hid the perpetrators, but also allowed women to discharge some of their bottled-up grievances, and revealed many important information surrounding sexual harassment. In this paper, we present our analysis of about one million such tweets collected between October 15 and October 31, 2017 that reveals some interesting patterns and attributes of the people, place, emotions, actions, and reactions related to the tweeted stories. Based on our analysis, we also advance the discussion on the potential role of online social media in breaking the silence of women by factoring in the strengths and limitations of these platforms.


title: Rotational spectroscopy of isotopic species of methyl mercaptan at millimeter and submillimeter wavelengths: CH$_3$$^{34}$SH

abstract: Methyl mercaptan (CH$_3$SH) is an important sulfur-bearing species in the interstellar medium, terrestrial environment, and potentially in planetary atmospheres. The aim of the present study is to provide accurate spectroscopic parameters for the most abundant minor isotopolog CH$_3$$^{34}$SH to support radio astronomical observations at millimeter and submillimeter wavelengths. The rotational spectrum of CH$_3$$^{34}$SH, which is complicated by the large-amplitude internal rotation of the CH$_3$ group versus the $^{34}$SH frame, was investigated in the 49$-$510 GHz and 1.1$-$1.5 THz frequency ranges in natural isotopic abundance. The analysis of the spectrum was performed up to the second excited torsional state, and the obtained data were modeled with the RAM36 program. A fit within experimental accuracy was obtained with a RAM Hamiltonian model that uses 72 parameters. Predictions based on this fit are used to search for CH$_3$$^{34}$SH with the Atacama Large Millimeter/submillimeter Array (ALMA) toward the hot molecular core Sgr B2(N2), but blends with emission lines of other species prevent its firm identification in this source.


title: A $2$-compact group as a spets

abstract: In 1993, Brou\'{e}, Malle and Michel initiated the study of spetses on the Greek island bearing the same name. These are mysterious objects attached to non-real Weyl groups. In algebraic topology, a $p$-compact group $\mathbf{X}$ is a space which is a homotopy-theoretic $p$-local analogue of a compact Lie group. A connected $p$-compact group $\mathbf{X}$ is determined by its root datum which in turn determines its Weyl group $W_\mathbf{X}$. In this article we give strong numerical evidence for a connection between these two objects by considering the case when $\mathbf{X}$ is the exotic $2$-compact group DI$(4)$ constructed by Dwyer--Wilkerson and $W_\mathbf{X}$ is the complex reflection group $G_{24} \cong$ GL$_3(2) \times C_2$. Inspired by results in Deligne--Lusztig theory for classical groups, if $q$ is an odd prime power we propose a set Irr$(\mathbf{X}(q))$ of `ordinary irreducible characters' associated to the space $\mathbf{X}(q)$ of homotopy fixed points under the unstable Adams operation $\psi^q$. Notably Irr$(\mathbf{X}(q))$ includes the set of unipotent characters associated to $G_{24}$ constructed by Brou\'{e}, Malle and Michel from the Hecke algebra of $G_{24}$ using the theory of spetses. By regarding $\mathbf{X}(q)$ as the classifying space of a Benson--Solomon fusion system Sol$(q)$ we formulate and prove an analogue of Robinson's ordinary weight conjecture that the number of characters of defect $d$ in Irr$(\mathbf{X}(q))$ can be counted locally.


title: A Tannakian framework for $G$-displays and Rapoport-Zink spaces

abstract: We develop a Tannakian framework for group-theoretic analogs of displays, originally introduced by B\"ultel and Pappas, and further studied by Lau. We use this framework to define Rapoport-Zink functors associated to triples $(G,\{\mu\},[b])$, where $G$ is a flat affine group scheme over $\mathbb{Z}_p$ and $\mu$ is a cocharacter of $G$ defined over a finite unramified extension of $\mathbb{Z}_p$. We prove these functors give a quotient stack presented by Witt vector loop groups, thereby showing our definition generalizes the group-theoretic definition of Rapoport-Zink spaces given by B\"ultel and Pappas. As an application, we prove a special case of a conjecture of B\"ultel and Pappas by showing their definition coincides with that of Rapoport and Zink in the case of unramified EL-type local Shimura data.


title: First Passage Time of Nonlinear Diffusion Processes with Singular Boundary Behavior

abstract: New theorems for the moments of the first passage time of one dimensional nonlinear stochastic processes with an entrance boundary are formulated. This important class of one dimensional stochastic processes results among others from approximations of the energy or amplitude of second order nonlinear stochastic differential equations. Since the diffusion of a stochastic process vanishes at an entrance boundary, the entrance boundary is called a singular point of the stochastic process. The theorems for the moments of the first passage times are validated based on existing analytical results. In addition, the first passage times of a nonlinear stochastic differential equation, which is important for the determination of dangerous ship roll dynamics, are calculated. The proposed analytical expressions for the moments of the first passage times can be calculated very fast using standard quadrature formulas.


title: The iMet Collection 2019 Challenge Dataset

abstract: Existing computer vision technologies in artwork recognition focus mainly on instance retrieval or coarse-grained attribute classification. In this work, we present a novel dataset for fine-grained artwork attribute recognition. The images in the dataset are professional photographs of classic artworks from the Metropolitan Museum of Art, and annotations are curated and verified by world-class museum experts. In addition, we also present the iMet Collection 2019 Challenge as part of the FGVC6 workshop. Through the competition, we aim to spur the enthusiasm of the fine-grained visual recognition research community and advance the state-of-the-art in digital curation of museum collections.


title: Globally diffeomorphic $\sigma$--harmonic mappings

abstract: Given a two--dimensional mapping $U$ whose components solve a divergence structure elliptic equation, we give necessary and sufficient conditions on the boundary so that $U$ is a global diffeomorphism.


title: Steady-state Voltage Profile and Long-term Voltage Stability of Electrified Road with Wireless Dynamic Charging

abstract: Wireless dynamic charging technologies are becoming a promising alternative solution to plug-in ones as they allow on-the-move charging for electric vehicles. From a power network point of view, this type of charging makes electric vehicles a new type of loads--the moving loads. Such moving loads are different from the traditional loads as they may change their locations constantly in the grids. To study the effect of these moving loads on power distribution grids, this work focuses on the steady-state analysis of electrified roads equipped with wireless dynamic charging. In particular, the voltage profile and the long-term voltage stability of the electrified roads are considered. Unusual shapes of the voltage profile are observed such as the half-leaf veins for a one-way road and the harp-like shape for a two-way road. Voltage swings are also detected while the vehicles move in the two-way road configuration. As for the long-term voltage stability, continuation power flow is used to characterize the maximum length of a road as well as the maximum number of vehicles that the road can accommodate.


title: Deep ReLU Networks Have Surprisingly Few Activation Patterns

abstract: The success of deep networks has been attributed in part to their expressivity: per parameter, deep networks can approximate a richer class of functions than shallow networks. In ReLU networks, the number of activation patterns is one measure of expressivity; and the maximum number of patterns grows exponentially with the depth. However, recent work has showed that the practical expressivity of deep networks - the functions they can learn rather than express - is often far from the theoretical maximum. In this paper, we show that the average number of activation patterns for ReLU networks at initialization is bounded by the total number of neurons raised to the input dimension. We show empirically that this bound, which is independent of the depth, is tight both at initialization and during training, even on memorization tasks that should maximize the number of activation patterns. Our work suggests that realizing the full expressivity of deep networks may not be possible in practice, at least with current methods.


title: Fitts' Law for speed-accuracy trade-off describes a diversity-enabled sweet spot in sensorimotor control

abstract: Human sensorimotor control exhibits remarkable speed and accuracy, and the tradeoff between them is encapsulated in Fitts' Law for reaching and pointing. While Fitts related this to Shannon's channel capacity theorem, despite widespread study of Fitts' Law, a theory that connects implementation of sensorimotor control at the system and hardware level has not emerged. Here we describe a theory that connects hardware (neurons and muscles with inherent severe speed-accuracy tradeoffs) with system level control to explain Fitts' Law for reaching and related laws. The results supporting the theory show that diversity between hardware components is exploited to achieve both fast and accurate control performance despite slow or inaccurate hardware. Such "diversity-enabled sweet spots" (DESSs) are ubiquitous in biology and technology, and explain why large heterogeneities exist in biological and technical components and how both engineers and natural selection routinely evolve fast and accurate systems using imperfect hardware.


title: Effect of Grain Orientation and Local Strains on Void Growth and Coalescence in Titanium

abstract: Ductile fracture has been extensively studied in metals with weak mechanical anisotropy such as copper and aluminum. The fracture of more anisotropic metals, especially those with a hexagonal crystal structure (e.g. titanium), remains far less understood. This paper investigates the ductile fracture process in commercially pure titanium (CP-Ti) with particular emphasis on the influence of grain orientation and local state of strain on void growth. An experimental approach was developed to directly relate the growth of a void in three dimensions to its underlying grain orientation. Grain orientation was obtained by electron back scattered diffraction on void-containing CP-Ti sheets prior to their diffusion bonding. Changes in void dimensions were measured during in-situ straining within an x-ray tomography system. The strong influence of the embedded grain orientation and that of its neighbors on void growth rate and coalescence has been experimentally quantified. Finite element crystal plasticity simulations that take into account both grain orientation and the local strain state were found to predict the experimental void growth. Grains where basal slip dominates show the largest void growth rates because they are closer to a plane strain condition that favors void growth and coalescence.


title: K-theory formulas for orthogonal and symplectic orbit closures

abstract: The complex orthogonal and symplectic groups both act on the complete flag variety with finitely many orbits. We study two families of polynomials introduced by Wyser and Yong representing the $K$-theory classes of the closures of these orbits. Our polynomials are analogous to the Grothendieck polynomials representing $K$-classes of Schubert varieties, and we show that like Grothendieck polynomials, they are uniquely characterized among all polynomials representing the relevant classes by a certain stability property. We show that the same polynomials represent the equivariant $K$-classes of symmetric and skew-symmetric analogues of Knutson and Miller's matrix Schubert varieties. We derive explicit expressions for these polynomials in special cases, including a Pfaffian formula relying on a more general degeneracy locus formula of Anderson. Finally, we show that taking an appropriate limit of our representatives recovers the $K$-theoretic Schur $Q$-functions of Ikeda and Naruse.


title: Phase-based Minimalist Parsing and complexity in non-local dependencies

abstract: A cognitively plausible parsing algorithm should perform like the human parser in critical contexts. Here I propose an adaptation of Earley's parsing algorithm, suitable for Phase-based Minimalist Grammars (PMG, Chesi 2012), that is able to predict complexity effects in performance. Focusing on self-paced reading experiments of object clefts sentences (Warren & Gibson 2005) I will associate to parsing a complexity metric based on cued features to be retrieved at the verb segment (Feature Retrieval & Encoding Cost, FREC). FREC is crucially based on the usage of memory predicted by the discussed parsing algorithm and it correctly fits with the reading time revealed.


title: Joint CLT for top eigenvalues of sample covariance matrices of separable high dimensional long memory processes

abstract: For $N,n\in\mathbb N$, consider the sample covariance matrix $$S_N(T)=\frac{1}{N}XX^*$$ from a data set $X=C_N^{1/2}ZT_n^{1/2}$, where $Z=(Z_{i,j})$ is a $N\times n$ matrix having i.i.d. entries with mean zero and variance one, and $C_N, T_n$ are deterministic positive semi-definite Hermitian matrices of dimension $N$ and $n$, respectively. We assume that $(C_N)_N$ is bounded in spectral norm, and $T_n$ is a Toeplitz matrix with its largest eigenvalues diverging to infinity. The matrix $X$ can be viewed as a data set of an $N$-dimensional long memory stationary process having separable dependence structure. As $N,n\to \infty$ and $Nn^{-1} \to r\in (0,\infty)$, we establish the asymptotics and the joint CLT for $(\lambda_1(S_N(T)),\cdots, \lambda_m(S_N(T))^\top$ where $\lambda_j(S_N(T))$ denotes the $j$th largest eigenvalue of $S_N(T)$, and $m$ is a fixed integer. For the CLT, we first study the case where the entries of $Z$ are Gaussian, and then we generalize the result to some more generic cases. This result substantially extends our previous result in Merlev\`ede et al. 2019, where we studied $\lambda_1(S_N(T))$ in the case where $m=1$ and $X=ZT_n^{1/2}$ with $Z$ having Gaussian entries. In order to establish this CLT, we are led to study the first order asymptotics of the largest eigenvalues and the associated eigenvectors of some deterministic Toeplitz matrices. We are specially interested in the autocovariance matrices of long memory stationary processes. We prove multiple spectral gap properties for the largest eigenvalues and a delocalization property for their associated eigenvectors.


title: Learning Representations by Maximizing Mutual Information Across Views

abstract: We propose an approach to self-supervised representation learning based on maximizing mutual information between features extracted from multiple views of a shared context. For example, one could produce multiple views of a local spatio-temporal context by observing it from different locations (e.g., camera positions within a scene), and via different modalities (e.g., tactile, auditory, or visual). Or, an ImageNet image could provide a context from which one produces multiple views by repeatedly applying data augmentation. Maximizing mutual information between features extracted from these views requires capturing information about high-level factors whose influence spans multiple views -- e.g., presence of certain objects or occurrence of certain events. Following our proposed approach, we develop a model which learns image representations that significantly outperform prior methods on the tasks we consider. Most notably, using self-supervised learning, our model learns representations which achieve 68.1% accuracy on ImageNet using standard linear evaluation. This beats prior results by over 12% and concurrent results by 7%. When we extend our model to use mixture-based representations, segmentation behaviour emerges as a natural side-effect. Our code is available online: https://github.com/Philip-Bachman/amdim-public.


title: Current fluctuations in a stochastic system of classical particles with next-nearest-neighbor interactions

abstract: A totally asymmetric exclusion process consisting of classical particles with next-nearest-neighbor interactions has been considered on a 1D discrete lattice with a ring geometry. Using large deviation techniques, we have investigated fluctuations of particle current in two and three-particle sectors. In two-particle sector, we have obtained exact large deviation function for the probability distribution of particle current. In this sector, we have also calculated the the propensity of each configuration to exhibit atypical particle current. Analytical results for both scaled cumulant generating function of particle current and average particle current are compared with those obtained from cloning Monte Carlo simulations. Numerical results in three-particle sector have also been presented.


title: Temporal Density Extrapolation using a Dynamic Basis Approach

abstract: Density estimation is a versatile technique underlying many data mining tasks and techniques,ranging from exploration and presentation of static data, to probabilistic classification, or identifying changes or irregularities in streaming data. With the pervasiveness of embedded systems and digitisation, this latter type of streaming and evolving data becomes more important. Nevertheless, research in density estimation has so far focused on stationary data, leaving the task of of extrapolating and predicting density at time points outside a training window an open problem. For this task, Temporal Density Extrapolation (TDX) is proposed. This novel method models and predicts gradual monotonous changes in a distribution. It is based on the expansion of basis functions, whose weights are modelled as functions of compositional data over time by using an isometric log-ratio transformation. Extrapolated density estimates are then obtained by extrapolating the weights to the requested time point, and querying the density from the basis functions with back-transformed weights. Our approach aims for broad applicability by neither being restricted to a specific parametric distribution, nor relying on cluster structure in the data.It requires only two additional extrapolation-specific parameters, for which reasonable defaults exist. Experimental evaluation on various data streams, synthetic as well as from the real-world domains of credit scoring and environmental health, shows that the model manages to capture monotonous drift patterns accurately and better than existing methods. Thereby, it requires not more than 1.5-times the run time of a corresponding static density estimation approach.


title: Compact binary coalescences: Constraints on waveforms

abstract: Gravitational waveforms for compact binary coalescences (CBCs) have been invaluable for detections by the LIGO-Virgo collaboration. They are obtained by a combination of semi-analytical models and numerical simulations. So far systematic errors arising from these procedures appear to be less than statistical ones. However, the significantly enhanced sensitivity of the new detectors that will become operational in the near future will require waveforms to be much more accurate. This task would be facilitated if one has a variety of cross-checks to \emph{evaluate} accuracy, particularly in the regions of parameter space where numerical simulations are sparse. Currently errors are estimated by comparing the candidate waveforms with the numerical relativity (NR) ones, which are taken to be exact. The goal of this paper is to propose a qualitatively different tool. We show that full non-linear general relativity (GR) imposes an infinite number of sharp constraints on the CBC waveforms. These can provide clear-cut measures to evaluate the accuracy of candidate waveforms against exact GR, help find systematic errors, and also provide external checks on NR simulations themselves.


title: Generalizations of $k$-Weisfeiler-Leman stabilization

abstract: The family of Weisfeiler-Leman equivalences on graphs is a widely studied approximation of graph isomorphism with many different characterizations. We study these, and other approximations of isomorphism defined in terms of refinement operators and Schurian Polynomial Approximation Schemes (SPAS). The general framework of SPAS allows us to study a number of parameters of the refinement operators based on Weisfeiler-Leman refinement, logic with counting, lifts of Weisfeiler-Leman as defined by Evdokimov and Ponomarenko, and the invertible map test introduced by Dawar and Holm, and variations of these, and establish relationships between them.


title: Stochastic Computing for Hardware Implementation of Binarized Neural Networks

abstract: Binarized Neural Networks, a recently discovered class of neural networks with minimal memory requirements and no reliance on multiplication, are a fantastic opportunity for the realization of compact and energy efficient inference hardware. However, such neural networks are generally not entirely binarized: their first layer remains with fixed point input. In this work, we propose a stochastic computing version of Binarized Neural Networks, where the input is also binarized. Simulations on the example of the Fashion-MNIST and CIFAR-10 datasets show that such networks can approach the performance of conventional Binarized Neural Networks. We evidence that the training procedure should be adapted for use with stochastic computing. Finally, the ASIC implementation of our scheme is investigated, in a system that closely associates logic and memory, implemented by Spin Torque Magnetoresistive Random Access Memory. This analysis shows that the stochastic computing approach can allow considerable savings with regards to conventional Binarized Neural networks in terms of area (62% area reduction on the Fashion-MNIST task). It can also allow important savings in terms of energy consumption, if we accept reasonable reduction of accuracy: for example a factor 2.1 can be saved, with the cost of 1.4% in Fashion-MNIST test accuracy. These results highlight the high potential of Binarized Neural Networks for hardware implementation, and that adapting them to hardware constrains can provide important benefits.


title: Software Adaptation and Generalization of Physically-Constrained Games

abstract: In this paper we provide a case study of the use of relatively sophisticated mathematics and algorithms to redefine and adapt a simple traditional game/puzzle to exploit the computational power of smart devices. The focus here is not so much on the end product as it is on the process and considerations underpinning its development. Ancillary results of the venture include generalizations of the circular-shift operator and examination of its computational complexity.


title: Learning Interpretable Shapelets for Time Series Classification through Adversarial Regularization

abstract: Times series classification can be successfully tackled by jointly learning a shapelet-based representation of the series in the dataset and classifying the series according to this representation. However, although the learned shapelets are discriminative, they are not always similar to pieces of a real series in the dataset. This makes it difficult to interpret the decision, i.e. difficult to analyze if there are particular behaviors in a series that triggered the decision. In this paper, we make use of a simple convolutional network to tackle the time series classification task and we introduce an adversarial regularization to constrain the model to learn more interpretable shapelets. Our classification results on all the usual time series benchmarks are comparable with the results obtained by similar state-of-the-art algorithms but our adversarially regularized method learns shapelets that are, by design, interpretable.


title: New solution of a problem of Kolmogorov on width asymptotics in holomorphic function spaces

abstract: Given a domain $D$ in $\mathbb{C}^n$ and $K$ a compact subset of $D$, the set $\mathcal{A}_K^D$ of all restrictions of functions holomorphic on $D$ the modulus of which is bounded by $1$ is a compact subset of the Banach space $C(K)$ of continuous functions on $K$. The sequence $(d_m(\mathcal{A}_K^D))_{m\in \mathbb{N}}$ of Kolmogorov $m$-widths of $\mathcal{A}_K^D$ provides a measure of the degree of compactness of the set $\mathcal{A}_K^D$ in $C(K)$ and the study of its asymptotics has a long history, essentially going back to Kolmogorov's work on $\epsilon$-entropy of compact sets in the 1950s. In the 1980s Zakharyuta showed that for suitable $D$ and $K$ the asymptotics \begin{equation*} \lim_{m\to \infty}\frac{- \log d_m(\mathcal{A}_K^D)}{m^{1/n}} = 2\pi \left ( \frac{n!}{C(K,D)}\right ) ^{1/n}\,, \end{equation*} where $C(K,D)$ is the Bedford-Taylor relative capacity of $K$ in $D$ is implied by a conjecture, now known as Zakharyuta's Conjecture, concerning the approximability of the regularised relative extremal function of $K$ and $D$ by certain pluricomplex Green functions. Zakharyuta's Conjecture was proved by Nivoche in 2004 thus settling the asymptotics above at the same time. We shall give a new proof of the asymptotics above for $D$ strictly hyperconvex and $K$ non-pluripolar which does not rely on Zakharyuta's Conjecture. Instead we proceed more directly by a two-pronged approach establishing sharp upper and lower bounds for the Kolmogorov widths. The lower bounds follow from concentration results of independent interest for the eigenvalues of a certain family of Toeplitz operators, while the upper bounds follow from an application of the Bergman-Weil formula together with an exhaustion procedure by special holomorphic polyhedra.


title: Production of Z-bosons in the parton branching method

abstract: Transverse Momentum Dependent (TMD) parton distributions obtained from the Parton Branching (PB) method are combined with next-to-leading-order (NLO) calculations of Drell-Yan (DY) production. We apply the MCatNLO method for the hard process calculation and matching with the PB TMDs. We compute predictions for the transverse momentum, rapidity and $\phi^*$ spectra of Z-bosons. We find that the theoretical uncertainties of the predictions are dominated by the renormalization and factorization scale dependence, while the impact of TMD uncertainties is moderate. The theoretical predictions agree well, within uncertainties, with measurements at the Large Hadron Collider (LHC). In particular, we study the region of lowest transverse momenta at the LHC, and comment on its sensitivity to nonperturbative TMD contributions.


title: Optimising portfolio diversification and dimensionality

abstract: A new framework for portfolio diversification is introduced which goes beyond the classical mean-variance approach and portfolio allocation strategies such as risk parity. It is based on a novel concept called portfolio dimensionality that connects diversification to the non-Gaussianity of portfolio returns and can typically be defined in terms of the ratio of risk measures which are homogenous functions of equal degree. The latter arises naturally due to our requirement that diversification measures should be leverage invariant. We introduce this new framework and argue the benefits relative to existing measures of diversification in the literature, before addressing the question of optimizing diversification or, equivalently, dimensionality. Maximising portfolio dimensionality leads to highly non-trivial optimization problems with objective functions which are typically non-convex and potentially have multiple local optima. Two complementary global optimization algorithms are thus presented. For problems of moderate size and more akin to asset allocation problems, a deterministic Branch and Bound algorithm is developed, whereas for problems of larger size a stochastic global optimization algorithm based on Gradient Langevin Dynamics is given. We demonstrate analytically and through numerical experiments that the framework reflects the desired properties often discussed in the literature.


title: Automorphisms of categories of schemes

abstract: Given two schemes $S$ and $S'$, we prove that every equivalence between $\mathbf{Sch}_S$ and $\mathbf{Sch}_{S'}$ comes from a unique isomorphism between $S$ and $S'$. This eliminates all Noetherian and finite type hypotheses from a result of Mochizuki and fully answers a programme set out by Brandenburg in a series of questions on MathOverflow in 2011.


title: The role of orbital angular momentum constraints in the variational optimization of the two-electron reduced-density matrix

abstract: The direct variational determination of the two-electron reduced-density matrix (2-RDM) is usually carried out under the assumption that the 2-RDM is a real-valued quantity. However, in systems that possess orbital angular momentum symmetry, the description of states with a well-defined, non-zero z-projection of the orbital angular momentum requires a complex-valued 2-RDM. We consider a semidefinite program suitable for the direct optimization of a complex-valued 2-RDM and explore the role of orbital angular momentum constraints in systems that possess the relevant symmetries. For atomic systems, constraints on the expectation values of the square and z-projection of the orbital angular momentum operator allow one to optimize 2-RDMs for multiple orbital angular momentum states. Similarly, in linear molecules, orbital angular momentum projection constraints enable the description of multiple electronic states, and, moreover, for states with a non-zero z-projection of the orbital angular momentum, the use of complex-valued quantities is essential for a qualitatively correct description of the electronic structure. For example, in the case of molecular oxygen, we demonstrate that orbital angular momentum constraints are necessary to recover the correct energy ordering of the lowest-energy singlet and triplet states near the equilibrium geometry. However, care must still be taken in the description of the dissociation limit, as the 2-RDM-based approach is not size consistent, and the size-consistency error varies dramatically, depending on the z-projections of the spin and orbital angular momenta.


title: TACAM: Topic And Context Aware Argument Mining

abstract: In this work we address the problem of argument search. The purpose of argument search is the distillation of pro and contra arguments for requested topics from large text corpora. In previous works, the usual approach is to use a standard search engine to extract text parts which are relevant to the given topic and subsequently use an argument recognition algorithm to select arguments from them. The main challenge in the argument recognition task, which is also known as argument mining, is that often sentences containing arguments are structurally similar to purely informative sentences without any stance about the topic. In fact, they only differ semantically. Most approaches use topic or search term information only for the first search step and therefore assume that arguments can be classified independently of a topic. We argue that topic information is crucial for argument mining, since the topic defines the semantic context of an argument. Precisely, we propose different models for the classification of arguments, which take information about a topic of an argument into account. Moreover, to enrich the context of a topic and to let models understand the context of the potential argument better, we integrate information from different external sources such as Knowledge Graphs or pre-trained NLP models. Our evaluation shows that considering topic information, especially in connection with external information, provides a significant performance boost for the argument mining task.


title: Charged Quantum Fields in AdS$_2$

abstract: We consider quantum field theory near the horizon of an extreme Kerr black hole. In this limit, the dynamics is well approximated by a tower of electrically charged fields propagating in an $SL(2,\mathbb{R})$ invariant AdS$_2$ geometry endowed with a constant, symmetry preserving background electric field. At large charge the fields oscillate near the AdS$_2$ boundary and no longer admit a standard Dirichlet treatment. From the Kerr black hole perspective, this phenomenon is related to the presence of an ergosphere. We discuss a definition for the quantum field theory whereby we 'UV' complete AdS$_2$ by appending an asymptotically two dimensional Minkowski region. This allows the construction of a novel observable for the flux-carrying modes that resembles the standard flat space S-matrix. We relate various features displayed by the highly charged particles to the principal series representations of $SL(2,\mathbb{R})$. These representations are unitary and also appear for massive quantum fields in dS$_2$. Both fermionic and bosonic fields are studied. We find that the free charged massless fermion is exactly solvable for general background, providing an interesting arena for the problem at hand.


title: 3D Appearance Super-Resolution with Deep Learning

abstract: We tackle the problem of retrieving high-resolution (HR) texture maps of objects that are captured from multiple view points. In the multi-view case, model-based super-resolution (SR) methods have been recently proved to recover high quality texture maps. On the other hand, the advent of deep learning-based methods has already a significant impact on the problem of video and image SR. Yet, a deep learning-based approach to super-resolve the appearance of 3D objects is still missing. The main limitation of exploiting the power of deep learning techniques in the multi-view case is the lack of data. We introduce a 3D appearance SR (3DASR) dataset based on the existing ETH3D [42], SyB3R [31], MiddleBury, and our Collection of 3D scenes from TUM [21], Fountain [51] and Relief [53]. We provide the high- and low-resolution texture maps, the 3D geometric model, images and projection matrices. We exploit the power of 2D learning-based SR methods and design networks suitable for the 3D multi-view case. We incorporate the geometric information by introducing normal maps and further improve the learning process. Experimental results demonstrate that our proposed networks successfully incorporate the 3D geometric information and super-resolve the texture maps.


title: Human information processing in complex networks

abstract: Humans communicate using systems of interconnected stimuli or concepts -- from language and music to literature and science -- yet it remains unclear how, if at all, the structure of these networks supports the communication of information. Although information theory provides tools to quantify the information produced by a system, traditional metrics do not account for the inefficient ways that humans process this information. Here we develop an analytical framework to study the information generated by a system as perceived by a human observer. We demonstrate experimentally that this perceived information depends critically on a system's network topology. Applying our framework to several real networks, we find that they communicate a large amount of information (having high entropy) and do so efficiently (maintaining low divergence from human expectations). Moreover, we show that such efficient communication arises in networks that are simultaneously heterogeneous, with high-degree hubs, and clustered, with tightly-connected modules -- the two defining features of hierarchical organization. Together, these results suggest that many communication networks are constrained by the pressures of information transmission, and that these pressures select for specific structural features.


title: Redshift Evolution of the Fundamental Plane Relation in the IllustrisTNG Simulation

abstract: We investigate the fundamental plane (FP) evolution of early-type galaxies in the IllustrisTNG-100 simulation (TNG100) from redshift $z=0$ to $z=2$. We find that a tight plane relation already exists as early as $z=2$. Its scatter stays as low as $\sim 0.08$ dex across this redshift range. Both slope parameters $b$ and $c$ (where $R \propto \sigma^b I^c$ with $R$, $\sigma$, and $I$ being the typical size, velocity dispersion, and surface brightness) of the plane evolve mildly since $z=2$, roughly consistent with observations. The FP residual $\rm Res$ ($\equiv\,a\,+\,b\log \sigma\,+\,c\log I\,-\,\log R$, where $a$ is the zero point of the FP) is found to strongly correlate with stellar age, indicating that stellar age can be used as a crucial fourth parameter of the FP. However, we find that $4c+b+2=\delta$, where $\delta \sim 0.8$ for FPs in TNG, rather than zero as is typically inferred from observations. This implies that a tight power-law relation between the dynamical mass-to-light ratio $M_{\rm dyn}/L$ and the dynamical mass $M_{\rm dyn}$ (where $M_{\rm dyn}\equiv 5\sigma^2R/G$, with $G$ being the gravitational constant) is not present in the TNG100 simulation. Recovering such a relation requires proper mixing between dark matter and baryons, as well as star formation occurring with correct efficiencies at the right mass scales. This represents a powerful constraint on the numerical models, which has to be satisfied in future hydrodynamical simulations.


title: Anchored Causal Inference in the Presence of Measurement Error

abstract: We consider the problem of learning a causal graph in the presence of measurement error. This setting is for example common in genomics, where gene expression is corrupted through the measurement process. We develop a provably consistent procedure for estimating the causal structure in a linear Gaussian structural equation model from corrupted observations on its nodes, under a variety of measurement error models. We provide an estimator based on the method-of-moments, which can be used in conjunction with constraint-based causal structure discovery algorithms. We prove asymptotic consistency of the procedure and also discuss finite-sample considerations. We demonstrate our method's performance through simulations and on real data, where we recover the underlying gene regulatory network from zero-inflated single-cell RNA-seq data.


title: Necessary and Sufficient Conditions for the Validity of Luttinger's Theorem

abstract: Luttinger's theorem is a major result in many-body physics that states the volume of the Fermi surface is directly proportional to the particle density. In its "hard" form, Luttinger's theorem implies that the Fermi volume is invariant with respect to interactions (as opposed to a "soft" Luttinger's theorem, where this invariance is lost). Despite it's simplicity, the conditions on the fermionic self energy under which Luttinger's theorem is valid remains a matter of debate, with possible requirements for its validity ranging from particle-hole symmetry to analyticity about the Fermi surface. In this paper, we propose the minimal requirements for the application of a hard Luttinger's Theorem to a generic fermionic system of arbitrary interaction strength by invoking the Atiyah-Singer index theorem to quantify the topologically-robust behavior of a generalized Fermi surface. We show that the applicability of a hard Luttinger's theorem in a D-dimensional system is directly dependent on the existence of a (D-1)-dimensional manifold of gapless chiral excitations at the Fermi level, regardless of whether the system exhibits Luttinger or Fermi surfaces (i.e., manifolds of zeroes of the Green's function and inverse Green's function, respectively). The exact form of the self-energy which guarantees validity of a hard Luttinger's theorem is derived, and agreement with current experiments, numerics, and theories are discussed.


title: A necessary and sufficient stability notion for adaptive generalization

abstract: We introduce a new notion of the stability of computations, which holds under post-processing and adaptive composition. We show that the notion is both necessary and sufficient to ensure generalization in the face of adaptivity, for any computations that respond to bounded-sensitivity linear queries while providing accuracy with respect to the data sample set. The stability notion is based on quantifying the effect of observing a computation's outputs on the posterior over the data sample elements. We show a separation between this stability notion and previously studied notion and observe that all differentially private algorithms also satisfy this notion.


title: On Radically Expanding the Landscape of Potential Applications for Automated Proof Methods

abstract: In this paper we examine the potential of computer-assisted proof methods to be applied much more broadly than commonly recognized. More specifically, we contend that there are vast opportunities to derive useful mathematical results and properties that are extremely narrow in scope, and of practical relevance only to highly-specialized engineering applications, that are presently overlooked because they have characteristics atypical of those that are conventionally pursued in the areas of pure and applied mathematics. As a concrete example, we demonstrate use of automated methods for certifying polynomial nonnegativity as a part of a dimension-pinning strategy to prove that the inverse of the relative gain array (RGA) of a d-dimensional positive-definite matrix is doubly-stochastic for $d\leq 4$.


title: Y-GAN: A Generative Adversarial Network for Depthmap Estimation from Multi-camera Stereo Images

abstract: Depth perception is a key component for autonomous systems that interact in the real world, such as delivery robots, warehouse robots, and self-driving cars. Tasks in autonomous robotics such as 3D object recognition, simultaneous localization and mapping (SLAM), path planning and navigation, require some form of 3D spatial information. Depth perception is a long-standing research problem in computer vision and robotics and has had a long history. Many approaches using deep learning, ranging from structure from motion, shape-from-X, monocular, binocular, and multi-view stereo, have yielded acceptable results. However, there are several shortcomings of these methods such as requiring expensive hardware, needing supervised training data, no ground truth data for comparison, and disregard for occlusion. In order to address these shortcomings, this work proposes a new deep convolutional generative adversarial network architecture, called Y-GAN, that uses data from three cameras to estimate a depth map for each frame in a multi-camera video stream.


title: Entropy and the second law for driven, or quenched, thermally isolated systems

abstract: The entropy of a thermally isolated system should not decrease after a quench or external driving. For a classical system following Hamiltonian dynamics, we show how this statement emerges for a large system in the sense that the extensive part of the entropy change does not become negative. However, for any finite system and small driving, the mean entropy change can well be negative. We derive these results using as micro-canonical entropy a variant recently introduced by Swendsen and co-workers called "canonical". This canonical entropy is the one of a canonical ensemble with the corresponding mean energy. As we show by refining the micro-canonical Crooks relation, the same results hold true for the two more conventional choices of micro-canonical entropy given either by the area of a constant energy shell, the Boltzmann entropy, or the volume underneath it, the Gibbs volume entropy. These results are exemplified with quenched $N$-dimensional harmonic oscillators.


title: Deligne-Lusztig duality on the stack of local systems

abstract: In the setting of the geometric Langlands conjecture, we argue that the phenomenon of divergence at infinity on Bun_G (that is, the difference between $!$-extensions and $*$-extensions) is controlled, Langlands-dually, by the locus of semisimple $\check{G}$-local systems. To see this, we first rephrase the question in terms of Deligne-Lusztig duality and then study the Deligne-Lusztig functor DL_G^\spec acting on the spectral Langlands DG category IndCoh_N(LS_G). We prove that DL_G^\spec is the projection IndCoh_N(LS_G) \to QCoh(LS_G), followed by the action of a coherent D-module St_G which we call the {Steinberg} D-module. We argue that St_G might be regarded as the dualizing sheaf of the locus of semisimple $G$-local systems. We also show that DL_G^\spec, while far from being conservative, is fully faithful on the subcategory of compact objects.


title: The general position problem and strong resolving graph

abstract: The general position number ${\rm gp}(G)$ of a connected graph $G$ is the cardinality of a largest set $S$ of vertices such that no three pairwise distinct vertices from $S$ lie on a common geodesic. It is proved that ${\rm gp}(G)\ge \omega(G_{\rm SR}$, where $G_{\rm SR}$ is the strong resolving graph of $G$, and $\omega(G_{\rm SR})$ is its clique number. That the bound is sharp is demonstrated with numerous constructions including for instance direct products of complete graphs and different families of strong products, of generalized lexicographic products, and of rooted product graphs. For the strong product it is proved that $gp(G\boxtimes H) \ge gp(G)gp(H)$, and asked whether the equality holds for arbitrary connected graphs $G$ and $H$. It is proved that the answer is in particular positive for strong products with a complete factor, for strong products of complete bipartite graphs, and for certain strong cylinders.


title: Mapping the Phases of Quantum Chromodynamics with Beam Energy Scan

abstract: We review the present status of the search for a phase transition and critical point as well as anomalous transport phenomena in Quantum Chromodynamics (QCD), with an emphasis on the Beam Energy Scan program at the Relativistic Heavy Ion Collider at Brookhaven National Laboratory. We present the conceptual framework and discuss the observables deemed most sensitive to a phase transition, QCD critical point, and anomalous transport, focusing on fluctuation and correlation measurements. Selected experimental results for these observables together with those characterizing the global properties of the systems created in heavy ion collisions are presented. We then discuss what can be already learned from the currently available data about the QCD critical point and anomalous transport as well as what additional measurements and theoretical developments are needed in order to discover these phenomena.


title: Service-Oriented Re-engineering of Legacy JEE Applications: Issues and Research Directions

abstract: Service-orientation views applications as orchestrations of independent software services that (1) implement functions that are reusable across many applications, (2) can be invoked remotely, and (3) are packaged to decouple potential callers from their implementation technology. As such, it enables organizations to develop quality applications faster than without services. Legacy applications are not service-oriented. Yet, they implement many reusable functions that could be exposed as \emph{services}. Organizations face three main issues when re-engineering legacy application to (re)use services: (1) to mine their existing applications for reusable functions that can become services, (2) to package those functions into services, and (3) to refactor legacy applications to invoke those services to ease future maintenance. In this paper, we explore these three issues and propose research directions to address them. We choose to focus on the service-oriented re-engineering of recent legacy object-oriented applications, and more specifically, on JEE applications, for several reasons. First, we wanted to focus on architectural challenges, and thus we choose to \textit{not} have to deal with programming language difference between source and target system. We chose JEE applications, in particular, because they embody the range of complexities that one can encounter in recent legacy applications, namely, multi-language systems, multi-tier applications, the reliance on external configuration files, and the reliance on frameworks and container services during runtime. These characteristics pose unique challenges for the three issues mentioned above.


title: Big-Data Clustering: K-Means or K-Indicators?

abstract: The K-means algorithm is arguably the most popular data clustering method, commonly applied to processed datasets in some "feature spaces", as is in spectral clustering. Highly sensitive to initializations, however, K-means encounters a scalability bottleneck with respect to the number of clusters K as this number grows in big data applications. In this work, we promote a closely related model called K-indicators model and construct an efficient, semi-convex-relaxation algorithm that requires no randomized initializations. We present extensive empirical results to show advantages of the new algorithm when K is large. In particular, using the new algorithm to start the K-means algorithm, without any replication, can significantly outperform the standard K-means with a large number of currently state-of-the-art random replications.


title: Cellular Traffic Prediction and Classification: a comparative evaluation of LSTM and ARIMA

abstract: Prediction of user traffic in cellular networks has attracted profound attention for improving resource utilization. In this paper, we study the problem of network traffic traffic prediction and classification by employing standard machine learning and statistical learning time series prediction methods, including long short-term memory (LSTM) and autoregressive integrated moving average (ARIMA), respectively. We present an extensive experimental evaluation of the designed tools over a real network traffic dataset. Within this analysis, we explore the impact of different parameters to the effectiveness of the predictions. We further extend our analysis to the problem of network traffic classification and prediction of traffic bursts. The results, on the one hand, demonstrate superior performance of LSTM over ARIMA in general, especially when the length of the training time series is high enough, and it is augmented by a wisely-selected set of features. On the other hand, the results shed light on the circumstances in which, ARIMA performs close to the optimal with lower complexity.