title: Positivity and nonadditivity of quantum capacities using generalized erasure channels

abstract: We consider various forms of a process, which we call {\em gluing}, for combining two or more complementary quantum channel pairs $(\mathcal{B},\mathcal{C})$ to form a composite. One type of gluing combines a perfect channel with a second channel to produce a \emph{generalized erasure channel} pair $(\mathcal{B}_g,\mathcal{C}_g)$. We consider two cases in which the second channel is (i) an amplitude-damping, or (ii) a phase-damping qubit channel; (ii) is the \emph{dephrasure channel} of Leditzky et al. For both (i) and (ii), $(\mathcal{B}_g,\mathcal{C}_g)$ depends on the damping parameter $0\leq p\leq 1$ and a parameter $0 \leq \lambda \leq 1$ that characterizes the gluing process. In both cases we study $Q^{(1)}(\mathcal{B}_g)$ and $Q^{(1)}(\mathcal{C}_g)$, where $Q^{(1)}$ is the channel coherent information, and determine the regions in the $(p,\lambda)$ plane where each is zero or positive, confirming previous results for (ii). A somewhat surprising result for which we lack any intuitive explanation is that $Q^{(1)}(\mathcal{C}_g)$ is zero for $\lambda \leq 1/2$ when $p=0$, but is strictly positive (though perhaps extremely small) for all values of $\lambda> 0$ when $p$ is positive by even the smallest amount. In addition we study the nonadditivity of $Q^{(1)}(\mathcal{B}_g)$ for two identical channels in parallel. It occurs in a well-defined region of the $(p,\lambda)$ plane in case (i). In case (ii) we have extended previous results for the dephrasure channel without, however, identifying the full range of $(p,\lambda)$ values where nonadditivity occurs. Again, an intuitive explanation is lacking.


title: Change Point Detection in Software Performance Testing

abstract: We describe our process for automatic detection of performance changes for a software product in the presence of noise. A large collection of tests run periodically as changes to our software product are committed to our source repository, and we would like to identify the commits responsible for performance regressions. Previously, we relied on manual inspection of time series graphs to identify significant changes. That was later replaced with a threshold-based detection system, but neither system was sufficient for finding changes in performance in a timely manner. This work describes our recent implementation of a change point detection system built upon the E-Divisive means algorithm. The algorithm produces a list of change points representing significant changes from a given history of performance results. A human reviews the list of change points for actionable changes, which are then triaged for further inspection. Using change point detection has had a dramatic impact on our ability to detect performance changes. Quantitatively, it has dramatically dropped our false positive rate for performance changes, while qualitatively it has made the entire performance evaluation process easier, more productive (ex. catching smaller regressions), and more timely.


title: Online Hierarchical Forecasting for Power Consumption Data

abstract: We study the forecasting of the power consumptions of a population of households and of subpopulations thereof. These subpopulations are built according to location, to exogenous information and/or to profiles we determined from historical households consumption time series. Thus, we aim to forecast the electricity consumption time series at several levels of households aggregation. These time series are linked through some summation constraints which induce a hierarchy. Our approach consists in three steps: feature generation, aggregation and projection. Firstly (feature generation step), we build, for each considering group for households, a benchmark forecast (called features), using random forests or generalized additive models. Secondly (aggregation step), aggregation algorithms, run in parallel, aggregate these forecasts and provide new predictions. Finally (projection step), we use the summation constraints induced by the time series underlying hierarchy to re-conciliate the forecasts by projecting them in a well-chosen linear subspace. We provide some theoretical guaranties on the average prediction error of this methodology, through the minimization of a quantity called regret. We also test our approach on households power consumption data collected in Great Britain by multiple energy providers in the Energy Demand Research Project context. We build and compare various population segmentations for the evaluation of our approach performance.


title: Autonomously revealing hidden local structures in supercooled liquids

abstract: Few questions in condensed matter science have proven as difficult to unravel as the interplay between structure and dynamics in supercooled liquids and glasses. The conundrum: close to the glass transition, the dynamics slow down dramatically and become heterogeneous while the structure appears largely unperturbed. Largely unperturbed, however, is not the same as unperturbed, and many studies have attempted to identify "slow" local structures by exploiting dynamical information. Nonetheless, the question remains open: is the key to the slow dynamics imprinted in purely structural information? And if so, is there a way to determine the relevant structures without any dynamical information? Here, we use a newly developed unsupervised machine learning (UML) algorithm to identify structural heterogeneities in three archetypical glass formers. In each system, the UML approach autonomously designs an order parameter based purely on structural variation within a single snapshot. Impressively, this order parameter strongly correlates with the dynamical heterogeneity. Moreover, the structural characteristics linked to slow particles disappear as we move away from the glass transition. Our results demonstrate the power of machine learning techniques to detect structural patterns even in disordered systems, and provide a new way forward for unraveling the structural origins of the slow dynamics of glassy materials.


title: Lectures on Bulk Reconstruction

abstract: If the AdS/CFT conjecture holds, every question about bulk physics can be answered by the boundary CFT. But we still don't know how to translate all the questions about bulk physics to questions about the boundary CFT. Completing this bulk-boundary dictionary is the aim of the bulk reconstruction program, which we review in these lectures. We cover the HKLL construction, bulk reconstruction in AdS/Rindler, mirror operator construction of Papadodimas and Raju and the Marolf-Wall paradox. These notes are based on lectures given at ST4 2018.


title: A Reconfigurable Hybrid Actuator with Rigid and Soft Components

abstract: Classical rigid-bodied robotic systems are presented with proven success in theoretical development and industrial applications, are recently challenged by the emergence of soft robotics due to a growing need in physical human-robot interactions (pHRI), such as wearable devices, medical robots, personal robots, etc. In this paper, we present the design and fabrication of a robust, hybrid bending actuator build from both rigid and soft components inspired by crustaceans, where its bending radius and axis can be mechanically programmed through the selective activation of the rigid exterior joints, actuated by the soft actuators inside. The hybrid actuator was experimentally measured in terms of bending and force tests to demonstrate the utility of this design. Finally, a case study was presented to demonstrate its capacity to adapt to specific objects geometry, anticipating its potential application in situations where compliance is the priority.


title: Universal Lex Ideal Approximations of Extended Hilbert Functions and Hamilton Numbers

abstract: Let $R^h$ denote the polynomial ring in variables $x_1,\,\ldots,\, x_h$ over a specified field $K$. We consider all of these rings simultaneously, and in each use lexicographic (lex) monomial order with $x_1 > \cdots > x_h$. Given a fixed homogeneous ideal $I$ in $R^h$, for each $d$ there is unique lex ideal generated in degree at most $d$ whose Hilbert function agrees with the Hilbert function of $I$ up to degree $d$. When we consider $IR^N$ for $N \geq h$, the set $\mathfrak{B}_d(I,N)$ of minimal generators for this lex ideal in degree at most $d$ may change, but $\mathfrak{B}_d(I,N)$ is constant for all $N \gg 0$. We let $\mathfrak{B}_d(I)$ denote the set of generators one obtains for all $N \gg 0$, and we let $b_d = b_d(I)$ be its cardinality. The sequences $b_1, \, \ldots, \, b_d, \, \ldots$ obtained in this way may grow very fast. Remarkably, even when $I = (x_1^2, x_2^2)$, one obtains a very interesting sequence, 0, 2, 3, 4, 6, 12, 924, 409620,$\,\ldots$. This sequence is the same as $H_{d-1} + 1$ for $d \geq 2$, where $H_d$ is the $d\,$th Hamilton number. The Hamilton numbers were studied by Hamilton and by Hammond and Sylvester because of their occurrence in a counting problem connected with the use of Tschirnhaus transformations in manipulating polynomial equations.


title: Hamiltonian for scalar field model of infinite derivative gravity

abstract: Theories with an infinite number of derivatives are described by non-local Lagrangians for which the standard Hamiltonian formalism cannot be applied. Hamiltonians of special types of non-local theories can be constructed by means of the (1+1)-dimensional Hamiltonian formalism. In this paper, we consider a simple scalar field model inspired by the infinite derivative gravity and study its reduced phase space by using this formalism. Assuming the expansion of the solutions in the coupling constant, we compute the perturbative Hamiltonian and the symplectic 2-form. We also discuss an example of a theory leading to an infinite-dimensional reduced phase space for a different choice of the form factor.


title: Unstaggered-staggered solitons on one- and two-dimensional two-component discrete nonlinear Schr\"{o}dinger lattices

abstract: We study coupled unstaggered-staggered soliton pairs emergent from a system of two coupled discrete nonlinear Schr\"{o}dinger (DNLS) equations with the self-attractive on-site self-phase-modulation nonlinearity, coupled by the repulsive cross-phase-modulation interaction, on 1D and 2D lattice domains. These mixed modes are of a "symbiotic" type, as each component in isolation may only carry ordinary unstaggered solitons. While most work on DNLS systems addressed symmetric on-site-centered fundamental solitons, these models give rise to a variety of other excited states, which may also be stable. The simplest among them are antisymmetric states in the form of discrete twisted solitons, which have no counterparts in the continuum limit. In the extension to 2D lattice domains, a natural counterpart of the twisted states are vortical solitons. We first introduce a variational approximation (VA) for the solitons, and then correct it numerically to construct exact stationary solutions, which are then used as initial conditions for simulations to check if the stationary states persist under time evolution. Two-component solutions obtained include (i) 1D fundamental-twisted and twisted-twisted soliton pairs, (ii) 2D fundamental-fundamental soliton pairs, and (iii) 2D vortical-vortical soliton pairs. We also highlight a variety of other transient dynamical regimes, such as breathers and amplitude death. The findings apply to modeling binary Bose-Einstein condensates, loaded in a deep lattice potential, with identical or different atomic masses of the two components, and arrays of bimodal optical waveguides.


title: Sheaves of Higher Categories on Generalised Spaces

abstract: We study the homotopy right Kan extension of homotopy sheaves on a category to its free cocompletion, i.e. to its category of presheaves. Any pretopology on the original category induces a canonical pretopology of generalised coverings on the free cocompletion. We show that with respect to these pretopologies the homotopy right Kan extension along the Yoneda embedding preserves homotopy sheaves valued in (sufficiently nice) simplicial model categories. Moreover, we show that this induces an equivalence between sheaves of spaces on the original category and colimit-preserving sheaves of spaces on its free cocompletion. We present three applications in geometry and topology: first, we prove that diffeological vector bundles descend along subductions of diffeological spaces. Second, we deduce that various flavours of bundle gerbes with connection satisfy $(\infty,2)$-categorical descent. Finally, we investigate smooth diffeomorphism actions in smooth bordism-type field theories on a manifold. We show how these smooth actions allow us to extract the values of a field theory on any object coherently from its values on generating objects of the bordism category.


title: True and false discoveries with independent e-values

abstract: In this note we use e-values (a non-Bayesian version of Bayes factors) in the context of multiple hypothesis testing assuming that the base tests produce independent e-values. Our simulation studies and theoretical considerations suggest that, under this assumption, our new algorithms are superior to the known algorithms using independent p-values and to our recent algorithms using e-values that are not necessarily independent.


title: Rethinking Fully Convolutional Networks for the Analysis of Photoluminescence Wafer Images

abstract: The manufacturing of light-emitting diodes is a complex semiconductor-manufacturing process, interspersed with different measurements. Among the employed measurements, photoluminescence imaging has several advantages, namely being a non-destructive, fast and thus cost-effective measurement. On a photoluminescence measurement image of an LED wafer, every pixel corresponds to an LED chip's brightness after photo-excitation, revealing chip performance information. However, generating a chip-fine defect map of the LED wafer, based on photoluminescence images, proves challenging for multiple reasons: on the one hand, the measured brightness values vary from image to image, in addition to local spots of differing brightness. On the other hand, certain defect structures may assume multiple shapes, sizes and brightness gradients, where salient brightness values may correspond to defective LED chips, measurement artefacts or non-defective structures. In this work, we revisit the creation of chip-fine defect maps using fully convolutional networks and show that the problem of segmenting objects at multiple scales can be improved by the incorporation of densely connected convolutional blocks and atrous spatial pyramid pooling modules. We also share implementation details and our experiences with training networks with small datasets of measurement images. The proposed architecture significantly improves the segmentation accuracy of highly variable defect structures over our previous version.


title: Perverse equivalence in $SL(2,q)$

abstract: We will be defining a type of perverse equivalence that always corresponds to a derived equivalence with two-term tilting complexes. We are going to show that the tilting considered by Okuyama and Yoshii for the proof of Brou\'e's conjecture for $SL(2,q)$ in defining characteristic is a composition of such perverse equivalences.


title: Overcoming the curse of dimensionality in the numerical approximation of high-dimensional semilinear elliptic partial differential equations

abstract: Recently, so-called full-history recursive multilevel Picard (MLP) approximation schemes have been introduced and shown to overcome the curse of dimensionality in the numerical approximation of semilinear parabolic partial differential equations (PDEs) with Lipschitz nonlinearities. The key contribution of this article is to introduce and analyze a new variant of MLP approximation schemes for certain semilinear elliptic PDEs with Lipschitz nonlinearities and to prove that the proposed approximation schemes overcome the curse of dimensionality in the numerical approximation of such semilinear elliptic PDEs.


title: Criteria for exact saturation and singular compactness

abstract: We introduce the class of unshreddable theories, which contains the simple and NIP theories, and prove that such theories have exactly saturated models in singular cardinals, satisfying certain set-theoretic hypotheses. We also give criteria for a theory to have singular compactness.


title: Data Normalization for Bilinear Structures in High-Frequency Financial Time-series

abstract: Financial time-series analysis and forecasting have been extensively studied over the past decades, yet still remain as a very challenging research topic. Since the financial market is inherently noisy and stochastic, a majority of financial time-series of interests are non-stationary, and often obtained from different modalities. This property presents great challenges and can significantly affect the performance of the subsequent analysis/forecasting steps. Recently, the Temporal Attention augmented Bilinear Layer (TABL) has shown great performances in tackling financial forecasting problems. In this paper, by taking into account the nature of bilinear projections in TABL networks, we propose Bilinear Normalization (BiN), a simple, yet efficient normalization layer to be incorporated into TABL networks to tackle potential problems posed by non-stationarity and multimodalities in the input series. Our experiments using a large scale Limit Order Book (LOB) consisting of more than 4 million order events show that BiN-TABL outperforms TABL networks using other state-of-the-arts normalization schemes by a large margin.


title: A regularity result for shortest generalized billiard trajectories in convex bodies in $\mathbb{R}^n$

abstract: We study length-minimizing closed generalized Euclidean billiard trajectories in convex bodies in $\mathbb{R}^n$ and investigate their relation to the inclusion minimal affine sections that contain these trajectories. We show that when passing to these sections, the length-minimizing closed billiard trajectories are still billiard trajectories, but their length-minimality as well as their regularity can be destroyed. In light of this, we prove what weaker regularity is actually preserved under passing to these sections. Based on the results, we develop an algorithm in order to calculate length-minimizing closed regular billiard trajectories in convex polytopes in $\mathbb{R}^n$.


title: A Lobster-inspired Hybrid Actuator With Rigid and Soft Components

abstract: Soft actuators have drawn significant attention from researchers with an inherently compliant design to address the safety issues in physical human-robot interactions. However, they are also vulnerable and pose new challenges in the design, fabrication, and analysis due to their inherent material softness. In this paper, a novel hybrid actuator design is presented with bio-inspirations from the lobster, or crustaceans in a broader perspective. We enclose a soft chamber with rectangular cross-section using a series of articulated rigid shells to produce bending under pneumatic input. By mimicking the shell pattern of lobsters' abdomen, foldable rigid shells are designed to provide the soft actuator with full protection throughout the motion range. The articulation of the rigid shells predefines the actuator's bending motions. As a result, the proposed design enables one to analyze this hybrid actuator with simplified quasi-static models and rigid-body kinematics, which are further validated by mechanical tests. This paper demonstrates that the proposed hybrid actuator design is capable of bridging the major design drawbacks of the entirely rigid and soft robots while preserving their engineering merits in performance.


title: 3D Point Cloud Processing and Learning for Autonomous Driving

abstract: We present a review of 3D point cloud processing and learning for autonomous driving. As one of the most important sensors in autonomous vehicles, light detection and ranging (LiDAR) sensors collect 3D point clouds that precisely record the external surfaces of objects and scenes. The tools for 3D point cloud processing and learning are critical to the map creation, localization, and perception modules in an autonomous vehicle. While much attention has been paid to data collected from cameras, such as images and videos, an increasing number of researchers have recognized the importance and significance of LiDAR in autonomous driving and have proposed processing and learning algorithms to exploit 3D point clouds. We review the recent progress in this research area and summarize what has been tried and what is needed for practical and safe autonomous vehicles. We also offer perspectives on open issues that are needed to be solved in the future.


title: Federating Recommendations Using Differentially Private Prototypes

abstract: Machine learning methods allow us to make recommendations to users in applications across fields including entertainment, dating, and commerce, by exploiting similarities in users' interaction patterns. However, in domains that demand protection of personally sensitive data, such as medicine or banking, how can we learn such a model without accessing the sensitive data, and without inadvertently leaking private information? We propose a new federated approach to learning global and local private models for recommendation without collecting raw data, user statistics, or information about personal preferences. Our method produces a set of prototypes that allows us to infer global behavioral patterns, while providing differential privacy guarantees for users in any database of the system. By requiring only two rounds of communication, we both reduce the communication costs and avoid the excessive privacy loss associated with iterative procedures. We test our framework on synthetic data as well as real federated medical data and Movielens ratings data. We show local adaptation of the global model allows our method to outperform centralized matrix-factorization-based recommender system models, both in terms of accuracy of matrix reconstruction and in terms of relevance of the recommendations, while maintaining provable privacy guarantees. We also show that our method is more robust and is characterized by smaller variance than individual models learned by independent entities.


title: Fractional Little-Parks effect observed in a topological superconductor

abstract: In superconductors, the condensation of Cooper pairs gives rise to fluxoid quantization in discrete units of $\Phi_0 = hc / 2e$. The denominator of $2e$ is the signature of electron pairing, which is evidenced by a number of macroscopic quantum phenomena, such as the Little-Parks effect and the Josephson effect, where the critical temperature or the critical current oscillates in the period of $\Phi_0$. Here we report the observation of fractional Little-Parks effect in mesoscopic rings of epitaxial $\beta$-Bi$_2$Pd, a topological superconductor. Besides $\Phi_0$, novel Little-Parks oscillation periodicities of $2\Phi_0$, $3\Phi_0$ and $4\Phi_0$ are also observed, implying quasiparticles with effective charges being a fraction of a Cooper pair. We show that the fractional Little-Parks effect may be closely related to the fractional Josephson effect, which is a key signature of chiral Majorana edge states.


title: Abelian surfaces with fixed $3$-torsion

abstract: Given a genus two curve $X: y^2 = x^5 + a x^3 + b x^2 + c x + d$, we give an explicit parametrization of all other such curves $Y$ with a specified symplectic isomorphism on three-torsion of Jacobians $\mbox{Jac}(X)[3] \cong \mbox{Jac}(Y)[3]$. It is known that under certain conditions modularity of $X$ implies modularity of infinitely many of the $Y$, and we explain how our formulas render this transfer of modularity explicit. Our method centers on the invariant theory of the complex reflection group $C_3 \times \operatorname{Sp}_4(\mathbf{F}_3)$. We discuss other examples where complex reflection groups are related to moduli spaces of curves, and in particular motivate our main computation with an exposition of the simpler case of the group $\operatorname{Sp}_2(\mathbf{F}_3) = \mathrm{SL}_2(\mathbf{F}_3)$ and $3$-torsion on elliptic curves.


title: Stein Variational Inference for Discrete Distributions

abstract: Gradient-based approximate inference methods, such as Stein variational gradient descent (SVGD), provide simple and general-purpose inference engines for differentiable continuous distributions. However, existing forms of SVGD cannot be directly applied to discrete distributions. In this work, we fill this gap by proposing a simple yet general framework that transforms discrete distributions to equivalent piecewise continuous distributions, on which the gradient-free SVGD is applied to perform efficient approximate inference. The empirical results show that our method outperforms traditional algorithms such as Gibbs sampling and discontinuous Hamiltonian Monte Carlo on various challenging benchmarks of discrete graphical models. We demonstrate that our method provides a promising tool for learning ensembles of binarized neural network (BNN), outperforming other widely used ensemble methods on learning binarized AlexNet on CIFAR-10 dataset. In addition, such transform can be straightforwardly employed in gradient-free kernelized Stein discrepancy to perform goodness-of-fit (GOF) test on discrete distributions. Our proposed method outperforms existing GOF test methods for intractable discrete distributions.


title: Participatory Budgeting: Models and Approaches

abstract: Participatory budgeting is a democratic approach to deciding the funding of public projects, which has been adopted in many cities across the world. We present a survey of research on participatory budgeting emerging from the computational social choice literature, which draws ideas from computer science and microeconomic theory. We present a mathematical model for participatory budgeting, which charts existing models across different axes including whether the projects are treated as "divisible" or "indivisible" and whether there are funding limits on individual projects. We then survey various approaches and methods from the literature, giving special emphasis on issues of preference elicitation, welfare objectives, fairness axioms, and voter incentives. Finally, we discuss several directions in which research on participatory budgeting can be extended in the future.


title: Entanglement-Separability Boundary Within a Quantum State

abstract: Quantum states are the key mathematical objects in quantum mechanics, and entanglement lies at the heart of the nascent fields of quantum information processing and computation. What determines whether an arbitrary quantum state is entangled or separable is therefore very important for investigating both fundamental physics and practical applications. Here we show that an arbitrary bipartite state can be divided into a unique purely entangled structure and a unique purely separable structure. We show that whether a quantum state is entangled or not is determined by the ratio of its weight of the purely entangled structure and its weight of the purely separable structure. We provide a general algorithm for the purely entangled structure and the purely separable structure, and a general algorithm for the best separable approximation (BSA) decomposition, that has been a long-standing open problem. Our result implies that quantum states exist as families in theory, and that the entanglement (separability) of family members can be determined by referring to a crucial member of the family.


title: MBGD-RDA Training and Rule Pruning for Concise TSK Fuzzy Regression Models

abstract: To effectively train Takagi-Sugeno-Kang (TSK) fuzzy systems for regression problems, a Mini-Batch Gradient Descent with Regularization, DropRule, and AdaBound (MBGD-RDA) algorithm was recently proposed. It has demonstrated superior performances; however, there are also some limitations, e.g., it does not allow the user to specify the number of rules directly, and only Gaussian MFs can be used. This paper proposes two variants of MBGD-RDA to remedy these limitations, and show that they outperform the original MBGD-RDA and the classical ANFIS algorithms with the same number of rules. Furthermore, we also propose a rule pruning algorithm for TSK fuzzy systems, which can reduce the number of rules without significantly sacrificing the regression performance. Experiments showed that the rules obtained from pruning are generally better than training them from scratch directly, especially when Gaussian MFs are used.


title: Optimizing Dynamic Trajectories for Robustness to Disturbances Using Polytopic Projections

abstract: This paper focuses on robustness to disturbance forces and uncertain payloads. We present a novel formulation to optimize the robustness of dynamic trajectories. A straightforward transcription of this formulation into a nonlinear programming problem is not tractable for state-of-the-art solvers, but it is possible to overcome this complication by exploiting the structure induced by the kinematics of the robot. The non-trivial transcription proposed allows trajectory optimization frameworks to converge to highly robust dynamic solutions. We demonstrate the results of our approach using a quadruped robot equipped with a manipulator.


title: Gimme That Model!: A Trusted ML Model Trading Protocol

abstract: We propose a HE-based protocol for trading ML models and describe possible improvements to the protocol to make the overall transaction more efficient and secure.


title: General Formulation of Coulomb Explosion Dynamics of Highly Symmetric Charge Distributions

abstract: We present a theoretical approach to study the dynamics of spherical, cylindrical and ellipsoidal charge distributions under their self-Coulomb field and a stochastic force due to collisions and random motions of charged particles. The approach is based on finding the current density of the charge distribution from the charge-current continuity equation and determining the drift velocities of the particles. The latter can be used either to derive the Lagrangian of the system, or to write Newtons equation of motion with the Lorentz force. We develop a kinetic theory to include the stochastic force due to random motions of electrons into our model. To demonstrate the efficacy of our method, we apply it to various charge distributions and compare our results to N-body simulations. We show that our method reproduces the well-known emittance term in the envelope equation of uniform spherical and cylindrical charge distributions with correct coefficients. We use our model for the gravitational collapse of an ideal gas as well as the cyclotron dynamics of a cylindrical charge distribution in a uniform magnetic field and propose a method to measure the emittance of electron beams.


title: Adhesion-driven patterns in a calcium-dependent model of cancer cell movement

abstract: Cancer cells exhibit increased motility and proliferation, which are instrumental in the formation of tumours and metastases. These pathological changes can be traced back to malfunctions of cellular signalling pathways, and calcium signalling plays a prominent role in these. We formulate a new model for cancer cell movement which for the first time explicitly accounts for the dependence of cell proliferation and cell-cell adhesion on calcium. At the heart of our work is a non-linear, integro-differential (non-local) equation for cancer cell movement, accounting for cell diffusion, advection and proliferation. We also employ an established model of cellular calcium signalling with a rich dynamical repertoire that includes experimentally observed periodic wave trains and solitary pulses. The cancer cell density exhibits travelling fronts and complex spatial patterns arising from an adhesion-driven instability (ADI). We show how the different calcium signals and variations in the strengths of cell-cell attraction and repulsion shape the emergent cellular aggregation patterns, which are a key component of the metastatic process. Performing a linear stability analysis, we identify parameter regions corresponding to ADI. These regions are confirmed by numerical simulations, which also reveal different types of aggregation patterns and these patterns are significantly affected by \ca. Our study demonstrates that the maximal cell density decreases with calcium concentration, while the frequencies of the calcium oscillations and the cell density oscillations are approximately equal in many cases. Furthermore, as the calcium levels increase the speed of the travelling fronts increases, which is related to a higher cancer invasion potential. These novel insights provide a step forward in the design of new cancer treatments that may rely on controlling the dynamics of cellular calcium.


title: How Do We Move: Modeling Human Movement with System Dynamics

abstract: Modeling how human moves in the space is useful for policy-making in transportation, public safety, and public health. Human movements can be viewed as a dynamic process that human transits between states (\eg, locations) over time. In the human world where intelligent agents like humans or vehicles with human drivers play an important role, the states of agents mostly describe human activities, and the state transition is influenced by both the human decisions and physical constraints from the real-world system (\eg, agents need to spend time to move over a certain distance). Therefore, the modeling of state transition should include the modeling of the agent's decision process and the physical system dynamics. In this paper, we propose \ours to model state transition in human movement from a novel perspective, by learning the decision model and integrating the system dynamics. \ours learns the human movement with Generative Adversarial Imitation Learning and integrates the stochastic constraints from system dynamics in the learning process. To the best of our knowledge, we are the first to learn to model the state transition of moving agents with system dynamics. In extensive experiments on real-world datasets, we demonstrate that the proposed method can generate trajectories similar to real-world ones, and outperform the state-of-the-art methods in predicting the next location and generating long-term future trajectories.


title: Connected Components on a PRAM in Log Diameter Time

abstract: We present an $O(\log d + \log\log_{m/n} n)$-time randomized PRAM algorithm for computing the connected components of an $n$-vertex, $m$-edge undirected graph with maximum component diameter $d$. The algorithm runs on an ARBITRARY CRCW (concurrent-read, concurrent-write with arbitrary write resolution) PRAM using $O(m)$ processors. The time bound holds with good probability. Our algorithm is based on the breakthrough results of Andoni et al. [FOCS'18] and Behnezhad et al. [FOCS'19]. Their algorithms run on the more powerful MPC model and rely on sorting and computing prefix sums in $O(1)$ time, tasks that take $\Omega(\log n / \log\log n)$ time on a CRCW PRAM with $\text{poly}(n)$ processors. Our simpler algorithm uses limited-collision hashing and does not sort or do prefix sums. It matches the time and space bounds of the algorithm of Behnezhad et al., who improved the time bound of Andoni et al. It is widely believed that the larger private memory per processor and unbounded local computation of the MPC model admit algorithms faster than that on a PRAM. Our result suggests that such additional power might not be necessary, at least for fundamental graph problems like connected components and spanning forest.


title: PSF--NET: A Non-parametric Point Spread Function Model for Ground Based Optical Telescopes

abstract: Ground based optical telescopes are seriously affected by atmospheric turbulence induced aberrations. Understanding properties of these aberrations is important both for instruments design and image restoration methods development. Because the point spread function can reflect performance of the whole optic system, it is appropriate to use the point spread function to describe atmospheric turbulence induced aberrations. Assuming point spread functions induced by the atmospheric turbulence with the same profile belong to the same manifold space, we propose a non-parametric point spread function -- PSF-NET. The PSF-NET has a cycle convolutional neural network structure and is a statistical representation of the manifold space of PSFs induced by the atmospheric turbulence with the same profile. Testing the PSF-NET with simulated and real observation data, we find that a well trained PSF--NET can restore any short exposure images blurred by atmospheric turbulence with the same profile. Besides, we further use the impulse response of the PSF-NET, which can be viewed as the statistical mean PSF, to analyze interpretation properties of the PSF-NET. We find that variations of statistical mean PSFs are caused by variations of the atmospheric turbulence profile: as the difference of the atmospheric turbulence profile increases, the difference between statistical mean PSFs also increases. The PSF-NET proposed in this paper provides a new way to analyze atmospheric turbulence induced aberrations, which would be benefit to develop new observation methods for ground based optical telescopes.

categories: astro-ph.IM astro-ph.SR cs.CV physics.optics


title: Multi-channel Opto-mechanical Switch and Locking System for Wavemeters

abstract: Here we present a cost effective multi-channel opto-mechanical switch and software PID system for locking multiple lasers to a single channel commercial wavemeter. The switch is based on a rotating cylinder that selectively transmits one laser beam at a time to the wavemeter, the wavelength is read by the computer and an error signal is output to the lasers to correct wavelength drifts every millisecond. We use this system to stabilise 740 nm (subsequently frequency doubled to 370 nm), 399 nm and 935 nm lasers for trapping and cooling different isotopes of Yb+ ion. We characterize the frequency stability of the three lasers by using a second, more precise, commercial wavemeter. We also characterise the absolute frequency stability of the 740 nm laser using the fluorescence drift rate of a trapped 174Yb+ ion. For the 740 nm laser we demonstrate an Allan deviation, df/f, of 3 x 10^-10 (at 20 s integration time), equivalent to sub-200 KHz stability.


title: Approximate Cross-validation: Guarantees for Model Assessment and Selection

abstract: Cross-validation (CV) is a popular approach for assessing and selecting predictive models. However, when the number of folds is large, CV suffers from a need to repeatedly refit a learning procedure on a large number of training datasets. Recent work in empirical risk minimization (ERM) approximates the expensive refitting with a single Newton step warm-started from the full training set optimizer. While this can greatly reduce runtime, several open questions remain including whether these approximations lead to faithful model selection and whether they are suitable for non-smooth objectives. We address these questions with three main contributions: (i) we provide uniform non-asymptotic, deterministic model assessment guarantees for approximate CV; (ii) we show that (roughly) the same conditions also guarantee model selection performance comparable to CV; (iii) we provide a proximal Newton extension of the approximate CV framework for non-smooth prediction problems and develop improved assessment guarantees for problems such as l1-regularized ERM.


title: Revisiting the low temperature electron-phonon relaxation of noble metals

abstract: The low temperature electron-phonon (e-ph) relaxation near the surface of noble metals, Cu and Ag, is studied by using the density-functional theory approach. The appearance of the surface phonon mode can give rise to a strong enhancement of the Eliashberg function at low frequency $\omega$. Assuming the Eliashberg function proportional to the square of $\omega$ in the low frequency limit, the e-ph relaxation time obtained from the surface calculations is shorter than that from the bulk calculation. The calculated e-ph relaxation time for the former is in agreement with a recent experiment for thin films.


title: Extremely Dense Point Correspondences using a Learned Feature Descriptor

abstract: High-quality 3D reconstructions from endoscopy video play an important role in many clinical applications, including surgical navigation where they enable direct video-CT registration. While many methods exist for general multi-view 3D reconstruction, these methods often fail to deliver satisfactory performance on endoscopic video. Part of the reason is that local descriptors that establish pair-wise point correspondences, and thus drive reconstruction, struggle when confronted with the texture-scarce surface of anatomy. Learning-based dense descriptors usually have larger receptive fields enabling the encoding of global information, which can be used to disambiguate matches. In this work, we present an effective self-supervised training scheme and novel loss design for dense descriptor learning. In direct comparison to recent local and dense descriptors on an in-house sinus endoscopy dataset, we demonstrate that our proposed dense descriptor can generalize to unseen patients and scopes, thereby largely improving the performance of Structure from Motion (SfM) in terms of model density and completeness. We also evaluate our method on a public dense optical flow dataset and a small-scale SfM public dataset to further demonstrate the effectiveness and generality of our method. The source code is available at https://github.com/lppllppl920/DenseDescriptorLearning-Pytorch.


title: The stability for an inverse problem of bottom recovering in water-waves

abstract: In this article we deal with a class of geometric inverse problem for bottom detection by one single measurement on the free surface in water--waves. We found upper and lower bounds for the size of the region enclosed between two different bottoms, in terms of Neumann and/or Dirichlet data on the free surface. Starting from the general water--waves system in bounded domains with side walls, we manage to formulate the problem in terms of the Dirichlet to Neumann operator and thus, as an elliptic problem in a bounded domain with Neumann homogeneous condition on the rigid boundary. Then we study the properties of the Dirichlet to Neumann map and analyze the called method of size estimation.


title: Graph Signal Processing of Indefinite and Complex Graphs using Directed Variation

abstract: In the field of graph signal processing (GSP), directed graphs present a particular challenge for the "standard approaches" of GSP to due to their asymmetric nature. The presence of negative- or complex-weight directed edges, a graphical structure used in fields such as neuroscience, critical infrastructure, and robot coordination, further complicates the issue. Recent results generalized the total variation of a graph signal to that of directed variation as a motivating principle for developing a graphical Fourier transform (GFT). Here, we extend these techniques to concepts of signal variation appropriate for indefinite and complex-valued graphs and use them to define a GFT for these classes of graph. Simulation results on random graphs are presented, as well as a case study of a portion of the fruit fly connectome.


title: Extremal problems for hypergraph blowups of trees

abstract: In this paper we present a novel approach in extremal set theory which may be viewed as an asymmetric version of Katona's permutation method. We use it to find more Tur\'an numbers of hypergraphs in the Erd\H{o}s--Ko--Rado range. An $(a,b)$-path $P$ of length $2k-1$ consists of $2k-1$ sets of size $r=a+b$ as follows. Take $k$ pairwise disjoint $a$-element sets $A_0, A_2, \dots, A_{2k-2}$ and other $k$ pairwise disjoint $b$-element sets $B_1, B_3, \dots, B_{2k-1}$ and order them linearly as $A_0, B_1, A_2, B_3, A_4\dots$. Define the (hyper)edges of $P_{2k-1}(a,b)$ as the sets of the form $A_i\cup B_{i+1}$ and $B_j\cup A_{j+1}$. The members of $P$ can be represented as $r$-element intervals of the $ak+bk$ element underlying set. Our main result is about hypergraphs that are blowups of trees, and implies that for fixed $k,a,b$, as $n\to \infty$ \[ {\rm ex}_r(n,P_{2k-1}(a,b)) = (k - 1){n \choose r - 1} + o(n^{r - 1}).\] This generalizes the Erd\H{o}s--Gallai theorem for graphs which is the case of $a=b=1$. We also determine the asymptotics when $a+b$ is even; the remaining cases are still open.


title: Left orderable surgeries of double twist knots II

abstract: A slope $r$ is called a left orderable slope of a knot $K \subset S^3$ if the 3-manifold obtained by $r$-surgery along $K$ has left orderable fundamental group. Consider two-bridge knots $C(2m, \pm 2n)$ and $C(2m+1, -2n)$ in the Conway notation, where $m \ge 1$ and $n \ge 2$ are integers. By using \textit{continuous} families of hyperbolic $\mathrm{SL}_2(\mathbb{R})$-representations of knot groups, it was shown in \cite{HT-genus1, Tr} that any slope in $(-4n, 4m)$ (resp. $[0, \max\{4m, 4n\})$) is a left orderable slope of $C(2m, 2n)$ (resp. $C(2m, - 2n)$) and in \cite{Ga} that any slope in $(-4n,0]$ is a left orderable slope of $C(2m+1,-2n)$. However, the proofs of these results are incomplete since the \textit{continuity} of the families of representations was not proved. In this paper, we complete these proofs and moreover we show that any slope in $(-4n, 4m)$ is a left orderable slope of $C(2m+1,-2n)$ detected by hyperbolic $\mathrm{SL}_2(\mathbb{R})$-representations of the knot group.


title: Timely Synchronization with Sporadic Status Changes

abstract: In this paper, we consider a status updating system where the transmitter sends status updates of the signal it monitors to the destination through a rate-limited link. We consider the scenario where the status of the monitored signal only changes at discrete time points. The objective is to let the destination be synchronized with the source in a timely manner once a status change happens. What complicates the problem is that the transmission takes multiple time slots due to the link-rate constraint. Thus, the transmitter has to decide to switch or to skip a new update when the status of the monitored signal changes and it has not completed the transmission of the previous one yet. We adopt a metric called "Age of Synchronization" (AoS) to measure the "dissatisfaction" of the destination when it is desynchronized with the source. Then, the objective of this paper is to minimize the time-average AoS by designing optimal transmission policies for the transmitter. We formulate the problem as a Markov decision process (MDP) and prove the multi-threshold structure of the optimal policy. Based on that, we propose a low computational-complexity algorithm for the MDP value iteration. We then evaluate the performance of the multi-threshold policy through simulations and compare it with two baseline policies and the AoI-optimal policy.


title: Proving identities on weight polynomials of tiered trees via Tutte polynomials

abstract: A {\it tiered graph} $G=(V,E)$ with $m $ tiers is a simple graph with $V\subseteq \brk{n}$, where $\brk{n}=\{1,2,\cdots,n\}$, and with a surjective map $t$ from $V$ to $\brk{m}$ such that if $v$ is a vertex adjacent to $v'$ in $G$ with $v>v'$, then $t(v) >t(v')$. For any ordered partition $p=(p_1,p_2,\cdots,p_m)$ of $n$, let $\sett_p$ denote the set of tiered trees with vertex set $\brk{n}$ and with a map $t: \brk{n}\rightarrow \brk{m}$ such that $|t^{-1}(i)|=p_i$ for all $i=1,2,\ldots,m$. For any $T\in \sett_p$, let $K_T$ denote the complete tiered graph whose vertex set and tiering map are the same as those of $T$. If the edges of $K_T$ are ordered lexicographically by their endpoints, then the weight $w(T)$ of $T$ is the external activity of $T$ in $K_T$, i.e., the number of edges $e\in E(K_{T})\setminus E(T)$ such that $e$ is the least element in the unique cycle determined by $T\cup e$. Let $P_p(q)=\sum_{T\in \sett_{p}}q^{w(T)}$. Dugan, Glennon, Gunnells and Steingr\'imsson [J. Combin. Theory, Ser. A 164 (2019) pp. 24-49] asked for an elementary proof of the identity $P_p(q)=P_{\pi(p)}(q)$ for any permutation $\pi$ of $1,2,\cdots,m$, where $\pi(p)=p_{\pi(1)},p_{\pi(2)},\cdots,p_{\pi(m)})$. In this article, we will prove an extension of this identity by applying Tutte polynomials. Furthermore, we also provide a proof of the identity $P_{(1,p_1,p_2)}(q)=P_{(p_1+1,p_2+1)}(q)$ via Tutte polynomials.


title: Nanometric square skyrmion lattice in a centrosymmetric tetragonal magnet

abstract: Magnetic skyrmions are topologically stable spin swirls with particle-like character and potentially suitable for the design of high-density information bits. While most known skyrmion systems arise in noncentrosymmetric systems with Dzyaloshinskii-Moriya interaction, also centrosymmetric magnets with a triangular lattice can give rise to skyrmion formation, with geometrically-frustrated lattice being considered essential in this case. Until today, it remains an open question if skyrmions can also exist in the absence of both geometrically-frustrated lattice and inversion symmetry breaking. Here, we discover a square skyrmion lattice state with 1.9 nm diameter skyrmions in the centrosymmetric tetragonal magnet GdRu2Si2 without geometrically-frustrated lattice by means of resonant X-ray scattering and Lorentz transmission electron microscopy experiments. A plausible origin of the observed skyrmion formation is four-spin interactions mediated by itinerant electrons in the presence of easy-axis anisotropy. Our results suggest that rare-earth intermetallics with highly-symmetric crystal lattices may ubiquitously host nanometric skyrmions of exotic origins.


title: Cluster-Based Social Reinforcement Learning

abstract: Social Reinforcement Learning methods, which model agents in large networks, are useful for fake news mitigation, personalized teaching/healthcare, and viral marketing, but it is challenging to incorporate inter-agent dependencies into the models effectively due to network size and sparse interaction data. Previous social RL approaches either ignore agents dependencies or model them in a computationally intensive manner. In this work, we incorporate agent dependencies efficiently in a compact model by clustering users (based on their payoff and contribution to the goal) and combine this with a method to easily derive personalized agent-level policies from cluster-level policies. We also propose a dynamic clustering approach that captures changing user behavior. Experiments on real-world datasets illustrate that our proposed approach learns more accurate policy estimates and converges more quickly, compared to several baselines that do not use agent correlations or only use static clusters.


title: Learning Force Control for Contact-rich Manipulation Tasks with Rigid Position-controlled Robots

abstract: Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autonomously. However, RL is still not widely adopted on real robotic systems because working with real hardware entails additional challenges, especially when using rigid position-controlled manipulators. These challenges include the need for a robust controller to avoid undesired behavior, that risk damaging the robot and its environment, and constant supervision from a human operator. The main contributions of this work are, first, we proposed a learning-based force control framework combining RL techniques with traditional force control. Within said control scheme, we implemented two different conventional approaches to achieve force control with position-controlled robots; one is a modified parallel position/force control, and the other is an admittance control. Secondly, we empirically study both control schemes when used as the action space of the RL agent. Thirdly, we developed a fail-safe mechanism for safely training an RL agent on manipulation tasks using a real rigid robot manipulator. The proposed methods are validated on simulation and a real robot, an UR3 e-series robotic arm.


title: Non-Gaussianities and tensor-to-scalar ratio in non-local $R^{2}$-like inflation

abstract: In this paper we will study $R^2$-like inflation in a non-local modification of gravity which contains quadratic in Ricci scalar and Weyl tensor terms with analytic infinite derivative form-factors in the action. It is known that the inflationary solution of the local $R+R^2$ gravity remains a particular exact solution in this model. It was shown earlier that the power spectrum of scalar perturbations generated during inflation in the non-local setup remains the same as in the local $R+R^2$ inflation, whereas the power spectrum of tensor perturbations gets modified due to the non-local Weyl tensor squared term. In the present paper we go beyond 2-point correlators and compute the non-Gaussian parameter $f_{NL}$ related to 3-point correlations generated during inflation, which we found to be different from those in the original local inflationary model and scenarios alike based on a local gravity. We evaluate non-local corrections to the scalar bi-spectrum which give non-zero contributions to squeezed, equilateral and orthogonal configurations. We show that $f_{NL}\sim O(1)$ with an arbitrary sign is achievable in this model based on the choice of form-factors and the scale of non-locality. We present the predictions for the tensor-to-scalar ratio, $r$, and the tensor tilt, $n_t$. In contrast to standard inflation in a local gravity, here the possibility $n_t$>0 is not excluded. Thus, future CMB data can probe non-local behaviour of gravity at high space-time curvatures.


title: Distributionally Robust Bottleneck Combinatorial Problems: Uncertainty Quantification and Robust Decision Making

abstract: This paper studies data-driven distributionally robust bottleneck combinatorial problems (DRBCP) with stochastic costs, where the probability distribution of the cost vector is contained in a ball of distributions centered at the empirical distribution specified by the Wasserstein distance. We study two distinct versions of DRBCP from different applications: (i) Motivated by the multi-hop wireless network application, we first study the uncertainty quantification of DRBCP (denoted by DRBCP-U), where decision-makers would like to have an accurate estimation of the worst-case value of DRBCP. The difficulty of DRBCP-U is to handle its max-min-max form. Fortunately, the alternative forms of the bottleneck combinatorial problems from their blockers allow us to derive equivalent deterministic reformulations, which can be computed via mixed-integer programs. In addition, by drawing the connection between DRBCP-U and its sampling average approximation counterpart under empirical distribution, we show that the Wasserstein radius can be chosen in the order of negative square root of sample size, improving the existing known results; and (ii) Next, motivated by the ride-sharing application, decision-makers choose the best service-and-passenger matching that minimizes the unfairness. This gives rise to the decision-making DRBCP (denoted by DRBCP-D). For DRBCP-D, we show that its optimal solution is also optimal to its sampling average approximation counterpart, and the Wasserstein radius can be chosen in a similar order as DRBCP-U. When the sample size is small, we propose to use the optimal value of DRBCP-D to construct an indifferent solution space and propose an alternative decision-robust model, which finds the best indifferent solution to minimize the empirical variance. We further show that the decision robust model can be recast as a mixed-integer program.


title: Sparsity Meets Robustness: Channel Pruning for the Feynman-Kac Formalism Principled Robust Deep Neural Nets

abstract: Deep neural nets (DNNs) compression is crucial for adaptation to mobile devices. Though many successful algorithms exist to compress naturally trained DNNs, developing efficient and stable compression algorithms for robustly trained DNNs remains widely open. In this paper, we focus on a co-design of efficient DNN compression algorithms and sparse neural architectures for robust and accurate deep learning. Such a co-design enables us to advance the goal of accommodating both sparsity and robustness. With this objective in mind, we leverage the relaxed augmented Lagrangian based algorithms to prune the weights of adversarially trained DNNs, at both structured and unstructured levels. Using a Feynman-Kac formalism principled robust and sparse DNNs, we can at least double the channel sparsity of the adversarially trained ResNet20 for CIFAR10 classification, meanwhile, improve the natural accuracy by $8.69$\% and the robust accuracy under the benchmark $20$ iterations of IFGSM attack by $5.42$\%. The code is available at \url{https://github.com/BaoWangMath/rvsm-rgsm-admm}.


title: Empirical Photometric Control of Mars Context Camera Images

abstract: The Mars Reconnaissance Orbiter (MRO) spacecraft has been in orbit around Mars since March 2006. The Context Camera (CTX) on MRO has returned over 100,000 images of the planet at approximately 5-6 meters per pixel, providing nearly global coverage. During that time, Mars has gone through nearly 7 of its own years, changing solar distance from 1.38 to 1.67 AU and the corresponding solar flux by 45% due to its orbital eccentricity. Seasonal effects and transient phenomena affect atmospheric transparency. Combined with an aging detector, CTX images are difficult to mosaic seamlessly, for all of these changes prevent equalizing images to create a visually smoothly illuminated product. We have developed a method, based on previous work by other researchers for other datasets, to mitigate almost all photometric variations between images in order to create the appearance of an evenly illuminated, practically seamless mosaic. We describe how the process works, which uses a reference source to tie brightness values, and demonstrate its effects across Mars' surface. While the workflow developed for this product is applicable to other planetary bodies, it requires a reference source, which may not yet exist.


title: Counting Richelot isogenies between superspecial abelian surfaces

abstract: Castryck, Decru, and Smith used superspecial genus-2 curves and their Richelot isogeny graph for basing genus-2 isogeny cryptography, and recently, Costello and Smith devised an improved isogeny path-finding algorithm in the genus-2 setting. In order to establish a firm ground for the cryptographic construction and analysis, we give a new characterization of {\em decomposed Richelot isogenies} in terms of {\em involutive reduced automorphisms} of genus-2 curves over a finite field, and explicitly count such decomposed (and non-decomposed) Richelot isogenies between {\em superspecial} principally polarized abelian surfaces. As a corollary, we give another algebraic geometric proof of Theorem 2 in the paper of Castryck et al.


title: A simple proof of curvature estimate for convex solution of $k$-Hessian equation

abstract: Guan-Ren-Wang established the curvature estimate of convex hypersurface satisfying the Weingarten curvature equation $\sigma_{k}(\kappa(X)) = f(X,\nu(X))$. In this note, we give a simple proof of this result.


title: Permutohedral-GCN: Graph Convolutional Networks with Global Attention

abstract: Graph convolutional networks (GCNs) update a node's feature vector by aggregating features from its neighbors in the graph. This ignores potentially useful contributions from distant nodes. Identifying such useful distant contributions is challenging due to scalability issues (too many nodes can potentially contribute) and oversmoothing (aggregating features from too many nodes risks swamping out relevant information and may result in nodes having different labels but indistinguishable features). We introduce a global attention mechanism where a node can selectively attend to, and aggregate features from, any other node in the graph. The attention coefficients depend on the Euclidean distance between learnable node embeddings, and we show that the resulting attention-based global aggregation scheme is analogous to high-dimensional Gaussian filtering. This makes it possible to use efficient approximate Gaussian filtering techniques to implement our attention-based global aggregation scheme. By employing an approximate filtering method based on the permutohedral lattice, the time complexity of our proposed global aggregation scheme only grows linearly with the number of nodes. The resulting GCNs, which we term permutohedral-GCNs, are differentiable and trained end-to-end, and they achieve state of the art performance on several node classification benchmarks.


title: Matching Neuromorphic Events and Color Images via Adversarial Learning

abstract: The event camera has appealing properties: high dynamic range, low latency, low power consumption and low memory usage, and thus provides complementariness to conventional frame-based cameras. It only captures the dynamics of a scene and is able to capture almost "continuous" motion. However, different from frame-based camera that reflects the whole appearance as scenes are, the event camera casts away the detailed characteristics of objects, such as texture and color. To take advantages of both modalities, the event camera and frame-based camera are combined together for various machine vision tasks. Then the cross-modal matching between neuromorphic events and color images plays a vital and essential role. In this paper, we propose the Event-Based Image Retrieval (EBIR) problem to exploit the cross-modal matching task. Given an event stream depicting a particular object as query, the aim is to retrieve color images containing the same object. This problem is challenging because there exists a large modality gap between neuromorphic events and color images. We address the EBIR problem by proposing neuromorphic Events-Color image Feature Learning (ECFL). Particularly, the adversarial learning is employed to jointly model neuromorphic events and color images into a common embedding space. We also contribute to the community N-UKbench and EC180 dataset to promote the development of EBIR problem. Extensive experiments on our datasets show that the proposed method is superior in learning effective modality-invariant representation to link two different modalities.


title: A Novel Recurrent Encoder-Decoder Structure for Large-Scale Multi-view Stereo Reconstruction from An Open Aerial Dataset

abstract: A great deal of research has demonstrated recently that multi-view stereo (MVS) matching can be solved with deep learning methods. However, these efforts were focused on close-range objects and only a very few of the deep learning-based methods were specifically designed for large-scale 3D urban reconstruction due to the lack of multi-view aerial image benchmarks. In this paper, we present a synthetic aerial dataset, called the WHU dataset, we created for MVS tasks, which, to our knowledge, is the first large-scale multi-view aerial dataset. It was generated from a highly accurate 3D digital surface model produced from thousands of real aerial images with precise camera parameters. We also introduce in this paper a novel network, called RED-Net, for wide-range depth inference, which we developed from a recurrent encoder-decoder structure to regularize cost maps across depths and a 2D fully convolutional network as framework. RED-Net's low memory requirements and high performance make it suitable for large-scale and highly accurate 3D Earth surface reconstruction. Our experiments confirmed that not only did our method exceed the current state-of-the-art MVS methods by more than 50% mean absolute error (MAE) with less memory and computational cost, but its efficiency as well. It outperformed one of the best commercial software programs based on conventional methods, improving their efficiency 16 times over. Moreover, we proved that our RED-Net model pre-trained on the synthetic WHU dataset can be efficiently transferred to very different multi-view aerial image datasets without any fine-tuning. Dataset are available at http://gpcv.whu.edu.cn/data.


title: Permutation Invariant Graph Generation via Score-Based Generative Modeling

abstract: Learning generative models for graph-structured data is challenging because graphs are discrete, combinatorial, and the underlying data distribution is invariant to the ordering of nodes. However, most of the existing generative models for graphs are not invariant to the chosen ordering, which might lead to an undesirable bias in the learned distribution. To address this difficulty, we propose a permutation invariant approach to modeling graphs, using the recent framework of score-based generative modeling. In particular, we design a permutation equivariant, multi-channel graph neural network to model the gradient of the data distribution at the input graph (a.k.a., the score function). This permutation equivariant model of gradients implicitly defines a permutation invariant distribution for graphs. We train this graph neural network with score matching and sample from it with annealed Langevin dynamics. In our experiments, we first demonstrate the capacity of this new architecture in learning discrete graph algorithms. For graph generation, we find that our learning approach achieves better or comparable results to existing models on benchmark datasets.


title: Learning from Easy to Complex: Adaptive Multi-curricula Learning for Neural Dialogue Generation

abstract: Current state-of-the-art neural dialogue systems are mainly data-driven and are trained on human-generated responses. However, due to the subjectivity and open-ended nature of human conversations, the complexity of training dialogues varies greatly. The noise and uneven complexity of query-response pairs impede the learning efficiency and effects of the neural dialogue generation models. What is more, so far, there are no unified dialogue complexity measurements, and the dialogue complexity embodies multiple aspects of attributes---specificity, repetitiveness, relevance, etc. Inspired by human behaviors of learning to converse, where children learn from easy dialogues to complex ones and dynamically adjust their learning progress, in this paper, we first analyze five dialogue attributes to measure the dialogue complexity in multiple perspectives on three publicly available corpora. Then, we propose an adaptive multi-curricula learning framework to schedule a committee of the organized curricula. The framework is established upon the reinforcement learning paradigm, which automatically chooses different curricula at the evolving learning process according to the learning status of the neural dialogue generation model. Extensive experiments conducted on five state-of-the-art models demonstrate its learning efficiency and effectiveness with respect to 13 automatic evaluation metrics and human judgments.


title: Novel Interpretation Strategy for Searches of Singly Produced Vector-like Quarks at the LHC

abstract: Vector-like Quarks (VLQs) are potential signatures of physics beyond the Standard Model at the TeV energy scale and major efforts have been put forward at both ATLAS and CMS experiments in search of these particles. In order to make these search results more relatable in the context of most plausible theories of VLQs, it is deemed important to present the analysis results in a general fashion. We investigate the challenges associated with such interpretations of singly produced VLQ searches and propose a generalized, semi-analytical framework that allows a model-independent casting of the results in terms of unconstrained, free parameters of the VLQ Lagrangian. We also propose a simple parameterization of the correction factor to the single VLQ production cross-section at large decay widths. We illustrate how the proposed framework can be used to conveniently represent statistical limits by numerically reinterpreting results from benchmark ATLAS and CMS analyses.


title: VAE/WGAN-Based Image Representation Learning For Pose-Preserving Seamless Identity Replacement In Facial Images

abstract: We present a novel variational generative adversarial network (VGAN) based on Wasserstein loss to learn a latent representation from a face image that is invariant to identity but preserves head-pose information. This facilitates synthesis of a realistic face image with the same head pose as a given input image, but with a different identity. One application of this network is in privacy-sensitive scenarios; after identity replacement in an image, utility, such as head pose, can still be recovered. Extensive experimental validation on synthetic and real human-face image datasets performed under 3 threat scenarios confirms the ability of the proposed network to preserve head pose of the input image, mask the input identity, and synthesize a good-quality realistic face image of a desired identity. We also show that our network can be used to perform pose-preserving identity morphing and identity-preserving pose morphing. The proposed method improves over a recent state-of-the-art method in terms of quantitative metrics as well as synthesized image quality.


title: Inverse scattering by a random periodic structure

abstract: This paper develops an efficient numerical method for the inverse scattering problem of a time-harmonic plane wave incident on a perfectly reflecting random periodic structure. The method is based on a novel combination of the Monte Carlo technique for sampling the probability space, a continuation method with respect to the wavenumber, and the Karhunen-Lo$\grave{e}$ve expansion of the random structure, which reconstructs key statistical properties of the profile for the unknown random periodic structure from boundary measurements of the scattered fields away from the structure. Numerical results are presented to demonstrate the reliability and efficiency of the proposed method.


title: A Systematic Literature Review of Modern Software Visualization

abstract: We report on the state-of-the-art of software visualization. To ensure reproducibility, we adopted the Systematic Literature Review methodology. That is, we analyzed 1440 entries from IEEE Xplore and ACM Digital Library databases. We selected 105 relevant full papers published in 2013-2019, which we classified based on the aspect of the software system that is supported (i.e., structure, behavior, and evolution). For each paper, we extracted main dimensions that characterize software visualizations, such as software engineering tasks, roles of users, information visualization techniques, and media used to display visualizations. We provide researchers in the field an overview of the state-of-the-art in software visualization and highlight research opportunities. We also help developers to identify suitable visualizations for their particular context by matching software visualizations to development concerns and concrete details to obtain available visualization tools.


title: Descriptive complexity of real computation and probabilistic independence logic

abstract: We introduce a novel variant of BSS machines called Separate Branching BSS machines (S-BSS in short) and develop a Fagin-type logical characterisation for languages decidable in non-deterministic polynomial time by S-BSS machines. We show that NP on S-BSS machines is strictly included in NP on BSS machines and that every NP language on S-BSS machines is a countable union of closed sets in the usual topology of R^n. Moreover, we establish that on Boolean inputs NP on S-BSS machines without real constants characterises a natural fragment of the complexity class existsR (a class of problems polynomial time reducible to the true existential theory of the reals) and hence lies between NP and PSPACE. Finally we apply our results to determine the data complexity of probabilistic independence logic.


title: Communication-Efficient Multimodal Split Learning for mmWave Received Power Prediction

abstract: The goal of this study is to improve the accuracy of millimeter wave received power prediction by utilizing camera images and radio frequency (RF) signals, while gathering image inputs in a communication-efficient and privacy-preserving manner. To this end, we propose a distributed multimodal machine learning (ML) framework, coined multimodal split learning (MultSL), in which a large neural network (NN) is split into two wirelessly connected segments. The upper segment combines images and received powers for future received power prediction, whereas the lower segment extracts features from camera images and compresses its output to reduce communication costs and privacy leakage. Experimental evaluation corroborates that MultSL achieves higher accuracy than the baselines utilizing either images or RF signals. Remarkably, without compromising accuracy, compressing the lower segment output by 16x yields 16x lower communication latency and 2.8% less privacy leakage compared to the case without compression.


title: A review of machine learning applications in wildfire science and management

abstract: Artificial intelligence has been applied in wildfire science and management since the 1990s, with early applications including neural networks and expert systems. Since then the field has rapidly progressed congruently with the wide adoption of machine learning (ML) in the environmental sciences. Here, we present a scoping review of ML in wildfire science and management. Our objective is to improve awareness of ML among wildfire scientists and managers, as well as illustrate the challenging range of problems in wildfire science available to data scientists. We first present an overview of popular ML approaches used in wildfire science to date, and then review their use in wildfire science within six problem domains: 1) fuels characterization, fire detection, and mapping; 2) fire weather and climate change; 3) fire occurrence, susceptibility, and risk; 4) fire behavior prediction; 5) fire effects; and 6) fire management. We also discuss the advantages and limitations of various ML approaches and identify opportunities for future advances in wildfire science and management within a data science context. We identified 298 relevant publications, where the most frequently used ML methods included random forests, MaxEnt, artificial neural networks, decision trees, support vector machines, and genetic algorithms. There exists opportunities to apply more current ML methods (e.g., deep learning and agent based learning) in wildfire science. However, despite the ability of ML models to learn on their own, expertise in wildfire science is necessary to ensure realistic modelling of fire processes across multiple scales, while the complexity of some ML methods requires sophisticated knowledge for their application. Finally, we stress that the wildfire research and management community plays an active role in providing relevant, high quality data for use by practitioners of ML methods.


title: Improved Constraints on Anisotropic Birefringent Lorentz Invariance and CPT Violation from Broadband Optical Polarimetry of High Redshift Galaxies

abstract: In the framework of the Standard Model Extension (SME), we present improved constraints on anisotropic Lorentz invariance and Charge-Parity-Time (CPT) violation by searching for astrophysical signals of cosmic vacuum birefringence with broadband optical polarimetry of high redshift astronomical sources, including Active Galactic Nuclei and Gamma-Ray Burst afterglows. We generalize the work in Kislat 2018, which studied the SME mass dimension $d = 4$ case, to arbitrary mass dimension for both the CPT-even and CPT-odd cases. We then present constraints on all 10, 16, and 42 anisotropic birefringent SME coefficients for dimension $d = 4$, $d = 5$, and $d = 6$ models, respectively, using 7554 observations for odd d and 7376 observations for even d of 1278 unique sources on the sky, which, to our knowledge, comprises the most complete catalog of optical polarization from extragalactic sources in the literature to date. Compared to the smaller sample of 44 and 45 broadband optical polarimetry observations analyzed in Kislat 2018 and Kislat and Krawczynski 2017, our dimension $d = 4$ and $d = 5$ average constraints are more sensitive by factors of 35 and 10, corresponding to a reduction in allowed SME parameter space volume for these studies of 15 and 16 orders of magnitude, respectively. Constraints from individual lines of sight can be significantly stronger using spectropolarimetry. Nevertheless, due to the increased number of observations and lines of sight in our catalog, our average $d = 4$ and $d = 5$ broadband constraints are within factors of 2 and 12 of previous constraints using spectropolarimetry from Kislat 2018 and Kislat and Krawczynski 2017, respectively, using an independent data set and an improved analysis method. By contrast, our anisotropic constraints on all 42 birefringent SME coefficients for $d = 6$ are the first to be presented in the literature.


title: Intelligent Reflecting Surface Assisted Multi-User OFDMA: Channel Estimation and Training Design

abstract: To achieve the full passive beamforming gains of intelligent reflecting surface (IRS), accurate channel state information (CSI) is indispensable but practically challenging to acquire, due to the excessive amount of channel parameters to be estimated which increases with the number of IRS reflecting elements as well as that of IRS-served users. To tackle this challenge, we propose in this paper two efficient channel estimation schemes for different channel setups in an IRS-assisted multi-user broadband communication system employing the orthogonal frequency division multiple access (OFDMA). The first channel estimation scheme, which estimates the CSI of all users in parallel simultaneously at the access point (AP), is applicable for arbitrary frequency-selective fading channels. In contrast, the second channel estimation scheme, which exploits a key property that all users share the same (common) IRS-AP channel to enhance the training efficiency and support more users, is proposed for the typical scenario with line-of-sight (LoS) dominant user-IRS channels. For the two proposed channel estimation schemes, we further optimize their corresponding training designs (including pilot tone allocations for all users and IRS time-varying reflection pattern) to minimize the channel estimation error. Moreover, we derive and compare the fundamental limits on the minimum training overhead and the maximum number of supportable users of these two schemes. Simulation results verify the effectiveness of the proposed channel estimation schemes and training designs, and show their significant performance improvement over various benchmark schemes.


title: Tightening Curves on Surfaces Monotonically with Applications

abstract: We prove the first polynomial bound on the number of monotonic homotopy moves required to tighten a collection of closed curves on any compact orientable surface, where the number of crossings in the curve is not allowed to increase at any time during the process. The best known upper bound before was exponential, which can be obtained by combining the algorithm of de Graaf and Schrijver [J. Comb. Theory Ser. B, 1997] together with an exponential upper bound on the number of possible surface maps. To obtain the new upper bound we apply tools from hyperbolic geometry, as well as operations in graph drawing algorithms---the cluster and pipe expansions---to the study of curves on surfaces. As corollaries, we present two efficient algorithms for curves and graphs on surfaces. First, we provide a polynomial-time algorithm to convert any given multicurve on a surface into minimal position. Such an algorithm only existed for single closed curves, and it is known that previous techniques do not generalize to the multicurve case. Second, we provide a polynomial-time algorithm to reduce any $k$-terminal plane graph (and more generally, surface graph) using degree-1 reductions, series-parallel reductions, and $\Delta Y$-transformations for arbitrary integer $k$. Previous algorithms only existed in the planar setting when $k \le 4$, and all of them rely on extensive case-by-case analysis based on different values of $k$. Our algorithm makes use of the connection between electrical transformations and homotopy moves, and thus solves the problem in a unified fashion.


title: Global Major-Element Maps of Mercury from Four Years of MESSENGER X-Ray Spectrometer Observations

abstract: The X-Ray Spectrometer (XRS) on the MESSENGER spacecraft provided measurements of major-element ratios across Mercury's surface. We present global maps of Mg/Si, Al/Si, S/Si, Ca/Si, and Fe/Si derived from XRS data collected throughout MESSENGER's orbital mission. We describe the procedures we used to select and filter data and to combine them to make the final maps, which are archived in NASA's Planetary Data System. Areal coverage is variable for the different element-ratio maps, with 100% coverage for Mg/Si and Al/Si, but only 18% coverage for Fe/Si north of 30 $^{\circ}$ N, where the spatial resolution is highest. The spatial resolution is improved over previous maps by 10-15% because of the inclusion of higher-resolution data from late in the mission when the spacecraft periapsis altitude was low. Unlike typical planetary data maps, however, the spatial resolution of the XRS maps can vary from pixel to pixel, and thus care must be taken in interpreting small-scale features. We provide several examples of how the XRS maps can be used to investigate elemental variations in the context of geological features on Mercury, which range in size from single $\sim$100-km-diameter craters to large impact basins. We expect that these maps will provide the basis for and/or contribute to studies of Mercury's origin and geological history for many years to come.


title: Global Context-Aware Progressive Aggregation Network for Salient Object Detection

abstract: Deep convolutional neural networks have achieved competitive performance in salient object detection, in which how to learn effective and comprehensive features plays a critical role. Most of the previous works mainly adopted multiple level feature integration yet ignored the gap between different features. Besides, there also exists a dilution process of high-level features as they passed on the top-down pathway. To remedy these issues, we propose a novel network named GCPANet to effectively integrate low-level appearance features, high-level semantic features, and global context features through some progressive context-aware Feature Interweaved Aggregation (FIA) modules and generate the saliency map in a supervised way. Moreover, a Head Attention (HA) module is used to reduce information redundancy and enhance the top layers features by leveraging the spatial and channel-wise attention, and the Self Refinement (SR) module is utilized to further refine and heighten the input features. Furthermore, we design the Global Context Flow (GCF) module to generate the global context information at different stages, which aims to learn the relationship among different salient regions and alleviate the dilution effect of high-level features. Experimental results on six benchmark datasets demonstrate that the proposed approach outperforms the state-of-the-art methods both quantitatively and qualitatively.


title: GANs with Conditional Independence Graphs: On Subadditivity of Probability Divergences

abstract: Generative Adversarial Networks (GANs) are modern methods to learn the underlying distribution of a data set. GANs have been widely used in sample synthesis, de-noising, domain transfer, etc. GANs, however, are designed in a model-free fashion where no additional information about the underlying distribution is available. In many applications, however, practitioners have access to the underlying independence graph of the variables, either as a Bayesian network or a Markov Random Field (MRF). We ask: how can one use this additional information in designing model-based GANs? In this paper, we provide theoretical foundations to answer this question by studying subadditivity properties of probability divergences, which establish upper bounds on the distance between two high-dimensional distributions by the sum of distances between their marginals over (local) neighborhoods of the graphical structure of the Bayes-net or the MRF. We prove that several popular probability divergences satisfy some notion of subadditivity under mild conditions. These results lead to a principled design of a model-based GAN that uses a set of simple discriminators on the neighborhoods of the Bayes-net/MRF, rather than a giant discriminator on the entire network, providing significant statistical and computational benefits. Our experiments on synthetic and real-world datasets demonstrate the benefits of our principled design of model-based GANs.


title: Adversarial Attacks and Defenses on Graphs: A Review, A Tool and Empirical Studies

abstract: Deep neural networks (DNNs) have achieved significant performance in various tasks. However, recent studies have shown that DNNs can be easily fooled by small perturbation on the input, called adversarial attacks. As the extensions of DNNs to graphs, Graph Neural Networks (GNNs) have been demonstrated to inherit this vulnerability. Adversary can mislead GNNs to give wrong predictions by modifying the graph structure such as manipulating a few edges. This vulnerability has arisen tremendous concerns for adapting GNNs in safety-critical applications and has attracted increasing research attention in recent years. Thus, it is necessary and timely to provide a comprehensive overview of existing graph adversarial attacks and the countermeasures. In this survey, we categorize existing attacks and defenses, and review the corresponding state-of-the-art methods. Furthermore, we have developed a repository with representative algorithms (https://github.com/DSE-MSU/DeepRobust/tree/master/deeprobust/graph). The repository enables us to conduct empirical studies to deepen our understandings on attacks and defenses on graphs.


title: Renormalization group evolution induced leptogenesis in the minimal seesaw model with the trimaximal mixing and mu-tau reflection symmetry

abstract: In this paper, we consider the imbedding of the popular and well-motivated trimaximal mixing and $\mu$-$\tau$ reflection symmetry (which can help us shape the forms of the neutrino mass matrix) in the minimal seesaw model (which contains much fewer parameters than the general seesaw model) with two TeV-scale right-handed neutrinos (for realizing a low-scale seesaw) of nearly degenerate masses (for realizing a resonant leptogenesis). However, either for the trimaximal mixing scenario (which is realized through the Form Dominance approach here) or for the $\mu$-$\tau$ reflection symmetry scenario, leptogenesis cannot proceed. To address this issue, we consider the possibility that the special forms of the neutrino mass matrix for the trimaximal mixing and $\mu$-$\tau$ reflection symmetry are slightly broken by the renormalization group evolution effect, thus allowing leptogenesis to proceed. It is found that in the normal case of the neutrino mass ordering, the baryon asymmetry thus generated can reproduce the observed value. For completeness, we have also extended our analysis to the scenario that two right-handed neutrinos are not nearly degenerate any more. Unfortunately, in this scenario the final baryon asymmetry is smaller than the observed value by several orders of magnitude.


title: Uncertainty-Gated Stochastic Sequential Model for EHR Mortality Prediction

abstract: Electronic health records (EHR) are characterized as non-stationary, heterogeneous, noisy, and sparse data; therefore, it is challenging to learn the regularities or patterns inherent within them. In particular, sparseness caused mostly by many missing values has attracted the attention of researchers, who have attempted to find a better use of all available samples for determining the solution of a primary target task through the defining a secondary imputation problem. Methodologically, existing methods, either deterministic or stochastic, have applied different assumptions to impute missing values. However, once the missing values are imputed, most existing methods do not consider the fidelity or confidence of the imputed values in the modeling of downstream tasks. Undoubtedly, an erroneous or improper imputation of missing variables can cause difficulties in modeling as well as a degraded performance. In this study, we present a novel variational recurrent network that (i) estimates the distribution of missing variables allowing to represent uncertainty in the imputed values, (ii) updates hidden states by explicitly applying fidelity based on a variance of the imputed values during a recurrence (i.e., uncertainty propagation over time), and (iii) predicts the possibility of in-hospital mortality. It is noteworthy that our model can conduct these procedures in a single stream and learn all network parameters jointly in an end-to-end manner. We validated the effectiveness of our method using the public datasets of MIMIC-III and PhysioNet challenge 2012 by comparing with and outperforming other state-of-the-art methods for mortality prediction considered in our experiments. In addition, we identified the behavior of the model that well represented the uncertainties for the imputed estimates, which indicated a high correlation between the calculated MAE and the uncertainty.


title: Machine Learning Portfolio Allocation

abstract: We find economically and statistically significant gains when using machine learning for portfolio allocation between the market index and risk-free asset. Optimal portfolio rules for time-varying expected returns and volatility are implemented with two Random Forest models. One model is employed in forecasting the sign probabilities of the excess return with payout yields. The second is used to construct an optimized volatility estimate. Reward-risk timing with machine learning provides substantial improvements over the buy-and-hold in utility, risk-adjusted returns, and maximum drawdowns. This paper presents a new theoretical basis and unifying framework for machine learning applied to both return- and volatility-timing.

categories: q-fin.PM q-fin.GN q-fin.PR q-fin.RM q-fin.ST


title: Wireless User-Generic Ear EEG

abstract: In the past few years it has been demonstrated that electroencephalography (EEG) can be recorded from inside the ear (in-ear EEG). To open the door to low-profile earpieces as wearable brain-computer interfaces (BCIs), this work presents a practical in-ear EEG device based on multiple dry electrodes, a user-generic design, and a lightweight wireless interface for streaming data and device programming. The earpiece is designed for improved ear canal contact across a wide population of users and is fabricated in a low-cost and scalable manufacturing process based on standard techniques such as vacuum forming,plasma-treatment, and spray coating. A 2.5x2.5 cm^2 wireless recording module is designed to record and stream data wirelessly to a host computer. Performance was evaluated on three human subjects over three months and compared with clinical-grade wet scalp EEG recordings. Recordings of spontaneous and evoked physiological signals, eye-blinks, alpha rhythm, and the auditory steady-state response (ASSR), are presented. This is the first wireless in-ear EEG to our knowledge to incorporate a dry multielectrode, user-generic design. The user-generic ear EEG recorded a mean alpha modulation of 2.17, outperforming the state-of-the-art in dry electrode in-ear EEG systems.


title: Socially-Aware Robot Planning via Bandit Human Feedback

abstract: In this paper, we consider the problem of designing collision-free, dynamically feasible, and socially-aware trajectories for robots operating in environments populated by humans. We define trajectories to be social-aware if they do not interfere with humans in any way that causes discomfort. In this paper, discomfort is defined broadly and, depending on specific individuals, it can result from the robot being too close to a human or from interfering with human sight or tasks. Moreover, we assume that human feedback is a bandit feedback indicating a complaint or no complaint on the part of the robot trajectory that interferes with the humans, and it does not reveal any contextual information about the locations of the humans or the reason for a complaint. Finally, we assume that humans can move in the obstacle-free space and, as a result, human utility can change. We formulate this planning problem as an online optimization problem that minimizes the social value of the time-varying robot trajectory, defined by the total number of incurred human complaints. As the human utility is unknown, we employ zeroth order, or derivative-free, optimization methods to solve this problem, which we combine with off-the-shelf motion planners to satisfy the dynamic feasibility and collision-free specifications of the resulting trajectories. To the best of our knowledge, this is a new framework for socially-aware robot planning that is not restricted to avoiding collisions with humans but, instead, focuses on increasing the social value of the robot trajectories using only bandit human feedback.


title: The statistical physics of discovering exogenous and endogenous factors in a chain of events

abstract: Event occurrence is not only subject to the environmental changes, but is also facilitated by the events that have occurred in a system. Here, we develop a method for estimating such extrinsic and intrinsic factors from a single series of event-occurrence times. The analysis is performed using a model that combines the inhomogeneous Poisson process and the Hawkes process, which represent exogenous fluctuations and endogenous chain-reaction mechanisms, respectively. The model is fit to a given dataset by minimizing the free energy, for which statistical physics and a path-integral method are utilized. Because the process of event occurrence is stochastic, parameter estimation is inevitably accompanied by errors, and it can ultimately occur that exogenous and endogenous factors cannot be captured even with the best estimator. We obtained four regimes categorized according to whether respective factors are detected. By applying the analytical method to real time series of debate in a social-networking service, we have observed that the estimated exogenous and endogenous factors are close to the first comments and the follow-up comments, respectively. This method is general and applicable to a variety of data, and we have provided an application program, by which anyone can analyze any series of event times.


title: Upper Confidence Primal-Dual Reinforcement Learning for CMDP with Adversarial Loss

abstract: We consider online learning for episodic stochastically constrained Markov decision processes (CMDPs), which plays a central role in ensuring the safety of reinforcement learning. Here the loss function can vary arbitrarily across the episodes, and both the loss received and the budget consumption are revealed at the end of each episode. Previous works solve this problem under the restrictive assumption that the transition model of the Markov decision processes (MDPs) is known a priori and establish regret bounds that depend polynomially on the cardinalities of the state space $\mathcal{S}$ and the action space $\mathcal{A}$. In this work, we propose a new \emph{upper confidence primal-dual} algorithm, which only requires the trajectories sampled from the transition model. In particular, we prove that the proposed algorithm achieves $\widetilde{\mathcal{O}}(L|\mathcal{S}|\sqrt{|\mathcal{A}|T})$ upper bounds of both the regret and the constraint violation, where $L$ is the length of each episode. Our analysis incorporates a new high-probability drift analysis of Lagrange multiplier processes into the celebrated regret analysis of upper confidence reinforcement learning, which demonstrates the power of "optimism in the face of uncertainty" in constrained online learning.


title: On Lie algebras of generalized Jacobi matrices

abstract: In this lecutre note, we consider infinite dimensional Lie algebras of generalized Jacobi matrices $\mathfrak{g}J(k)$ and $\mathfrak{gl}_\infty(k)$, which are important in soliton theory, and their orthogonal and symplectic subalgebras. In particular, we construct the homology ring of the Lie algebra $\mathfrak{g}J(k)$ and of the orthogonal and symplectic subalgebras.


title: Uncertainty-Aware Variational-Recurrent Imputation Network for Clinical Time Series

abstract: Electronic health records (EHR) consist of longitudinal clinical observations portrayed with sparsity, irregularity, and high-dimensionality, which become major obstacles in drawing reliable downstream clinical outcomes. Although there exist great numbers of imputation methods to tackle these issues, most of them ignore correlated features, temporal dynamics and entirely set aside the uncertainty. Since the missing value estimates involve the risk of being inaccurate, it is appropriate for the method to handle the less certain information differently than the reliable data. In that regard, we can use the uncertainties in estimating the missing values as the fidelity score to be further utilized to alleviate the risk of biased missing value estimates. In this work, we propose a novel variational-recurrent imputation network, which unifies an imputation and a prediction network by taking into account the correlated features, temporal dynamics, as well as the uncertainty. Specifically, we leverage the deep generative model in the imputation, which is based on the distribution among variables, and a recurrent imputation network to exploit the temporal relations, in conjunction with utilization of the uncertainty. We validated the effectiveness of our proposed model on two publicly available real-world EHR datasets: PhysioNet Challenge 2012 and MIMIC-III, and compared the results with other competing state-of-the-art methods in the literature.