title: Perception Evaluation -- A new solar image quality metric based on the multi-fractal property of texture features

abstract: Next-generation ground-based solar observations require good image quality metrics for post-facto processing techniques. Based on the assumption that texture features in solar images are multi-fractal which can be extracted by a trained deep neural network as feature maps, a new reduced-reference objective image quality metric, the perception evaluation is proposed. The perception evaluation is defined as cosine distance of Gram matrix between feature maps extracted from high resolution reference image and that from blurred images. We evaluate performance of the perception evaluation with simulated and real observation images. The results show that with a high resolution image as reference, the perception evaluation can give robust estimate of image quality for solar images of different scenes.


title: Markovian Random Iterations of Maps

abstract: In this paper, we study Markovian random iterations of maps on standard measurable spaces. We establish a one-to-one correspondence between stationary measures and a certain class of invariant measures of a Markovian random iteration, extending a similar classical result of independent and identically distributed random iterations. As an application, we prove a local synchronization property for Markovian random iterations of homeomorphisms of the circle $S^{1}$.


title: Hypothesis Testing Interpretations and Renyi Differential Privacy

abstract: Differential privacy is a de facto standard in data privacy, with applications in the public and private sectors. A way to explain differential privacy, which is particularly appealing to statistician and social scientists is by means of its statistical hypothesis testing interpretation. Informally, one cannot effectively test whether a specific individual has contributed her data by observing the output of a private mechanism---any test cannot have both high significance and high power. In this paper, we identify some conditions under which a privacy definition given in terms of a statistical divergence satisfies a similar interpretation. These conditions are useful to analyze the distinguishability power of divergences and we use them to study the hypothesis testing interpretation of some relaxations of differential privacy based on Renyi divergence. This analysis also results in an improved conversion rule between these definitions and differential privacy.


title: On Recurrent Neural Networks for Sequence-based Processing in Communications

abstract: In this work, we analyze the capabilities and practical limitations of neural networks (NNs) for sequence-based signal processing which can be seen as an omnipresent property in almost any modern communication systems. In particular, we train multiple state-of-the-art recurrent neural network (RNN) structures to learn how to decode convolutional codes allowing a clear benchmarking with the corresponding maximum likelihood (ML) Viterbi decoder. We examine the decoding performance for various kinds of NN architectures, beginning with classical types like feedforward layers and gated recurrent unit (GRU)-layers, up to more recently introduced architectures such as temporal convolutional networks (TCNs) and differentiable neural computers (DNCs) with external memory. As a key limitation, it turns out that the training complexity increases exponentially with the length of the encoding memory $\nu$ and, thus, practically limits the achievable bit error rate (BER) performance. To overcome this limitation, we introduce a new training-method by gradually increasing the number of ones within the training sequences, i.e., we constrain the amount of possible training sequences in the beginning until first convergence. By consecutively adding more and more possible sequences to the training set, we finally achieve training success in cases that did not converge before via naive training. Further, we show that our network can learn to jointly detect and decode a quadrature phase shift keying (QPSK) modulated code with sub-optimal (anti-Gray) labeling in one-shot at a performance that would require iterations between demapper and decoder in classic detection schemes.


title: Experimental Realization of Acoustic Bianisotropic Gratings

abstract: Acoustic bianisotropic materials couple pressure and local particle velocity fields to simultaneously excite monopole and dipole scattering, which results in asymmetric wave transmission and reflection of airborne sound. In this work, we systematically realize an arbitrarily given bianisotropic coupling between the pressure and velocity fields for asymmetric wave propagation by an acoustic grating with inversion symmetry breaking. This acoustic bianisotropic grating is designed by optimizing the unit cells with a finite element method to achieve the desired scattering wavevectors determined by the bianisotropic induced asymmetric wave propagation. The symmetry and Bloch wavevectors in the reciprocal space resulted from the grating are analyzed, which match with the desired scattering wavevectors. The designed structures are fabricated for the experimental demonstration of the bianisotropic properties. The measured results match with the desired asymmetric wave scattering fields.


title: Atomic Cross-Chain Swaps with Improved Space and Local Time Complexity

abstract: An effective atomic cross-chain swap protocol is introduced by Herlihy [Herlihy, 2018] as a distributed coordination protocol in order to exchange assets across multiple blockchains among multiple parties. An atomic cross-chain swap protocol guarantees; (1) if all parties conform to the protocol, then all assets are exchanged among parties, (2) even if some parties or coalitions of parties deviate from the protocol, no party conforming to the protocol suffers a loss, and (3) no coalition has an incentive to deviate from the protocol. Herlihy [Herlihy, 2018] invented this protocol by using hashed timelock contracts. A cross-chain swap is modeled as a directed graph D = (V,A). Vertex set V denotes a set of parties and arc set A denotes a set of proposed asset transfers. Herlihy's protocol uses the graph topology and signature information to set appropriate hashed timelock contracts. The space complexity of the protocol (i.e., the total number of bits written in the blockchains in a swap) is O(|A|^2). The local time complexity of the protocol (i.e., the maximum execution time of a contract in a swap to transfer the corresponding asset) is O(|V||L|), where L is a feedback vertex set computed by the protocol. We propose a new atomic cross-chain swap protocol which uses only signature information and improves the space complexity to O(|A||V|) and the local time complexity to O(|V|).


title: A maximum principle on unbounded domains and a Liouville theorem for fractional p-harmonic functions

abstract: In this paper, we establish the following Liouville theorem for fractional \emph{p}-harmonic functions. {\em Assume that $u$ is a bounded solution of $$(-\lap)^s_p u(x) = 0, \;\; x \in \mathbb{R}^n,$$ with $0<s<1$ and $p \geq 2$. Then $u$ must be constant.} A new idea is employed to prove this result, which is completely different from the previous ones in deriving Liouville theorems. For any given hyper-plane in $\mathbb{R}^n$, we show that $u$ is symmetric about the plane. To this end, we established a {\em maximum principle} for anti-symmetric functions on any half space. We believe that this {\em maximum principle}, as well as the ideas in the proof, will become useful tools in studying a variety of problems involving nonlinear non-local operators.


title: On diagonals of operators: selfadjoint, normal and other classes

abstract: We provide a survey of the current state of the study of diagonals of operators, especially selfadjoint operators. In addition, we provide a few new results made possible by recent work of M\"uller-Tomilov and Kaftal-Loreaux. This is an expansion of the second author's lecture part II at OT27.


title: Decentralized Informative Path Planning with Exploration-Exploitation Balance for Swarm Robotic Search

abstract: Swarm robotic search is concerned with searching targets in unknown environments (e.g., for search and rescue or hazard localization), using a large number of collaborating simple mobile robots. In such applications, decentralized swarm systems are touted for their task/coverage scalability, time efficiency, and fault tolerance. To guide the behavior of such swarm systems, two broad classes of approaches are available, namely nature-inspired swarm heuristics and multi-robotic search methods. However, simultaneously offering computationally-efficient scalability and fundamental insights into the exhibited behavior (instead of a black-box behavior model), remains challenging under either of these two class of approaches. In this paper, we develop an important extension of the batch Bayesian search method for application to embodied swarm systems, searching in a physical 2D space. Key contributions lie in: 1) designing an acquisition function that not only balances exploration and exploitation across the swarm, but also allows modeling knowledge extraction over trajectories; and 2) developing its distributed implementation to allow asynchronous task inference and path planning by the swarm robots. The resulting collective informative path planning approach is tested on target search case studies of varying complexity, where the target produces a spatially varying (measurable) signal. Significantly superior performance, in terms of mission completion efficiency, is observed compared to exhaustive search and random walk baselines, along with favorable performance scalability with increasing swarm size.


title: Robust Mahalanobis Metric Learning via Geometric Approximation Algorithms

abstract: Learning Mahalanobis metric spaces is an important problem that has found numerous applications. Several algorithms have been designed for this problem, including Information Theoretic Metric Learning (ITML) [Davis et al. 2007] and Large Margin Nearest Neighbor (LMNN) classification [Weinberger and Saul 2009]. We study the problem of learning a Mahalanobis metric space in the presence of adversarial label noise. To that end, we consider a formulation of Mahalanobis metric learning as an optimization problem, where the objective is to minimize the number of violated similarity/dissimilarity constraints. We show that for any fixed ambient dimension, there exists a fully polynomial-time approximation scheme (FPTAS) with nearly-linear running time. This result is obtained using tools from the theory of linear programming in low dimensions. As a consequence, we obtain a fully-parallelizable algorithm that recovers a nearly-optimal metric space, even when a small fraction of the labels is corrupted adversarially. We also discuss improvements of the algorithm in practice, and present experimental results on real-world, synthetic, and poisoned data sets.


title: A gradient algorithm for Hamiltonian identification of open quantum systems

abstract: In this paper, we present a gradient algorithm for identifying unknown parameters in an open quantum system from the measurements of time traces of local observables. The open system dynamics is described by a general Markovian master equation based on which the Hamiltonian identification problem can be formulated as minimizing the distance between the real time traces of the observables and those predicted by the master equation. The unknown parameters can then be learned with a gradient descent algorithm from the measurement data. We verify the effectiveness of our algorithm in a circuit QED system described by a Jaynes-Cumming model whose Hamiltonian identification has been rarely considered. We also show that our gradient algorithm can learn the spectrum of a non-Markovian environment based on an augmented system model.


title: Virtual Complete Intersections in $\mathbb{P}^1 \times \mathbb{P}^1$

abstract: The minimal free resolution of the coordinate ring of a complete intersection in projective space is a Koszul complex on a regular sequence. In the product of projective spaces $\mathbb{P}^1 \times \mathbb{P}^1$, we investigate which sets of points have a virtual resolution that is a Koszul complex on a regular sequence. This paper provides conditions on sets of points; some of which guarantee the points have this property, and some of which guarantee the points do not have this property.


title: Fast Convergence of Belief Propagation to Global Optima: Beyond Correlation Decay

abstract: Belief propagation is a fundamental message-passing algorithm for probabilistic reasoning and inference in graphical models. While it is known to be exact on trees, in most applications belief propagation is run on graphs with cycles. Understanding the behavior of "loopy" belief propagation has been a major challenge for researchers in machine learning, and positive convergence results for BP are known under strong assumptions which imply the underlying graphical model exhibits decay of correlations. We show that under a natural initialization, BP converges quickly to the global optimum of the Bethe free energy for Ising models on arbitrary graphs, as long as the Ising model is \emph{ferromagnetic} (i.e. neighbors prefer to be aligned). This holds even though such models can exhibit long range correlations and may have multiple suboptimal BP fixed points. We also show an analogous result for iterating the (naive) mean-field equations; perhaps surprisingly, both results are dimension-free in the sense that a constant number of iterations already provides a good estimate to the Bethe/mean-field free energy.


title: Inference of Dynamic Graph Changes for Functional Connectome

abstract: Dynamic functional connectivity is an effective measure for the brain's responses to continuous stimuli. We propose an inferential method to detect the dynamic changes of brain networks based on time-varying graphical models. Whereas most existing methods focus on testing the existence of change points, the dynamics in the brain network offer more signals in many neuroscience studies. We propose a novel method to conduct hypothesis testing on changes in dynamic brain networks. We introduce a bootstrap statistic to approximate the supreme of the high-dimensional empirical processes over dynamically changing edges. Our simulations show that this framework can capture the change points with changed connectivity. Finally, we apply our method to a brain imaging dataset under a natural audio-video stimulus and illustrate that we are able to detect temporal changes in brain networks. The functions of the identified regions are consistent with specific emotional annotations, which are closely associated with changes inferred by our method.


title: FSD: Feature Skyscraper Detector for Stem End and Blossom End of Navel Orange

abstract: To accurately and efficiently distinguish the stem end and the blossom end of navel orange from its black spots, we propose a feature skyscraper detector (FSD) with low computational cost, compact architecture and high detection accuracy. The main part of the detector is inspired from small object that stem (blossom) end is complex and black spot is densely distributed, so we design the feature skyscraper networks (FSN) based on dense connectivity. In particular, FSN is distinguished from regular feature pyramids, and which provides more intensive detection of high-level features. Then we design the backbone of the FSD based on attention mechanism and dense block for better feature extraction to the FSN. In addition, the architecture of the detector is also added Swish to further improve the accuracy. And we create a dataset in Pascal VOC format annotated three types of detection targets the stem end, the blossom end and the black spot. Experimental results on our orange data set confirm that FSD has competitive results to the state-of-the-art one-stage detectors like SSD, DSOD, YOLOv2, YOLOv3, RFB and FSSD, and it achieves 87.479%mAP at 131 FPS with only 5.812M parameters.


title: Precision Test of the Weak Equivalence Principle from Gamma-Ray Burst Polarization

abstract: If the weak equivalence principle (WEP) is broken, the measured values of the parametrized post-Newtonian parameter $\gamma$ from photons with left- and right-handed circular polarizations should differ slightly, leading to the arrival-time difference of these two circular components. Thus, the polarization vector of a linearly polarized light may rotate during the propagation. The rotation angle of the polarization vector depends on both the photon energy and the distance of the source. It is believed that if the rotation angle differs by more than $\pi/2$ over an energy range, then the net polarization of the signal would be significantly suppressed and could not be as high as the observed level. Thus, the detection of highly polarized photons implies that the relative rotation angle ($\Delta\Theta$) should not be too large. In this paper, we give a detailed calculation on the evolution of gamma-ray burst (GRB) polarization arising from a possible violation of the WEP, and we find that more than $60\%$ of the initial polarization degree can be conserved even if $\Delta\Theta$ is larger than $\pi/2$. In addition, to tightly constrain the WEP violation, GRBs with harder spectra and polarization observations in a wider energy range seem to be favored. Applying our formulas to the measurements of linear polarization from GRB 110721A and GRB 061122, we obtain strict limits on the differences of the $\gamma$ values as low as $\Delta\gamma<1.3\times10^{-33}$ and $\Delta\gamma<0.8\times10^{-33}$. These provide the most stringent limits to date on a deviation from the WEP, improving at least 6 orders of magnitude over previous bounds.


title: Verifying Asynchronous Event-Driven Programs Using Partial Abstract Transformers (Extended Manuscript)

abstract: We address the problem of analyzing asynchronous event-driven programs, in which concurrent agents communicate via unbounded message queues. The safety verification problem for such programs is undecidable. We present in this paper a technique that combines queue-bounded exploration with a convergence test: if the sequence of certain abstractions of the reachable states, for increasing queue bounds k, converges, we can prove any property of the program that is preserved by the abstraction. If the abstract state space is finite, convergence is guaranteed; the challenge is to catch the point k_max where it happens. We further demonstrate how simple invariants formulated over the concrete domain can be used to eliminate spurious abstract states, which otherwise prevent the sequence from converging. We have implemented our technique for the P programming language for event-driven programs. We show experimentally that the sequence of abstractions often converges fully automatically, in hard cases with minimal designer support in the form of sequentially provable invariants, and that this happens for a value of k_max small enough to allow the method to succeed in practice.


title: Painless Stochastic Gradient: Interpolation, Line-Search, and Convergence Rates

abstract: Recent works have shown that stochastic gradient descent (SGD) achieves the fast convergence rates of full-batch gradient descent for over-parameterized models satisfying certain interpolation conditions. However, the step-size used in these works depends on unknown quantities and SGD's practical performance heavily relies on the choice of this step-size. We propose to use line-search techniques to automatically set the step-size when training models that can interpolate the data. In the interpolation setting, we prove that SGD with a stochastic variant of the classic Armijo line-search attains the deterministic convergence rates for both convex and strongly-convex functions. Under additional assumptions, SGD with Armijo line-search is shown to achieve fast convergence for non-convex functions. Furthermore, we show that stochastic extra-gradient with a Lipschitz line-search attains linear convergence for an important class of non-convex functions and saddle-point problems satisfying interpolation. To improve the proposed methods' practical performance, we give heuristics to use larger step-sizes and acceleration. We compare the proposed algorithms against numerous optimization methods on standard classification tasks using both kernel methods and deep networks. The proposed methods result in competitive performance across all models and datasets, while being robust to the precise choices of hyper-parameters. For multi-class classification using deep networks, SGD with Armijo line-search results in both faster convergence and better generalization.


title: Self-Critical Reasoning for Robust Visual Question Answering

abstract: Visual Question Answering (VQA) deep-learning systems tend to capture superficial statistical correlations in the training data because of strong language priors and fail to generalize to test data with a significantly different question-answer (QA) distribution. To address this issue, we introduce a self-critical training objective that ensures that visual explanations of correct answers match the most influential image regions more than other competitive answer candidates. The influential regions are either determined from human visual/textual explanations or automatically from just significant words in the question and answer. We evaluate our approach on the VQA generalization task using the VQA-CP dataset, achieving a new state-of-the-art i.e., 49.5% using textual explanations and 48.5% using automatically annotated regions.


title: Monotonicity of solutions for fractional equations with De Giorgi type nonlinearities

abstract: In this paper, we develop a sliding method for the fractional Laplacian. We first obtain the key ingredients needed in the sliding method either in a bounded domain or in the whole space, such as narrow region principles and maximum principles in unbounded domains. Then using semi-linear equations involving the fractional Laplacian in both bounded domains and in the whole space, we illustrate how this new sliding method can be employed to obtain monotonicity of solutions. Some new ideas are introduced. Among which, one is to use Poisson integral representation of $s$-subharmonic functions in deriving the maximum principle, the other is to estimate the singular integrals defining the fractional Laplacians along a sequence of approximate maximum points by using a generalized average inequality. We believe that this new inequality will become a useful tool in analyzing fractional equations.


title: Implicit Label Augmentation on Partially Annotated Clips via Temporally-Adaptive Features Learning

abstract: Partially annotated clips contain rich temporal contexts that can complement the sparse key frame annotations in providing supervision for model training. We present a novel paradigm called Temporally-Adaptive Features (TAF) learning that can utilize such data to learn better single frame models. By imposing distinct temporal change rate constraints on different factors in the model, TAF enables learning from unlabeled frames using context to enhance model accuracy. TAF generalizes "slow feature" learning and we present much stronger empirical evidence than prior works, showing convincing gains for the challenging semantic segmentation task over a variety of architecture designs and on two popular datasets. TAF can be interpreted as an implicit label augmentation method but is a more principled formulation compared to existing explicit augmentation techniques. Our work thus connects two promising methods that utilize partially annotated clips for single frame model training and can inspire future explorations in this direction.


title: Equivalence bundles over a finite group and strong Morita equivalence for unital inclusions of unital $C^*$-algebras

abstract: Let $\mathcal{A}= \{A_t \}_{t \in G}$ and $\mathcal{B}= \{B_t \}_{t\in G}$ be $C^*$-algebraic bundles over a finite group $G$. Let $C=\oplus_{t \in G}A_t$ and $D=\oplus_{t\in G}B_t$. Also, let $A=A_e$ and $B=B_e$, where $e$ is the unit element in $G$. We suppose that $C$ and $D$ are unital and $A$ and $B$ have the unit elements in $C$ and $D$, respectively. In this paper, we shall show that if there is an equivalence $\mathcal{A}-\mathcal{B}$-bundle over $G$ with some properties, then the unital inclusions of unital $C^*$-algebras $A \subset C$ and $B \subset D$ induced by $\mathcal{A}$ and $\mathcal{B}$ are strongly Morita equivalent. Also, we suppose that $\mathcal{A}$ and $\mathcal{B}$ are saturated and that $A' \cap C= \mathbf{C} 1$. We shall show that if $A \subset C$ and $B \subset D$ are strongly Morita equivalent, then there are an automorphism $f$ of $G$ and an equivalence bundle $\mathcal{A}-\mathcal{B}^f $-bundle over $G$ with the some properties, where $\mathcal{B}^f$ is the $C^*$-algebraic bundle induced by $\mathcal{B}$ and $f$, which is defined by $\mathcal{B}^f = \{B_{f(t)} \}_{t \in G}$. Furthermore, we shall give an application.


title: Optimal control of a parabolic fractional PDE: analysis and discretization

abstract: We consider the integral definition of the fractional Laplacian and analyze a linear-quadratic optimal control problem for the so-called fractional heat equation; control constraints are also considered. We derive existence and uniqueness results, first order optimality conditions, and regularity estimates for the optimal variables. To discretize the state equation equation we propose a fully discrete scheme that relies on an implicit finite difference discretization in time combined with a piecewise linear finite element discretization in space. We derive stability results and a novel $L^2(0,T;L^2(\Omega))$ a priori error estimate. On the basis of the aforementioned solution technique, we propose a fully discrete scheme for our optimal control problem that discretizes the control variable with piecewise constant functions and derive a priori error estimates for it. We illustrate the theory with one- and two-dimensional numerical experiments.


title: Sequential Gaussian Processes for Online Learning of Nonstationary Functions

abstract: Many machine learning problems can be framed in the context of estimating functions, and often these are time-dependent functions that are estimated in real-time as observations arrive. Gaussian processes (GPs) are an attractive choice for modeling real-valued nonlinear functions due to their flexibility and uncertainty quantification. However, the typical GP regression model suffers from several drawbacks: 1) Conventional GP inference scales $O(N^{3})$ with respect to the number of observations; 2) Updating a GP model sequentially is not trivial; and 3) Covariance kernels typically enforce stationarity constraints on the function, while GPs with non-stationary covariance kernels are often intractable to use in practice. To overcome these issues, we propose a sequential Monte Carlo algorithm to fit infinite mixtures of GPs that capture non-stationary behavior while allowing for online, distributed inference. Our approach empirically improves performance over state-of-the-art methods for online GP estimation in the presence of non-stationarity in time-series data. To demonstrate the utility of our proposed online Gaussian process mixture-of-experts approach in applied settings, we show that we can sucessfully implement an optimization algorithm using online Gaussian process bandits.


title: CRANE: A MOOSE-based Open Source Tool for Plasma Chemistry Applications

abstract: Numerical simulation of plasma discharges is often performed by models developed in-house and coupling externally and separately written codes. The MOOSE (Multiphysics Object Oriented Simulation Environment) framework provides tools for quickly developing and coupling together software in a scalable framework, making it well-suited for plasma simulations. A new MOOSE application, CRANE (Chemical ReAction NEtwork), was developed in order to add an independent chemical kinetics application to the framework. In this work the capabilities of CRANE are detailed, including its use as a standalone solver for global plasma chemistry models. The capability of fully coupling applications in the MOOSE framework is also shown by compiling CRANE directly into the MOOSE-based plasma transport software Zapdos, showing the possibility to solve fully coupled drift-diffusion-reaction plasma chemistry problems. The code is open-source and available at the following url, https://github.com/lcpp-org/crane.


title: A concatenation construction for propelinear perfect codes from regular subgroups of GA(r,2)

abstract: A code $C$ is called propelinear if there is a subgroup of $Aut(C)$ of order $|C|$ acting transitively on the codewords of $C$. In the paper new propelinear perfect binary codes of any admissible length more than $7$ are obtained by a particular case of the Solov'eva concatenation construction--1981 and the regular subgroups of the general affine group of the vector space over $GF(2)$.


title: Graph Representations for Higher-Order Logic and Theorem Proving

abstract: This paper presents the first use of graph neural networks (GNNs) for higher-order proof search and demonstrates that GNNs can improve upon state-of-the-art results in this domain. Interactive, higher-order theorem provers allow for the formalization of most mathematical theories and have been shown to pose a significant challenge for deep learning. Higher-order logic is highly expressive and, even though it is well-structured with a clearly defined grammar and semantics, there still remains no well-established method to convert formulas into graph-based representations. In this paper, we consider several graphical representations of higher-order logic and evaluate them against the HOList benchmark for higher-order theorem proving.


title: Forward-backward asymmetry in the gauge-Higgs unification at the International Linear Collider

abstract: The signals of the SO(5) \times U(1) gauge-Higgs unification model at the International Linear Collider are studied. In this model, Kaluza-Klein modes of the neutral gauge bosons affect fermion pair productions. The deviations of the forward-backward asymmetries of the $e^+e^-\to \bar{b}b$, $\bar{t}t$ processes from the standard model predictions are clearly seen by using polarised beams. The deviations of these values are predicted for two cases, the bulk mass parameters of quarks are positive and negative case.


title: Interaction between high intensity beam and structure resonances

abstract: With the help of the linearized perturbation theory, the collective beam instability due to the space charge, modelled by the Vlasov-Poisson equation, is well studied in the former research theoretically in a general sense [Chao Li and R. A. Jameson PRAB, 21, 024204 (2018)], where the related instability is depicted by the "structure resonance". As an extension of the theoretical study, this paper aims to verify the validity of the structure resonance with numerical simulations and to show the basic principles which interpret the interaction between structure resonance and beam in a general sense. It is found that the reaction of beam to the structure resonance ($n\sigma\approx 180^\circ$) differs for the cases with $n= 0$ and $n\ne 0$ stop bands. The non-resonant "plasma oscillation" is also revisited; the "phase space mixing", lying in the transient plasma oscillation, is the mechanism that ties the resonant effects, non-resonant effects and macroscopic beam phenomena together.


title: Not All Features Are Equal: Feature Leveling Deep Neural Networks for Better Interpretation

abstract: Self-explaining models are models that reveal decision making parameters in an interpretable manner so that the model reasoning process can be directly understood by human beings. General Linear Models (GLMs) are self-explaining because the model weights directly show how each feature contributes to the output value. However, deep neural networks (DNNs) are in general not self-explaining due to the non-linearity of the activation functions, complex architectures, obscure feature extraction and transformation process. In this work, we illustrate the fact that existing deep architectures are hard to interpret because each hidden layer carries a mix of low level features and high level features. As a solution, we propose a novel feature leveling architecture that isolates low level features from high level features on a per-layer basis to better utilize the GLM layer in the proposed architecture for interpretation. Experimental results show that our modified models are able to achieve competitive results comparing to main-stream architectures on standard datasets while being more self-explainable. Our implementations and configurations are publicly available for reproductions


title: Segmentation of MRI head anatomy using deep volumetric networks and multiple spatial priors

abstract: Purpose: Conventional automated segmentation of the head anatomy in MRI distinguishes different brain and non-brain tissues based on image intensities and prior tissue probability maps (TPM). This works well for normal head anatomies, but fails in the presence of unexpected lesions. Deep convolutional neural networks leverage instead spatial patterns and can learn to segment lesions, but often ignore prior probabilities. Approach: We add three sources of prior information to a three-dimensional convolutional network, namely, spatial priors with a TPM, morphological priors with conditional random fields, and spatial context with a wider field-of-view at lower resolution. We train and test these networks on 3D images of 43 stroke patients and 4 healthy individuals which have been manually segmented. Results: We demonstrate the benefits of each sources of prior information, and we show that the new architecture, which we call Multiprior network, improves the performance of existing segmentation software, such as SPM, FSL, and DeepMedic for abnormal anatomies. The relevance of the different priors was compared and the TPM was found to be most beneficial. The benefit of adding a TPM is generic in that it can boost the performance of established segmentation networks such as the DeepMedic and a UNet. We also provide an out-of-sample validation and clinical application of the approach on an additional 47 patients with disorders of consciousness. We make the code and trained networks freely available. Conclusions: Biomedical images follow imaging protocols that can be leveraged as prior information into deep convolutional neural networks to improve performance. The network segmentations match human manual corrections performed in 3D, and are comparable in performance to human segmentations obtained from scratch in 2D for abnormal brain anatomies.


title: Light-Weight RetinaNet for Object Detection

abstract: Object detection has gained great progress driven by the development of deep learning. Compared with a widely studied task -- classification, generally speaking, object detection even need one or two orders of magnitude more FLOPs (floating point operations) in processing the inference task. To enable a practical application, it is essential to explore effective runtime and accuracy trade-off scheme. Recently, a growing number of studies are intended for object detection on resource constraint devices, such as YOLOv1, YOLOv2, SSD, MobileNetv2-SSDLite, whose accuracy on COCO test-dev detection results are yield to mAP around 22-25% (mAP-20-tier). On the contrary, very few studies discuss the computation and accuracy trade-off scheme for mAP-30-tier detection networks. In this paper, we illustrate the insights of why RetinaNet gives effective computation and accuracy trade-off for object detection and how to build a light-weight RetinaNet. We propose to only reduce FLOPs in computational intensive layers and keep other layer the same. Compared with most common way -- input image scaling for FLOPs-accuracy trade-off, the proposed solution shows a constantly better FLOPs-mAP trade-off line. Quantitatively, the proposed method result in 0.1% mAP improvement at 1.15x FLOPs reduction and 0.3% mAP improvement at 1.8x FLOPs reduction.


title: A Trilinear Immersed Finite Element Method for Solving Elliptic Interface Problems

abstract: This article presents an immersed finite element (IFE) method for solving the typical three-dimensional second order elliptic interface problem with an interface-independent Cartesian mesh. The local IFE space on each interface element consists of piecewise trilinear polynomials which are constructed by extending polynomials from one subelement to the whole element according to the jump conditions of the interface problem. In this space, the IFE shape functions with the Lagrange degrees of freedom can always be constructed regardless of interface location and discontinuous coefficients. The proposed IFE space is proven to have the optimal approximation capabilities to the functions satisfying the jump conditions. A group of numerical examples with representative interface geometries are presented to demonstrate features of the proposed IFE method.


title: Deep-gKnock: nonlinear group-feature selection with deep neural network

abstract: Feature selection is central to contemporary high-dimensional data analysis. Grouping structure among features arises naturally in various scientific problems. Many methods have been proposed to incorporate the grouping structure information into feature selection. However, these methods are normally restricted to a linear regression setting. To relax the linear constraint, we combine the deep neural networks (DNNs) with the recent Knockoffs technique, which has been successful in an individual feature selection context. We propose Deep-gKnock (Deep group-feature selection using Knockoffs) as a methodology for model interpretation and dimension reduction. Deep-gKnock performs model-free group-feature selection by controlling group-wise False Discovery Rate (gFDR). Our method improves the interpretability and reproducibility of DNNs. Experimental results on both synthetic and real data demonstrate that our method achieves superior power and accurate gFDR control compared with state-of-the-art methods.


title: Axions and Atomic Clocks

abstract: The equations of electrodynamics are altered in the presence of a classical coherent axion dark matter background field, changing the dispersion relation for electromagnetic waves. Careful measurements of the frequency stability in sensitive atomic clocks could in principle provide evidence for such a background for $f_a \ge 10^7$ GeV. Turning on a background magnetic field might enhance these effects in a controllable way, and interferometric measurements might also be useful for probing the time-varying photon dispersion relation that results from a coherent cosmic axion background.


title: On the entropies of subshifts of finite type on countable amenable groups

abstract: Let $G,H$ be two countable amenable groups. We introduce the notion of group charts, which gives us a tool to embed an arbitrary $H$-subshift into a $G$-subshift. Using an entropy addition formula derived from this formalism we prove that whenever $H$ is finitely presented and admits a subshift of finite type (SFT) on which $H$ acts freely, then the set of real numbers attained as topological entropies of $H$-SFTs is contained in the set of topological entropies of $G$-SFTs modulo an arbitrarily small additive constant for any finitely generated group $G$ which admits a translation-like action of $H$. In particular, we show that the set of topological entropies of $G$-SFTs on any such group which has decidable word problem and admits a translation-like action of $\mathbb{Z}^2$ coincides with the set of non-negative upper semi-computable real numbers. We use this result to give a complete characterization of the entropies of SFTs in several classes of groups.


title: A Micro-Objective Perspective of Reinforcement Learning

abstract: The standard reinforcement learning (RL) formulation considers the expectation of the (discounted) cumulative reward. This is limiting in applications where we are concerned with not only the expected performance, but also the distribution of the performance. In this paper, we introduce micro-objective reinforcement learning --- an alternative RL formalism that overcomes this issue. In this new formulation, a RL task is specified by a set of micro-objectives, which are constructs that specify the desirability or undesirability of events. In addition, micro-objectives allow prior knowledge in the form of temporal abstraction to be incorporated into the global RL objective. The generality of this formalism, and its relations to single/multi-objective RL, and hierarchical RL are discussed.


title: Computational cost for determining an approximate global minimum using the selection and crossover algorithm

abstract: This work examines the expected computational cost to determine an approximate global minimum of a class of cost functions characterized by the variance of coefficients. The cost function takes $N$-dimensional binary states as arguments and has many local minima. Iterations in the order of $2^N$ are required to determine an approximate global minimum using random search. This work analytically and numerically demonstrates that the selection and crossover algorithm with random initialization can reduce the required computational cost (i.e., number of iterations) for identifying an approximate global minimum to the order of $\lambda^N$ with $\lambda$ less than 2. The two best solutions, referred to as parents, are selected from a pool of randomly sampled states. Offspring generated by crossovers of the parents' states are distributed with a mean cost lower than that of the original distribution that generated the parents. It is revealed that in contrast to the mean, the variance of the cost of the offspring is asymptotically the same as that of the original distribution. Consequently, sampling from the offspring's distribution leads to a higher chance of determining an approximate global minimum than sampling from the original distribution, thereby accelerating the global search. This feature is distinct from the distribution obtained by a mixture of a large population of favorable states, which leads to a lower variance of offspring. These findings demonstrate the advantage of the crossover between two favorable states over a mixture of many favorable states for an efficient determination of an approximate global minimum.


title: Momentum-Based Variance Reduction in Non-Convex SGD

abstract: Variance reduction has emerged in recent years as a strong competitor to stochastic gradient descent in non-convex problems, providing the first algorithms to improve upon the converge rate of stochastic gradient descent for finding first-order critical points. However, variance reduction techniques typically require carefully tuned learning rates and willingness to use excessively large "mega-batches" in order to achieve their improved results. We present a new algorithm, STORM, that does not require any batches and makes use of adaptive learning rates, enabling simpler implementation and less hyperparameter tuning. Our technique for removing the batches uses a variant of momentum to achieve variance reduction in non-convex optimization. On smooth losses $F$, STORM finds a point $\boldsymbol{x}$ with $\mathbb{E}[\|\nabla F(\boldsymbol{x})\|]\le O(1/\sqrt{T}+\sigma^{1/3}/T^{1/3})$ in $T$ iterations with $\sigma^2$ variance in the gradients, matching the optimal rate but without requiring knowledge of $\sigma$.


title: Optimal nonparametric change point detection and localization

abstract: We study change point detection and localization for univariate data in fully nonparametric settings in which, at each time point, we acquire an i.i.d. sample from an unknown distribution. We quantify the magnitude of the distributional changes at the change points using the Kolmogorov--Smirnov distance. We allow all the relevant parameters -- the minimal spacing between two consecutive change points, the minimal magnitude of the changes in the Kolmogorov--Smirnov distance, and the number of sample points collected at each time point -- to change with the length of time series. We generalize the renowned binary segmentation (e.g. Scott and Knott, 1974) algorithm and its variant, the wild binary segmentation of Fryzlewicz (2014), both originally designed for univariate mean change point detection problems, to our nonparametric settings and exhibit rates of consistency for both of them. In particular, we prove that the procedure based on wild binary segmentation is nearly minimax rate-optimal. We further demonstrate a phase transition in the space of model parameters that separates parameter combinations for which consistent localization is possible from the ones for which this task is statistical unfeasible. Finally, we provide extensive numerical experiments to support our theory. R code is available at https://github.com/hernanmp/NWBS.


title: An optical all-pass filter realized by using self-compensation of loss

abstract: Filters are key devices in optical systems and are usually applied to signal suppression or selection based on their amplitude frequency responses. Different from amplitude filtering, an all-pass filter (APF) is a unique type of filter that exhibits a uniform amplitude and variable phase in the frequency response. Traditionally, an APF is designed to be ideal and lossless, which is impossible in practice. Here we demonstrate a method of realizing an APF even when transmission loss exists, and a possible structure for realizing the lossy APF is proposed. The method indicates that a lossy APF can be realized by introducing self-compensation of loss to the structure of an ideal single-stage APF, and an APF based on silicon-on-insulator (SOI) foundry is fabricated and demonstrated. The method of self-compensation of loss can also be used to realize APFs in the electrical domain. We anticipate that our work will inspire realizations of more APF-related devices that once seemed impossible in practice.


title: A Note on Inclusions of Discrete Morrey Spaces

abstract: We give a necessary condition for inclusion relations between discrete Morrey spaces which can be seen as a complement of the results in \cite{GKS,HS2}. We also prove another inclusion property of discrete Morrey spaces which can be viewed as a generalization of the inclusion property of the spaces of $p$-summable sequences. Analogous results for weak type discrete Morrey spaces is also presented. In addition, we show that each of these inclusion relations is proper. Some connections between inclusion properties of discrete Morrey spaces and those of Morrey spaces are also discussed.


title: Patent Citation Dynamics Modeling via Multi-Attention Recurrent Networks

abstract: Modeling and forecasting forward citations to a patent is a central task for the discovery of emerging technologies and for measuring the pulse of inventive progress. Conventional methods for forecasting these forward citations cast the problem as analysis of temporal point processes which rely on the conditional intensity of previously received citations. Recent approaches model the conditional intensity as a chain of recurrent neural networks to capture memory dependency in hopes of reducing the restrictions of the parametric form of the intensity function. For the problem of patent citations, we observe that forecasting a patent's chain of citations benefits from not only the patent's history itself but also from the historical citations of assignees and inventors associated with that patent. In this paper, we propose a sequence-to-sequence model which employs an attention-of-attention mechanism to capture the dependencies of these multiple time sequences. Furthermore, the proposed model is able to forecast both the timestamp and the category of a patent's next citation. Extensive experiments on a large patent citation dataset collected from USPTO demonstrate that the proposed model outperforms state-of-the-art models at forward citation forecasting.


title: Separation Effect of Early Visual Cortex V1 Under Different Crowding Conditions A TMS Study

abstract: The visual crowding makes it difficult to identify the patterns in peripheral vision, but the neural mechanism for this phenomenon is still unclear because of different opinions. In order to study the separation effect of V1 under different crowding conditions, single-pulse transcranial magnetic stimulation is applied within the right V1. The experimental design includes two factors: TMS intensity (10%, 65%, and 90% of the phosphene threshold) and crowding (high and low) conditions. The accuracy results show that there is a strong interaction between crowding condition and TMS condition. When the TMS stimulation intensity is lower than the phosphene threshold, more crowding will be perceived under the high crowding condition, and less crowding will be perceived under the low crowding condition. The above results conclude that the high and low crowding condition separate by TMS stimulation. The results support the assumption that the crowding is related to V1 and occurs in the visual coding phase.


title: An Analysis of Source-Side Grammatical Errors in NMT

abstract: The quality of Neural Machine Translation (NMT) has been shown to significantly degrade when confronted with source-side noise. We present the first large-scale study of state-of-the-art English-to-German NMT on real grammatical noise, by evaluating on several Grammar Correction corpora. We present methods for evaluating NMT robustness without true references, and we use them for extensive analysis of the effects that different grammatical errors have on the NMT output. We also introduce a technique for visualizing the divergence distribution caused by a source-side error, which allows for additional insights.


title: A counter-top search for macroscopic dark matter

abstract: A number of dark matter candidates have been discussed that are macroscopic, of approximately nuclear density, and scatter ordinary matter essentially elastically with approximately their geometric cross-section. A wide range of mass and geometric cross-section is still unprobed for these "macros." Macros passing through rock would melt the material in cylinders surrounding their long nearly straight trajectories. Once cooled, the resolidified rock would be easily distinguishable from its surroundings. We discuss how, by visually examining ordinary slabs of rock such as are widely available commercially for kitchen countertops, one could probe an interesting segment of the open macro parameter space.


title: Design of boundary stabilizers for the non-autonomous cubic semilinear heat equation, driven by a multiplicative noise

abstract: Here we design boundary feedback stabilizers to unbounded trajectories, for semi-linear stochastic heat equation with cubic non-linearity. The feedback controller is linear, given in a simple explicit form and involves only the eigenfunctions of the Laplace operator. It is supported in a given open subset of the boundary of the domain. Via a rescaling argument, we transform the stochastic equation into a random deterministic one. Then, the simple form of the feedback, we propose here, allows to write the solution, of the random equation, in a mild formulation via a kernel. Appealing to a fixed point argument the existence \& stabilization result is proved.


title: Neural Temporal-Difference and Q-Learning Provably Converge to Global Optima

abstract: Temporal-difference learning (TD), coupled with neural networks, is among the most fundamental building blocks of deep reinforcement learning. However, due to the nonlinearity in value function approximation, such a coupling leads to nonconvexity and even divergence in optimization. As a result, the global convergence of neural TD remains unclear. In this paper, we prove for the first time that neural TD converges at a sublinear rate to the global optimum of the mean-squared projected Bellman error for policy evaluation. In particular, we show how such global convergence is enabled by the overparametrization of neural networks, which also plays a vital role in the empirical success of neural TD. Beyond policy evaluation, we establish the global convergence of neural (soft) Q-learning, which is further connected to that of policy gradient algorithms.


title: Do log factors matter? On optimal wavelet approximation and the foundations of compressed sensing

abstract: A signature result in compressed sensing is that Gaussian random sampling achieves stable and robust recovery of sparse vectors under optimal conditions on the number of measurements. However, in the context of image reconstruction, it has been extensively documented that sampling strategies based on Fourier measurements outperform this purportedly optimal approach. Motivated by this seeming paradox, we investigate the problem of optimal sampling for compressed sensing. Rigorously combining the theories of wavelet approximation and infinite-dimensional compressed sensing, our analysis leads to new error bounds in terms of the total number of measurements $m$ for the approximation of piecewise $\alpha$-H\"{o}lder functions. Our theoretical findings suggest that Fourier sampling outperforms random Gaussian sampling when the H\"older exponent $\alpha$ is large enough. Moreover, we establish a provably optimal sampling strategy. This work is an important first step towards the resolution of the claimed paradox, and provides a clear theoretical justification for the practical success of compressed sensing techniques in imaging problems.


title: Power up! Robust Graph Convolutional Network via Graph Powering

abstract: Graph convolutional networks (GCNs) are powerful tools for graph-structured data. However, they have been recently shown to be vulnerable to topological attacks. To enhance adversarial robustness, we go beyond spectral graph theory to robust graph theory. By challenging the classical graph Laplacian, we propose a new convolution operator that is provably robust in the spectral domain and is incorporated in the GCN architecture to improve expressivity and interpretability. By extending the original graph to a sequence of graphs, we also propose a robust training paradigm that encourages transferability across graphs that span a range of spatial and spectral characteristics. The proposed approaches are demonstrated in extensive experiments to simultaneously improve performance in both benign and adversarial situations.


title: Asymptotic Behaviour of Discretised Functionals of Long-Range Dependent Functional Data

abstract: The paper studies the asymptotic behaviour of weighted functionals of long-range dependent data over increasing observation windows. Various important statistics, including sample means, high order moments, occupation measures can be given by these functionals. It is shown that in the discrete sampling case additive functionals have the same asymptotic distribution as the corresponding integral functionals for the continuous functional data case. These results are applied to obtain non-central limit theorems for weighted additive functionals of random fields. As the majority of known results concern the discrete sampling case the developed methodology helps in translating these results to functional data without deriving them again. Numerical studies suggest that the theoretical findings are valid for wider classes of long-range dependent data.


title: Accuracy-Memory Tradeoffs and Phase Transitions in Belief Propagation

abstract: The analysis of Belief Propagation and other algorithms for the {\em reconstruction problem} plays a key role in the analysis of community detection in inference on graphs, phylogenetic reconstruction in bioinformatics, and the cavity method in statistical physics. We prove a conjecture of Evans, Kenyon, Peres, and Schulman (2000) which states that any bounded memory message passing algorithm is statistically much weaker than Belief Propagation for the reconstruction problem. More formally, any recursive algorithm with bounded memory for the reconstruction problem on the trees with the binary symmetric channel has a phase transition strictly below the Belief Propagation threshold, also known as the Kesten-Stigum bound. The proof combines in novel fashion tools from recursive reconstruction, information theory, and optimal transport, and also establishes an asymptotic normality result for BP and other message-passing algorithms near the critical threshold.

categories: cs.IT math.IT math.ST stat.CO stat.ML stat.TH


title: Interaction between two modes of field mediated by two quantum dots in a photonic crystal cavity

abstract: We show unusual cooperative two-photon resonance between two-modes of field inside a photonic crystal cavity. The two-photon resonance occurs when two off resonant quantum dots emit one photon in each cavity mode and de-excite simultaneously. In the presence of phonon coupling the conditions for two-photon resonance change significantly. Using such two-photon two-mode interaction we propose to generate entangled state of two qutrits. The basis of a qutrit are formed by the state of the cavity mode containing $0$, $1$ and $2$ photons. We also discuss effect of phonon coupling on negativity of the generated entangled state.


title: Personalizing Dialogue Agents via Meta-Learning

abstract: Existing personalized dialogue models use human designed persona descriptions to improve dialogue consistency. Collecting such descriptions from existing dialogues is expensive and requires hand-crafted feature designs. In this paper, we propose to extend Model-Agnostic Meta-Learning (MAML)(Finn et al., 2017) to personalized dialogue learning without using any persona descriptions. Our model learns to quickly adapt to new personas by leveraging only a few dialogue samples collected from the same user, which is fundamentally different from conditioning the response on the persona descriptions. Empirical results on Persona-chat dataset (Zhang et al., 2018) indicate that our solution outperforms non-meta-learning baselines using automatic evaluation metrics, and in terms of human-evaluated fluency and consistency.


title: Power Lower Bounds for the Central Moments of the Last Passage Time for Directed Percolation in a Thin Rectangle

abstract: In directed last passage site percolation with i.i.d.~random weights with finite support over a $n\times\lfloor n^{\alpha}\rfloor$ grid, we prove that for $n$ large enough, the order of the $r$-th central moment, $1\le r<+\infty$, of the last passage time is lower bounded by $n^{r(1-\alpha)/2}$, $0<\alpha<1/3$.


title: Parallel Coordinate Order for High-Dimensional Data

abstract: Visualization of high-dimensional data is counter-intuitive using conventional graphs. Parallel coordinates are proposed as an alternative to explore multivariate data more effectively. However, it is difficult to extract relevant information through the parallel coordinates when the data are high-dimensional with thousands of lines overlapping. The order of the axes determines the perception of information on parallel coordinates. Thus, the information between attributes remain hidden if coordinates are improperly ordered. Here we propose a general framework to reorder the coordinates. This framework is general to cover a large range of data visualization objective. It is also flexible to contain many conventional ordering measures. Consequently, we present the coordinate ordering binary optimization problem and enhance towards a computationally efficient greedy approach that suites high-dimensional data. Our approach is applied on wine data and on genetic data. The purpose of dimension reordering of wine data is highlighting attributes dependence. Genetic data are reordered to enhance cluster detection. The presented framework shows that it is able to adapt the measures and criteria tested.


title: Realization of Modular Galois Representations in Jacobians of modular curves

abstract: In this paper, we propose an improved algorithm for computing mod $\ell$ Galois representations associated to eigenforms of arbitrary levels prime to $\ell$. Precisely, we present a method to find the Jacobians of modular curves which have the smallest possible dimensions in a well-defined sense to realize the modular Galois representations. This algorithm also works without the assumption $\ell \ge k-1$, where $k$ are the weights of the eigenforms.


title: Brain-mediated Transfer Learning of Convolutional Neural Networks

abstract: The human brain can effectively learn a new task from a small number of samples, which indicate that the brain can transfer its prior knowledge to solve tasks in different domains. This function is analogous to transfer learning (TL) in the field of machine learning. TL uses a well-trained feature space in a specific task domain to improve performance in new tasks with insufficient training data. TL with rich feature representations, such as features of convolutional neural networks (CNNs), shows high generalization ability across different task domains. However, such TL is still insufficient in making machine learning attain generalization ability comparable to that of the human brain. To examine if the internal representation of the brain could be used to achieve more efficient TL, we introduce a method for TL mediated by human brains. Our method transforms feature representations of audiovisual inputs in CNNs into those in activation patterns of individual brains via their association learned ahead using measured brain responses. Then, to estimate labels reflecting human cognition and behavior induced by the audiovisual inputs, the transformed representations are used for TL. We demonstrate that our brain-mediated TL (BTL) shows higher performance in the label estimation than the standard TL. In addition, we illustrate that the estimations mediated by different brains vary from brain to brain, and the variability reflects the individual variability in perception. Thus, our BTL provides a framework to improve the generalization ability of machine-learning feature representations and enable machine learning to estimate human-like cognition and behavior, including individual variability.


title: The $M-\sigma$ relation between supermassive black holes and their host galaxies

abstract: Supermassive black holes (SMBHs) are found in the centres of most galaxies. Their masses, and hence their gravitational potentials, are negligible compared with those of the host galaxy. However, several strong correlations between SMBH masses and host galaxy properties have been observed, notably the $M-\sigma$ relation connecting the SMBH mass to the characteristic velocity of stars in the galaxy. The existence of these correlations implies that the SMBH influences the evolution of its host galaxy. In this review, we present the most promising physical model of this influence, known as the Active galactic nucleus (AGN) wind feedback model. Winds launched from the accretion disc around the SMBH can drive powerful outflows, provided that the SMBH is massive enough - this condition establishes the $M-\sigma$ relation. Outflows can have a profound influence on the evolution of the host galaxy, by compressing its gas and driving it out, affecting the star formation rate. We present the current status of the model and the observational evidence for it, as well as the directions of future research.


title: Outline Generation: Understanding the Inherent Content Structure of Documents

abstract: In this paper, we introduce and tackle the Outline Generation (OG) task, which aims to unveil the inherent content structure of a multi-paragraph document by identifying its potential sections and generating the corresponding section headings. Without loss of generality, the OG task can be viewed as a novel structured summarization task. To generate a sound outline, an ideal OG model should be able to capture three levels of coherence, namely the coherence between context paragraphs, that between a section and its heading, and that between context headings. The first one is the foundation for section identification, while the latter two are critical for consistent heading generation. In this work, we formulate the OG task as a hierarchical structured prediction problem, i.e., to first predict a sequence of section boundaries and then a sequence of section headings accordingly. We propose a novel hierarchical structured neural generation model, named HiStGen, for the task. Our model attempts to capture the three-level coherence via the following ways. First, we introduce a Markov paragraph dependency mechanism between context paragraphs for section identification. Second, we employ a section-aware attention mechanism to ensure the semantic coherence between a section and its heading. Finally, we leverage a Markov heading dependency mechanism and a review mechanism between context headings to improve the consistency and eliminate duplication between section headings. Besides, we build a novel WIKIOG dataset, a public collection which consists of over 1.75 million document-outline pairs for research on the OG task. Experimental results on our benchmark dataset demonstrate that our model can significantly outperform several state-of-the-art sequential generation models for the OG task.


title: OSOM: A simultaneously optimal algorithm for multi-armed and linear contextual bandits

abstract: We consider the stochastic linear (multi-armed) contextual bandit problem with the possibility of hidden simple multi-armed bandit structure in which the rewards are independent of the contextual information. Algorithms that are designed solely for one of the regimes are known to be sub-optimal for the alternate regime. We design a single computationally efficient algorithm that simultaneously obtains problem-dependent optimal regret rates in the simple multi-armed bandit regime and minimax optimal regret rates in the linear contextual bandit regime, without knowing a priori which of the two models generates the rewards. These results are proved under the condition of stochasticity of contextual information over multiple rounds. Our results should be viewed as a step towards principled data-dependent policy class selection for contextual bandits.


title: Efficient Batch Black-box Optimization with Deterministic Regret Bounds

abstract: In this work, we investigate black-box optimization from the perspective of frequentist kernel methods. We propose a novel batch optimization algorithm, which jointly maximizes the acquisition function and select points from a whole batch in a holistic way. Theoretically, we derive regret bounds for both the noise-free and perturbation settings irrespective of the choice of kernel. Moreover, we analyze the property of the adversarial regret that is required by a robust initialization for Bayesian Optimization (BO). We prove that the adversarial regret bounds decrease with the decrease of covering radius, which provides a criterion for generating a point set to minimize the bound. We then propose fast searching algorithms to generate a point set with a small covering radius for the robust initialization. Experimental results on both synthetic benchmark problems and real-world problems show the effectiveness of the proposed algorithms.


title: Effects of the fermionic vacuum polarization in QED

abstract: Some effects of vacuum polarization in QED due to the presence of field sources are investigated. We focus on effects with no counter-part in Maxwell electrodynamics. The the Uehling interaction energy between two stationary point-like charges is calculated exactly in terms of Meijer-G functions. Effects induced on a hydrogen atom by the vacuum polarization in the vicinity of a Dirac string are considered. We also calculate the interaction between two parallel Dirac strings and corrections to the energy levels of a quantum particle constrained to move on a ring circumventing a solenoid.


title: High efficiency dark-to-bright exciton conversion in carbon nanotubes

abstract: We report that dark excitons can have a large contribution to the emission intensity in carbon nanotubes due to an efficient exciton conversion from a dark state to a bright state. Time-resolved photoluminescence measurements are used to investigate decay dynamics and diffusion properties of excitons, and we obtain intrinsic lifetimes and diffusion lengths of bright excitons as well as diffusion coefficients for both bright and dark excitons. We find that the dark-to-bright transition rates can be considerably high, and that more than half of the dark excitons can be transformed into the bright excitons. The state transition rates have a large chirality dependence with a family pattern, and the conversion efficiency is found to be significantly enhanced by adsorbed air molecules on the surface of the nanotubes. Our findings show the nontrivial significance of the dark excitons on the emission kinetics in low dimensional materials, and demonstrate the potential for engineering the dark-to-bright conversion process by using surface interactions.


title: BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions

abstract: In this paper we study yes/no questions that are naturally occurring --- meaning that they are generated in unprompted and unconstrained settings. We build a reading comprehension dataset, BoolQ, of such questions, and show that they are unexpectedly challenging. They often query for complex, non-factoid information, and require difficult entailment-like inference to solve. We also explore the effectiveness of a range of transfer learning baselines. We find that transferring from entailment data is more effective than transferring from paraphrase or extractive QA data, and that it, surprisingly, continues to be very beneficial even when starting from massive pre-trained language models such as BERT. Our best method trains BERT on MultiNLI and then re-trains it on our train set. It achieves 80.4% accuracy compared to 90% accuracy of human annotators (and 62% majority-baseline), leaving a significant gap for future work.


title: Curriculum Loss: Robust Learning and Generalization against Label Corruption

abstract: Deep neural networks (DNNs) have great expressive power, which can even memorize samples with wrong labels. It is vitally important to reiterate robustness and generalization in DNNs against label corruption. To this end, this paper studies the 0-1 loss, which has a monotonic relationship with an empirical adversary (reweighted) risk~\citep{hu2016does}. Although the 0-1 loss has some robust properties, it is difficult to optimize. To efficiently optimize the 0-1 loss while keeping its robust properties, we propose a very simple and efficient loss, i.e. curriculum loss (CL). Our CL is a tighter upper bound of the 0-1 loss compared with conventional summation based surrogate losses. Moreover, CL can adaptively select samples for model training. As a result, our loss can be deemed as a novel perspective of curriculum sample selection strategy, which bridges a connection between curriculum learning and robust learning. Experimental results on benchmark datasets validate the robustness of the proposed loss.


title: Invariant subspaces of biconfluent Heun operators and special solutions of Painlev\'e IV

abstract: We show that there is a full correspondence between the parameters space of the degenerate biconfluent Heun connection (BHC) and that of Painlev\'{e} IV that admits special solutions. The BHC degenerates when either the Stokes' data for the irregular singularity at $\infty$ degenerates or the regular singular point at the origin becomes an apparent singularity. We show that if the BHC is written as isomonodromy family of biconfluent Heun equations (BHE), then the BHE degenerates precisely when it admits eigen-solutions of the biconfluent Heun operators, after choosing appropriate accessory parameter, of specially constructed invariant subspaces of finite dimensional solution spaces spanned by parabolic cylinder functions. We have found all eigen-solutions over this parameter space apart from three exceptional cases after choosing the right accessory parameters. These eigen-solutions are expressed as certain finite sum of parabolic cylinder functions. We extend the above sum to new convergent series expansion in terms of parabolic cylinder functions to the BHE. The infinite sum solutions of the BHE terminates precisely when the parameters of the BHE assumes the same values as those of the degenerate biconfluent Heun connection except at three instances after choosing the right accessory parameter.


title: Highly stable linearly polarized arbitrary temporal shaping of picosecond laser pulses

abstract: This paper reports the study and demonstration of a new variable temporal shaping method capable of generating linearly polarized picosecond laser pulses with arbitrary predefined shapes, which are highly desired by various applications including low emittance high brightness electron bunch generation in photocathode guns. It is found that both high transmittance and high stability of the shaped pulses can be achieved simultaneously when birefringent stages (BSs) are set at specific phase delay. Such variable temporal shaping technique may lead to new opportunities for many potential applications over a wide range of laser wavelengths, pulse repetition rates, time structures and power levels, etc. In addition, a new double-pass variable temporal shaping method is also proposed and could significantly simplify the shaper structure and reduce the cost.


title: Beyond Intra-modality: A Survey of Heterogeneous Person Re-identification

abstract: An efficient and effective person re-identification (ReID) system relieves the users from painful and boring video watching and accelerates the process of video analysis. Recently, with the explosive demands of practical applications, a lot of research efforts have been dedicated to heterogeneous person re-identification (Hetero-ReID). In this paper, we provide a comprehensive review of state-of-the-art Hetero-ReID methods that address the challenge of inter-modality discrepancies. According to the application scenario, we classify the methods into four categories -- low-resolution, infrared, sketch, and text. We begin with an introduction of ReID, and make a comparison between Homogeneous ReID (Homo-ReID) and Hetero-ReID tasks. Then, we describe and compare existing datasets for performing evaluations, and survey the models that have been widely employed in Hetero-ReID. We also summarize and compare the representative approaches from two perspectives, i.e., the application scenario and the learning pipeline. We conclude by a discussion of some future research directions. Follow-up updates are avaible at: https://github.com/lightChaserX/Awesome-Hetero-reID


title: Ultra-broadband, few cycle pulses directly from a Mamyshev fiber oscillator

abstract: While the performance of mode-locked fiber lasers has been improved significantly, the limited gain bandwidth restricts them to generate ultrashort pulses approaching a few cycles or even shorter. Here we present a novel method to achieve few cycle pulses (~5 cycles) with ultra-broad spectrum (~400 nm). To our best knowledge, this is the shortest pulse width and broadest spectrum directly generated from fiber lasers. It is noteworthy that a dramatic ultrashort pulse evolution can be stabilized in a laser oscillator by the unique nonlinear processes of a self-similar evolution as a nonlinear attractor in the gain fiber and a perfect saturable absorber action of the Mamyshev oscillator.


title: Spherically Symmetric Wormholes with anisotropic matter

abstract: We study the geometry of a wormhole spacetime filled with anisotropic matter in the context of general relativity. In the course of the study, new static and spherically symmetric solutions, analytic and numerical ones, are found. We specify the existence condition for a wormhole throat. We analyze properties of the solutions after categorizing them based on the spacetime regularity and the signature of energy density. The necessary conditions which allow a wormhole spacetime to be nonsingular are described.


title: Radiative and mechanical feedback into the molecular gas in the Large Magellanic Cloud. II. 30 Doradus

abstract: With an aim of probing the physical conditions and excitation mechanisms of warm molecular gas in individual star-forming regions, we performed Herschel SPIRE FTS observations of 30 Doradus in the LMC. In our FTS observations, important FIR cooling lines in the ISM, including CO J=4-3 to 13-12, [CI] 370 micron, and [NII] 205 micron, were clearly detected. In combination with ground-based CO data, we then constructed CO spectral line energy distributions (SLEDs) on 10 pc scales over a 60 pc x 60 pc area and found that the shape of the observed CO SLEDs considerably changes across 30 Doradus, e.g., the peak transition varies from J=6-5 to 10-9, while the slope characterized by the high-to-intermediate J ratio ranges from 0.4 to 1.8. To examine the source(s) of these variations in CO transitions, we analyzed the CO observations, along with [CII] 158 micron, [CI] 370 micron, [OI] 145 micron, H2 0-0 S(3), and FIR luminosity data, using state-of-the-art models of PDRs and shocks. Our detailed modeling showed that the observed CO emission likely originates from highly-compressed (thermal pressure ~ 1e7-1e9 K cm-3) clumps on 0.7-2 pc scales, which could be produced by either UV photons (UV radiation field ~ 1e3-1e5 Mathis fields) or low-velocity C-type shocks (pre-shock medium density ~ 1e4-1e6 cm-3 and shock velocity ~ 5-10 km s-1). Considering the stellar content in 30 Doradus, however, we tentatively excluded the stellar origin of CO excitation and concluded that low-velocity shocks driven by kpc scale processes (e.g., interaction between the Milky Way and the Magellanic Clouds) are likely the dominant source of heating for CO. The shocked CO-bright medium was then found to be warm (temperature ~ 100-500 K) and surrounded by a UV-regulated low pressure component (a few (1e4-1e5) K cm-3) that is bright in [CII] 158 micron, [CI] 370 micron, [OI] 145 micron, and FIR dust continuum emission.


title: Implications of Superrotations

abstract: A framework of connections between asymptotic symmetries, soft theorems, and memory effects has recently shed light on a universal structure associated with infrared physics. Here, we show how this pattern has been used to fill in missing elements. After the necessary groundwork, we begin by proving a Ward identity for superrotations using the subleading soft graviton theorem, thereby demonstrating a semiclassical Virasoro symmetry for scattering in quantum gravity. Next, we show there exists a new spin memory effect associated with this symmetry, explain more generally how the connections between the vertices of the infrared triangle predicted this, and describe what other examples and variations have been unveiled. Taking to heart this newly motivated Virasoro symmetry, we review how the soft theorem has been recast as a Virasoro Ward identity for a putative two dimensional conformal field theory. This derivation relies upon a map from plane wave scattering states to a conformal primary basis, which we then construct. We provide examples of familiar scattering amplitudes recast in this basis and discuss the somewhat exotic nature of the putative CFT2. We conclude by describing ongoing efforts to tame some of these features and what this change of basis in turn has taught us about the infrared limit which began our story.


title: Federated Forest

abstract: Most real-world data are scattered across different companies or government organizations, and cannot be easily integrated under data privacy and related regulations such as the European Union's General Data Protection Regulation (GDPR) and China' Cyber Security Law. Such data islands situation and data privacy & security are two major challenges for applications of artificial intelligence. In this paper, we tackle these challenges and propose a privacy-preserving machine learning model, called Federated Forest, which is a lossless learning model of the traditional random forest method, i.e., achieving the same level of accuracy as the non-privacy-preserving approach. Based on it, we developed a secure cross-regional machine learning system that allows a learning process to be jointly trained over different regions' clients with the same user samples but different attribute sets, processing the data stored in each of them without exchanging their raw data. A novel prediction algorithm was also proposed which could largely reduce the communication overhead. Experiments on both real-world and UCI data sets demonstrate the performance of the Federated Forest is as accurate as the non-federated version. The efficiency and robustness of our proposed system had been verified. Overall, our model is practical, scalable and extensible for real-life tasks.


title: A Compressive Sensing Video dataset using Pixel-wise coded exposure

abstract: Manifold amount of video data gets generated every minute as we read this document, ranging from surveillance to broadcasting purposes. There are two roadblocks that restrain us from using this data as such, first being the storage which restricts us from only storing the information based on the hardware constraints. Secondly, the computation required to process this data is highly expensive which makes it infeasible to work on them. Compressive sensing(CS)[2] is a signal process technique[11], through optimization, the sparsity of a signal can be exploited to recover it from far fewer samples than required by the Shannon-Nyquist sampling theorem. There are two conditions under which recovery is possible. The first one is sparsity which requires the signal to be sparse in some domain. The second one is incoherence which is applied through the isometric property which is sufficient for sparse signals[9][10]. To sustain these characteristics, preserving all attributes in the uncompressed domain would help any kind of in this field. However, existing dataset fallback in terms of continuous tracking of all the object present in the scene, very few video datasets have comprehensive continuous tracking of objects. To address these problems collectively, in this work we propose a new comprehensive video dataset, where the data is compressed using pixel-wise coded exposure [3] that resolves various other impediments.


title: Contrasting magnetism in isovalent layered LaSr3NiRuO4H4 and LaSrNiRuO4 due to distinct spin-orbital states

abstract: The recently synthesized first 4d transition-metal oxide-hydride LaSr3NiRuO4H4 with the unusual high H:O ratio surprisingly displays no magnetic order down to 1.8 K. This is in sharp contrast to the similar unusual low-valent Ni+ - Ru2+ layered oxide LaSrNiRuO4 which has a rather high ferromagnetic (FM) ordering Curie temperature TC about 250 K. In this work, using density functional calculations with aid of crystal field level diagrams and superexchange pictures, we find that the contrasting magnetism is due to the distinct spin-orbital states of the Ru2+ ions (in addition to the common Ni+ S=1/2 state but with a different orbital state): the Ru2+ S=0 state in LaSr3NiRuO4H4, but the Ru2+ S=1 state in LaSrNiRuO4. The Ru2+ S=0 state has the (xy)2(xz; yz)4 occupation due to the RuH4O2 octahedral coordination, and then the nonmagnetic Ru2+ ions dilute the S=1/2 Ni+ sublattice which consequently has a very weak antiferromagnetic (AF) superexchange and thus accounts for no presence of magnetic order down to 1.8 K in LaSr3NiRuO4H4. In strong contrast, the Ru2+ S=1 state in LaSrNiRuO4 has the (3z2-r2)2(xz; yz)3(xy)1 occupation due to the planar square RuO4 coordination, and then the multi-orbital FM superexchange between the S=1/2 Ni+ and S=1 Ru2+ ions gives rise to the high TC in LaSrNiRuO4. This work highlights the importance of spin-orbital states in determining the distinct magnetism.


title: A Study of Stress-Tensor Distribution around Flux Tube in Abelian-Higgs Model

abstract: We study the stress-tensor distribution around the flux tube in static quark and anti-quark systems based on the momentum conservation and the Abelian-Higgs (AH) model. We first investigate constraints on the stress-tensor distribution from the momentum conservation and show that the effect of boundaries plays a crucial role to describe the structure of the flux tube in SU(3) Yang-Mills theory which has measured recently on the lattice. We then study the distributions of the stress tensor and energy density around the magnetic vortex with and without boundaries in the AH model, and compare them with the distributions in SU(3) Yang-Mills theory based on the dual superconductor picture. It is shown that a wide parameter range of the AH model is excluded by a comparison with the lattice results in terms of the stress tensor.


title: Operational total space theory of principal 2--bundles I: operational geometric framework

abstract: It is a classic result that the geometry of the total space of a principal bundle with reference to the action of the bundle's structure group is codified in the bundle's operation, a collection of derivations comprising the de Rham differential and the contraction and Lie derivatives of all vertical vector fields and obeying the six Cartan relations. In particular, connections and gauge transformations can be defined through the way they are acted upon by the operation's derivations. In this paper, the first of a series of two extending the ordinary theory, we construct an operational total space theory of strict principal 2--bundles with regard to the action of the structure strict 2--group. Expressing this latter via a crossed module $(\mathsans{E},\mathsans{G})$, the operation is based on the derived Lie group $\mathfrak{e}[1]\rtimes\mathsans{G}$. In the second paper, an original formulation of the theory of $2$--connections and $1$-- and $2$--gauge transformations based on the operational framework worked out here will be provided.


title: High-Mobility Massive MIMO Communications:Doppler Compensation and Transmit Diversity

abstract: High-mobility wireless communications have been receiving a lot attentions. In this paper, we consider the highmobility uplink transmission from a high-speed terminal (HST) to a base station (BS). We propose two transmit diversity schemes for high-mobility massive communications with angle domain Doppler compensation. In the first scheme, we propose the idea of block-wise angle domain Doppler compensation, such that the uplink equivalent channel would exhibit the feature of nearly perfect independent block fading. The signal space diversity encoding technique is then exploited to achieve transmit diversity. In the second scheme, the multiple parallel beamformers with Doppler compensation are exclusively occupied to transmit multiple orthogonal space-time block coding (OSTBC) data streams. Both analysis and numerical results verify that both the proposed schemes can achieve transmit diversity and outperform the conventional scheme.


title: Pose-adaptive Hierarchical Attention Network for Facial Expression Recognition

abstract: Multi-view facial expression recognition (FER) is a challenging task because the appearance of an expression varies in poses. To alleviate the influences of poses, recent methods either perform pose normalization or learn separate FER classifiers for each pose. However, these methods usually have two stages and rely on good performance of pose estimators. Different from existing methods, we propose a pose-adaptive hierarchical attention network (PhaNet) that can jointly recognize the facial expressions and poses in unconstrained environment. Specifically, PhaNet discovers the most relevant regions to the facial expression by an attention mechanism in hierarchical scales, and the most informative scales are then selected to learn the pose-invariant and expression-discriminative representations. PhaNet is end-to-end trainable by minimizing the hierarchical attention losses, the FER loss and pose loss with dynamically learned loss weights. We validate the effectiveness of the proposed PhaNet on three multi-view datasets (BU-3DFE, Multi-pie, and KDEF) and two in-the-wild FER datasets (AffectNet and SFEW). Extensive experiments demonstrate that our framework outperforms the state-of-the-arts under both within-dataset and cross-dataset settings, achieving the average accuracies of 84.92\%, 93.53\%, 88.5\%, 54.82\% and 31.25\% respectively.


title: A Dual Reinforcement Learning Framework for Unsupervised Text Style Transfer

abstract: Unsupervised text style transfer aims to transfer the underlying style of text but keep its main content unchanged without parallel data. Most existing methods typically follow two steps: first separating the content from the original style, and then fusing the content with the desired style. However, the separation in the first step is challenging because the content and style interact in subtle ways in natural language. Therefore, in this paper, we propose a dual reinforcement learning framework to directly transfer the style of the text via a one-step mapping model, without any separation of content and style. Specifically, we consider the learning of the source-to-target and target-to-source mappings as a dual task, and two rewards are designed based on such a dual structure to reflect the style accuracy and content preservation, respectively. In this way, the two one-step mapping models can be trained via reinforcement learning, without any use of parallel data. Automatic evaluations show that our model outperforms the state-of-the-art systems by a large margin, especially with more than 8 BLEU points improvement averaged on two benchmark datasets. Human evaluations also validate the effectiveness of our model in terms of style accuracy, content preservation and fluency. Our code and data, including outputs of all baselines and our model are available at https://github.com/luofuli/DualLanST.


title: Generalizations of expansiveness in Non-Autonomous Discrete Systems

abstract: In this paper, we define and study generalizations of expansiveness, namely n- expansiveness, $\aleph_0$-expansiveness, continuum-wise expansive and meagre expansiveness for non-autonomous discrete dynamical systems. We discuss various properties of such non-autonomous systems and give necessary examples. We prove results related to non-existence of $\aleph_0$-expansive and meagre expansive non-autonomous system on certain spaces. We also study relation between $\aleph_0$-expansive and meagre-expansive non-autonomous systems.


title: A multiparameter semipositone fractional laplacian problem involving critical exponent

abstract: In this paper we prove the existence of at least one positive solution for nonlocal semipositone problem of the type $$ (P_\lambda^\mu)\left\{ \begin{array}{lll} (-\Delta)^s u&=& \lambda(u^{q}-1)+\mu u^r \mbox{ in } \Omega\\ u&>&0 \mbox{ in } \Omega\\ u&\equiv &0 \mbox{ on }{\mathbb R^N\setminus\Omega}. \end{array}\right. $$ when the positive parameters $\lambda$ and $\mu$ belongs to certain range. Here $\Omega\subset\mathbb R^N$ is assumed to be a bounded open set with smooth boundary, $s\in (0,1), N> 2s$ and $0<q<1<r\leq \frac{N+2s}{N- 2s}.$ The proof relies on the construction of a positive subsolution for $(P_\lambda^0)$ for $\lambda>\lambda_0.$ Now for each $\lambda>\lambda_0,$ for all small $0<\mu<\mu_{\lambda}$ we establish the existence of at least one positive solution of $(P_\lambda^\mu)$ using variational method. Also in the subcritical case, i.e., for $1<r<\frac{N+2s}{N-2s}$, we show the existence of second positive solution via mountain pass argument.


title: On the GWP of focusing energy-ciritical inhomogeneous NLS

abstract: We consider the focussing energy-critical inhomogeneous nonlinear Schr\"odinger equation: $$ iu_t + \Delta u + g|u|^2u = 0, u(0)= \varphi \in \dot{H}^1,\;\; 0 \le g_i \le |x|g \le g_s.$$ On the road map of Kenig-Merle \cite{km} we show the global well-posedness and scattering of radial solutions under energy condition $$E_g(\varphi) < E_g(Q),\;\;\mbox{and}\;\; g_s\|\varphi\|_{\dot{H}^1}^2 < \|Q\|_{\dot{H}^1}^2,$$ where $Q$ is the solution of $\Delta Q + |x|^{-1}Q^3 = 0$, together with scaling condition $|g(x)| + |x||\nabla g(x)| \lesssim |x|^{-1}$, variational condition $g_s(2-g_i) \le 1$, and rigidity condition $-g(x) \le x\cdot \nabla g(x)$. We also provide sharp finite time blowup results for nonradial and radial solutions. For this we utilize the localized virial identity.


title: OVSNet : Towards One-Pass Real-Time Video Object Segmentation

abstract: Video object segmentation aims at accurately segmenting the target object regions across consecutive frames. It is technically challenging for coping with complicated factors (e.g., shape deformations, occlusion and out of the lens). Recent approaches have largely solved them by using backforth re-identification and bi-directional mask propagation. However, their methods are extremely slow and only support offline inference, which in principle cannot be applied in real time. Motivated by this observation, we propose a efficient detection-based paradigm for video object segmentation. We propose an unified One-Pass Video Segmentation framework (OVS-Net) for modeling spatial-temporal representation in a unified pipeline, which seamlessly integrates object detection, object segmentation, and object re-identification. The proposed framework lends itself to one-pass inference that effectively and efficiently performs video object segmentation. Moreover, we propose a maskguided attention module for modeling the multi-scale object boundary and multi-level feature fusion. Experiments on the challenging DAVIS 2017 demonstrate the effectiveness of the proposed framework with comparable performance to the state-of-the-art, and the great efficiency about 11.5 FPS towards pioneering real-time work to our knowledge, more than 5 times faster than other state-of-the-art methods.


title: A Customised App to Attract Female Teenagers to Coding

abstract: The number of women in IT-related disciplines is far below the number of men, especially in developed countries. Middle-school girls appear to be engaged in coding courses, but when they choose academic majors relevant to their future careers, only few pursue computer science as a major. In order to show students a new way of learning and to engage them with coding activities, we used the learning app Pocket Code. In the "No One Left Behind" H2020 European project, the app was evaluated in several school subjects. An evaluation of the attractiveness of the app shows that students were motivated by Pocket Code's ease of use and its appealing design; however, girls rated the app less enthusiastically. To appeal to female teenagers in particular, a tailored version of the app "Luna&Cat" has been developed. This customised version stands in contrast to the "one size fits all" solution Pocket Code, which may discourage certain user groups. For apps to have a higher chance to appeal to a specific target group, it is, among many other points, necessary to optimise their store listing on app stores, especially as we found that app stores are the most effective way to reach teenagers. Thus, this paper covers the following research question. What customizations are necessary in Pocket Code to reinforce female teenagers in their coding activities? To answer this question, a focus group discussion was performed. This discussion first brought insights about our target group and suggested names and designs for the new app; and second, allowed each student to make proposals for their desired games. Later, these game ideas were analysed, graphically designed, and further developed together with university design students. By showing female teenagers games designed by other young women in their age group, we help them to get ideas and inspiration to code their own programs.


title: A quadrupolar generalization of the Erez-Rosen coordinates

abstract: The MSA system of coordinates [1] for the M Q-solution [2] is proved to be the unique solution of certain partial differential equation with boundary and asymptotic conditions. Such a differential equation is derived from the orthogonality condition between two surfaces which hold a functional relationship. The obtained expressions for the MSA system recover the asymptotic expansions previously calculated [1] for those coordinates, as well as the Erez-Rosen coordinates in the spherical case. It is also shown that the event horizon of the M Q-solution can be easily obtained from those coordinates leading to already known results. But in addition, it allows us to correct a mistaken conclusion related to some bound imposed to the value of the quadrupole moment [3]. Finally, it is explored the possibility of extending this method of generalizing the Erez-Rosen coordinates to the general case of solutions with any finite number of Relativistic Multipole Moments (RMM). It is discussed as well, the possibility of determining the Weyl moments of those solutions from their corresponding MSA coordinates, aiming to establish a relation between the uniqueness of the MSA coordinates and the solutions itself.


title: A note on higher spin symmetry in the IIB matrix model with the operator interpretation

abstract: We study the IIB matrix model in an interpretation where the matrices are differential operators defined on curved spacetimes. In this interpretation, coefficients of higher derivative operators formally appear to be massless higher spin fields. In this paper, we examine whether the unitary symmetry of the matrices includes appropriate higher spin gauge symmetries. We focus on fields that are bosonic and relatively simple in the viewpoint of the representation of Lorentz group. We find that the additional auxiliary fields need to be introduced in order to see the higher spin gauge symmetries explicitly. At the same time, we point out that a part of these extra fields are gauged-away, and the rest of part can be written in terms of a totally symmetric tensor field. The transformation to remove its longitudinal components exists as well. As a result, we observe that the independent physical DoF are the transverse components of that symmetric field, and that the theory describes the corresponding higher spin field. We also find that the field is not the Fronsdal field, rather the generalization of curvature.