title: Doubly robust off-policy evaluation with shrinkage

abstract: We propose a new framework for designing estimators for off-policy evaluation in contextual bandits. Our approach is based on the asymptotically optimal doubly robust estimator, but we shrink the importance weights to minimize a bound on the mean squared error, which results in a better bias-variance tradeoff in finite samples. We use this optimization-based framework to obtain three estimators: (a) a weight-clipping estimator, (b) a new weight-shrinkage estimator, and (c) the first shrinkage-based estimator for combinatorial action sets. Extensive experiments in both standard and combinatorial bandit benchmark problems show that our estimators are highly adaptive and typically outperform state-of-the-art methods.


title: Bayesian Zero-Shot Learning

abstract: Object classes that surround us have a natural tendency to emerge at varying levels of abstraction. We propose a Bayesian approach to zero-shot learning (ZSL) that introduces the notion of meta-classes and implements a Bayesian hierarchy around these classes to effectively blend data likelihood with local and global priors. Local priors driven by data from seen classes, i.e. classes that are available at training time, become instrumental in recovering unseen classes, i.e. classes that are missing at training time, in a generalized ZSL setting. Hyperparameters of the Bayesian model offer a convenient way to optimize the trade-off between seen and unseen class accuracy in addition to guiding other aspects of model fitting. We conduct experiments on seven benchmark datasets including the large scale ImageNet and show that our model improves the current state of the art in the challenging generalized ZSL setting.


title: MOCMC: Method of Characteristics Moment Closure, a Numerical Method for Covariant Radiation Magnetohydrodynamics

abstract: We present a conservative numerical method for radiation magnetohydrodynamics with frequency-dependent full transport in stationary spacetimes. This method is stable and accurate for both large and small optical depths and radiation pressures. The radiation stress-energy tensor is evolved in flux-conservative form, and closed with a swarm of samples that each transport a multigroup representation of the invariant specific intensity along a null geodesic. In each zone, the enclosed samples are used to efficiently construct a Delaunay triangulation of the unit sphere in the comoving frame, which in turn is used to calculate the Eddington tensor, average source terms, and adaptively refine the sample swarm. Radiation four-fources are evaluated in the moment sector in a semi-implicit fashion. The radiative transfer equation is solved in invariant form deterministically for each sample. Since each sample carries a discrete representation of the full spectrum, the cost of evaluating the transport operator is independent of the number of frequency groups, representing a significant reduction of algorithmic complexity for transport in frequency dependent problems. The major approximation we make in this work is performing scattering in an angle-averaged way, with Compton scattering further approximated by the Kompaneets equation. Local adaptivity in samples also makes this scheme more amenable to nonuniform meshes than a traditional Monte Carlo method. We describe the method and present results on a suite of test problems. We find that MOCMC converges at least as $\sim N^{-1}$, rather than the canonical Monte Carlo $N^{-1/2}$, where $N$ is the number of samples per zone. On several problems we demonstrate substantial improvement over Eddington and M1 closures and gray opacities.


title: On the nature of the resonant drag instability of dust streaming in protoplanetary disc

abstract: The recently discovered resonant drag instability (RDI) of dust streaming in protoplanetary disc is considered as the mode coupling of subsonic gas-dust mixture perturbations. This mode coupling is coalescence of two modes with nearly equal phase velocities: inertial wave (IW) having positive energy and a streaming dust wave (SDW) having negative energy as measured in the frame of gas environment being at rest in vertical hydrostatic equilibrium. SDW is a trivial mode produced by the bulk streaming of dust, which transports perturbations of dust density. In this way, settling combined with radial drift of the dust makes possible coupling of SDW with IW and the onset of the instability. In accordance with the concept of the mode coupling, RDI growth rate is proportional to the square root of the coupling term of the dispersion equation, which itself is proportional to mass fraction of dust, $f\ll 1$. This clarifies why RDI growth rate $\propto f^{1/2}$. When SDW has positive energy, its resonance with IW provides an avoided crossing instead of the mode coupling. In the high wavenumber limit RDI with unbounded growth rate $\propto f^{1/3}$ is explained by the triple mode coupling, which is coupling of SDW with two IW. It coexists with a new quasi-resonant instability accompanied by bonding of two oppositely propagating low-frequency IW. The mode coupling does not exist for dust streaming only radially in a disc. In this case RDI is provided by the obscured mechanism associated with the inertia of solids.


title: Infinite Orbit depth and length of Melnikov functions

abstract: In this paper we study polynomial Hamiltonian systems $dF=0$ in the plane and their small perturbations: $dF+\epsilon\omega=0$. The first nonzero Melnikov function $M_{\mu}=M_{\mu}(F,\gamma,\omega)$ of the Poincar\'e map along a loop $\gamma$ of $dF=0$ is given by an iterated integral. In a previous work (see arXiv 1703.03837), we bounded the length of the iterated integral $M_\mu$ by a geometric number $k=k(F,\gamma)$ which we call orbit depth. We conjectured that the bound is optimal. Here, we give a simple example of a Hamiltonian system $F$ and its orbit $\gamma$ having infinite orbit depth. If our conjecture is true, for this example there should exist deformations $dF+\epsilon\omega$ with arbitrary high length first nonzero Melnikov function $M_\mu$ along $\gamma$. We construct deformations $dF+\epsilon\omega=0$ whose first nonzero Melnikov function $M_\mu$ is of length three and explain the difficulties in constructing deformations having high length first nonzero Melnikov functions $M_\mu$.


title: Limit Shape of Subpartition Maximizing Partitions

abstract: This is an expository note answering a question posed to us by Richard Stanley, in which we prove a limit shape theorem for partitions of $n$ which maximize the number of subpartitions. The limit shape and the growth rate of the number of subpartitions are explicit. The key ideas are to use large deviations estimates for random walks, together with convex analysis and the Hardy-Ramanujan asymptotics. Our limit shape coincides with Vershik's limit shape for uniform random partitions.


title: Ice Spiral Patterns on the Ocean Surface

abstract: We investigate a new two-dimensional compressible Navier-Stokes hydrodynamic model design to explain and study large scale ice swirls formation at the surface of the ocean. The linearized model generates a basis of Bessel solutions from where various types of spiral patterns can be generated and their evolution and stability in time analyzed. By restricting the nonlinear system of equations to its quadratic terms we obtain swirl solutions emphasizing logarithmic spiral geometry. The resulting solutions are analyzed and validated using three mathematical approaches: one predicting the formation of patterns as Townes solitary modes, another approach mapping the nonlinear system into a sine-Gordon equation, and a third approach uses a series expansion. Pure radial, azimuthal and spiral modes are obtained from the fully nonlinear equations. Combinations of multiple-spiral solutions are also obtained, matching the experimental observations. The nonlinear stability of the spiral patterns is analyzed by Arnold's convexity method, and the Hamiltonian of the solutions is plotted versus some order parameters showing the existence of geometric phase transitions.


title: Collisional Cooling of Ultracold Molecules

abstract: Since the original work on Bose-Einstein condensation, quantum degenerate gases of atoms have allowed the quantum emulation of important systems from condensed matter and nuclear physics, as well as the study of novel many-body states with no analog in other fields of physics. Ultracold molecules in the micro- and nano-Kelvin regimes promise to bring powerful new capabilities to quantum emulation and quantum computing, thanks to their rich internal degrees of freedom compared to atoms. They also open new possibilities for precision measurement and the study of quantum chemistry. Quantum gases of atoms were made possible by collision-based cooling schemes, such as evaporative cooling. For ultracold molecules, thermalization and collisional cooling have not been realized. With other techniques such as supersonic jets and cryogenic buffer gases, studies have been limited to temperatures above 10 mK. Here we show cooling of NaLi molecules at micro- and nano-Kelvin temperatures through collisions with ultracold Na atoms, both prepared in their stretched hyperfine spin states. We find a lower bound on the elastic to inelastic collision ratio between molecules and atoms greater than 50 -- large enough to support sustained collisional cooling. By employing two stages of evaporation, we increase the phase-space density (PSD) of the molecules by a factor of 20, achieving temperatures as low as 220 nK. The favorable collisional properties of a Na and NaLi mixture show great promise for making deeply quantum degenerate dipolar molecules and suggest the potential for such cooling in other systems.


title: Analysis of Quantum Approximate Optimization Algorithm under Realistic Noise in Superconducting Qubits

abstract: The quantum approximate optimization algorithm (QAOA) is a promising quantum-classical hybrid technique to solve combinatorial optimization problems in near-term gate-based noisy quantum devices. In QAOA, the objective is a function of the quantum state, which itself is a function of the gate parameters of a multi-level parameterized quantum circuit (PQC). A classical optimizer varies the continuous gate parameters to generate distributions (quantum state) with significant support to the optimal solution. Even at the lowest circuit depth, QAOA offers non-trivial provable performance guarantee which is expected to increase with the circuit depth. However, the existing analysis fails to consider non-idealities in the qubit quality i.e., short lifetime and imperfect gate operations in realistic quantum hardware. In this article, we investigate the impact of various noise sources on the performance of QAOA both in simulation and on a real quantum computer from IBM. Our analyses indicate that the optimal number of stages (p-value) for any QAOA instance is limited by the noise characteristics (gate error, coherence time, etc.) of the target hardware as opposed to the current perception that higher-depth QAOA will provide monotonically better performance for a given problem compared to the low-depth implementations.


title: Homogenized Flux-Body Force Treatment of Compressible Viscous Porous Wall Boundary Conditions

abstract: A homogenization approach is proposed for the treatment of porous wall boundary conditions in the computation of compressible viscous flows. Like any other homogenization approach, it eliminates the need for pore-resolved fluid meshes and therefore enables practical flow simulations in computational fluid domains with porous wall boundaries. Unlike alternative approaches however, it does not require prescribing a mass flow rate and does not introduce in the computational model a heuristic discharge coefficient. Instead, it models the inviscid flux through a porous wall surrounded by the flow as a weighted average of the inviscid flux at an impermeable surface and that through pores. It also introduces a body force term in the governing equations to account for friction loss along the pore boundaries. The source term depends on the thickness of the porous wall and the concept of an equivalent single pore. The feasibility of the latter concept is demonstrated using low-speed permeability test data for the fabric of the Mars Science Laboratory parachute canopy. The overall homogenization approach is illustrated with a series of supersonic flow computations through the same fabric and verified using supersonic, pore-resolved numerical simulations.


title: Low-Variance and Zero-Variance Baselines for Extensive-Form Games

abstract: Extensive-form games (EFGs) are a common model of multi-agent interactions with imperfect information. State-of-the-art algorithms for solving these games typically perform full walks of the game tree that can prove prohibitively slow in large games. Alternatively, sampling-based methods such as Monte Carlo Counterfactual Regret Minimization walk one or more trajectories through the tree, touching only a fraction of the nodes on each iteration, at the expense of requiring more iterations to converge due to the variance of sampled values. In this paper, we extend recent work that uses baseline estimates to reduce this variance. We introduce a framework of baseline-corrected values in EFGs that generalizes the previous work. Within our framework, we propose new baseline functions that result in significantly reduced variance compared to existing techniques. We show that one particular choice of such a function --- predictive baseline --- is provably optimal under certain sampling schemes. This allows for efficient computation of zero-variance value estimates even along sampled trajectories.


title: Codensity Games for Bisimilarity

abstract: Bisimilarity as an equivalence notion of systems has been central to process theory. Due to the recent rise of interest in quantitative systems (probabilistic, weighted, hybrid, etc.), bisimilarity has been extended in various ways: notably, bisimulation metric between probabilistic systems. An important feature of bisimilarity is its game-theoretic characterization, where Spoiler and Duplicator play against each other; extension of bisimilarity games to quantitative settings has been actively pursued too. In this paper, we present a general framework that uniformly describes game characterizations of bisimilarity-like notions. Our framework is formalized categorically using fibrations and coalgebras. In particular, our characterization of bisimilarity in terms of fibrational predicate transformers allows us to derive codensity bisimilarity games: a general categorical game characterization of bisimilarity. Our framework covers known bisimilarity-like notions (such as bisimulation metric) as well as new ones (including what we call bisimulation topology).


title: The Distance from a Rank $n-1$ Projection to the Nilpotent Operators on $\mathbb{C}^n$

abstract: Building on MacDonald's formula for the distance from a rank-one projection to the set of nilpotents in $\mathbb{M}_n(\mathbb{C})$, we prove that the distance from a rank $n-1$ projection to the set of nilpotents in $\mathbb{M}_n(\mathbb{C})$ is $\frac{1}{2}\sec\left(\frac{\pi}{\frac{n}{n-1}+2}\right)$. For each $n\geq 2$, we construct examples of pairs $(Q,T)$ where $Q$ is a projection of rank $n-1$ and $T\in\mathbb{M}_n(\mathbb{C})$ is a nilpotent of minimal distance to $Q$. Furthermore, we prove that any two such pairs are unitarily equivalent. We end by discussing possible extensions of these results in the case of projections of intermediate ranks.


title: On Modeling ASR Word Confidence

abstract: We present a new method for computing ASR word confidences that effectively mitigates the effect of ASR errors for diverse downstream applications, improves the word error rate of the 1-best result, and allows better comparison of scores across different models. We propose 1) a new method for modeling word confidence using a Heterogeneous Word Confusion Network (HWCN) that addresses some key flaws in conventional Word Confusion Networks, and 2) a new score calibration method for facilitating direct comparison of scores from different models. Using a bidirectional lattice recurrent neural network to compute the confidence scores of each word in the HWCN, we show that the word sequence with the best overall confidence is more accurate than the default 1-best result of the recognizer, and that the calibration method can substantially improve the reliability of recognizer combination.


title: An Investigation into Outlier Elimination and Calculation Methods in the Determination of Reference Intervals using Serum Immunoglobulin A as a Model Data Collection

abstract: Background: Reference intervals are essential to interpret diagnostic tests, but their determination has become controversial. Methods: In this paper parametric, non-parametric and robust reference intervals with Tukey and block elimination are calculated from a dataset of over 32,000 serum immunoglobulin A (IgA) measurements. Results: The outlier elimination method was significantly more determinative of the reference intervals than the calculation method. The Tukey elimination procedure consistently eliminated significantly more values than the block method of Dixon and Reed across all age ranges. If Tukey elimination was applied, variation between reference intervals produced by the different calculation methods was minimal. Block elimination rarely eliminated values. The non-parametric reference intervals were more sensitive to outliers, which in the IgA context, led to higher and wider reference intervals for the older age groups. There were only minimal differences between robust and parametric reference intervals. Conclusions: This suggests that Tukey elimination should be preferred over the block D/R method for datasets similar to the one used in this study. These are predominantly new observations, as previous literature has focused on the calculation technique and not discussed outlier elimination. This suggests the robust method is not advantageous over the parametric method and therefore due to its complexity is not particularly useful, contrary to CLSI Guidelines.


title: Super-Planckian Radiative Heat Transfer between Metallic Surfaces Due to Near-Field and Thin-Film Effects

abstract: In this Letter we experimentally demonstrate that the radiative heat transfer between metallic planar surfaces exceeds the blackbody limit by employing the near-field and thin-film effects. Nanosized polystyrene particles were used to create a nanometer gap between aluminum thin-films of different thicknesses coated on 5x5 mm2 diced silicon chips while the gap spacing is fitted from the near-field measurement with bare Si chips. The experimental results are validated by theoretical calculation based on fluctuational electrodynamics. The near-field radiative heat flux between 13-nm Al thin-film samples at 215 nm gap distance is measured to be 6.4 times over the blackbody limit and 420 times compared to the far-field radiative heat transfer between metallic surfaces with a temperature difference of 65 K. In addition, the theoretical prediction suggests a near-field enhancement of 122 times relative to the blackbody limit and 8000 times over far-field one at 50-nm vacuum gap between 20-nm Al thin-film samples, under the same temperature difference of 65 K. This work will facilitate the understanding and application of near-field radiation to thermal power conversion, noncontact cooling, heat flow management, and optical storage where metallic materials are involved.


title: Semi-Parametric Hierarchical Bayes Estimates of New Yorkers' Willingness to Pay for Features of Shared Automated Vehicle Services

abstract: In this paper, we contrast parametric and semi-parametric representations of unobserved heterogeneity in hierarchical Bayesian multinomial logit models and leverage these methods to infer distributions of willingness to pay for features of shared automated vehicle (SAV) services. Specifically, we compare the multivariate normal (MVN), finite mixture of normals (F-MON) and Dirichlet process mixture of normals (DP-MON) mixing distributions. The latter promises to be particularly flexible in respect to the shapes it can assume and unlike other semi-parametric approaches does not require that its complexity is fixed prior to estimation. However, its properties relative to simpler mixing distributions are not well understood. In this paper, we evaluate the performance of the MVN, F-MON and DP-MON mixing distributions using simulated data and real data sourced from a stated choice study on preferences for SAV services in New York City. Our analysis shows that the DP-MON mixing distribution provides superior fit to the data and performs at least as well as the competing methods at out-of-sample prediction. The DP-MON mixing distribution also offers substantive behavioural insights into the adoption of SAVs. We find that preferences for in-vehicle travel time by SAV with ride-splitting are strongly polarised. Whereas one third of the sample is willing to pay between 10 and 80 USD/h to avoid sharing a vehicle with strangers, the remainder of the sample is either indifferent to ride-splitting or even desires it. Moreover, we estimate that new technologies such as vehicle automation and electrification are relatively unimportant to travellers. This suggests that travellers may primarily derive indirect, rather than immediate benefits from these new technologies through increases in operational efficiency and lower operating costs.


title: Light Field Super-resolution via Attention-Guided Fusion of Hybrid Lenses

abstract: This paper explores the problem of reconstructing high-resolution light field (LF) images from hybrid lenses, including a high-resolution camera surrounded by multiple low-resolution cameras. To tackle this challenge, we propose a novel end-to-end learning-based approach, which can comprehensively utilize the specific characteristics of the input from two complementary and parallel perspectives. Specifically, one module regresses a spatially consistent intermediate estimation by learning a deep multidimensional and cross-domain feature representation; the other one constructs another intermediate estimation, which maintains the high-frequency textures, by propagating the information of the high-resolution view. We finally leverage the advantages of the two intermediate estimations via the learned attention maps, leading to the final high-resolution LF image. Extensive experiments demonstrate the significant superiority of our approach over state-of-the-art ones. That is, our method not only improves the PSNR by more than 2 dB, but also preserves the LF structure much better. To the best of our knowledge, this is the first end-to-end deep learning method for reconstructing a high-resolution LF image with a hybrid input. We believe our framework could potentially decrease the cost of high-resolution LF data acquisition and also be beneficial to LF data storage and transmission. The code is available at https://github.com/jingjin25/LFhybridSR-Fusion.


title: Dilated floor functions having nonnegative commutator II. Negative dilations

abstract: This paper completes the classification of the set $S$ of all real parameter pairs $(\alpha,\beta)$ such that the dilated floor functions $f_\alpha(x) = \lfloor{\alpha x}\rfloor$, $f_\beta(x) = \lfloor{\beta x}\rfloor$ have a nonnegative commutator, i.e. $ [ f_{\alpha}, f_{\beta}](x) = \lfloor{\alpha \lfloor{\beta x}\rfloor}\rfloor - \lfloor{\beta \lfloor{\alpha x}\rfloor}\rfloor \geq 0$ for all real $x$. This paper treats the case where both dilation parameters $\alpha, \beta$ are negative. This result is equivalent to classifying all positive $\alpha, \beta$ satisfying $ \lfloor{\alpha \lceil{\beta x}\rceil}\rfloor - \lfloor{\beta \lceil{\alpha x}\rceil}\rfloor \geq 0$ for all real $x$. The classification analysis is connected with the theory of Beatty sequences and with the Diophantine Frobenius problem in two generators.


title: A Generalized Framework for Edge-preserving and Structure-preserving Image Smoothing

abstract: Image smoothing is a fundamental procedure in applications of both computer vision and graphics. The required smoothing properties can be different or even contradictive among different tasks. Nevertheless, the inherent smoothing nature of one smoothing operator is usually fixed and thus cannot meet the various requirements of different applications. In this paper, a non-convex non-smooth optimization framework is proposed to achieve diverse smoothing natures where even contradictive smoothing behaviors can be achieved. To this end, we first introduce the truncated Huber penalty function which has seldom been used in image smoothing. A robust framework is then proposed. When combined with the strong flexibility of the truncated Huber penalty function, our framework is capable of a range of applications and can outperform the state-of-the-art approaches in several tasks. In addition, an efficient numerical solution is provided and its convergence is theoretically guaranteed even the optimization framework is non-convex and non-smooth. The effectiveness and superior performance of our approach are validated through comprehensive experimental results in a range of applications.


title: Highlight Every Step: Knowledge Distillation via Collaborative Teaching

abstract: High storage and computational costs obstruct deep neural networks to be deployed on resource-constrained devices. Knowledge distillation aims to train a compact student network by transferring knowledge from a larger pre-trained teacher model. However, most existing methods on knowledge distillation ignore the valuable information among training process associated with training results. In this paper, we provide a new Collaborative Teaching Knowledge Distillation (CTKD) strategy which employs two special teachers. Specifically, one teacher trained from scratch (i.e., scratch teacher) assists the student step by step using its temporary outputs. It forces the student to approach the optimal path towards the final logits with high accuracy. The other pre-trained teacher (i.e., expert teacher) guides the student to focus on a critical region which is more useful for the task. The combination of the knowledge from two special teachers can significantly improve the performance of the student network in knowledge distillation. The results of experiments on CIFAR-10, CIFAR-100, SVHN and Tiny ImageNet datasets verify that the proposed knowledge distillation method is efficient and achieves state-of-the-art performance.


title: Hamming Polynomial of a Demimatroid

abstract: Following Britz, Johnsen, Mayhew and Shiromoto, we consider demi\-ma\-troids as a(nother) natural generalization of matroids. As they have shown, demi\-ma\-troids are the appropriate combinatorial objects for studying Wei's duality. Our results here apport further evidence about the trueness of that observation. We define the Hamming polynomial of a demimatroid $M$, denoted by $W(x,y,t)$, as a generalization of the extended Hamming weight enumerator of a matroid. The polynomial $W(x,y,t)$ is a specialization of the Tutte polynomial of $M$, and actually is equivalent to it. Guided by work of Johnsen, Roksvold and Verdure for matroids, we prove that Betti numbers of a demimatroid and its elongations determine the Hamming polynomial. Our results may be applied to simplicial complexes since in a canonical way they can be viewed as demimatroids. Furthermore, following work of Brylawski and Gordon, we show how demimatroids may be generalized one step further, to combinatroids. A combinatroid, or Brylawski structure, is an integer valued function $\rho$, defined over the power set of a finite ground set, satisfying the only condition $\rho(\emptyset)=0$. Even in this extreme generality, we will show that many concepts and invariants in coding theory can be carried on directly to combinatroids, say, Tutte polynomial, characteristic polynomial, MacWilliams identity, extended Hamming polynomial, and the $r$-th generalized Hamming polynomial; this last one, at least conjecturelly, guided by the work of Jurrius and Pellikaan for linear codes. All this largely extends the notions of deletion, contraction, duality and codes to non-matroidal structures.


title: Interstellar neutral helium in the heliosphere from IBEX observations. VI. The He$^+$ density and the ionization state in the Very Local Interstellar Matter

abstract: Interstellar neutral gas atoms penetrate the heliopause and reach 1~au, where they are detected by IBEX. The flow of neutral interstellar helium through the perturbed interstellar plasma in the outer heliosheath (OHS) results in creation of the secondary population of interstellar He atoms, the so-called Warm Breeze, due to charge exchange with perturbed ions. The secondary population brings the imprint of the OHS conditions to the IBEX-Lo instrument. Based on a global simulation of the heliosphere with measurement-based parameters and detailed kinetic simulation of the filtration of He in the OHS, we find the number density of interstellar He$^+$ population at $(8.98\pm 0.12)\times 10^{-3}$~cm$^{-3}$. With this, we obtain the absolute density of interstellar H$^+$ $5.4\times 10^{-2}$~cm$^{-3}$ and electrons $6.3\times 10^{-2}$~cm$^{-3}$, and ionization degrees of H 0.26 and He 0.37. The results agree with estimates of the Very Local Interstellar Matter parameters obtained from fitting the observed spectra of diffuse interstellar EUV and soft X-Ray background.


title: Partial regularity of harmonic maps from Alexandrov spaces

abstract: In this paper, we prove the Lipschitz regularity of continuous harmonic maps from an finite dimensional Alexandrov space to a compact smooth Riemannian manifold. This solves a conjecture of F. H. Lin in \cite{lin97}. The proof extends the argument of Huang-Wang \cite {hua-w10}.


title: Few-shot Learning for Domain-specific Fine-grained Image Classification

abstract: Learning to recognize novel visual categories from a few examples is a challenging task for machines in real-world industrial applications. In contrast, humans have the ability to discriminate even similar objects with little supervision. This paper attempts to address the few shot fine-grained image classification problem. We propose a feature fusion model to explore discriminative features by focusing on key regions. The model utilizes the focus area location mechanism to discover the perceptually similar regions among objects. High-order integration is employed to capture the interaction information among intra-parts. We also design a Center Neighbor Loss to form robust embedding space distributions. Furthermore, we build a typical fine-grained and few-shot learning dataset miniPPlankton from the real-world application in the area of marine ecological environments. Extensive experiments are carried out to validate the performance of our method. The results demonstrate that our model achieves competitive performance compared with state-of-the-art models. Our work is a valuable complement to the model domain-specific industrial applications.


title: An introduction to decentralized stochastic optimization with gradient tracking

abstract: Decentralized solutions to finite-sum minimization are of significant importance in many signal processing, control, and machine learning applications. In such settings, the data is distributed over a network of arbitrarily-connected nodes and raw data sharing is prohibitive often due to communication or privacy constraints. In this article, we review decentralized stochastic first-order optimization methods and illustrate some recent improvements based on gradient tracking and variance reduction, focusing particularly on smooth and strongly-convex objective functions. We provide intuitive illustrations of the main technical ideas as well as applications of the algorithms in the context of decentralized training of machine learning models.


title: Ascent concordance

abstract: A cobordism between links in thickened surfaces consists of a surface $ S $ and a $3$-manifold $M $, with $ S $ properly embedded in $ M \times I $. We show that there exist links in thickened surfaces such that if $(S,M) $ is a cobordism between them in which $ S $ is simple, then $ M $ must be complex. That is, there are cases in which low complexity of the surface does not imply low complexity of the $3$-manifold. Specifically, we show that there exist concordant links in thickened surfaces between which a concordance can only be realised by passing through thickenings of higher genus surfaces. We exhibit an infinite family of such links that are detected by an elementary method and other families of links that are not detectable in this way. We investigate an augmented version of Khovanov homology, and use it to detect these families. Such links provide counterexamples to an analogue of the Slice-Ribbon conjecture.


title: Fast Radio Burst dispersion measures and rotation measures and the origin of intergalactic magnetic fields

abstract: We investigate the possibility of measuring intergalactic magnetic fields using the dispersion measures and rotation measures of fast radio bursts. With Bayesian methods, we produce probability density functions for values of these measures. We distinguish between contributions from the intergalactic medium, the host galaxy and the local environment of the progenitor. To this end, we use constrained, magnetohydrodynamic simulations of the local Universe to compute lines-of-sight integrals from the position of the Milky Way. In particular, we differentiate between predominantly astrophysical and primordial origins of magnetic fields in the intergalactic medium. We test different possible types of host galaxies and probe different distribution functions of fast radio burst progenitor locations inside the host galaxy. Under the assumption that fast radio bursts are produced by magnetars, we use analytic predictions to account for the contribution of the local environment. We find that less than 100 fast radio bursts from magnetars in stellar-wind environments hosted by starburst dwarf galaxies at redshift $z \gtrsim 0.5$ suffice to discriminate between predominantly primordial and astrophysical origins of intergalactic magnetic fields. However, this requires the contribution of the Milky Way to be removed with a precision of $\approx 1 \rm~rad~m^{-2}$. We show the potential existence of a subset of fast radio bursts whose rotation measure carry information on the strength of the intergalactic magnetic field and its origins.

categories: astro-ph.CO astro-ph.GA astro-ph.HE astro-ph.IM


title: Integrating Travel Demand and Network Modelling: a Myth or Future of Transport Modelling

abstract: In this paper, a novel transport planning model system (TPMS) is formulated which is built on the concepts of supernetworks, multi-modality, integrity and calibration. In the proposed formulation, activity travel pattern (ATP) choice facets including the choices of activity, activity sequence, mode, departure time, and parking location, are all unified into a time-dependent supernetwork. The proposed model accounts for the dynamicity of the network, including time-of-day and congestion effects. These help capturing the interdependencies among all different attributes of a full transport planning system. Moreover, the proposed TPMS explicitly formulates an operating capacitated public transport system. To allow visiting locations multiple times and to alleviate the complexity of the proposed supernetwork, a novel multi-visit vehicle routing problem is proposed which does not enumerate the node and link visits. In order to calibrate the model based on the major travel attributes of the travel survey data, a set of splitting ratios are introduced to distribute trips on the supernetwork. The model uses the splitting ratios to integrate the supernetwork and the traffic assignment model in a unified TPMS structure. At last, numerical examples are provided to demonstrate the advantages of the proposed approach.


title: Off-policy Learning for Multiple Loggers

abstract: It is well known that the historical logs are used for evaluating and learning policies in interactive systems, e.g. recommendation, search, and online advertising. Since direct online policy learning usually harms user experiences, it is more crucial to apply off-policy learning in real-world applications instead. Though there have been some existing works, most are focusing on learning with one single historical policy. However, in practice, usually a number of parallel experiments, e.g. multiple AB tests, are performed simultaneously. To make full use of such historical data, learning policies from multiple loggers becomes necessary. Motivated by this, in this paper, we investigate off-policy learning when the training data coming from multiple historical policies. Specifically, policies, e.g. neural networks, can be learned directly from multi-logger data, with counterfactual estimators. In order to understand the generalization ability of such estimator better, we conduct generalization error analysis for the empirical risk minimization problem. We then introduce the generalization error bound as the new risk function, which can be reduced to a constrained optimization problem. Finally, we give the corresponding learning algorithm for the new constrained problem, where we can appeal to the minimax problems to control the constraints. Extensive experiments on benchmark datasets demonstrate that the proposed methods achieve better performances than the state-of-the-arts.


title: GA-DAN: Geometry-Aware Domain Adaptation Network for Scene Text Detection and Recognition

abstract: Recent adversarial learning research has achieved very impressive progress for modelling cross-domain data shifts in appearance space but its counterpart in modelling cross-domain shifts in geometry space lags far behind. This paper presents an innovative Geometry-Aware Domain Adaptation Network (GA-DAN) that is capable of modelling cross-domain shifts concurrently in both geometry space and appearance space and realistically converting images across domains with very different characteristics. In the proposed GA-DAN, a novel multi-modal spatial learning technique is designed which converts a source-domain image into multiple images of different spatial views as in the target domain. A new disentangled cycle-consistency loss is introduced which balances the cycle consistency in appearance and geometry spaces and improves the learning of the whole network greatly. The proposed GA-DAN has been evaluated for the classic scene text detection and recognition tasks, and experiments show that the domain-adapted images achieve superior scene text detection and recognition performance while applied to network training.


title: Lagrangian cobordisms and Legendrian invariants in knot Floer homology

abstract: We prove that the LOSS and GRID invariants of Legendrian links in knot Floer homology behave in certain functorial ways with respect to decomposable Lagrangian cobordisms in the symplectization of the standard contact structure on $\mathbb{R}^3$. Our results give new, computable, and effective obstructions to the existence of such cobordisms.


title: Energy-Efficient Hybrid Precoding for Massive MIMO mmWave Systems With a Fully-Adaptive-Connected Structure

abstract: This paper investigates the hybrid precoding design in millimeter-wave (mmWave) systems with a fully-adaptive-connected precoding structure, where a switch-controlled connection is deployed between every antenna and every radio frequency (RF) chain. To maximally enhance the energy efficiency (EE) of hybrid precoding under this structure, the joint optimization of switch-controlled connections and the hybrid precoders is formulated as a large-scale mixed-integer non-convex problem with high-dimensional power constraints. To efficiently solve such a challenging problem, we first decouple it into a continuous hybrid precoding (CHP) subproblem. Then, with the hybrid precoder obtained from the CHP subproblem, the original problem can be equivalently reformulated as a discrete connection-state (DCS) problem with only 0-1 integer variables. For the CHP subproblem, we propose an alternating hybrid precoding (AHP) algorithm. Then, with the hybrid precoder provided by the AHP algorithm, we develop a matching assisted fully-adaptive hybrid precoding (MA-FAHP) algorithm to solve the DCS problem. It is theoretically shown that the proposed MA-FAHP algorithm always converges to a stable solution with the polynomial complexity. Finally, simulation results demonstrate that the superior performance of the proposed MA-FAHP algorithm in terms of EE and beampattern.


title: Grasping Using Tactile Sensing and Deep Calibration

abstract: Tactile perception is an essential ability of intelligent robots in interaction with their surrounding environments. This perception as an intermediate level acts between sensation and action and has to be defined properly to generate suitable action in response to sensed data. In this paper, we propose a feedback approach to address robot grasping task using force-torque tactile sensing. While visual perception is an essential part for gross reaching, constant utilization of this sensing modality can negatively affect the grasping process with overwhelming computation. In such case, human being utilizes tactile sensing to interact with objects. Inspired by, the proposed approach is presented and evaluated on a real robot to demonstrate the effectiveness of the suggested framework. Moreover, we utilize a deep learning framework called Deep Calibration in order to eliminate the effect of bias in the collected data from the robot sensors.


title: Efficient Knowledge Graph Accuracy Evaluation

abstract: Estimation of the accuracy of a large-scale knowledge graph (KG) often requires humans to annotate samples from the graph. How to obtain statistically meaningful estimates for accuracy evaluation while keeping human annotation costs low is a problem critical to the development cycle of a KG and its practical applications. Surprisingly, this challenging problem has largely been ignored in prior research. To address the problem, this paper proposes an efficient sampling and evaluation framework, which aims to provide quality accuracy evaluation with strong statistical guarantee while minimizing human efforts. Motivated by the properties of the annotation cost function observed in practice, we propose the use of cluster sampling to reduce the overall cost. We further apply weighted and two-stage sampling as well as stratification for better sampling designs. We also extend our framework to enable efficient incremental evaluation on evolving KG, introducing two solutions based on stratified sampling and a weighted variant of reservoir sampling. Extensive experiments on real-world datasets demonstrate the effectiveness and efficiency of our proposed solution. Compared to baseline approaches, our best solutions can provide up to 60% cost reduction on static KG evaluation and up to 80% cost reduction on evolving KG evaluation, without loss of evaluation quality.


title: Make Skeleton-based Action Recognition Model Smaller, Faster and Better

abstract: Although skeleton-based action recognition has achieved great success in recent years, most of the existing methods may suffer from a large model size and slow execution speed. To alleviate this issue, we analyze skeleton sequence properties to propose a Double-feature Double-motion Network (DD-Net) for skeleton-based action recognition. By using a lightweight network structure (i.e., 0.15 million parameters), DD-Net can reach a super fast speed, as 3,500 FPS on one GPU, or, 2,000 FPS on one CPU. By employing robust features, DD-Net achieves the state-of-the-art performance on our experimental datasets: SHREC (i.e., hand actions) and JHMDB (i.e., body actions). Our code will be released with this paper later.


title: Enhancing the Discriminative Feature Learning for Visible-Thermal Cross-Modality Person Re-Identification

abstract: Existing person re-identification has achieved great progress in the visible domain, capturing all the person images with visible cameras. However, in a 24-hour intelligent surveillance system, the visible cameras may be noneffective at night. In this situation, thermal cameras are the best supplemental components, which capture images without depending on visible light. Therefore, in this paper, we investigate the visible-thermal cross-modality person re-identification (VT Re-ID) problem. In VT Re-ID, there are two knotty problems should be well handled, cross-modality discrepancy and intra-modality variations. To address these two issues, we propose focusing on enhancing the discriminative feature learning (EDFL) with two extreme simple means from two core aspects, (1) skip-connection for mid-level features incorporation to improve the person features with more discriminability and robustness, and (2) dual-modality triplet loss to guide the training procedures by simultaneously considering the cross-modality discrepancy and intra-modality variations. Additionally, the two-stream CNN structure is adopted to learn the multi-modality sharable person features. The experimental results on two datasets show that our proposed EDFL approach distinctly outperforms state-of-the-art methods by large margins, demonstrating the effectiveness of our EDFL to enhance the discriminative feature learning for VT Re-ID.


title: The pointwise H\"older spectrum of general self-affine functions on an interval

abstract: This paper gives the pointwise H\"older (or multifractal) spectrum of continuous functions on the interval $[0,1]$ whose graph is the attractor of an iterated function system consisting of $r\geq 2$ affine maps on $\mathbb{R}^2$. These functions satisfy a functional equation of the form $\phi(a_k x+b_k)=c_k x+d_k\phi(x)+e_k$, for $k=1,2,\dots,r$ and $x\in[0,1]$. They include the Takagi function, the Riesz-Nagy singular functions, Okamoto's functions, and many other well-known examples. It is shown that the multifractal spectrum of $\phi$ is given by the multifractal formalism when $|d_k|\geq |a_k|$ for at least one $k$, but the multifractal formalism may fail otherwise, depending on the relationship between the shear parameters $c_k$ and the other parameters. In the special case when $a_k>0$ for every $k$, an exact expression is derived for the pointwise H\"older exponent at any point. These results extend recent work by the author [Adv. Math. 328 (2018), 1-39] and S. Dubuc [Expo. Math. 36 (2018), 119-142].


title: Asymmetric delay attack on an entanglement-based bidirectional clock synchronization protocol

abstract: We demonstrate an attack on a clock synchronization protocol that attempts to detect tampering of the synchronization channel using polarization-entangled photon pairs. The protocol relies on a symmetrical channel, where propagation delays do not depend on propagation direction, for correctly deducing the offset between clocks -- a condition that could be manipulated with optical circulators, which rely on static magnetic fields to break the reciprocity of propagating electromagnetic fields. Despite the polarization transformation induced within a set of circulators, our attack creates an error in time synchronization while successfully evading detection.


title: A correction to the paper "On Curves with Split Jacobian"

abstract: In [5], without giving a detailed proof, Yamauchi provided a formula to calculate the genus of a certain family of smooth complete intersection algebraic curves. That formula is used extensively in [1] to study the algebraic curves for which their Jacobian has superelliptic components. In this note, we determine the correct version of the genus formula with an algebraic proof. Then, we show that the formula given in [5] works only under certain conditions.


title: Uniform Decay Estimates for Solutions of a Class of Retarded Integral Inequalities

abstract: Some uniform decay estimates are established for solutions of the following type of retarded integral inequalities: $$y(t)\leq E(t,\tau)||y_\tau||+\int_\tau^t K_1(t,s)||y_s||ds+\int_t^\infty K_2(t,s)||y_s||ds+\rho, \hspace{0.5cm} t\geq\tau\geq 0.$$ As a simple example of application, the retarded scalar functional differential equation $\dot x=-a(t)x+B(t,x_t)$ is considered, and the global asymptotic stability of the equation is proved under weaker conditions. Another example is the ODE system $\dot x=F_0(t,x)+\sum_{i=1}^m F_i(t,x(t-r_i(t)))$ on $R^n$ with superlinear nonlinearities $F_i$ ($0\leq i\leq m$). The existence of a global pullback attractor of the system is established under appropriate dissipation conditions. The third example for application concerns the study of the dynamics of the functional cocycle system $\frac{du}{dt}+Au=F(\theta_tp,u_t)$ in a Banach space $X$ with sublinear nonlinearity. In particular, the existence and uniqueness of a nonautonomous stationary solution $\Gamma$ is obtained under the hyperbolicity assumption on operator $A$ and some additional hypotheses, and the global asymptotic stability of $\Gamma$ is also addressed.


title: Autonomous Probabilistic Coprocessing with Petaflips per Second

abstract: In this paper we present a concrete design for a probabilistic (p-) computer based on a network of p-bits, robust classical entities fluctuating between -1 and +1, with probabilities that are controlled through an input constructed from the outputs of other p-bits. The architecture of this probabilistic computer is similar to a stochastic neural network with the p-bit playing the role of a binary stochastic neuron, but with one key difference: there is no sequencer used to enforce an ordering of p-bit updates, as is typically required. Instead, we explore \textit{sequencerless} designs where all p-bits are allowed to flip autonomously and demonstrate that such designs can allow ultrafast operation unconstrained by available clock speeds without compromising the solution's fidelity. Based on experimental results from a hardware benchmark of the autonomous design and benchmarked device models, we project that a nanomagnetic implementation can scale to achieve petaflips per second with millions of neurons. A key contribution of this paper is the focus on a hardware metric $-$ flips per second $-$ as a problem and substrate-independent figure-of-merit for an emerging class of hardware annealers known as Ising Machines. Much like the shrinking feature sizes of transistors that have continually driven Moore's Law, we believe that flips per second can be continually improved in later technology generations of a wide class of probabilistic, domain specific hardware.


title: Compact Global Descriptor for Neural Networks

abstract: Long-range dependencies modeling, widely used in capturing spatiotemporal correlation, has shown to be effective in CNN dominated computer vision tasks. Yet neither stacks of convolutional operations to enlarge receptive fields nor recent nonlocal modules is computationally efficient. In this paper, we present a generic family of lightweight global descriptors for modeling the interactions between positions across different dimensions (e.g., channels, frames). This descriptor enables subsequent convolutions to access the informative global features with negligible computational complexity and parameters. Benchmark experiments show that the proposed method can complete state-of-the-art long-range mechanisms with a significant reduction in extra computing cost. Code available at https://github.com/HolmesShuan/Compact-Global-Descriptor.


title: Smash Products for Non-cartesian Internal Prestacks

abstract: The smash product construction (or the Grothendieck construction) takes a functor (or prestack) $F \colon B^{op} \to \mathbf{Cat}$ and returns a fibration $p \colon A \to B$. In this paper, we develop an analogue of the smash product for prestacks internal to a non-cartesian monoidal category. Our construction simultaneously generalizes the Grothendieck construction for prestacks and smash products for $B$-module algebras over a bialgebra $B$. Further, taking fibers or coinvariants allows one to recover the original prestack.


title: Algebro-Geometric Finite Gap Solutions to the Korteweg--de Vries Equation as Primitive Solutions

abstract: In this paper we show that all algebro-geometric finite gap solutions to the Korteweg--de Vries equation can be realized as a limit of N-soliton solutions as N diverges to infinity (see remark 1 for the precise meaning of this statement). This is done using the the primitive solution framework initiated by [5,28,31]. One implication of this result is that the N-soliton solutions can approximate any bounded periodic solution to the Korteweg--de Vries equation arbitrarily well in the limit as N diverges to infinity. We also study primitive solutions numerically that have the same spectral properties as the algebro-geometric finite gap solutions but are not algebro-geometric solutions.


title: Efficient Approximation Algorithms for Adaptive Seed Minimization

abstract: As a dual problem of influence maximization, the seed minimization problem asks for the minimum number of seed nodes to influence a required number $\eta$ of users in a given social network $G$. Existing algorithms for seed minimization mostly consider the non-adaptive setting, where all seed nodes are selected in one batch without observing how they may influence other users. In this paper, we study seed minimization in the adaptive setting, where the seed nodes are selected in several batches, such that the choice of a batch may exploit information about the actual influence of the previous batches. We propose a novel algorithm, ASTI, which addresses the adaptive seed minimization problem in $O\Big(\frac{\eta \cdot (m+n)}{\varepsilon^2}\ln n \Big)$ expected time and offers an approximation guarantee of $\frac{(\ln \eta+1)^2}{(1 - (1-1/b)^b) (1-1/e)(1-\varepsilon)}$ in expectation, where $\eta$ is the targeted number of influenced nodes, $b$ is size of each seed node batch, and $\varepsilon \in (0, 1)$ is a user-specified parameter. To the best of our knowledge, ASTI is the first algorithm that provides such an approximation guarantee without incurring prohibitive computation overhead. With extensive experiments on a variety of datasets, we demonstrate the effectiveness and efficiency of ASTI over competing methods.


title: EmotionX-HSU: Adopting Pre-trained BERT for Emotion Classification

abstract: This paper describes our approach to the EmotionX-2019, the shared task of SocialNLP 2019. To detect emotion for each utterance of two datasets from the TV show Friends and Facebook chat log EmotionPush, we propose two-step deep learning based methodology: (i) encode each of the utterance into a sequence of vectors that represent its meaning; and (ii) use a simply softmax classifier to predict one of the emotions amongst four candidates that an utterance may carry. Notice that the source of labeled utterances is not rich, we utilise a well-trained model, known as BERT, to transfer part of the knowledge learned from a large amount of corpus to our model. We then focus on fine-tuning our model until it well fits to the in-domain data. The performance of the proposed model is evaluated by micro-F1 scores, i.e., 79.1% and 86.2% for the testsets of Friends and EmotionPush, respectively. Our model ranks 3rd among 11 submissions.


title: Deformable Registration Using Average Geometric Transformations for Brain MR Images

abstract: Accurate registration of medical images is vital for doctor's diagnosis and quantitative analysis. In this paper, we propose a new deformable medical image registration method based on average geometric transformations and VoxelMorph CNN architecture. We compute the differential geometric information including Jacobian determinant(JD) and the curl vector(CV) of diffeomorphic registration field and use them as multi-channel of VoxelMorph CNN for second train. In addition, we use the average transformation to construct a standard brain MRI atlas which can be used as fixed image. We verify our method on two datasets including ADNI dataset and MRBrainS18 Challenge dataset, and obtain excellent improvement on MR image registration with average Dice scores and non-negative Jacobian locations compared with MIT's original method. The experimental results show the method can achieve better performance in brain MRI diagnosis.


title: Pre-Learning Environment Representations for Data-Efficient Neural Instruction Following

abstract: We consider the problem of learning to map from natural language instructions to state transitions (actions) in a data-efficient manner. Our method takes inspiration from the idea that it should be easier to ground language to concepts that have already been formed through pre-linguistic observation. We augment a baseline instruction-following learner with an initial environment-learning phase that uses observations of language-free state transitions to induce a suitable latent representation of actions before processing the instruction-following training data. We show that mapping to pre-learned representations substantially improves performance over systems whose representations are learned from limited instructional data alone.


title: Tunable Coupling between Surface States of a Three-Dimensional Topological Insulator in the Quantum Hall Regime

abstract: The paired top and bottom Dirac surface states, each associated with a half-integer quantum Hall (QH) effect, and a resultant integer QH conductance ({\nu}e2/h), are hallmarks of a three-dimensional (3D) topological insulator (TI). In a dual-gated system, chemical potentials of the paired surface states are controlled through separate gates. In this work, we establish tunable capacitive coupling between the surface states of a bulk-insulating TI BiSbTeSe2 and study the effect of this coupling on QH plateaus and Landau level (LL) fan diagram via dual-gate control. We observe non-linear QH transitions at low charge density in strongly-coupled surface states, which are related to the charge-density-dependent coupling strength. A splitting of the N= 0 LL at the charge neutrality point for thin devices (but thicker than the 2D limit) indicates inter-surface hybridization possibly beyond single-particle effects. By applying capacitor charging models to the surface states, we explore their chemical potential as a function of charge density and extract the fundamental electronic quantity of LL energy gaps from dual-gated transport and capacitance measurements. These studies are essential for the realization of exotic quantum effects such as topological exciton condensation.


title: Multilevel Monte-Carlo for Solving POMDPs Online

abstract: Planning under partial obervability is essential for autonomous robots. A principled way to address such planning problems is the Partially Observable Markov Decision Process (POMDP). Although solving POMDPs is computationally intractable, substantial advancements have been achieved in developing approximate POMDP solvers in the past two decades. However, computing robust solutions for systems with complex dynamics remain challenging. Most on-line solvers rely on a large number of forward-simulations and standard Monte-Carlo methods to compute the expected outcomes of actions the robot can perform. For systems with complex dynamics, e.g., those with non-linear dynamics that admit no closed form solution, even a single forward simulation can be prohibitively expensive. Of course, this issue exacerbates for problems with long planning horizons. This paper aims to alleviate the above difficulty. To this end, we propose a new on-line POMDP solver, called Multilevel POMDP Planner (MLPP), that combines the commonly known Monte-Carlo-Tree-Search with the concept of Multilevel Monte-Carlo to speed-up our capability in generating approximately optimal solutions for POMDPs with complex dynamics. Experiments on four different problems of POMDP-based torque control, navigation and grasping indicate that MLPP substantially outperforms state-of-the-art POMDP solvers.


title: Locally Adaptive Scheduling Policy for Optimizing Information Freshness in Wireless Networks

abstract: Optimization of information freshness in wireless networks has usually been performed based on queueing analysis that captures only the temporal traffic dynamics associated with the transmitters and receivers. However, the effect of interference, which is mainly dominated by the interferers' geographic locations, is not well understood. In this paper, we leverage a spatiotemporal model, which allows one to characterize the age of information (AoI) from a joint queueing-geometry perspective, and design a decentralized scheduling policy that exploits local observation to make transmission decisions that minimize the AoI. Simulations results reveal that the proposed scheme not just largely reduces the peak AoI but also scales well with the network size.


title: Magnetotransport properties of granular oxide-segregated CoPtCr films for applications in future magnetic memory technology

abstract: Magnetotransport properties of granular oxide-segregated CoPtCr films were studied on both macroscopic and microscopic length scales by performing bulk and point-contact magnetoresistance measurements, respectively. Such a perpendicular magnetic medium is used in state-of-the-art hard disc drives and if combined with magnetoresistive phenomena (for read/write operations) may lead to a novel concept for magnetic recording with high areal density. While the bulk measurements on the films showed only small variations in dc resistance as a function of applied magnetic field (magnetoresistance of less than 0.02 %), the point-contact measurements revealed giant-magnetoresistance-like changes in resistance with up to 50,000 % ratios. The observed magnetorestive effect could be attributed to a tunnel magnetoresistance between CoPtCr grains with different coercivity. The tunneling picture of electronic transport in our granular medium was confirmed by the observation of tunneling-like current-voltage characteristics and bias dependence of magnetoresistance; both the point-contact resistance and magnetoresistance were found to decrease with the applied dc bias.


title: Black holes in new massive conformal gravity

abstract: We investigate the black holes in the new massive conformal gravity which is not invariant under conformal transformations because of the presence of the Einstein-Hilbert term. First, we show that the small Schwarzschild black hole is unstable against the $s$-mode of linearized Ricci tensor by solving the Lichnerowicz-Ricci tensor equation. This instability induces the appearance of the non-BBMB (Bocharova-Bronnikov-Melnikov-Bekenstein) black hole that has both Ricci tensor and conformal scalar hair.


title: Photoemission and Dynamical Mean Field Theory Study of Electronic Correlation in a $t_{2g}^{5}$ Metal of SrRhO$_{3}$ Thin Film

abstract: Perovskite rhodates are characterized by intermediate strengths of both electronic correlation as well as spin-orbit coupling (SOC) and usually behave as moderately correlated metals. A recent publication (Phys. Rev. B 95, 245121(2017)) on epitaxial SrRhO$_3$ thin films unexpectedly reported a bad-metallic behavior and suggested the occurrence of antiferromagnetism below 100 K. We studied this SrRhO$_3$ thin film by hard x-ray photoemission spectroscopy and found a very small density of states (DOS) at Fermi level, which is consistent with the reported bad-metallic behavior. However, this negligible DOS persists up to room temperature, which contradicts with the explanation of antiferromagnetic transition at around 100 K. We also employed electronic structure calculations within the framework of density functional theory and dynamical mean-field theory. In contrast to the experimental results, our calculations indicate metallic behavior of both bulk SrRhO$_3$ and the SrRhO$_3$ thin film. The thin film exhibits stronger correlation effects than the bulk, but the correlation effects are not sufficient to drive a transition to an insulating state. The calculated uniform magnetic susceptibility is substantially larger in the thin film than that in the bulk. The role of SOC was also investigated and only a moderate modulation of the electronic structure was observed. Hence SOC is not expected to play an important role for electronic correlation in SrRhO$_3$.


title: Continuity of Subharmonic Functions

abstract: We prove that the set of points where a subharmonic function fails to be continuous is polar.


title: Effortless Deep Training for Traffic Sign Detection Using Templates and Arbitrary Natural Images

abstract: Deep learning has been successfully applied to several problems related to autonomous driving. Often, these solutions rely on large networks that require databases of real image samples of the problem (i.e., real world) for proper training. The acquisition of such real-world data sets is not always possible in the autonomous driving context, and sometimes their annotation is not feasible (e.g., takes too long or is too expensive). Moreover, in many tasks, there is an intrinsic data imbalance that most learning-based methods struggle to cope with. It turns out that traffic sign detection is a problem in which these three issues are seen altogether. In this work, we propose a novel database generation method that requires only (i) arbitrary natural images, i.e., requires no real image from the domain of interest, and (ii) templates of the traffic signs, i.e., templates synthetically created to illustrate the appearance of the category of a traffic sign. The effortlessly generated training database is shown to be effective for the training of a deep detector (such as Faster R-CNN) on German traffic signs, achieving 95.66% of mAP on average. In addition, the proposed method is able to detect traffic signs with an average precision, recall and F1-score of about 94%, 91% and 93%, respectively. The experiments surprisingly show that detectors can be trained with simple data generation methods and without problem domain data for the background, which is in the opposite direction of the common sense for deep learning.


title: Prediction of H$\alpha$ and [OIII] Emission Line Galaxy Number Counts for Future Galaxy Redshift Surveys

abstract: We perform a simulation with Galacticus, a semi-analytical galaxy formation model, to predict the number counts of H$\alpha$ and [OIII] emitting galaxies. With a state-of-the-art N-body simulation, UNIT, we first calibrate Galacticus with the current observation of H$\alpha$ luminosity function. The resulting model coupled with a dust attenuation model, can reproduce the current observations, including the H$\alpha$ luminosity function from HiZELS and number density from WISP. We extrapolate the model prediction to higher redshift and the result is found to be consistent with previous investigations. We then use the same galaxy formation model to predict the number counts for [OIII] emitting galaxies. The result provides further validation of our galaxy formation model and dust model. We present number counts of H$\alpha$ and [OIII] emission line galaxies for three different line flux limits: $5\times10^{-17}$erg/s/cm$^{2}$, $1\times10^{-16}$erg/s/cm$^{2}$ (6.5$\sigma$ nominal depth for WFIRST GRS), and $2\times10^{-16}$erg/s/cm$^{2}$ (3.5$\sigma$ depth of Euclid GRS). At redshift $2<z<3$, our model predicts that WFIRST can observe hundreds of [OIII] emission line galaxies per square degree with a line flux limit of $1\times10^{-16}$erg/s/cm$^{2}$. This will provide accurate measurement of large scale structure to probe dark energy over a huge cosmic volume to an unprecedented high redshift. Finally, we compare the flux ratio of H$\alpha$/[OIII] within the redshift range of $0<z<3$. Our results show the known trend of increasing H$\alpha$/[O III] flux ratio with H$\alpha$ flux at low redshift, which becomes a weaker trend at higher redshifts.


title: A Demazure Character Formula for the Product Monomial Crystal

abstract: The product monomial crystal was defined by Kamnitzer, Tingley, Webster, Weekes, and Yacobi for any semisimple simply-laced Lie algebra $\mathfrak{g}$, and depends on a collection of parameters $\mathbf{R}$. We show that a family of truncations of this crystal are Demazure crystals, and give a Demazure-type formula for the character of each truncation, and the crystal itself. This character formula shows that the product monomial crystal is the crystal of a generalised Demazure module, as defined by Lakshmibai, Littelmann and Magyar. In type $A$, we show the product monomial crystal is the crystal of a generalised Schur module associated to a column-convex diagram depending on $\mathbf{R}$.


title: Similarity-Preserving Knowledge Distillation

abstract: Knowledge distillation is a widely applicable technique for training a student neural network under the guidance of a trained teacher network. For example, in neural network compression, a high-capacity teacher is distilled to train a compact student; in privileged learning, a teacher trained with privileged data is distilled to train a student without access to that data. The distillation loss determines how a teacher's knowledge is captured and transferred to the student. In this paper, we propose a new form of knowledge distillation loss that is inspired by the observation that semantically similar inputs tend to elicit similar activation patterns in a trained network. Similarity-preserving knowledge distillation guides the training of a student network such that input pairs that produce similar (dissimilar) activations in the teacher network produce similar (dissimilar) activations in the student network. In contrast to previous distillation methods, the student is not required to mimic the representation space of the teacher, but rather to preserve the pairwise similarities in its own representation space. Experiments on three public datasets demonstrate the potential of our approach.


title: Long-term variations of Venus' 365-nm albedo observed by Venus Express, Akatsuki, MESSENGER, and Hubble Space Telescope

abstract: An unknown absorber near the cloud top level of Venus generates a broad absorption feature from the ultraviolet (UV) to visible, peaking around 360 nm, and therefore plays a critical role in the solar energy absorption. We present a quantitative study on the variability of the cloud albedo at 365 nm and its impact on Venus' solar heating rates based on an analysis of Venus Express and Akatsuki's UV images, and Hubble Space Telescope and MESSENGER's UV spectral data; in this analysis the calibration correction factor of the UV images of Venus Express (VMC) is updated relative to the Hubble and MESSENGER albedo measurements. Our results indicate that the 365-nm albedo varied by a factor of 2 from 2006 to 2017 over the entire planet, producing a 25-40% change in the low latitude solar heating rate according to our radiative transfer calculations. Thus, the cloud top level atmosphere should have experienced considerable solar heating variations over this period. Our global circulation model calculations show that this variable solar heating rate may explain the observed variations of zonal wind from 2006 to 2017. Overlaps in the timescale of the long-term UV albedo and the solar activity variations make it plausible that solar extreme UV intensity and cosmic-ray variations influenced the observed albedo trends. The albedo variations might also be linked with temporal variations of the upper cloud SO2 gas abundance, which affects the H2SO4-H2O aerosol formation.


title: Pseudo-Nambu-Goldstone dark matter and two-Higgs-doublet models

abstract: We study a dark matter model with one singlet complex scalar and two Higgs doublets. The scalar potential respects a softly broken global symmetry, which makes the imaginary part of the singlet become a pseudo-Nambu-Goldstone boson acting as a dark matter candidate. The pseudo-Nambu-Goldstone nature of the boson leads to the vanishing of its tree-level scattering amplitude off nucleons at zero momentum transfer. Therefore, although the interaction strength could be sufficiently large to yield a viable relic abundance via thermal mechanism, direct detection is incapable of probing this candidate. We further investigate the constraints from Higgs measurements, relic abundance observation, and indirect detection.


title: Multiscale modelling of microscale heterogeneous systems: analysis supports systematic and efficient macroscale modelling and simulation

abstract: These are lecture notes for five sessions in the AMSI Winter School on 'Computational Modelling of Heterogeneous Media' held at QUT in July 2019 [https://ws.amsi.org.au/]. Aim: Discuss a mix of new mathematical approaches for multiscale modelling, heterogeneous material in particular, along with corresponding novel computational techniques and issues. I include discussion of a developing toolbox that empowers you to implement effective multiscale `equation-free' computation [https://github.com/uoa1184615/EquationFreeGit.git].


title: A formula for systems of Boolean polynomial equations and applications to computational complexity

abstract: It is known a method for converting a system of Boolean polynomial equations to a single Boolean polynomial equation with less variables. In this paper, we show a formula for systems of Boolean polynomial equations which is based on the method. The formula has a structure of binary tree, and conforms to De Morgan's duality. Using the formula, we prove a computational complexity result with a parameter for solving systems. The parameter is the bandwidth in matrix and graph theories: to be precise, the definition follows convention in matrix and the value depends on the order of variables. We also apply the result to the NP-complete problems, SAT and graph list-coloring, to show that these problems are fixed parameter tractable by bandwidth.


title: Inductive dimensions of coarse proximity spaces

abstract: In this paper, we generalize Dranishnikov's asymptotic inductive dimension to the setting of coarse proximity spaces. We show that in this more general context, the asymptotic inductive dimension of a coarse proximity space is bigger or equal to the inductive dimension of its boundary, and consequently may be strictly bigger than the covering dimension of the boundary. We also give a condition, called complete traceability, on the boundary of the coarse proximity space under which the asymptotic inductive dimension of a coarse proximity space and the inductive dimension of its boundary coincide. Finally, we show that spaces whose boundaries are $Z$-sets and spaces admitting metrizable compactifications have completely traceable boundaries.


title: Explaining Retrocausality Phenomena in Quantum Mechanics using a Modified Variational Principle

abstract: A modified lagrangian with causal and retrocausal momenta was used to derive a first causal wave equation and a second retrocausal wave equation using the principle of least action. The retrocausal wave function obtained through this method was found to be equivalent to the complex conjugate of the causal wave function, thus leading to the conclusion that a retrocausal effect is already implicit in quantum mechanics through the means of complex conjugation of the wave function when computing the probability density for a particle. Lastly, the same variational principle was employed with a fractionary langriangian, (that is, containing fractional Riemann derivatives) to obtain a pair of modified wave equations, one causal and other retrocausal, both of which correspond to the differential equation of a damped oscillator in the free particle (potential energy V=0) case. The solutions of this damped wave equations remain to be explored.


title: Non-commutative disintegrations: existence and uniqueness in finite dimensions

abstract: Motivated by advances in categorical probability, we introduce non-commutative almost everywhere (a.e.) equivalence and disintegrations in the setting of C*-algebras. We show that C*-algebras (resp. W*-algebras) and a.e. equivalence classes of 2-positive (resp. positive) unital maps form a category. We prove non-commutative disintegrations are a.e. unique whenever they exist. We provide an explicit characterization for when disintegrations exist in the setting of finite-dimensional C*-algebras, and we give formulas for the associated disintegrations.


title: Ghostfree quadratic curvature theories with massive spin-2 and spin-0 particles

abstract: We consider generic derivative corrections to the Einstein gravity and find new classes of theories without ghost around the Minkowski background by means of an extension of the spacetime geometry. We assume the Riemann-Cartan geometry, i.e. a geometry with a non-vanishing torsion, and consider all possible terms in the Lagrangian up to scaling dimension four. We first clarify the number, spins, and parities of all particle species around the Minkowski background and find that some of those particle species are ghosts for generic choices of parameters. For special choices of the parameters, on the other hand, those would-be ghosts become infinitely heavy and thus can be removed from the physical content of particle species. Imposing the conditions on the coupling constants to eliminate the ghosts, we find new quadratic curvature theories which are ghost-free around the Minkowski background for a range of parameters. A key feature of these theories is that there exist a non-ghost massive spin-2 particle and a non-ghost massive spin-0 particle in the graviton propagator, as well as the massless spin-2 graviton. In the limit of the infinite mass of the torsion, the Riemann-Cartan geometry reduces to the Riemannian geometry and thus the physical content of particle species coincides with that of the well-known quadratic curvature theory in the metric formalism, i.e. a massive spin-2 ghost, a massive spin-0 particle and the massless spin-2 graviton. Ghost-freedom therefore sets, besides other constraints, an upper bound on the mass of the torsion. In addition to the above mentioned particle species, the ghost-free theory contains either the set of a massive spin-1 and a massive spin-0 (Class I) or a couple of spin-1 (Class II). These additional particle species mediate gravity sourced by the spin of matter fields.


title: Deep-SLAM++: Object-level RGBD SLAM based on class-specific deep shape priors

abstract: In an effort to increase the capabilities of SLAM systems and produce object-level representations, the community increasingly investigates the imposition of higher-level priors into the estimation process. One such example is given by employing object detectors to load and register full CAD models. Our work extends this idea to environments with unknown objects and imposes object priors by employing modern class-specific neural networks to generate complete model geometry proposals. The difficulty of using such predictions in a real SLAM scenario is that the prediction performance depends on the view-point and measurement quality, with even small changes of the input data sometimes leading to a large variability in the network output. We propose a discrete selection strategy that finds the best among multiple proposals from different registered views by re-enforcing the agreement with the online depth measurements. The result is an effective object-level RGBD SLAM system that produces compact, high-fidelity, and dense 3D maps with semantic annotations. It outperforms traditional fusion strategies in terms of map completeness and resilience against degrading measurement quality.


title: Discourse Marker Augmented Network with Reinforcement Learning for Natural Language Inference

abstract: Natural Language Inference (NLI), also known as Recognizing Textual Entailment (RTE), is one of the most important problems in natural language processing. It requires to infer the logical relationship between two given sentences. While current approaches mostly focus on the interaction architectures of the sentences, in this paper, we propose to transfer knowledge from some important discourse markers to augment the quality of the NLI model. We observe that people usually use some discourse markers such as "so" or "but" to represent the logical relationship between two sentences. These words potentially have deep connections with the meanings of the sentences, thus can be utilized to help improve the representations of them. Moreover, we use reinforcement learning to optimize a new objective function with a reward defined by the property of the NLI datasets to make full use of the labels information. Experiments show that our method achieves the state-of-the-art performance on several large-scale datasets.


title: A Survey on Federated Learning Systems: Vision, Hype and Reality for Data Privacy and Protection

abstract: Federated learning has been a hot research topic in enabling the collaborative training of machine learning models among different organizations under the privacy restrictions. As researchers try to support more machine learning models with different privacy-preserving approaches, there is a requirement in developing systems and infrastructures to ease the development of various federated learning algorithms. Similar to deep learning systems such as PyTorch and TensorFlow that boost the development of deep learning, federated learning systems (FLSs) are equivalently important, and face challenges from various aspects such as effectiveness, efficiency, and privacy. In this survey, we conduct a comprehensive review on federated learning systems. To achieve smooth flow and guide future research, we introduce the definition of federated learning systems and analyze the system components. Moreover, we provide a thorough categorization for federated learning systems according to six different aspects, including data distribution, machine learning model, privacy mechanism, communication architecture, scale of federation and motivation of federation. The categorization can help the design of federated learning systems as shown in our case studies. By systematically summarizing the existing federated learning systems, we present the design factors, case studies, and future research opportunities.


title: Rigidity of smooth Schubert varieties in a rational homogeneous manifold associated to a short root

abstract: We classify smooth Schubert varieties S_0 in a rational homogeneous manifold S associated to a short root, and show that they are rigid in the sense that any subvariety of S having the same homology class as S_0 is induced by the action of Aut_0(S), unless S_0 is linear.


title: Adaptive Compression-based Lifelong Learning

abstract: The problem of a deep learning model losing performance on a previously learned task when fine-tuned to a new one is a phenomenon known as Catastrophic forgetting. There are two major ways to mitigate this problem: either preserving activations of the initial network during training with a new task; or restricting the new network activations to remain close to the initial ones. The latter approach falls under the denomination of lifelong learning, where the model is updated in a way that it performs well on both old and new tasks, without having access to the old task's training samples anymore. Recently, approaches like pruning networks for freeing network capacity during sequential learning of tasks have been gaining in popularity. Such approaches allow learning small networks while making redundant parameters available for the next tasks. The common problem encountered with these approaches is that the pruning percentage is hard-coded, irrespective of the number of samples, of the complexity of the learning task and of the number of classes in the dataset. We propose a method based on Bayesian optimization to perform adaptive compression/pruning of the network and show its effectiveness in lifelong learning. Our method learns to perform heavy pruning for small and/or simple datasets while using milder compression rates for large and/or complex data. Experiments on classification and semantic segmentation demonstrate the applicability of learning network compression, where we are able to effectively preserve performances along sequences of tasks of varying complexity.


title: Trainability of ReLU networks and Data-dependent Initialization

abstract: In this paper, we study the trainability of rectified linear unit (ReLU) networks. A ReLU neuron is said to be dead if it only outputs a constant for any input. Two death states of neurons are introduced; tentative and permanent death. A network is then said to be trainable if the number of permanently dead neurons is sufficiently small for a learning task. We refer to the probability of a network being trainable as trainability. We show that a network being trainable is a necessary condition for successful training and the trainability serves as an upper bound of successful training rates. In order to quantify the trainability, we study the probability distribution of the number of active neurons at the initialization. In many applications, over-specified or over-parameterized neural networks are successfully employed and shown to be trained effectively. With the notion of trainability, we show that over-parameterization is both a necessary and a sufficient condition for minimizing the training loss. Furthermore, we propose a data-dependent initialization method in the over-parameterized setting. Numerical examples are provided to demonstrate the effectiveness of the method and our theoretical findings.


title: Heavy-ball Algorithms Always Escape Saddle Points

abstract: Nonconvex optimization algorithms with random initialization have attracted increasing attention recently. It has been showed that many first-order methods always avoid saddle points with random starting points. In this paper, we answer a question: can the nonconvex heavy-ball algorithms with random initialization avoid saddle points? The answer is yes! Direct using the existing proof technique for the heavy-ball algorithms is hard due to that each iteration of the heavy-ball algorithm consists of current and last points. It is impossible to formulate the algorithms as iteration like xk+1= g(xk) under some mapping g. To this end, we design a new mapping on a new space. With some transfers, the heavy-ball algorithm can be interpreted as iterations after this mapping. Theoretically, we prove that heavy-ball gradient descent enjoys larger stepsize than the gradient descent to escape saddle points to escape the saddle point. And the heavy-ball proximal point algorithm is also considered; we also proved that the algorithm can always escape the saddle point.


title: Stochastic Tverberg theorems and their applications in multi-class logistic regression, data separability, and centerpoints of data

abstract: We present new stochastic geometry theorems that give bounds on the probability that $m$ random data classes all contain a point in common in their convex hulls. We apply these stochastic separation theorems to obtain bounds on the probability of existence of maximum likelihood estimators in multinomial logistic regression. We also discuss connections to condition numbers for analysis of steepest descent algorithms in logistic regression and to the computation of centerpoints of data clouds.


title: Learning to Select, Track, and Generate for Data-to-Text

abstract: We propose a data-to-text generation model with two modules, one for tracking and the other for text generation. Our tracking module selects and keeps track of salient information and memorizes which record has been mentioned. Our generation module generates a summary conditioned on the state of tracking module. Our model is considered to simulate the human-like writing process that gradually selects the information by determining the intermediate variables while writing the summary. In addition, we also explore the effectiveness of the writer information for generation. Experimental results show that our model outperforms existing models in all evaluation metrics even without writer information. Incorporating writer information further improves the performance, contributing to content planning and surface realization.


title: Enhancing Dynamic Symbolic Execution by Automatically Learning Search Heuristics

abstract: We present a technique to automatically generate search heuristics for dynamic symbolic execution. A key challenge in dynamic symbolic execution is how to effectively explore the program's execution paths to achieve high code coverage in a limited time budget. Dynamic symbolic execution employs a search heuristic to address this challenge, which favors exploring particular types of paths that are most likely to maximize the final coverage. However, manually designing a good search heuristic is nontrivial and typically ends up with suboptimal and unstable outcomes. The goal of this paper is to overcome this shortcoming of dynamic symbolic execution by automatically learning search heuristics. We define a class of search heuristics, namely a parametric search heuristic, and present an algorithm that efficiently finds an optimal heuristic for each subject program. Experimental results with industrial-strength symbolic execution tools (e.g., KLEE) show that our technique can successfully generate search heuristics that significantly outperform existing manually-crafted heuristics in terms of branch coverage and bug-finding.


title: Benchmarking Attribution Methods with Relative Feature Importance

abstract: Interpretability is an important area of research for safe deployment of machine learning systems. One particular type of interpretability method attributes model decisions to input features. Despite active development, quantitative evaluation of feature attribution methods remains difficult due to the lack of ground truth: we do not know which input features are in fact important to a model. In this work, we propose a framework for Benchmarking Attribution Methods (BAM) with a priori knowledge of relative feature importance. BAM includes 1) a carefully crafted dataset and models trained with known relative feature importance and 2) three complementary metrics to quantitatively evaluate attribution methods by comparing feature attributions between pairs of models and pairs of inputs. Our evaluation on several widely-used attribution methods suggests that certain methods are more likely to produce false positive explanations---features that are incorrectly attributed as more important to model prediction. We open source our dataset, models, and metrics.


title: BMN: Boundary-Matching Network for Temporal Action Proposal Generation

abstract: Temporal action proposal generation is an challenging and promising task which aims to locate temporal regions in real-world videos where action or event may occur. Current bottom-up proposal generation methods can generate proposals with precise boundary, but cannot efficiently generate adequately reliable confidence scores for retrieving proposals. To address these difficulties, we introduce the Boundary-Matching (BM) mechanism to evaluate confidence scores of densely distributed proposals, which denote a proposal as a matching pair of starting and ending boundaries and combine all densely distributed BM pairs into the BM confidence map. Based on BM mechanism, we propose an effective, efficient and end-to-end proposal generation method, named Boundary-Matching Network (BMN), which generates proposals with precise temporal boundaries as well as reliable confidence scores simultaneously. The two-branches of BMN are jointly trained in an unified framework. We conduct experiments on two challenging datasets: THUMOS-14 and ActivityNet-1.3, where BMN shows significant performance improvement with remarkable efficiency and generalizability. Further, combining with existing action classifier, BMN can achieve state-of-the-art temporal action detection performance.


title: Convergence of the perfectly matched layer method for transient acoustic-elastic interaction above an unbounded rough surface

abstract: This paper is concerned with the time-dependent acoustic-elastic interaction problem associated with a bounded elastic body immersed in a homogeneous air or fluid above an unbounded rough surface. The well-posedness and stability of the problem are first established by using the Laplace transform and the energy method. A perfectly matched layer (PML) is then introduced to truncate the interaction problem above a finite layer containing the elastic body, leading to a PML problem in a finite strip domain. We further establish the existence, uniqueness and stability estimate of solutions to the PML problem. Finally, we prove the exponential convergence of the PML problem in terms of the thickness and parameter of the PML layer, based on establishing an error estimate between the DtN operators of the original problem and the PML problem.


title: A Note on Universal Bilinear Portfolios

abstract: This note provides a neat and enjoyable expansion and application of the magnificent Ordentlich-Cover theory of "universal portfolios." I generalize Cover's benchmark of the best constant-rebalanced portfolio (or 1-linear trading strategy) in hindsight by considering the best bilinear trading strategy determined in hindsight for the realized sequence of asset prices. A bilinear trading strategy is a mini two-period active strategy whose final capital growth factor is linear separately in each period's gross return vector for the asset market. I apply Cover's ingenious (1991) performance-weighted averaging technique to construct a universal bilinear portfolio that is guaranteed (uniformly for all possible market behavior) to compound its money at the same asymptotic rate as the best bilinear trading strategy in hindsight. Thus, the universal bilinear portfolio asymptotically dominates the original (1-linear) universal portfolio in the same technical sense that Cover's universal portfolios asymptotically dominate all constant-rebalanced portfolios and all buy-and-hold strategies. In fact, like so many Russian dolls, one can get carried away and use these ideas to construct an endless hierarchy of ever more dominant $H$-linear universal portfolios.

categories: q-fin.MF econ.TH q-fin.CP q-fin.GN q-fin.PM


title: 2D-CTC for Scene Text Recognition

abstract: Scene text recognition has been an important, active research topic in computer vision for years. Previous approaches mainly consider text as 1D signals and cast scene text recognition as a sequence prediction problem, by feat of CTC or attention based encoder-decoder framework, which is originally designed for speech recognition. However, different from speech voices, which are 1D signals, text instances are essentially distributed in 2D image spaces. To adhere to and make use of the 2D nature of text for higher recognition accuracy, we extend the vanilla CTC model to a second dimension, thus creating 2D-CTC. 2D-CTC can adaptively concentrate on most relevant features while excluding the impact from clutters and noises in the background; It can also naturally handle text instances with various forms (horizontal, oriented and curved) while giving more interpretable intermediate predictions. The experiments on standard benchmarks for scene text recognition, such as IIIT-5K, ICDAR 2015, SVP-Perspective, and CUTE80, demonstrate that the proposed 2D-CTC model outperforms state-of-the-art methods on the text of both regular and irregular shapes. Moreover, 2D-CTC exhibits its superiority over prior art on training and testing speed. Our implementation and models of 2D-CTC will be made publicly available soon later.


title: LYTNet: A Convolutional Neural Network for Real-Time Pedestrian Traffic Lights and Zebra Crossing Recognition for the Visually Impaired

abstract: Currently, the visually impaired rely on either a sighted human, guide dog, or white cane to safely navigate. However, the training of guide dogs is extremely expensive, and canes cannot provide essential information regarding the color of traffic lights and direction of crosswalks. In this paper, we propose a deep learning based solution that provides information regarding the traffic light mode and the position of the zebra crossing. Previous solutions that utilize machine learning only provide one piece of information and are mostly binary: only detecting red or green lights. The proposed convolutional neural network, LYTNet, is designed for comprehensiveness, accuracy, and computational efficiency. LYTNet delivers both of the two most important pieces of information for the visually impaired to cross the road. We provide five classes of pedestrian traffic lights rather than the commonly seen three or four, and a direction vector representing the midline of the zebra crossing that is converted from the 2D image plane to real-world positions. We created our own dataset of pedestrian traffic lights containing over 5000 photos taken at hundreds of intersections in Shanghai. The experiments carried out achieve a classification accuracy of 94%, average angle error of 6.35 degrees, with a frame rate of 20 frames per second when testing the network on an iPhone 7 with additional post-processing steps.


title: RRNet: Repetition-Reduction Network for Energy Efficient Decoder of Depth Estimation

abstract: We introduce Repetition-Reduction network (RRNet) for resource-constrained depth estimation, offering significantly improved efficiency in terms of computation, memory and energy consumption. The proposed method is based on repetition-reduction (RR) blocks. The RR blocks consist of the set of repeated convolutions and the residual connection layer that take place of the pointwise reduction layer with linear connection to the decoder. The RRNet help reduce memory usage and power consumption in the residual connections to the decoder layers. RRNet consumes approximately 3.84 times less energy and 3.06 times less meory and is approaximately 2.21 times faster, without increasing the demand on hardware resource relative to the baseline network (Godard et al, CVPR'17), outperforming current state-of-the-art lightweight architectures such as SqueezeNet, ShuffleNet, MobileNet and PyDNet.