title: End-to-end Image Captioning Exploits Multimodal Distributional Similarity

abstract: We hypothesize that end-to-end neural image captioning systems work seemingly well because they exploit and learn `distributional similarity' in a multimodal feature space by mapping a test image to similar training images in this space and generating a caption from the same space. To validate our hypothesis, we focus on the `image' side of image captioning, and vary the input image representation but keep the RNN text generation component of a CNN-RNN model constant. Our analysis indicates that image captioning models (i) are capable of separating structure from noisy input representations; (ii) suffer virtually no significant performance loss when a high dimensional representation is compressed to a lower dimensional space; (iii) cluster images with similar visual and linguistic information together. Our findings indicate that our distributional similarity hypothesis holds. We conclude that regardless of the image representation used image captioning systems seem to match images and generate captions in a learned joint image-text semantic subspace.


title: Electronic implementation of a dynamical network with nearly identical hybrid nodes via unstable dissipative systems

abstract: A circuit architecture is proposed and implemented for a dynamical network composed of a type of hybrid chaotic oscillator based on Unstable Dissipative Systems (UDS). The circuit architecture allows selecting a network topology with its link attributes and to study, experimentally, the practical synchronous collective behavior phenomena. Additionally, based on the theory of dynamical networks, a mathematical model of the circuit was described, taking into account the natural tolerance of the electronic components. The network is analyzed both numerically and experimentally according to the parameters mismatch between nodes.


title: Nonconvex Variance Reduced Optimization with Arbitrary Sampling

abstract: We provide the first importance sampling variants of variance reduced algorithms for empirical risk minimization with non-convex loss functions. In particular, we analyze non-convex versions of SVRG, SAGA and SARAH. Our methods have the capacity to speed up the training process by an order of magnitude compared to the state of the art on real datasets. Moreover, we also improve upon current mini-batch analysis of these methods by proposing importance sampling for minibatches in this setting. Surprisingly, our approach can in some regimes lead to superlinear speedup with respect to the minibatch size, which is not usually present in stochastic optimization. All the above results follow from a general analysis of the methods which works with arbitrary sampling, i.e., fully general randomized strategy for the selection of subsets of examples to be sampled in each iteration. Finally, we also perform a novel importance sampling analysis of SARAH in the convex setting.


title: Noncontractible loops of symplectic embeddings between convex toric domains

abstract: Given two 4-dimensional ellipsoids whose symplectic sizes satisfy a specified inequality, we prove that a certain loop of symplectic embeddings between the two ellipsoids is noncontractible. The statement about symplectic ellipsoids is a particular case of a more general result. Given two convex toric domains whose first and second ECH capacities satisfy a specified inequality, we prove that a certain loop of symplectic embeddings between the two convex toric domains is noncontractible. We show how the constructed loops become contractible if the target domain becomes large enough. The proof involves studying certain moduli spaces of holomorphic cylinders in families of symplectic cobordisms arising from families of symplectic embeddings.


title: Detecting Crystallographic Lattice Chirality using Resonant Inelastic X-ray Scattering

abstract: The control and detection of crystallographic chirality is an important and challenging scientific problem. Chirality has wide ranging implications from medical physics to cosmology including an intimate but subtle connection in magnetic systems, for example Mn$_{1-x}$Fe$_{x}$Si. X-ray diffraction techniques with resonant or polarized variations of the experimental setup are currently utilized to characterize lattice chirality. We demonstrate using theoretical calculations the feasibility of indirect $K$ -edge bimagnon resonant inelastic X-ray scattering (RIXS) spectrum as a viable experimental technique to distinguish crystallographic handedness. We apply spin wave theory to the recently discovered $\sqrt {5}\times\sqrt {5}$ vacancy ordered chalcogenide Rb$_{0.89}$Fe$_{1.58}$Se$_{2}$ for realistic X-ray experimental set up parameters (incoming energy, polarization, and Bragg angle) to show that the computed RIXS spectrum is sensitive to the underlying handedness (right or left) of the lattice. A Flack parameter definition that incorporates the right- and left- chiral lattice RIXS response is introduced. It is shown that the RIXS response of the multiband magnon system RbFeSe arises both from inter- and intra- band scattering processes. The extinction or survival of these RIXS peaks are sensitive to the underlying chiral lattice orientation. This in turn allows for the identification of the two chiral lattice orientations.


title: Cram\'er-Rao analysis of lifetime estimations in time-resolved fluorescence microscopy

abstract: Measuring the lifetime of fluorescent emitters by time-correlated single photon counting (TCSPC) is a routine procedure in many research areas spanning from nanophotonics to biology. The precision of such measurement depends on the number of detected photons but also on the various sources of noise arising from the measurement process. Using Fisher information theory, we calculate the lower bound on the precision of lifetime estimations for mono-exponential and bi-exponential distributions. We analyse the dependence of the lifetime estimation precision on experimentally relevant parameters, including the contribution of a non-uniform background noise and the instrument response funtion (IRF) of the setup. We also provide an open-source code to determine the lower bound on the estimation precision for any experimental conditions. Two practical examples illustrate how this tool can be used to reach optimal precision in time-resolved fluorescence microscopy.


title: High-energy neutrino interaction physics with IceCube

abstract: Although they are best known for studying astrophysical neutrinos, neutrino telescopes like IceCube can study neutrino interactions, at energies far above those that are accessible at accelerators. In this writeup, I present two IceCube analyses of neutrino interactions at energies far above 1 TeV. The first measures neutrino absorption in the Earth, and, from that determines the neutrino-nucleon cross-section at energies between 6.3 and 980 TeV. We find that the cross-sections is 1.30 $^{+0.21}_{-0.19}$ (stat.) $^{+0.39}_{-0.43}$ (syst.) times the Standard Model cross-section. We also present a measurement of neutrino inelasticity, using $\nu_\mu$ charged-current interactions that occur within IceCube. We have measured the average inelasticity at energies from 1 TeV to above 100 TeV, and found that it is in agreement with the Standard Model expectations. We have also performed a series of fits to this track sample and a matching cascade sample, to probe aspects of the astrophysical neutrino flux, particularly the flavor ratio.


title: Feature-Specific Profiling

abstract: While high-level languages come with significant readability and maintainability benefits, their performance remains difficult to predict. For example, programmers may unknowingly use language features inappropriately, which cause their programs to run slower than expected. To address this issue, we introduce feature-specific profiling, a technique that reports performance costs in terms of linguistic constructs. Feature-specific profilers help programmers find expensive uses of specific features of their language. We describe the architecture of a profiler that implements our approach, explain prototypes of the profiler for two languages with different characteristics and implementation strategies, and provide empirical evidence for the approach's general usefulness as a performance debugging tool.


title: Modeling Electronic Excited States of Molecules in Solution

abstract: The presence of solvent tunes many properties of a molecule, such as its ground and excited state geometry, dipole moment, excitation energy, and absorption spectrum. Because the energy of the system will vary depending on the solvent configuration, explicit solute-solvent interactions are key to understanding solution-phase reactivity and spectroscopy, simulating accurate inhomogeneous broadening, and predicting absorption spectra. In this tutorial review, we give an overview of factors to consider when modeling excited states of molecules interacting with explicit solvent. We provide practical guidelines for sampling solute-solvent configurations, choosing a solvent model, performing the excited state electronic structure calculations, and computing spectral lineshapes. We also present our recent results combining the vertical excitation energies computed from an ensemble of solute-solvent configurations with the vibronic spectra obtained from a small number of frozen solvent configurations, resulting in improved simulation of absorption spectra for molecules in solution.


title: Joint Chance Constraints in AC Optimal Power Flow: Improving Bounds through Learning

abstract: This paper considers distribution systems with a high penetration of distributed, renewable generation and addresses the problem of incorporating the associated uncertainty into the optimal operation of these networks. Joint chance constraints, which satisfy multiple constraints simultaneously with a prescribed probability, are one way to incorporate uncertainty across sets of constraints, leading to a chance-constrained optimal power flow problem. Departing from the computationally-heavy scenario-based approaches or approximations that transform the joint constraint into conservative deterministic constraints, this paper develops a scalable, data-driven approach which learns operational trends in a power network, eliminates zero-probability events (e.g., inactive constraints), and accurately and efficiently approximates bounds on the joint chance constraint iteratively. In particular, the proposed framework improves upon the classic methods based on the union bound (or Boole's inequality) by generating a much less conservative set of single chance constraints that also guarantees the satisfaction of the original joint constraint. The proposed framework is evaluated numerically using the IEEE 37-node test feeder, focusing on the problem of voltage regulation in distribution grids.


title: Intensity and Rescale Invariant Copy Move Forgery Detection Techniques

abstract: In this contemporary world digital media such as videos and images behave as an active medium to carry valuable information across the globe on all fronts. However there are several techniques evolved to tamper the image which has made their authenticity untrustworthy. CopyMove Forgery CMF is one of the most common forgeries present in an image where a cluster of pixels are duplicated in the same image with potential postprocessing techniques. Various state-of-art techniques are developed in the recent years which are effective in detecting passive image forgery. However most methods do fail when the copied image is rescaled or added with certain intensity before being pasted due to de-synchronization of pixels in the searching process. To tackle this problem the paper proposes distinct novel algorithms which recognize a unique approach of using Hus invariant moments and Discreet Cosine Transformations DCT to attain the desired rescale invariant and intensity invariant CMF detection techniques respectively. The experiments conducted quantitatively and qualitatively demonstrate the effectiveness of the algorithm.


title: Can freestanding Xene monolayers behave as excitonic insulators?

abstract: We predict a phase transition in freestanding monolayer Xenes from the semiconducting phase to the excitonic insulating (EI) phase can be induced by reducing an external electric field below some critical value which is unique to each material. The splitting of the conduction and valence bands due to spin-orbit coupling at non-zero electric fields leads to the formation of $A$ and $B$ excitons in the larger or smaller band gap, with correspondingly larger or smaller binding energies. Our calculations show the coexistence of the semiconducting phase of $A$ excitons with the EI phase of $B$ excitons for a particular range of electric field. The dielectric environment precludes the existence of the EI phase in supported or encapsulated monolayer Xenes.


title: $d$-wave and $s^\pm$ Pairing Strengths in Ba$_2$CuO$_{3+\delta}$

abstract: Using a first principles derived two-orbital model ($d_{x^2-y^2}$, $d_{3z^2-r^2}$) and a random phase approximation treatment of the spin-fluctuation pairing vertex, we calculate the $d$-wave and $s^\pm$-wave pairing strengths for a model of the recently discovered Ba$_2$CuO$_{3+\delta}$ superconductor. We find that there is significant pairing strength in both of these channels. These results provide an interesting perspective on the relationship between the cuprates and Fe-based superconductors and the high-$T_c$ pairing mechanism.


title: Heated-Up Softmax Embedding

abstract: Metric learning aims at learning a distance which is consistent with the semantic meaning of the samples. The problem is generally solved by learning an embedding for each sample such that the embeddings of samples of the same category are compact while the embeddings of samples of different categories are spread-out in the feature space. We study the features extracted from the second last layer of a deep neural network based classifier trained with the cross entropy loss on top of the softmax layer. We show that training classifiers with different temperature values of softmax function leads to features with different levels of compactness. Leveraging these insights, we propose a "heating-up" strategy to train a classifier with increasing temperatures, leading the corresponding embeddings to achieve state-of-the-art performance on a variety of metric learning benchmarks.


title: Rigidity for smooth affine pairs over a field

abstract: Let $Z\to X$ be a closed immersion of smooth affine schemes over an arbitrary field $k$, and $X^h_Z$ denote the henselization of $X$ along $Z$. For each presheaf $E\colon \mathbf{SH}(k)\to \mathrm{Ab}^\mathrm{op}$ on the stable motivic homotopy category over $k$ and the induced continuous presheaf $E\colon \mathrm{EssSm}_k\to \mathrm{Ab}^\mathrm{op}$ on the category of essentially smooth schemes there is a homomorphism \[E(X^h_Z)\to E(Z).\] We prove that this is an isomorphism for any $l_\varepsilon$-torsion presheaf $E$, for $l\in \mathbb Z$, $(l,\mathrm{chark}\,k)=1$, and $l_\varepsilon=\sum_{i=1}^n \langle (-1)^i \rangle$. More generally, the isomorphism holds for any homotopy invariant $l_\varepsilon$-torsion linear $\sigma$-stable framed additive presheaf $F$ over $k$. The case of $l$-torsion presheaves follows as well. The result generalises known Gabber's rigidity theorems for local henselian schemes to the case of smooth affine henselian pairs. The above isomorphism is proven by constructing of (stable) $\mathbb{A}^1$-homotopies of motivic spaces via algebro-geometric techniques. To achieve this in our setting we replace often used Quillen's trick by an alternative construction that provides required smooth relative curves over smooth affine schemes for an arbitrary base field.


title: Restrictions of higher derivatives of the Fourier transform

abstract: We consider several problems related to the restriction of $(\nabla^k) \hat{f}$ to a surface $\Sigma \subset \mathbb R^d$ with nonvanishing Gauss curvature. While such restrictions clearly exist if $f$ is a Schwartz function, there are few bounds available that enable one to take limits with respect to the $L_p(\mathbb R^d)$ norm of $f$. We establish three scenarios where it is possible to do so: $\bullet$ When the restriction is measured according to a Sobolev space $H^{-s}(\Sigma)$ of negative index. We determine the complete range of indices $(k, s, p)$ for which such a bound exists. $\bullet$ Among functions where $\hat{f}$ vanishes on $\Sigma$ to order $k-1$, the restriction of $(\nabla^k) \hat{f}$ defines a bounded operator from (this subspace of) $L_p(\mathbb R^d)$ to $L_2(\Sigma)$ provided $1 \leq p \leq \frac{2d+2}{d+3+4k}$. $\bullet$ When there is _a priori_ control of $\hat{f}|_\Sigma$ in a space $H^{\ell}(\Sigma)$, $\ell > 0$, this implies improved regularity for the restrictions of $(\nabla^k)\hat{f}$. If $\ell$ is large enough then even $\|\nabla \hat{f}\|_{L_2(\Sigma)}$ can be controlled in terms of $\|\hat{f}\|_{H^\ell(\Sigma)}$ and $\|f\|_{L_p(\mathbb R^d)}$ alone. The techniques underlying these results are inspired by the spectral synthesis work of Y. Domar, which provides a mechanism for $L_p$ approximation by "convolving along surfaces", and the Stein-Tomas restriction theorem. Our main inequality is a bilinear form bound with similar structure to the Stein--Tomas $T^*T$ operator, generalized to accommodate smoothing along $\Sigma$ and derivatives transverse to it. It is used both to establish basic $H^{-s}(\Sigma)$ bounds for derivatives of $\hat{f}$ and to bootstrap from surface regularity of $\hat{f}$ to regularity of its higher derivatives.


title: Evidence for a massive dust-trapping vortex connected to spirals: a multi-wavelength analysis of the HD~135344B protoplanetary disk

abstract: Spiral arms, rings and large scale asymmetries are structures observed in high resolution observations of protoplanetary disks, and it appears that some of the disks showing spiral arms in scattered light also show asymmetries in millimeter-sized dust. HD~135344B is one of these disks. Planets are invoked as the origin of these structures, but no planet has been observed so far. We investigate the nature of the asymmetric structure in the HD~135344B disk in order to understand the origin of the spirals and of the asymmetry seen in this disk. Ultimately, we aim at understanding whether or not one or more planets are needed to explain such structures. We present new ALMA sub-0.1" resolution observations in Band 3 and 4. The high spatial resolution allows us to characterize the mm-dust morphology of the disk. The low optical depth of continuum emission probes the bulk of the dust in vortex. Moreover, we combine the new observations with archival data to perform a multi-wavelength analysis and to obtain information about the dust distribution and properties inside the asymmetry. We resolve the asymmetric disk into a symmetric ring + asymmetric crescent, and observe that: (1) the spectral index strongly decreases at the center of the vortex, consistent with the presence of large grains; (2) for the first time, an azimuthal shift of the peak of the vortex with wavelength is observed; (3) the azimuthal width of the vortex decreases at longer wavelengths, as expected for dust traps. These features allow to confirm the nature of the asymmetry as a vortex. Finally a lower limit to the total mass of the vortex is $0.3 M_{\rm Jupiter}$. Considering the uncertainties involved in this estimate, it is possible that the actual mass of the vortex is higher and possibly within the required values ($\sim 4\,\rm M_{\rm Jupiter}$) to launch spiral arms similar to those observed in scattered light.


title: $C^{1,\alpha}$ Isometric Embeddings of Polar Caps

abstract: We study isometric embeddings of $C^2$ Riemannian manifolds in the Euclidean space and we establish that the H\"older space $C^{1,\frac{1}{2}}$ is critical in a suitable sense: in particular we prove that for $\alpha > \frac{1}{2}$ the Levi-Civita connection of any isometric immersion is induced by the Euclidean connection, whereas for any $\alpha < \frac{1}{2}$ we construct $C^{1,\alpha}$ isometric embeddings of portions of the standard $2$-dimensional sphere for which such property fails.


title: A splitting of the virtual class for genus one stable maps

abstract: Moduli spaces of stable maps to a smooth projective variety typically have several components. We express the virtual class of the moduli space of genus one stable maps to a smooth projective variety as a sum of virtual classes of the components. The key ingredient is a generalised functoriality result for virtual classes. We show that the natural maps from 'ghost' components of the genus one moduli space to moduli spaces of genus zero stable maps satisfy the strong push forward property. As a consequence, we give a cycle-level formula which relates standard and reduced genus one Gromov--Witten invariants of a smooth projective Calabi--Yau theefold.


title: Adversarial Propagation and Zero-Shot Cross-Lingual Transfer of Word Vector Specialization

abstract: Semantic specialization is the process of fine-tuning pre-trained distributional word vectors using external lexical knowledge (e.g., WordNet) to accentuate a particular semantic relation in the specialized vector space. While post-processing specialization methods are applicable to arbitrary distributional vectors, they are limited to updating only the vectors of words occurring in external lexicons (i.e., seen words), leaving the vectors of all other words unchanged. We propose a novel approach to specializing the full distributional vocabulary. Our adversarial post-specialization method propagates the external lexical knowledge to the full distributional space. We exploit words seen in the resources as training examples for learning a global specialization function. This function is learned by combining a standard L2-distance loss with an adversarial loss: the adversarial component produces more realistic output vectors. We show the effectiveness and robustness of the proposed method across three languages and on three tasks: word similarity, dialog state tracking, and lexical simplification. We report consistent improvements over distributional word vectors and vectors specialized by other state-of-the-art specialization frameworks. Finally, we also propose a cross-lingual transfer method for zero-shot specialization which successfully specializes a full target distributional space without any lexical knowledge in the target language and without any bilingual data.


title: Chemical analysis of NGC 6528: one of the most metal-rich bulge globular cluster

abstract: The Bulge Globular Clusters (GCs) are key tracers of this central ancient component of our Galaxy. It is essential to understand their formation and evolution to study that of the bulge, as well as their relationship with the other Galactic GC systems (halo and disk GCs). Our main goals are to obtain detailed abundances for a sample of seven red giant members of NGC 6528 in order to characterize its chemical composition and study the relationship of this GC with the bulge, and with other bulge, halo and disk GCs. Moreover, we analyze this cluster$'$s behavior associated with the Multiple Populations (MPs) phenomenon. We obtained the stellar parameters and chemical abundances of light elements (Na, Al), iron-peak elements (V, Cr, Mn, Fe, Co, Ni, Cu), {\alpha}-elements (O, Mg, Si, Ca, Ti) and heavy elements (Zr, Ba, Eu) in seven red giant members of NGC 6528 using high resolution spectroscopy from FLAMES-UVES. We obtained in six stars of our sample a mean iron content of [Fe/H]=-0.14+/-0.03 dex, in good agreement with other studies. We found no significant internal iron spread. We detected one candidate variable star, which was excluded from the mean in iron content, we derived a metallicity in this star of [Fe/H]=-0.55+/-0.04 dex. Moreover, we found no extended O-Na anticorrelation but instead only an intrinsic Na spread. In addition, NGC 6528 does not exhibit a Mg-Al anticorrelation, and no significant spread in either Mg or Al. The {\alpha} and iron-peak elements show good agreement with the bulge field star trend. The heavy elements are slightly dominated by the r-process. The chemical analysis suggests an origin and evolution similar to that of typical old Bulge field stars. Finally, we find remarkable agreement in the chemical patterns of NGC 6528 and another bulge GC, NGC 6553, suggesting a similar origin and evolution.


title: Coupling of skyrmions mediated by RKKY interaction

abstract: A discussion on the interaction between skyrmions in a bi-layer system connected by a non-magnetic metal is presented. From considering a free charge carrier model, we have shown that the Ruderman-Kittel-Kasuya-Yosida (RKKY ) inter- action can induce attractive or repulsive interaction between the skyrmions depending on the spacer thickness. We have also shown that due to an increasing in RKKY energy when the skyrmions are far from each other, their widths are diminished. Finally, we have obtained analytical solutions to the skyrmion position when the in-plane distance between the skyrmions is small and it is shown that an attractive RKKY interaction yields a skyrmion precessory motion. This RKKY-induced coupling could be used as a skyrmion drag mechanism to displace skyrmions in multilayers.


title: Leabra7: a Python package for modeling recurrent, biologically-realistic neural networks

abstract: Emergent is a software package that uses the AdEx neural dynamics model and LEABRA learning algorithm to simulate and train arbitrary recurrent neural network architectures in a biologically-realistic manner. We present Leabra7, a complementary Python library that implements these same algorithms. Leabra7 is developed and distributed using modern software development principles, and integrates tightly with Python's scientific stack. We demonstrate recurrent Leabra7 networks using traditional pattern-association tasks and a standard machine learning task, classifying the IRIS dataset.


title: Vehicle Localization and Control on Roads with Prior Grade Map

abstract: We propose a map-aided vehicle localization method for GPS-denied environments. This approach exploits prior knowledge of the road grade map and vehicle on-board sensor measurements to accurately estimate the longitudinal position of the vehicle. Real-time localization is crucial to systems that utilize position-dependent information for planning and control. We validate the effectiveness of the localization method on a hierarchical control system. The higher level planner optimizes the vehicle velocity to minimize the energy consumption for a given route by employing traffic condition and road grade data. The lower level is a cruise control system that tracks the position-dependent optimal reference velocity. Performance of the proposed localization algorithm is evaluated using both simulations and experiments.


title: Production of atomic hydrogen by cosmic rays in dark clouds

abstract: The presence of small amounts of atomic hydrogen, detected as absorption dips in the 21 cm line spectrum, is a well-known characteristic of dark clouds. The abundance of hydrogen atoms measured in the densest regions of molecular clouds can be only explained by the dissociation of H$_2$ due to cosmic rays. We want to assess the role of Galactic cosmic rays in the formation of atomic hydrogen, by using recent developments in the characterisation of the low-energy spectra of cosmic rays and advances in the modelling of their propagation in molecular clouds. We model the attenuation of the interstellar cosmic rays entering a cloud and compute the dissociation rate of molecular hydrogen due to collisions with cosmic-ray protons and electrons as well as fast hydrogen atoms. We compare our results with the available observations. The cosmic-ray dissociation rate is entirely determined by secondary electrons produced in primary ionisation collisions. These secondary particles constitute the only source of atomic hydrogen at column densities above $\sim10^{21}$ cm$^{-2}$. We also find that the dissociation rate decreases with column density, while the ratio between the dissociation and ionisation rates varies between about 0.6 and 0.7. From comparison with observations we conclude that a relatively flat spectrum of interstellar cosmic-ray protons, as the one suggested by the most recent Voyager 1 data, can only provide a lower bound for the observed atomic hydrogen fraction. An enhanced spectrum of low-energy protons is needed to explain most of the observations. Our findings show that a careful description of molecular hydrogen dissociation by cosmic rays can explain the abundance of atomic hydrogen in dark clouds. An accurate characterisation of this process at high densities is crucial for understanding the chemical evolution of star-forming regions.


title: MACER improved: AGN feedback computed in rotating early-type galaxies at high resolution

abstract: Based on our previous modeling of AGN feedback in isolated elliptical galaxies (Gan et al. 2014) using the MACER (Massive AGN Controlled Ellipticals Resolved) code, we extend and improve the model to include rotation, to limit star formation to regions of high density and low temperature, to facilitate angular momentum transfer via the Toomre instability in gaseous disks, and to improve the treatment of hot mode (low accretion rate) AGN feedback. The model galaxy now has an extended dark matter profile that matches with standard observations, but has a resolution of parsecs in the inner region and resolves the Bondi radius. We find that the results agree reasonably well with a panoply of observations: (1) both AGN activity and star formation are primarily in central cold gaseous disks, are bursty and mainly driven by the Toomre instability; (2)AGN duty cycle agrees well with the Soltan argument, i.e., the AGN spends most of its lifetime when it is in low luminosity (half of time with $L/L_{Edd}<7\times10^{-5}$), while emitting most of its energy when it is in high luminosity (half of radiant energy emitted with $L/L_{Edd}>0.06$); (3) the total star formation is $\sim$ few percents of the initial stellar mass, occurring in the bursts that would be associated with the observed E+A phenomenon. Most of the star formation occurs in the circumnuclear disk of a size <1 kpc, which is in agreement with recent observations; (4) the ISM X-ray luminosity varies within a reasonable range (median $L_{\rm X, ISM}=9.1\times10^{39}$ erg/s) in agreement with observations.


title: A Cryptographic Escrow for Treaty Declarations and Step-by-Step Verification

abstract: The verification of arms-control and disarmament agreements requires states to provide declarations, including information on sensitive military sites and assets. There are important cases, however, where negotiations of these agreements are impeded because states are reluctant to provide any such data, because of concerns about prematurely handing over militarily significant information. To address this challenge, we present a cryptographic escrow that allows a state to make a complete declaration of sites and assets at the outset and commit to its content, but only reveal the sensitive information therein sequentially. Combined with an inspection regime, our escrow allows for step-by-step verification of the correctness and completeness of the initial declaration so that the information release and inspections keep pace with parallel diplomatic and political processes. We apply this approach to the possible denuclearization of North Korea. Such approach can be applied, however, to any agreement requiring the sharing of sensitive information.


title: From Natural to Artificial Camouflage: Components and Systems

abstract: We identify the components of bio-inspired artificial camouflage systems including actuation, sensing, and distributed computation. After summarizing recent results in understanding the physiology and system-level performance of a variety of biological systems, we describe computational algorithms that can generate similar patterns and have the potential for distributed implementation. We find that the existing body of work predominately treats component technology in an isolated manner that precludes a material-like implementation that is scale-free and robust. We conclude with open research challenges towards the realization of integrated camouflage solutions.


title: Coagulation with product kernel and arbitrary initial conditions: Exact kinetics within the Marcus-Lushnikov framework

abstract: The time evolution of a system of coagulating particles under the product kernel and arbitrary initial conditions is studied. Using the improved Marcus-Lushnikov approach, the master equation is solved for the probability $W(Q,t)$ to find the system in a given mass spectrum $Q=\{n_1,n_2,\dots,n_g\dots\}$, with $n_g$ being the number of particles of size $g$. The exact expression for the average number of particles, $\langle n_g(t)\rangle$, at arbitrary time $t$ is derived and its validity is confirmed in numerical simulations of several selected initial mass spectra.


title: Notes on the Onset of Clustering in Gas-Solid HCS

abstract: This study contributes to the body of work on instabilities in the homogeneous cooling system focusing on clustering in the multiphase gas-particle system. The critical system size for the onset of instability, $L^*_c$, is studied via three different numerical methods: i) particle resolved direct numerical simulation; ii) computational fluid dynamics-discrete element method; and iii) a two-fluid model derived from kinetic theory. In general, the $L^*_c$ results at several concentrations, inelasticities and initial thermal Reynolds numbers are in good qualitative agreement with one another. Additionally, most of the expected trends (i.e., general $L^*_c (\phi)$ behavior) are observed. However, there is a larger level of quantitative discrepancy between the continuum and discrete particle methods than observed previous (simpler) granular results. While the level of agreement may be expected to decrease with the increased physical complexity of the gas-solid system, a significant time-dependence is revealed and shown to be responsible for some of the oddities in the numerical data.


title: Verifiable Computations with RAM-like Running Times

abstract: Current and emerging trends such as cloud computing, fog computing, and more recently, multi-access edge computing (MEC) increase the interest in finding solutions to the verifiable computation problem. Furthermore, the number of computationally weak devices have increased drastically in recent years due to the ongoing realization of the Internet of Things. This work proposes a solution which enjoys the following two desirable properties: (1) cost of input preparation and verification is very low (low enough to allow verifiable outsourcing of computations by resource-constrained devices on constrained networks); (2) the running time of the verifiable computation is RAM-like.


title: On the geometry of the automorphism groups of affine varieties

abstract: This article is a survey on ind-varieties and ind-groups introduced by Shafarevich in 1965, with a special emphasis on automorphism groups of affine varieties and actions of ind-groups on ind-varieties. We give precise definitions and complete proofs, including several known results. The survey contains many examples and also some questions which came up during our work on the subject. Among the new results we show that for an affine variety X the automorphism group Aut(X) is always locally closed in the ind-semigroup End(X) of all endomorphisms, and we give an example of a strict closed subgroup of a connected ind-group which has the same Lie algebra, based on the work of Shestakov-Umirbaev on the existence of non-tame automorphisms of affine 3-space.


title: Phaseless Subspace Tracking

abstract: This work takes the first steps towards solving the "phaseless subspace tracking" (PST) problem. PST involves recovering a time sequence of signals (or images) from phaseless linear projections of each signal under the following structural assumption: the signal sequence is generated from a much lower dimensional subspace (than the signal dimension) and this subspace can change over time, albeit gradually. It can be simply understood as a dynamic (time-varying subspace) extension of the low-rank phase retrieval problem studied in recent work.


title: Time Series Analysis of Clickstream Logs from Online Courses

abstract: Due to the rapidly rising popularity of Massive Open Online Courses (MOOCs), there is a growing demand for scalable automated support technologies for student learning. Transferring traditional educational resources to online contexts has become an increasingly relevant problem in recent years. For learning science theories to be applicable, educators need a way to identify learning behaviors of students which contribute to learning outcomes, and use them to design and provide personalized intervention support to the students. Click logs are an important source of information about students' learning behaviors, however current literature has limited understanding of how these behaviors are represented within click logs. In this project, we have exploited the temporal dynamics of student behaviors both to do behavior modeling via graphical modeling approaches and to do performance prediction via recurrent neural network approaches in order to first identify student behaviors and then use them to predict their final outcome in the course. Our experiments showed that the long short-term memory (LSTM) model is capable of learning long-term dependencies in a sequence and outperforms other strong baselines in the prediction task. Further, these sequential approaches to click log analysis can be successfully imported to other courses when used with results obtained from graphical model behavior modeling.


title: The extraordinary outburst in the massive protostellar system NGC6334I-MM1: Flaring of the water masers in a north-south bipolar outflow driven by MM1B

abstract: We compare multi-epoch sub-arcsecond VLA imaging of the 22 GHz water masers toward the massive protocluster NGC6334I observed before and after the recent outburst of MM1B in (sub)millimeter continuum. Since the outburst, the water maser emission toward MM1 has substantially weakened. Simultaneously, the strong water masers associated with the synchrotron continuum point source CM2 have flared by a mean factor of 6.5 (to 4.2 kJy) with highly-blueshifted features (up to 70 km/s from LSR) becoming more prominent. The strongest flaring water masers reside 3000 au north of MM1B and form a remarkable bow shock pattern whose vertex coincides with CM2 and tail points back to MM1B. Excited OH masers trace a secondary bow shock located ~120 au downstream. ALMA images of CS (6-5) reveal a highly-collimated north-south structure encompassing the flaring masers to the north and the non-flaring masers to the south seen in projection toward the MM3-UCHII region. Proper motions of the southern water masers over 5.3 years indicate a bulk projected motion of 117 km/s southward from MM1B with a dynamical time of 170 yr. We conclude that CM2, the water masers, and many of the excited OH masers trace the interaction of the high velocity bipolar outflow from MM1B with ambient molecular gas. The previously-excavated outflow cavity has apparently allowed the radiative energy of the current outburst to propagate freely until terminating at the northern bow shock where it strengthened the masers. Additionally, water masers have been detected toward MM7 for the first time, and a highly-collimated CS (6-5) outflow has been detected toward MM4.


title: What can linguistics and deep learning contribute to each other?

abstract: Joe Pater's target article calls for greater interaction between neural network research and linguistics. I expand on this call and show how such interaction can benefit both fields. Linguists can contribute to research on neural networks for language technologies by clearly delineating the linguistic capabilities that can be expected of such systems, and by constructing controlled experimental paradigms that can determine whether those desiderata have been met. In the other direction, neural networks can benefit the scientific study of language by providing infrastructure for modeling human sentence processing and for evaluating the necessity of particular innate constraints on language acquisition.


title: Absorption and emission features of $^7$Be{\sc II} in the outburst spectra of V838 Her (Nova Her 1991)

abstract: High and low resolution $IUE$ spectra of V838 Her in the early outburst stages exhibit a strong absorption feature shortward of $\lambda$3130. We discuss the nature of this spectral feature and provide convincing evidence that it corresponds to the blue-shifted resonance doublet of singly-ionized $^7$Be, recently discovered in other novae. During the evolution of the outburst the appearance of an emission feature close to $\lambda$3130 is also identified as $^7$Be II $\lambda$3132 because the usual identification as the O III $\lambda$3133.7 Bowen fluorescence line is hardly compatible with both the known oxygen under-abundance in the nova ejecta and the low optical depths in the nebula due to the high outflow velocity. The average $^7$Be abundance relative to hydrogen, estimated by four different methods, i.e. the $^7$Be II / Mg II absorption ratio, and the $^7$Be II / Mg II, $^7$Be II / He II$_{1640}$, and $^7$Be II / H$\beta$ emission ratios is N(Be)/N(H) $\approx$ 2.5 $\times 10^{-5}$ (by number), i.e. $\approx$ 1.7 $\times 10^{-4}$ by mass. This corresponds to an overproduction of $^7$Be by about 1 dex in comparison with the theoretical models of massive CO and ONe novae. Since $^7$Be all converts into $^7$Li, the $^7$Be/H abundance implies a $^7$Li/H overabundance of about 4 dex over the $^7$/H meteoritic value and indicates a total ejected mass of $^7$Li of $\approx$ 9.5$\times$10$^{-10}$ $M_{\odot}$. These data are in line with previous observations and indicate that large amounts of $^7$Li can be synthesized in a variety of novae, including very fast ONe novae.


title: The arithmetic of arithmetic Coxeter groups

abstract: In the 1990s, J.H. Conway published a combinatorial-geometric method for analyzing integer-valued binary quadratic forms (BQFs). Using a visualization he named the "topograph," Conway revisited the reduction of BQFs and the solution of quadratic Diophantine equations such as Pell's equation. It appears that the crux of his method is the coincidence between the arithmetic group $PGL_2({\mathbb Z})$ and the Coxeter group of type $(3,\infty)$. There are many arithmetic Coxeter groups, and each may have unforeseen applications to arithmetic. We introduce Conway's topograph, and generalizations to other arithmetic Coxeter groups. This includes a study of "arithmetic flags" and variants of binary quadratic forms.


title: Iterative Segmentation from Limited Training Data: Applications to Congenital Heart Disease

abstract: We propose a new iterative segmentation model which can be accurately learned from a small dataset. A common approach is to train a model to directly segment an image, requiring a large collection of manually annotated images to capture the anatomical variability in a cohort. In contrast, we develop a segmentation model that recursively evolves a segmentation in several steps, and implement it as a recurrent neural network. We learn model parameters by optimizing the interme- diate steps of the evolution in addition to the final segmentation. To this end, we train our segmentation propagation model by presenting incom- plete and/or inaccurate input segmentations paired with a recommended next step. Our work aims to alleviate challenges in segmenting heart structures from cardiac MRI for patients with congenital heart disease (CHD), which encompasses a range of morphological deformations and topological changes. We demonstrate the advantages of this approach on a dataset of 20 images from CHD patients, learning a model that accurately segments individual heart chambers and great vessels. Com- pared to direct segmentation, the iterative method yields more accurate segmentation for patients with the most severe CHD malformations.


title: Post-common-envelope binary stars, radiative levitation, and blue large-amplitude pulsators

abstract: Following the discovery of blue large-amplitude pulsators (BLAPs), single star evolu- tion models of post red giant branch stars that have undergone a common envelope (CE) ejection in the form of a high mass loss rate have been constructed and analysed for pulsation stability. The effects of atomic diffusion, particularly radiative levitation, have been examined. Two principal models were considered, being post-CE stars of 0.31 and 0.46 M$_{\odot}$. Such stars are likely, in turn, to become either low-mass helium white dwarfs or core helium-burning extreme horizontal-branch stars. The inclusion of radiative levitation leads to opacity driven pulsations in both types of post-CE object when their effective temperatures are comparable to those of BLAPs, with similar periods. The extent of the instability region for models in these simulations, which are not in thermal balance, is larger than that found for static models, in agreement with previous theory. By comparing to observations, and making some simple evolutionary assumptions, we conclude the 0.31 M$_{\odot}$ star is the more likely candidate for BLAPs. The rate of period change is negative for both cases, so the origin of BLAPs with positive rates of period change remain uncertain.


title: Searching for Efficient Multi-Scale Architectures for Dense Image Prediction

abstract: The design of neural network architectures is an important component for achieving state-of-the-art performance with machine learning systems across a broad array of tasks. Much work has endeavored to design and build architectures automatically through clever construction of a search space paired with simple learning algorithms. Recent progress has demonstrated that such meta-learning methods may exceed scalable human-invented architectures on image classification tasks. An open question is the degree to which such methods may generalize to new domains. In this work we explore the construction of meta-learning techniques for dense image prediction focused on the tasks of scene parsing, person-part segmentation, and semantic image segmentation. Constructing viable search spaces in this domain is challenging because of the multi-scale representation of visual information and the necessity to operate on high resolution imagery. Based on a survey of techniques in dense image prediction, we construct a recursive search space and demonstrate that even with efficient random search, we can identify architectures that outperform human-invented architectures and achieve state-of-the-art performance on three dense prediction tasks including 82.7\% on Cityscapes (street scene parsing), 71.3\% on PASCAL-Person-Part (person-part segmentation), and 87.9\% on PASCAL VOC 2012 (semantic image segmentation). Additionally, the resulting architecture is more computationally efficient, requiring half the parameters and half the computational cost as previous state of the art systems.


abstract: In this paper, we propose a novel Deep Micro-Dictionary Learning and Coding Network (DDLCN). DDLCN has most of the standard deep learning layers (pooling, fully, connected, input/output, etc.) but the main difference is that the fundamental convolutional layers are replaced by novel compound dictionary learning and coding layers. The dictionary learning layer learns an over-complete dictionary for the input training data. At the deep coding layer, a locality constraint is added to guarantee that the activated dictionary bases are close to each other. Next, the activated dictionary atoms are assembled together and passed to the next compound dictionary learning and coding layers. In this way, the activated atoms in the first layer can be represented by the deeper atoms in the second dictionary. Intuitively, the second dictionary is designed to learn the fine-grained components which are shared among the input dictionary atoms. In this way, a more informative and discriminative low-level representation of the dictionary atoms can be obtained. We empirically compare the proposed DDLCN with several dictionary learning methods and deep learning architectures. The experimental results on four popular benchmark datasets demonstrate that the proposed DDLCN achieves competitive results compared with state-of-the-art approaches.


title: Satellites of Infinite Rank in the Smooth Concordance Group

abstract: We conjecture that satellite operations are either constant or have infinite rank in the concordance group. We reduce this to the difficult case of winding number zero satellites, and use $SO(3)$ gauge theory to provide a general criterion sufficient for the image of a satellite operation to generate an infinite rank subgroup of the smooth concordance group $\mathcal{C}$. Our criterion applies widely; notably to many unknotted patterns for which the corresponding operators on the topological concordance group are zero. We raise some questions and conjectures regarding satellite operators and their interaction with concordance.


title: Fourier-Domain Optimization for Image Processing

abstract: Image optimization problems encompass many applications such as spectral fusion, deblurring, deconvolution, dehazing, matting, reflection removal and image interpolation, among others. With current image sizes in the order of megabytes, it is extremely expensive to run conventional algorithms such as gradient descent, making them unfavorable especially when closed-form solutions can be derived and computed efficiently. This paper explains in detail the framework for solving convex image optimization and deconvolution in the Fourier domain. We begin by explaining the mathematical background and motivating why the presented setups can be transformed and solved very efficiently in the Fourier domain. We also show how to practically use these solutions, by providing the corresponding implementations. The explanations are aimed at a broad audience with minimal knowledge of convolution and image optimization. The eager reader can jump to Section 3 for a footprint of how to solve and implement a sample optimization function, and Section 5 for the more complex cases.


title: Layerwise Perturbation-Based Adversarial Training for Hard Drive Health Degree Prediction

abstract: With the development of cloud computing and big data, the reliability of data storage systems becomes increasingly important. Previous researchers have shown that machine learning algorithms based on SMART attributes are effective methods to predict hard drive failures. In this paper, we use SMART attributes to predict hard drive health degrees which are helpful for taking different fault tolerant actions in advance. Given the highly imbalanced SMART datasets, it is a nontrivial work to predict the health degree precisely. The proposed model would encounter overfitting and biased fitting problems if it is trained by the traditional methods. In order to resolve this problem, we propose two strategies to better utilize imbalanced data and improve performance. Firstly, we design a layerwise perturbation-based adversarial training method which can add perturbations to any layers of a neural network to improve the generalization of the network. Secondly, we extend the training method to the semi-supervised settings. Then, it is possible to utilize unlabeled data that have a potential of failure to further improve the performance of the model. Our extensive experiments on two real-world hard drive datasets demonstrate the superiority of the proposed schemes for both supervised and semi-supervised classification. The model trained by the proposed method can correctly predict the hard drive health status 5 and 15 days in advance. Finally, we verify the generality of the proposed training method in other similar anomaly detection tasks where the dataset is imbalanced. The results argue that the proposed methods are applicable to other domains.


title: Studies of Dimension-Six EFT effects in Vector Boson Scattering

abstract: We discuss the implications of dimension-six operators of the Effective Field Theory (EFT) framework in the study of Vector Boson Scattering (VBS) in the $pp \to Z Z j j $ channel. We show that operators of dimension-six should not be neglected in favour of those of dimension-eight. We observe that this process is very sensitive to some of the operators commonly fit using LEP and Higgs data, and that it can be used to improve the bounds on the former. Further we show that other operators than the ones generating anomalous triple and quartic gauge couplings (aTGCs/aQCGs) can have a non-negligible impact on the total and differential rates and their shapes. For this reason, a correct interpretation of the experimental results can only be achieved by including all the relevant, bosonic and fermionic operators; we finally discuss how such an interpretation of experimental measurements can be done.


title: A Comparison between Radio Loud and Quiet Gamma-Ray Bursts, and Evidence for a Potential Correlation between Intrinsic Duration and Redshift in the Radio Loud Population

abstract: We extend our study of energetic radio loud and quiet gamma-ray bursts (GRBs), suggesting these GRBs potentially come from two separate progenitor systems. We expand the sample from our previous paper (Lloyd-Ronning & Fryer, 2017) and find our results are strengthened - radio quiet GRBs have significantly shorter intrinsic prompt duration, and are also less energetic on average. However, the tenuous correlation between isotropic energy and intrinsic duration in the radio dark sample remains tenuous and is slightly weakened by adding more bursts. Interestingly, we find an anti-correlation between the intrinsic duration and redshift in the radio bright sample but not the radio dark sample, further supporting that these two samples may come from separate progenitors. We also find that very high energy (0.1 - 100 GeV) extended emission is only present in the radio loud sample. There is no significant difference between the presence of X-ray/optical plateaus or the average jet opening angles between the two samples. We explore the interpretation of these results in the context of different progenitor models. The data are consistent with the radio loud GRBs coming from a Helium-merger system and the radio quiet GRBs coming from a collapsar system, but may also reflect other dichotomies in the inner engine such as a neutron star versus black hole core.


title: Discovering Low-Precision Networks Close to Full-Precision Networks for Efficient Embedded Inference

abstract: To realize the promise of ubiquitous embedded deep network inference, it is essential to seek limits of energy and area efficiency. To this end, low-precision networks offer tremendous promise because both energy and area scale down quadratically with the reduction in precision. Here we demonstrate ResNet-18, -34, -50, -152, Inception-v3, Densenet-161, and VGG-16bn networks on the ImageNet classification benchmark that, at 8-bit precision exceed the accuracy of the full-precision baseline networks after one epoch of finetuning, thereby leveraging the availability of pretrained models. We also demonstrate ResNet-18, -34, -50, -152, Densenet-161, and VGG-16bn 4-bit models that match the accuracy of the full-precision baseline networks -- the highest scores to date. Surprisingly, the weights of the low-precision networks are very close (in cosine similarity) to the weights of the corresponding baseline networks, making training from scratch unnecessary. We find that gradient noise due to quantization during training increases with reduced precision, and seek ways to overcome this noise. The number of iterations required by SGD to achieve a given training error is related to the square of (a) the distance of the initial solution from the final plus (b) the maximum variance of the gradient estimates. Therefore, we (a) reduce solution distance by starting with pretrained fp32 precision baseline networks and fine-tuning, and (b) combat gradient noise introduced by quantization by training longer and reducing learning rates. Sensitivity analysis indicates that these simple techniques, coupled with proper activation function range calibration to take full advantage of the limited precision, are sufficient to discover low-precision networks, if they exist, close to fp32 precision baseline networks. The results herein provide evidence that 4-bits suffice for classification.


title: Hadronic Final States in DIS at NNLO QCD with Parton Showers

abstract: We present a parton-shower matched NNLO QCD calculation for hadronic final state production in Deep Inelastic Scattering. The computation is based on the UNLOPS method and is implemented in the publicly available event generation framework SHERPA. Results are compared to measurements performed by the H1 collaboration.


title: Faster Variational Execution with Transparent Bytecode Transformation

abstract: Variational execution is a novel dynamic analysis technique for exploring highly configurable systems and accurately tracking information flow. It is able to efficiently analyze many configurations by aggressively sharing redundancies of program executions. The idea of variational execution has been demonstrated to be effective in exploring variations in the program, especially when the configuration space grows out of control. Existing implementations of variational execution often require heavy lifting of the runtime interpreter, which is painstaking and error-prone. Furthermore, the performance of this approach is suboptimal. For example, the state-of-the-art variational execution interpreter for Java, VarexJ, slows down executions by 100 to 800 times over a single execution for small to medium size Java programs. Instead of modifying existing JVMs, we propose to transform existing bytecode to make it variational, so it can be executed on an unmodified commodity JVM. Our evaluation shows a dramatic improvement on performance over the state-of-the-art, with a speedup of 2 to 46 times, and high efficiency in sharing computations.


title: Inner vectors for Toeplitz operators

abstract: In this paper we survey and bring together several approaches to obtaining inner functions for Toeplitz operators. These approaches include the classical definition, the Wold decomposition, the operator-valued Poisson Integral, and Clark measures. We then extend these notions somewhat to inner functions on model spaces. Along the way we present some novel examples.


title: Clinically Deployed Distributed Magnetic Resonance Imaging Reconstruction: Application to Pediatric Knee Imaging

abstract: Magnetic resonance imaging is capable of producing volumetric images without ionizing radiation. Nonetheless, long acquisitions lead to prohibitively long exams. Compressed sensing (CS) can enable faster scanning via sub-sampling with reduced artifacts. However, CS requires significantly higher reconstruction computation, limiting current clinical applications to 2D/3D or limited-resolution dynamic imaging. Here we analyze the practical limitations to T2 Shuffling, a four-dimensional CS-based acquisition, which provides sharp 3D-isotropic-resolution and multi-contrast images in a single scan. Our improvements to the pipeline on a single machine provide a 3x overall reconstruction speedup, which allowed us to add algorithmic changes improving image quality. Using four machines, we achieved additional 2.1x improvement through distributed parallelization. Our solution reduced the reconstruction time in the hospital to 90 seconds on a 4-node cluster, enabling its use clinically. To understand the implications of scaling this application, we simulated running our reconstructions with a multiple scanner setup typical in hospitals.


title: Probing Gravitational Lensing of the CMB with SDSS-IV Quasars

abstract: We study the cross-correlation between the Planck CMB lensing convergence map and the eBOSS quasar overdensity obtained from the Sloan Digital Sky Survey (SDSS) IV, in the redshift range $0.9 < z < 2.2$. We detect the CMB lensing convergence-quasar cross power spectrum at $5.4 \sigma$ significance. The cross power spectrum provides a quasar clustering bias measurement that is expected to be particularly robust against systematic effects. The redshift distribution of the quasar sample has a median redshift $z \approx 1.55$, and an effective redshift about $1.51$. The best fit bias of the quasar sample is $b_q = 2.43 \pm 0.45$, corresponding to a host halo mass of $\log_{10}\left( \frac{M}{h^{-1} M_\odot} \right) = 12.54^{+0.25}_{-0.36}$. This is broadly consistent with the previous literature on quasars with a similar redshift range and selection. Since our constraint on the bias comes from the cross-correlation between quasars and CMB lensing, we expect it to be robust to a wide range of possible systematic effects that may contaminate the auto correlation of quasars. We checked for a number of systematic effects from both CMB lensing and quasar overdensity, and found that all systematics are consistent with null within $2 \sigma$. The data is not sensitive to a possible scale dependence of the bias at present, but we expect that as the number of quasars increases (in future surveys such as DESI), it is likely that strong constraints on the scale dependence of the bias can be obtained.


title: Change-Point Detection on Hierarchical Circadian Models

abstract: This paper addresses the problem of change-point detection on sequences of high-dimensional and heterogeneous observations, which also possess a periodic temporal structure. Due to the dimensionality problem, when the time between change-points is on the order of the dimension of the model parameters, drifts in the underlying distribution can be misidentified as changes. To overcome this limitation, we assume that the observations lie in a lower-dimensional manifold that admits a latent variable representation. In particular, we propose a hierarchical model that is computationally feasible, widely applicable to heterogeneous data and robust to missing instances. Additionally, the observations' periodic dependencies are captured by non-stationary periodic covariance functions. The proposed technique is particularly fitted to (and motivated by) the problem of detecting changes in human behavior using smartphones and its application to relapse detection in psychiatric patients. Finally, we validate the technique on synthetic examples and we demonstrate its utility in the detection of behavioral changes using real data acquired by smartphones.


title: Optimization with Non-Differentiable Constraints with Applications to Fairness, Recall, Churn, and Other Goals

abstract: We show that many machine learning goals, such as improved fairness metrics, can be expressed as constraints on the model's predictions, which we call rate constraints. We study the problem of training non-convex models subject to these rate constraints (or any non-convex and non-differentiable constraints). In the non-convex setting, the standard approach of Lagrange multipliers may fail. Furthermore, if the constraints are non-differentiable, then one cannot optimize the Lagrangian with gradient-based methods. To solve these issues, we introduce the proxy-Lagrangian formulation. This new formulation leads to an algorithm that produces a stochastic classifier by playing a two-player non-zero-sum game solving for what we call a semi-coarse correlated equilibrium, which in turn corresponds to an approximately optimal and feasible solution to the constrained optimization problem. We then give a procedure which shrinks the randomized solution down to one that is a mixture of at most $m+1$ deterministic solutions, given $m$ constraints. This culminates in algorithms that can solve non-convex constrained optimization problems with possibly non-differentiable and non-convex constraints with theoretical guarantees. We provide extensive experimental results enforcing a wide range of policy goals including different fairness metrics, and other goals on accuracy, coverage, recall, and churn.


title: Synthetic Attribute Data for Evaluating Consumer-side Fairness

abstract: When evaluating recommender systems for their fairness, it may be necessary to make use of demographic attributes, which are personally sensitive and usually excluded from publicly-available data sets. In addition, these attributes are fixed and therefore it is not possible to experiment with different distributions using the same data. In this paper, we describe the Frequency-Linked Attribute Generation (FLAG) algorithm, and show its applicability for assigning synthetic demographic attributes to recommendation data sets.


title: Sharp sectional curvature bounds and a new proof of The Spectral Theorem

abstract: We algebraically compute all possible sectional curvature values for canonical algebraic curvature tensors, and use this result to give a method for constructing general sectional curvature bounds. We use a well-known method to geometrically realize these results to produce a hypersurface with prescribed sectional curvatures at a point. By extending our methods, we give a relatively short proof of the Spectral Theorem for self-adjoint operators on a finite dimensional real vector space.


title: Wave Packets in Curved Space: Curvature-Field Coupling

abstract: Elastic wave propagation is a century-old problem. Unlike on a flat manifold, analytical solution is not well established for a curved manifold. In this study we take a step towards building an analytical framework for solving the elastic wave propagation problem on an arbitrary manifold which admits a Riemannian metric with a global non-zero scalar curvature. We demonstrate the accuracy of the method by solving for some test cases, and also discuss some interesting physical insight that comes from solving the wave equations for non-vanishing curvature.


title: Genuinely entangled subspace with all-encompassing distillable entanglement across every bipartition

abstract: In a multipartite scenario quantum entanglement manifests its most dramatic form when the state is genuinely entangled. Such a state is more beneficial for information theoretic applications if it contains distillable entanglement in every bipartition. It is, therefore, of significant operational interest to identify subspaces of multipartite quantum systems that contain such properties apriori. In this letter, we introduce the notion of unextendible biseparable bases (UBB) that provides an adequate method to construct genuinely entangled subspaces (GES). We provide an explicit construction of two types of UBBs -- party symmetric and party asymmetric -- for every $3$-{\it qudit} quantum system, with local dimension d\ge 3. Further, we show that the GES resulting from the symmetric construction is indeed a {\it bidistillable} subspace, i.e., all the states supported on it contain distillable entanglement across every bipartition.


title: Multimodal neural pronunciation modeling for spoken languages with logographic origin

abstract: Graphemes of most languages encode pronunciation, though some are more explicit than others. Languages like Spanish have a straightforward mapping between its graphemes and phonemes, while this mapping is more convoluted for languages like English. Spoken languages such as Cantonese present even more challenges in pronunciation modeling: (1) they do not have a standard written form, (2) the closest graphemic origins are logographic Han characters, of which only a subset of these logographic characters implicitly encodes pronunciation. In this work, we propose a multimodal approach to predict the pronunciation of Cantonese logographic characters, using neural networks with a geometric representation of logographs and pronunciation of cognates in historically related languages. The proposed framework improves performance by 18.1% and 25.0% respective to unimodal and multimodal baselines.


title: Possible determination of high-lying single particle components with (p,d) reactions

abstract: A detailed feasibility study on deducing the high-lying single-particle components (HLSPCs), which are important but used to be ignored, in the ground and low-lying excited states of even-even light nuclei is performed by analyses of $(p,d)$ reactions with \nuc{12}{C}, \nuc{24}{Mg}, \nuc{28}{Si}, and \nuc{40}{Ca} targets at 51.93 MeV. Coupled reaction channels (CRC) analyses have been made for $(p,d)$ transitions to the $j$-forbidden excited states in \nuc{11}{C} (${\tfrac{5}{2}}^-$, 4.32 MeV), \nuc{23}{Mg} (${\tfrac{7}{2}}^+$, 2.05 MeV), \nuc{27}{Si} (${\tfrac{7}{2}}^+$, 2.16 MeV) and \nuc{39}{Ca} (${\tfrac{9}{2}}^-$, 3.64 MeV), including the major allowed transition components together with direct components of HLSPCs. Spectroscopic amplitudes of the HLSPCs are deduced by fitting the angular distributions of the ground and the $j$-forbidden excited states simultaneously. The present analysis demonstrates for the first time that information about HLSPCs in atomic nuclei can be obtained from analysis of $(p,d)$ reactions.


title: Colorings and doubled colorings of virtual doodles

abstract: A virtual doodle is an equivalence class of virtual diagrams under an equivalence relation generated by flat version of classical Reidemesiter moves and virtual Reidemsiter moves such that Reidemeister moves of type 3 are forbidden. In this paper we discuss colorings of virtual diagrams using an algebra, called a doodle switch, and define an invariant of virtual doodles. Besides usual colorings of diagrams, we also introduce doubled colorings.


title: Temporal Pattern Attention for Multivariate Time Series Forecasting

abstract: Forecasting multivariate time series data, such as prediction of electricity consumption, solar power production, and polyphonic piano pieces, has numerous valuable applications. However, complex and non-linear interdependencies between time steps and series complicate the task. To obtain accurate prediction, it is crucial to model long-term dependency in time series data, which can be achieved to some good extent by recurrent neural network (RNN) with attention mechanism. Typical attention mechanism reviews the information at each previous time step and selects the relevant information to help generate the outputs, but it fails to capture the temporal patterns across multiple time steps. In this paper, we propose to use a set of filters to extract time-invariant temporal patterns, which is similar to transforming time series data into its "frequency domain". Then we proposed a novel attention mechanism to select relevant time series, and use its "frequency domain" information for forecasting. We applied the proposed model on several real-world tasks and achieved state-of-the-art performance in all of them with only one exception.


title: Cross Correlation-based Direct Positioning for Wideband Sources using Phased Arrays

abstract: Recent developments in Phased Array direct positioning methods have improved accuracy for passively geo-locating multiple radio frequency-emitting signal sources. However, the number of geo-localisable signal sources is still limited by the number of antenna elements at each node. This is the limitation for methods based on MUSIC, otherwise known as signal subspace identification. This paper attempts to exploit properties of wideband signal sources to compartmentalise signals into their respective Time Differences of Arrival. By performing direct positioning after the compartmentalisation process, we will show that geolocation of a large number of sources can be achieved by our proposed method at accuracies that exceed all existing methods, especially under low signal-to-noise ratio conditions.


title: Convolutional Neural Network Approach for EEG-based Emotion Recognition using Brain Connectivity and its Spatial Information

abstract: Emotion recognition based on electroencephalography (EEG) has received attention as a way to implement human-centric services. However, there is still much room for improvement, particularly in terms of the recognition accuracy. In this paper, we propose a novel deep learning approach using convolutional neural networks (CNNs) for EEG-based emotion recognition. In particular, we employ brain connectivity features that have not been used with deep learning models in previous studies, which can account for synchronous activations of different brain regions. In addition, we develop a method to effectively capture asymmetric brain activity patterns that are important for emotion recognition. Experimental results confirm the effectiveness of our approach.


title: Bidirectional Evaluation with Direct Manipulation

abstract: We present an evaluation update (or simply, update) algorithm for a full-featured functional programming language, which synthesizes program changes based on output changes. Intuitively, the update algorithm retraces the steps of the original evaluation, rewriting the program as needed to reconcile differences between the original and updated output values. Our approach, furthermore, allows expert users to define custom lenses that augment the update algorithm with more advanced or domain-specific program updates. To demonstrate the utility of evaluation update, we implement the algorithm in Sketch-n-Sketch, a novel direct manipulation programming system for generating HTML documents. In Sketch-n-Sketch, the user writes an ML-style functional program to generate HTML output. When the user directly manipulates the output using a graphical user interface, the update algorithm reconciles the changes. We evaluate bidirectional evaluation in Sketch-n-Sketch by authoring ten examples comprising approximately 1400 lines of code in total. These examples demonstrate how a variety of HTML documents and applications can be developed and edited interactively in Sketch-n-Sketch, mitigating the tedious edit-run-view cycle in traditional programming environments.


title: Electromagnetic fields induced by an electric charge near a Weyl semimetal

abstract: Weyl semimetals (WSM) are a new class of topological materials that exhibit a bulk Hall effect due to time-reversal symmetry breaking, as well as a chiral magnetic effect due to inversion symmetry breaking. These unusual electromagnetic responses can be characterized by an axion term $\theta \textbf{E} \cdot \textbf{B}$ with space and time dependent axion angle $\theta (\textbf{r} ,t)$. In this paper we compute the electromagnetic fields produced by an electric charge near to a topological Weyl semimetal with two Weyl nodes in the bulk Brillouin zone. We find that, as in ordinary metals and dielectrics, outside the WSM the electric field is mainly determined by the optical properties of the material. The magnetic field is, on the contrary, of topological origin in nature due to the magnetoelectric effect of topological phases. We show that the magnetic field exhibits a particularly interesting behavior above the WSM: the field lines begin at the surface and then end at the surface (but not at the same point). This behavior is quite different from that produced by an electric charge near the surface of a topological insulator, where the magnetic field above the surface is generated by an image magnetic monopole beneath the surface, in which case, the magnetic field lines are straight rays. The unconventional behavior of the magnetic field is an experimentally observable signature of the anomalous Hall effect in the bulk of the WSM. We discuss a simple candidate material for testing our predictions, as well as two experimental setups which must be sensitive to the effects of the induced magnetic field.


title: On scattering for the defocusing high dimensional inter-critical NLS

abstract: In this paper, we study the critical norm conjecture for the inter-critical nonlinear Schr{\"o}dinger equation with critical index $s_c$ satisfying $\frac{1}{2}<s_c<1$ when $d\geq 5$. Under the assumption of uniform boundedness of the critical norm, we prove the global well-posedness and scattering for the Cauchy problem. We follow the standard `Concentration compactness/Rigidity method' established in \cite{KenigMerle1,KenigMerle2}, and treat three scenarios for the critical element respectively. Moreover, double Duhamel method and interaction Morawetz estimate are applied to exclude the critical element.


title: Hyperspectral Image Classification in the Presence of Noisy Labels

abstract: Label information plays an important role in supervised hyperspectral image classification problem. However, current classification methods all ignore an important and inevitable problem---labels may be corrupted and collecting clean labels for training samples is difficult, and often impractical. Therefore, how to learn from the database with noisy labels is a problem of great practical importance. In this paper, we study the influence of label noise on hyperspectral image classification, and develop a random label propagation algorithm (RLPA) to cleanse the label noise. The key idea of RLPA is to exploit knowledge (e.g., the superpixel based spectral-spatial constraints) from the observed hyperspectral images and apply it to the process of label propagation. Specifically, RLPA first constructs a spectral-spatial probability transfer matrix (SSPTM) that simultaneously considers the spectral similarity and superpixel based spatial information. It then randomly chooses some training samples as "clean" samples and sets the rest as unlabeled samples, and propagates the label information from the "clean" samples to the rest unlabeled samples with the SSPTM. By repeating the random assignment (of "clean" labeled samples and unlabeled samples) and propagation, we can obtain multiple labels for each training sample. Therefore, the final propagated label can be calculated by a majority vote algorithm. Experimental studies show that RLPA can reduce the level of noisy label and demonstrates the advantages of our proposed method over four major classifiers with a significant margin---the gains in terms of the average OA, AA, Kappa are impressive, e.g., 9.18%, 9.58%, and 0.1043. The Matlab source code is available at https://github.com/junjun-jiang/RLPA


title: V$_5$S$_8$: a Kondo lattice based on intercalation of van der Waals layered transition metal dichalcogenide

abstract: Since the discovery of graphene, a tremendous amount of two dimensional (2D) materials have surfaced. Their electronic properties can usually be well understood without considering correlations between electrons. On the other hand, strong electronic correlations are known to give rise to a variety of exotic properties and new quantum phases, for instance, high temperature superconductivity, heavy fermions and quantum spin liquids. The study of these phenomena has been one of the main focuses of condensed matter physics. There is a strong incentive to introduce electronic correlations into 2D materials. Via intercalating a van der Waals layered compound VS$_2$, we show an emergence of a Kondo lattice, an extensively studied strongly correlated system, by magnetic, specific heat, electrical and thermoelectric transport studies. In particular, an exceptionally large Sommerfeld coefficient, 440 mJ$\cdot$K$^{-2}\cdot$mol$^{-1}$, indicates a strong electron correlation. The obtained Kadowaki-Woods ratio, $2.7\times 10^{-6}$ $\mu\Omega\cdot$cm$\cdot$mol$^2\cdot$K$^2\cdot$mJ$^{-2}$, also supports the strong electron-electron interaction. The temperature dependence of the resistivity and thermopower corroborate the Kondo lattice picture. The intercalated compound is one of a few rare examples of $d$-electron Kondo lattices. We further show that the Kondo physics persists in ultra-thin films. This work thus demonstrates a route to generate strong correlations in 2D materials.


title: Automatic, Personalized, and Flexible Playlist Generation using Reinforcement Learning

abstract: Songs can be well arranged by professional music curators to form a riveting playlist that creates engaging listening experiences. However, it is time-consuming for curators to timely rearrange these playlists for fitting trends in future. By exploiting the techniques of deep learning and reinforcement learning, in this paper, we consider music playlist generation as a language modeling problem and solve it by the proposed attention language model with policy gradient. We develop a systematic and interactive approach so that the resulting playlists can be tuned flexibly according to user preferences. Considering a playlist as a sequence of words, we first train our attention RNN language model on baseline recommended playlists. By optimizing suitable imposed reward functions, the model is thus refined for corresponding preferences. The experimental results demonstrate that our approach not only generates coherent playlists automatically but is also able to flexibly recommend personalized playlists for diversity, novelty and freshness.


title: Dynamic Interaction Probabilistic Movement Primitives

abstract: Human-robot collaboration is on the rise. Robots need to increasingly improve the efficiency and smoothness with which they assist humans by properly anticipating a human's intention. To do so, prediction models need to increase their accuracy and responsiveness. This work builds on top of Interaction Movement Primitives with phase estimation and re-formulates the framework to use dynamic human-motion observations which constantly update anticipatory motions. The original framework only considers a single fixed-duration static human observation which is used to perform only one anticipatory motion. Dynamic observations, with built-in phase estimation, yield a series of updated robot motion distributions. Co-activation is performed between the existing and newest most probably robot motion distribution. This results in smooth anticipatory robot motions that are highly accurate and with enhanced responsiveness.


title: On Markov Chain Gradient Descent

abstract: Stochastic gradient methods are the workhorse (algorithms) of large-scale optimization problems in machine learning, signal processing, and other computational sciences and engineering. This paper studies Markov chain gradient descent, a variant of stochastic gradient descent where the random samples are taken on the trajectory of a Markov chain. Existing results of this method assume convex objectives and a reversible Markov chain and thus have their limitations. We establish new non-ergodic convergence under wider step sizes, for nonconvex problems, and for non-reversible finite-state Markov chains. Nonconvexity makes our method applicable to broader problem classes. Non-reversible finite-state Markov chains, on the other hand, can mix substatially faster. To obtain these results, we introduce a new technique that varies the mixing levels of the Markov chains. The reported numerical results validate our contributions.


title: Gyrokinetic simulation of ITG turbulence with toroidal geometry including the magnetic axis by using field-aligned coordinates

abstract: Abstract Simulation domain in field-aligned coordinates of the electrostatic gyrokinetic nonlinear turbulence global code, NLT, is extended to include the magnetic axis. The artificial boundary near the magnetic axis is replaced by the natural boundary. The singularity at the magnetic axis in Vlasov solver is treated by considering the spatial relation of fixed grid points in field-aligned coordinates. A new Poisson's equation solver is developed, the coefficient matrix of algebraic equations is derived by using Gauss's theorem. Nonlinear relaxation test of the ITG turbulence with adiabatic electrons is performed. The gyrocenter conservation is much improved by including the magnetic axis in the simulation domain. The zonal field and the radial distribution of the perturbed electrostatic potential are different from previous results without the magnetic axis.


title: Cosmological constraints on $\Lambda(\alpha)$CDM models with time-varying fine structure constant

abstract: We study the $\Lambda(\alpha)$CDM models with $\Lambda(\alpha)$ being a function of the time-varying fine structure constant $\alpha$. We give a close look at the constraints on two specific $\Lambda(\alpha)$CDM models with one and two model parameters, respectively, based on the cosmological observational measurements along with 313 data points for the time-varying $\alpha$. We find that the model parameters are constrained to be around $10^{-4}$, which are similar to the results discussed previously but more accurately.


title: Security and Privacy Enhancement for Outsourced Biometric Identification

abstract: A lot of research has been focused on secure outsourcing of biometric identification in the context of cloud computing. In such schemes, both the encrypted biometric database and the identification process are outsourced to the cloud. The ultimate goal is to protect the security and privacy of the biometric database and the query templates. Security analysis shows that previous schemes suffer from the enrolment attack and unnecessarily expose more information than needed. In this paper, we propose a new secure outsourcing scheme aims at enhancing the security from these two aspects. First, besides all the attacks discussed in previous schemes, our proposed scheme is also secure against the enrolment attack. Second, we model the identification process as a fixed radius similarity query problem instead of the kNN search problem. Such a modelling is able to reduce the exposed information thus enhancing the privacy of the biometric database. Our comprehensive security and complexity analysis show that our scheme is able to enhance the security and privacy of the biometric database and query templates while maintaining the same computational savings from outsourcing.


title: Variation of Contact Resonance Frequency during Domain Switching in PFM Measurements for Ferroelectric Materials

abstract: Piezoresponse Force Spectroscopy (PFS) is a powerful method widely used for measuring the nanoscale ferroelectric responses of the materials. However, it is found that certain non-ferroelectric materials can also generate similar responses from the PFS measurements due to many other factors, hence, it is believed that PFS alone is not sufficient to differentiate the ferroelectric and non-ferroelectric materials. On the other hands, this work shows that there are distinct differences in contact resonance frequency variation during the PFS measurements for ferroelectric and non-ferroelectric materials. Therefore, a new, simple and effective method is proposed to differentiate the responses from the ferroelectric and non-ferroelectric materials, this new analysis uses contact resonance frequency responses during the PFS measurements as a new parameter to differentiate the PFS measured responses from different materials.


title: Constrained optimization as ecological dynamics with applications to random quadratic programming in high dimensions

abstract: Quadratic programming (QP) is a common and important constrained optimization problem. Here, we derive a surprising duality between constrained optimization with inequality constraints -- of which QP is a special case -- and consumer resource models describing ecological dynamics. Combining this duality with a recent `cavity solution', we analyze high-dimensional, random QP where the optimization function and constraints are drawn randomly. Our theory shows remarkable agreement with numerics and points to a deep connection between optimization, dynamical systems, and ecology.

categories: cond-mat.stat-mech cond-mat.dis-nn math.OC q-bio.PE


title: Correlators exceeding one in continuous measurements of superconducting qubits

abstract: We consider the effect of phase backaction on the correlator $\langle I(t)\, I(t+\tau )\rangle$ for the output signal $I(t)$ from continuous measurement of a qubit. We demonstrate that the interplay between informational and phase backactions in the presence of Rabi oscillations can lead to the correlator becoming larger than 1, even though $|\langle I\rangle|\leq 1$. The correlators can be calculated using the generalized "collapse recipe" which we validate using the quantum Bayesian formalism. The recipe can be further generalized to the case of multi-time correlators and arbitrary number of detectors, measuring non-commuting qubit observables. The theory agrees well with experimental results for continuous measurement of a transmon qubit. The experimental correlator exceeds the bound of 1 for a sufficiently large angle between the amplified and informational quadratures, causing the phase backaction. The demonstrated effect can be used to calibrate the quadrature misalignment.


title: Screening magnetic two-dimensional atomic crystals with nontrivial electronic topology

abstract: To date only a few two-dimensional (2D) magnetic crystals were experimentally confirmed, such as CrI3 and CrGeTe3, all with very low Curie temperatures (TC). High-throughput first-principles screening over a large set of materials yields 89 magnetic monolayers including 56 ferromagnetic (FM) and 33 antiferromagnetic compounds. Among them, 24 FM monolayers are promising candidates possessing TC higher than that of CrI3. High TC monolayers with fascinating electronic phases are identified: (i) quantum anomalous and valley Hall effects coexist in a single material RuCl3 or VCl3, leading to a valley-polarized quantum anomalous Hall state; (ii) TiBr3, Co2NiO6 and V2H3O5 are revealed to be half-metals. More importantly, a new type of fermion dubbed type-II Weyl ring is discovered in ScCl. Our work provides a database of 2D magnetic materials, which could guide experimental realization of high-temperature magnetic monolayers with exotic electronic states for future spintronics and quantum computing applications.


title: Access to Population-Level Signaling as a Source of Inequality

abstract: We identify and explore differential access to population-level signaling (also known as information design) as a source of unequal access to opportunity. A population-level signaler has potentially noisy observations of a binary type for each member of a population and, based on this, produces a signal about each member. A decision-maker infers types from signals and accepts those individuals whose type is high in expectation. We assume the signaler of the disadvantaged population reveals her observations to the decision-maker, whereas the signaler of the advantaged population forms signals strategically. We study the expected utility of the populations as measured by the fraction of accepted members, as well as the false positive rates (FPR) and false negative rates (FNR). We first show the intuitive results that for a fixed environment, the advantaged population has higher expected utility, higher FPR, and lower FNR, than the disadvantaged one (despite having identical population quality), and that more accurate observations improve the expected utility of the advantaged population while harming that of the disadvantaged one. We next explore the introduction of a publicly-observable signal, such as a test score, as a potential intervention. Our main finding is that this natural intervention, intended to reduce the inequality between the populations' utilities, may actually exacerbate it in settings where observations and test scores are noisy.


title: On the dispersionless Davey-Stewartson system: Hamiltonian vector fields Lax pair and relevant nonlinear Riemann-Hilbert problem for dDS-II system

abstract: In this paper, the semiclassical limit of Davey-Stewartson systems are studied. It shows that these dispersionless limited integrable systems of hydrodynamic type, which are defined as dDS (dispersionless Davey-Stewartson) systems, are arisen from the commutation condition of Lax pairs of one-parameter vector fields. The relevant nonlinear Riemann-Hilbert problems with some symmetries for the dDS-II system are also constructed. This kind of Riemann-Hilbert problems are meaningful for applying the formal inverse scattering transform method, recently developed by Manakov and Santini, to study the dDS-II system .


title: Attention based visual analysis for fast grasp planning with multi-fingered robotic hand

abstract: We present an attention based visual analysis framework to compute grasp-relevant information in order to guide grasp planning using a multi-fingered robotic hand. Our approach uses a computational visual attention model to locate regions of interest in a scene, and uses a deep convolutional neural network to detect grasp type and point for a sub-region of the object presented in a region of interest. We demonstrate the proposed framework in object grasping tasks, in which the information generated from the proposed framework is used as prior information to guide the grasp planning. Results show that the proposed framework can not only speed up grasp planning with more stable configurations, but also is able to handle unknown objects. Furthermore, our framework can handle cluttered scenarios. A new Grasp Type Dataset (GTD) that considers 6 commonly used grasp types and covers 12 household objects is also presented.


title: Deep Co-investment Network Learning for Financial Assets

abstract: Most recent works model the market structure of the stock market as a correlation network of the stocks. They apply pre-defined patterns to extract correlation information from the time series of stocks. Without considering the influences of the evolving market structure to the market index trends, these methods hardly obtain the market structure models which are compatible with the market principles. Advancements in deep learning have shown their incredible modeling capacity on various finance-related tasks. However, the learned inner parameters, which capture the essence of the finance time series, are not further exploited about their representation in the financial fields. In this work, we model the financial market structure as a deep co-investment network and propose a Deep Co-investment Network Learning (DeepCNL) method. DeepCNL automatically learns deep co-investment patterns between any pairwise stocks, where the rise-fall trends of the market index are used for distance supervision. The learned inner parameters of the trained DeepCNL, which encodes the temporal dynamics of deep co-investment patterns, are used to build the co-investment network between the stocks as the investment structure of the corresponding market. We verify the effectiveness of DeepCNL on the real-world stock data and compare it with the existing methods on several financial tasks. The experimental results show that DeepCNL not only has the ability to better reflect the stock market structure that is consistent with widely-acknowledged financial principles but also is more capable to approximate the investment activities which lead to the stock performance reported in the real news or research reports than other alternatives.


title: Ensemble of Convolutional Neural Networks for Automatic Grading of Diabetic Retinopathy and Macular Edema

abstract: In this manuscript, we automate the procedure of grading of diabetic retinopathy and macular edema from fundus images using an ensemble of convolutional neural networks. The availability of limited amount of labeled data to perform supervised learning was circumvented by using transfer learning approach. The models in the ensemble were pre-trained on a large dataset comprising natural images and were later fine-tuned with the limited data for the task of choice. For an image, the ensemble of classifiers generate multiple predictions, and a max-voting based approach was utilized to attain the final grade of the anomaly in the image. For the task of grading DR, on the test data (n=56), the ensemble achieved an accuracy of 83.9\%, while for the task for grading macular edema the network achieved an accuracy of 95.45% (n=44).


title: EEG-based video identification using graph signal modeling and graph convolutional neural network

abstract: This paper proposes a novel graph signal-based deep learning method for electroencephalography (EEG) and its application to EEG-based video identification. We present new methods to effectively represent EEG data as signals on graphs, and learn them using graph convolutional neural networks. Experimental results for video identification using EEG responses obtained while watching videos show the effectiveness of the proposed approach in comparison to existing methods. Effective schemes for graph signal representation of EEG are also discussed.


title: Trajectory Generation for Multiagent Point-To-Point Transitions via Distributed Model Predictive Control

abstract: This paper introduces a novel algorithm for multiagent offline trajectory generation based on distributed model predictive control. Central to the algorithm's scalability and success is the development of an on-demand collision avoidance strategy. By predicting future states and sharing this information with their neighbors, the agents are able to detect and avoid collisions while moving toward their goals. The proposed algorithm can be implemented in a distributed fashion and reduces the computation time by more than 85% compared to previous optimization approaches based on sequential convex programming, while only having a small impact on the optimality of the plans. The approach was validated both through extensive simulations and experimentally with teams of up to 25 quadrotors flying in confined indoor spaces.


title: Concentration for Coulomb gases on compact manifolds

abstract: We study the non-asymptotic behavior of a Coulomb gas on a compact Riemannian manifold. This gas is a symmetric n-particle Gibbs measure associated to the two-body interaction energy given by the Green function. We encode such a particle system by using an empirical measure. Our main result is a concentration inequality in Kantorovich-Wasserstein distance inspired from the work of Chafa\"i, Hardy and Ma\"ida on the Euclidean space. Their proof involves large deviation techniques together with an energy-distance comparison and a regularization procedure based on the superharmonicity of the Green function. This last ingredient is not available on a manifold. We solve this problem by using the heat kernel and its short-time asymptotic behavior.