title: Conditional Network Embeddings

abstract: Network Embeddings (NEs) map the nodes of a given network into $d$-dimensional Euclidean space $\mathbb{R}^d$. Ideally, this mapping is such that `similar' nodes are mapped onto nearby points, such that the NE can be used for purposes such as link prediction (if `similar' means being `more likely to be connected') or classification (if `similar' means `being more likely to have the same label'). In recent years various methods for NE have been introduced, all following a similar strategy: defining a notion of similarity between nodes (typically some distance measure within the network), a distance measure in the embedding space, and a loss function that penalizes large distances for similar nodes and small distances for dissimilar nodes. A difficulty faced by existing methods is that certain networks are fundamentally hard to embed due to their structural properties: (approximate) multipartiteness, certain degree distributions, assortativity, etc. To overcome this, we introduce a conceptual innovation to the NE literature and propose to create \emph{Conditional Network Embeddings} (CNEs); embeddings that maximally add information with respect to given structural properties (e.g. node degrees, block densities, etc.). We use a simple Bayesian approach to achieve this, and propose a block stochastic gradient descent algorithm for fitting it efficiently. We demonstrate that CNEs are superior for link prediction and multi-label classification when compared to state-of-the-art methods, and this without adding significant mathematical or computational complexity. Finally, we illustrate the potential of CNE for network visualization.


title: End-to-end driving simulation via angle branched network

abstract: Imitation learning for end-to-end autonomous driving has drawn attention from academic communities. Current methods either only use images as the input which is ambiguous when a car approaches an intersection, or use additional command information to navigate the vehicle but not automated enough. Focusing on making the vehicle drive along the given path, we propose a new navigation command that does not require human's participation and a novel model architecture called angle branched network. Both the new navigation command and the angle branched network are easy to understand and effective. Besides, we find that not only segmentation information but also depth information can boost the performance of the driving model. We conduct experiments in a 3D urban simulator and both qualitative and quantitative evaluation results show the effectiveness of our model.


title: A theoretical study of nonclassical effects in optical and spin systems and their applications

abstract: Nonclassical states, having no classical analogue, promise advantage in the performance in several fields of technology, such as computation, communication, sensing. This led to an escalated interest in the recent years for the generation and characterization of nonclassical states in various physical systems of interest. Keeping this in mind, we examined generation of various lower- and higher-order nonclassical states in both codirectional and contradirectional asymmetric nonlinear optical couplers operating under second harmonic generation with the help of moments-based criteria. Using another such system (a symmetric nonlinear optical coupler), we have also established the possibility of observing quantum Zeno and anti-Zeno effects and further reduced the obtained results to yield the corresponding expressions for the asymmetric coupler. These studies have been accomplished using a complete quantum description of the system considering all the field modes as weak. Further, characterization of nonclassicality in spin systems using quasiprobability distributions has been performed, which has also provided us the dynamics of the amount of nonclassicality (using nonclassical volume). As the reconstruction of quasiprobability distributions is possible with the help of tomograms accessible in the experiments, tomograms are computed here for both finite and infinite dimensional systems. Finally, a set of controlled quantum communication (both insecure and secure) schemes with minimum number of entangled qubits has been proposed, which is also analyzed over Markovian channels. The optimized controlled secure quantum communication scheme is observed to be reducible to several cryptographic tasks. Using this interesting observation, we obtained the performance of a set of cryptographic schemes over non-Markovian channels, too.


title: Autonomous discovery of the goal space to learn a parameterized skill

abstract: A parameterized skill is a mapping from multiple goals/task parameters to the policy parameters to accomplish them. Existing works in the literature show how a parameterized skill can be learned given a task space that defines all the possible achievable goals. In this work, we focus on tasks defined in terms of final states (goals), and we face on the challenge where the agent aims to autonomously acquire a parameterized skill to manipulate an initially unknown environment. In this case, the task space is not known a priori and the agent has to autonomously discover it. The agent may posit as a task space its whole sensory space (i.e. the space of all possible sensor readings) as the achievable goals will certainly be a subset of this space. However, the space of achievable goals may be a very tiny subspace in relation to the whole sensory space, thus directly using the sensor space as task space exposes the agent to the curse of dimensionality and makes existing autonomous skill acquisition algorithms inefficient. In this work we present an algorithm that actively discovers the manifold of the achievable goals within the sensor space. We validate the algorithm by employing it in multiple different simulated scenarios where the agent actions achieve different types of goals: moving a redundant arm, pushing an object, and changing the color of an object.


title: Learning Pixel-wise Labeling from the Internet without Human Interaction

abstract: Deep learning stands at the forefront in many computer vision tasks. However, deep neural networks are usually data-hungry and require a huge amount of well-annotated training samples. Collecting sufficient annotated data is very expensive in many applications, especially for pixel-level prediction tasks such as semantic segmentation. To solve this fundamental issue, we consider a new challenging vision task, Internetly supervised semantic segmentation, which only uses Internet data with noisy image-level supervision of corresponding query keywords for segmentation model training. We address this task by proposing the following solution. A class-specific attention model unifying multiscale forward and backward convolutional features is proposed to provide initial segmentation "ground truth". The model trained with such noisy annotations is then improved by an online fine-tuning procedure. It achieves state-of-the-art performance under the weakly-supervised setting on PASCAL VOC2012 dataset. The proposed framework also paves a new way towards learning from the Internet without human interaction and could serve as a strong baseline therein. Code and data will be released upon the paper acceptance.


title: Disc-aware Ensemble Network for Glaucoma Screening from Fundus Image

abstract: Glaucoma is a chronic eye disease that leads to irreversible vision loss. Most of the existing automatic screening methods firstly segment the main structure, and subsequently calculate the clinical measurement for detection and screening of glaucoma. However, these measurement-based methods rely heavily on the segmentation accuracy, and ignore various visual features. In this paper, we introduce a deep learning technique to gain additional image-relevant information, and screen glaucoma from the fundus image directly. Specifically, a novel Disc-aware Ensemble Network (DENet) for automatic glaucoma screening is proposed, which integrates the deep hierarchical context of the global fundus image and the local optic disc region. Four deep streams on different levels and modules are respectively considered as global image stream, segmentation-guided network, local disc region stream, and disc polar transformation stream. Finally, the output probabilities of different streams are fused as the final screening result. The experiments on two glaucoma datasets (SCES and new SINDI datasets) show our method outperforms other state-of-the-art algorithms.


title: DenseImage Network: Video Spatial-Temporal Evolution Encoding and Understanding

abstract: Many of the leading approaches for video understanding are data-hungry and time-consuming, failing to capture the gist of spatial-temporal evolution in an efficient manner. The latest research shows that CNN network can reason about static relation of entities in images. To further exploit its capacity in dynamic evolution reasoning, we introduce a novel network module called DenseImage Network(DIN) with two main contributions. 1) A novel compact representation of video which distills its significant spatial-temporal evolution into a matrix called DenseImage, primed for efficient video encoding. 2) A simple yet powerful learning strategy based on DenseImage and a temporal-order-preserving CNN network is proposed for video understanding, which contains a local temporal correlation constraint capturing temporal evolution at multiple time scales with different filter widths. Extensive experiments on two recent challenging benchmarks demonstrate that our DenseImage Network can accurately capture the common spatial-temporal evolution between similar actions, even with enormous visual variations or different time scales. Moreover, we obtain the state-of-the-art results in action and gesture recognition with much less time-and-memory cost, indicating its immense potential in video representing and understanding.


title: Electrochemical solid-state amorphization in the immiscible Cu-Li system: Size matters

abstract: As a typical immiscible binary system, copper (Cu) and lithium (Li) show no alloying and chemical intermixing under normal circumstances. A notable example that takes advantages of the immiscibility between Cu and Li is the widespread utilization of Cu foils as the anodic current collector in Li-ion batteries. Here we show that the nanoscale size effect can play a subtle yet critical role in mediating the chemical activity of Cu and therefore its miscibility with Li, such that the electrochemical alloying and solid-state amorphization will occur in such an immiscible system when decreasing Cu nanoparticle sizes into ultrasmall range. This unusual observation was accomplished by performing in-situ studies of the electrochemical lithiation processes of individual CuO nanowires inside a transmission electron microscopy (TEM). Upon lithiation, CuO nanowires are first electrochemically reduced to form discrete ultrasmall Cu nanocrystals that, unexpectedly, can in turn undergo further electrochemical lithiation to form amorphous CuLix nanoalloys. Real-time dynamic observations by in-situ TEM unveil that there is a critical grain size (ca. 6 nm), below which the crystalline Cu nanoparticles can be continuously lithiated and amorphized. Electron energy loss spectra indicate that there is a net charge transfer from Li to Cu in the amorphous CuLix nanoalloys. Another intriguing finding is that the amorphous alloying phenomena in Cu-Li system is reversible, as manifested by the in-situ observation of electron-beam-induced delithiation of the as-formed amorphous CuLix nanoalloys.


title: Regularization with Metric Double Integrals of Functions with Values in a Set of Vectors

abstract: We present an approach for variational regularization of inverse and imaging problems for recovering functions with values in a set of vectors. We introduce regularization functionals, which are derivative-free double integrals of such functions. These regularization functionals are motivated from double integrals, which approximate Sobolev semi-norms of intensity functions. These were introduced in Bourgain, Br\'ezis and Mironescu, "Another Look at Sobolev Spaces". In: Optimal Control and Partial Differential Equations-Innovations and Applications, IOS press, Amsterdam, 2001. For the proposed regularization functionals we prove existence of minimizers as well as a stability and convergence result for functions with values in a set of vectors.


title: Improved spot formation for flexible multi-mode fiber endoscope using partial reflector

abstract: Multi-mode fiber (MMF) endoscopes are a new type of endoscope that use only a single optical fiber to transmit images, achieving much higher spatial resolution for a given diameter than commercial fiber bundle endoscopes. However, a drawback of MMF endoscopes is that imaging quality degrades substantially as the MMF is perturbed. We propose a method for improving spot formation at the distal end of a perturbed MMF, and thus improving imaging quality, by attaching a partial reflector to the distal end of the MMF. We experimentally find that the perturbation of the light reflected from the partial reflector is highly correlated with the perturbation of the light transmitted through the MMF. We demonstrate a simple method exploiting this correlation that enables formation of spots at the distal fiber end with quality 10-15% higher than if the perturbation of the MMF is ignored. In the future, more advanced algorithms exploiting the correlation may enable further improvements in spot formation and imaging through perturbed fibers.


title: Persistence of magicity in neutron rich exotic $^{78}$Ni in ground as well as excited states

abstract: Recent experimental observation of magicity in $^{78}$Ni has infused the interest to examine the persistence of the magic character across the N$=$50 shell gap in extremely neutron rich exotic nucleus $^{78}$Ni in ground as well as excited states. A systematic study of Ni isotopes and N$=$50 isotones in ground state is performed within the microscopic framework of relativistic mean-field (RMF) and the triaxially deformed Nilson Strutinsky model (NSM). Ground state density distributions, charge form factors, radii, separation energies, pairing energies, single particle energies and the shell corrections show strong magicity in $^{78}$Ni. Excited nuclei are treated within the statistical theory of hot rotating nuclei where the variation of level density parameter and entropy shows significant magicity with a deep minima at N$=$50, which, persists up to the temperatures $\approx$ 1.5$-$2 MeV and then slowly disappear with increasing temperature. Rotational states are evaluated and effect of rotation on N$=$50 (Z$=$20$-$30) isotones are studied. Our results agree very well with the available experimental data and few other theoretical calculations.


title: Second-order photonic topological insulator with corner states

abstract: Higher-order topological insulators (HOTIs) which go beyond the description of conventional bulk-boundary correspondence, broaden the understanding of topological insulating phases. Being mainly focused on electronic materials, HOTIs have not been found in photonic systems yet. In this article, we propose a type of two-dimensional second-order photonic crystals with zero-dimensional corner states and one-dimensional boundary states for optical frequencies. All of these states are topologically non-trivial and can be understood based on the theory of topological polarization. Moreover, by tuning the easily-fabricated structure of the photonic crystals, we can realize different topological phases with unique topological boundary states straightforwardly. Our result can be generalized to higher dimensions and provides unprecedented venues for higher-order photonic topological insulators and semimetals.


title: MHV amplitudes at strong coupling and linearized TBA equations

abstract: The maximally helicity violating (MHV) amplitudes of ${\cal N} =4$ super Yang-Mills theory at strong coupling are obtained by solving auxiliary thermodynamic Bethe ansatz (TBA) integral equations. We consider a limit where the TBA equations are linearized for large chemical potentials and masses therein. By solving the linearized equations, we derive analytic expansions of the 6-point MHV amplitudes in terms of the ratio of the chemical potential $A$ and the mass $M$. The expansions are valid up to corrections exponentially small in $A$ or inversely proportional to powers of $A$. The analytic expansions describe the amplitudes for small conformal cross-ratios of the particle momenta in a standard basis, and interpolate the amplitudes with equal cross-ratios and those in soft/collinear limits. The leading power corrections are also obtained analytically. We compare the 6-point rescaled remainder functions at strong coupling and at 2 loops for the above kinematics. They are rather different, in contrast to other kinematic regions discussed in the literature where they are found to be similar to each other.


title: Nostalgic Adam: Weighting more of the past gradients when designing the adaptive learning rate

abstract: First-order optimization algorithms have been proven prominent in deep learning. In particular, algorithms such as RMSProp and Adam are extremely popular. However, recent works have pointed out the lack of ``long-term memory" in Adam-like algorithms, which could hamper their performance and lead to divergence. In our study, we observe that there are benefits of weighting more of the past gradients when designing the adaptive learning rate. We therefore propose an algorithm called the Nostalgic Adam (NosAdam) with theoretically guaranteed convergence at the best known convergence rate. NosAdam can be regarded as a fix to the non-convergence issue of Adam in alternative to the recent work of [Reddi et al., 2018]. Our preliminary numerical experiments show that NosAdam is a promising alternative algorithm to Adam. The proofs, code and other supplementary materials can be found in an anonymously shared link.


title: Low-loss forward and backward surface plasmons in a semiconductor nanowire coated by helical graphene strips

abstract: In the long-wavelength approximation, the effective conductivity tensor is introduced for graphene ribbons (strips) placed periodically at the interface between two media. The resulting conducting surface is considered as a coating for semiconductor nanowire. For the hybrid waves of such nanowire the dispersion equations are obtained in explicit form. Two types of surface plasmons are found to exist: (i) the modified surface plasmons, which originate from the ordinary surface plasmons of a graphene-coated semiconductor nanowire, and (ii) the spoof plasmons, which arise on the array of graphene ribbons and may possess forward-wave and backward-wave dispersion. It is revealed that the spoof surface plasmons are low-loss ones, and their frequencies, field-confinement and group velocities can be tuned widely by adjusting the coil angle and width of helical graphene strips.


title: Energetics of small electron acceleration episodes in the solar corona from radio noise storm observations

abstract: Observations of radio noise storms can act as sensitive probes of nonthermal electrons produced in small acceleration events in the solar corona. We use data from noise storm episodes observed jointly by the Giant Metrewave Radio Telescope (GMRT) and the Nancay Radioheliograph (NRH) to study characteristics of the nonthermal electrons involved in the emission. We find that the electrons carry $10^{21}$ to $10^{24}$ erg/s, and that the energy contained in the electrons producing a representative noise storm burst ranges from $10^{20}$ to $10^{23}$ ergs. These results are a direct probe of the energetics involved in ubiquitous, small-scale electron acceleration episodes in the corona, and could be relevant to a nanoflare-like scenario for coronal heating.


title: 2D superconductivity and vortex dynamics in 1T-MoS2

abstract: Two-dimensional (2D) superconductivity is a fascinating phenomenon packed with rich physics and wide technological application. The vortices and their dynamics arising from classical and quantum fluctuations give rise to Berezinskii-Kosterlitz-Thouless (BKT) transition and 2D Bose metallic phase both of which are of fundamental interest. In 2D, observation of superconductivity and the associated phenomena are sensitive to material disorders. Highly crystalline and inherently 2D van der Waals (vW) systems with carrier concentration and conductivity approaching metallic regime have been a potential platform. The metallic 1T phase of MoS2, a widely explored vW material system controllably, engineered from the semiconducting 2H phase, is a tangible choice. Here, we report the observation of 2D superconductivity accompanied by BKT transition and Bose metallic state in a few-layer 1T-MoS2. Structural characterization shows excellent crystallinity over extended lateral dimension. The electrical characterization confirms the metallic nature down to 4 K and a transition to a superconducting state below 1.2 K with a Tc ~ 920 mK. The 2D nature of the superconducting state is confirmed from the magneto-transport anisotropy against field orientations and the presence of BKT transition. In addition, our sample showcases a manifold increase in the parallel upper-critical-field above the Pauli limit. The inherent two-dimensionality and possibility of scalably engineering semiconducting, metallic and superconducting phases makes MoS2 a potential candidate for hosting monolithic all-two-dimensional hybrid quantum devices.


title: Transduction with Matrix Completion Using Smoothed Rank Function

abstract: In this paper, we propose two new algorithms for transduction with Matrix Completion (MC) problem. The joint MC and prediction tasks are addressed simultaneously to enhance the accuracy, i.e., the label matrix is concatenated to the data matrix forming a stacked matrix. Assuming the data matrix is of low rank, we propose new recommendation methods by posing the problem as a constrained minimization of the Smoothed Rank Function (SRF). We provide convergence analysis for the proposed algorithms. The simulations are conducted on real datasets in two different scenarios of randomly missing pattern with and without block loss. The results confirm that the accuracy of our proposed methods outperforms those of state-of-the-art methods even up to 10% in low observation rates for the scenario without block loss. Our accuracy in the latter scenario, is comparable to state-of-the-art methods while the complexity of the proposed algorithms are reduced up to 4 times.


title: Well-posedness of monotone semilinear SPDEs with semimartingale noise

abstract: We prove existence and uniqueness of strong solutions for a class of semilinear stochastic evolution equations driven by general Hilbert space-valued semimartingales, with drift equal to the sum of a linear maximal monotone operator in variational form and of the superposition operator associated to a random time-dependent monotone function defined on the whole real line. Such a function is only assumed to satisfy a very mild symmetry-like condition, but its rate of growth towards infinity can be arbitrary. Moreover, the noise is of multiplicative type and can be path-dependent. The solution is obtained via a priori estimates on solutions to regularized equations, interpreted both as stochastic equations as well as deterministic equations with random coefficients, and ensuing compactness properties. A key role is played by an infinite-dimensional Doob-type inequality due to M\'etivier and Pellaumail.


title: Reinforcement Learning of Theorem Proving

abstract: We introduce a theorem proving algorithm that uses practically no domain heuristics for guiding its connection-style proof search. Instead, it runs many Monte-Carlo simulations guided by reinforcement learning from previous proof attempts. We produce several versions of the prover, parameterized by different learning and guiding algorithms. The strongest version of the system is trained on a large corpus of mathematical problems and evaluated on previously unseen problems. The trained system solves within the same number of inferences over 40% more problems than a baseline prover, which is an unusually high improvement in this hard AI domain. To our knowledge this is the first time reinforcement learning has been convincingly applied to solving general mathematical problems on a large scale.


title: Decompositions into spanning rainbow structures

abstract: A subgraph of an edge-coloured graph is called rainbow if all its edges have distinct colours. The study of rainbow subgraphs goes back more than two hundred years to the work of Euler on Latin squares and has been the focus of extensive research ever since. Euler posed a problem equivalent to finding properly $n$-edge-coloured complete bipartite graphs $K_{n,n}$ which can be decomposed into rainbow perfect matchings. While there are proper edge-colourings of $K_{n,n}$ without even a single rainbow perfect matching, the theme of this paper is to show that with some very weak additional constraints one can find many disjoint rainbow perfect matchings. In particular, we prove that if some fraction of the colour classes have at most $(1-o(1)) n$ edges then one can nearly-decompose the edges of $K_{n,n}$ into edge-disjoint perfect rainbow matchings. As an application of this, we establish in a very strong form a conjecture of Akbari and Alipour and asymptotically prove a conjecture of Barat and Nagy. Both these conjectures concern rainbow perfect matchings in edge-colourings of $K_{n,n}$ with quadratically many colours. Using our techniques, we also prove a number of results on near-decompositions of graphs into other rainbow structures like Hamiltonian cycles and spanning trees. Most notably, we prove that any properly coloured complete graph can be nearly-decomposed into spanning rainbow trees. This asymptotically proves the Brualdi-Hollingsworth and Kaneko-Kano-Suzuki conjectures which predict that a perfect decomposition should exist under the same assumptions.


title: ACR: a cluster-based routing protocol for VANET

abstract: Clustering is a technique used in network routing to enhance the performance and conserve the network resources. This paper presents a cluster-based routing protocol for VANET utilizing a new addressing scheme in which each node gets an address according to its mobility pattern. Hamming distance technique is used then to partition the network in an address-centric manner. The simulation results show that this protocol enhances routing reachability, whereas reduces routing end-to-end delay and traffic received comparing with two benchmarks namely AODV and DSDV.


title: Wildest Faces: Face Detection and Recognition in Violent Settings

abstract: With the introduction of large-scale datasets and deep learning models capable of learning complex representations, impressive advances have emerged in face detection and recognition tasks. Despite such advances, existing datasets do not capture the difficulty of face recognition in the wildest scenarios, such as hostile disputes or fights. Furthermore, existing datasets do not represent completely unconstrained cases of low resolution, high blur and large pose/occlusion variances. To this end, we introduce the Wildest Faces dataset, which focuses on such adverse effects through violent scenes. The dataset consists of an extensive set of violent scenes of celebrities from movies. Our experimental results demonstrate that state-of-the-art techniques are not well-suited for violent scenes, and therefore, Wildest Faces is likely to stir further interest in face detection and recognition research.


title: Optimizing the F-measure for Threshold-free Salient Object Detection

abstract: Current CNN-based solutions to salient object detection (SOD) mainly rely on the optimization of cross-entropy loss (CELoss). Then the quality of detected saliency maps is often evaluated in terms of F-measure. In this paper, we investigate an interesting issue: can we consistently use the F-measure formulation in both training and evaluation for SOD? By reformulating the standard F-measure we propose the relaxed F-measure which is differentiable w.r.t the posterior and can be easily appended to the back of CNNs as the loss function. Compared to the conventional cross-entropy loss of which the gradients decrease dramatically in the saturated area, our loss function, named FLoss, holds considerable gradients even when the activation approaches the target. Consequently, the FLoss can continuously force the network to produce polarized activations. Comprehensive benchmarks on several popular datasets show that FLoss outperforms the state-of-the-art with a considerable margin. More specifically, due to the polarized predictions, our method is able to obtain high-quality saliency maps without carefully tuning the optimal threshold, showing significant advantages in real-world applications.


title: Partitioning SKA Dataflows for Optimal Graph Execution

abstract: Optimizing data-intensive workflow execution is essential to many modern scientific projects such as the Square Kilometre Array (SKA), which will be the largest radio telescope in the world, collecting terabytes of data per second for the next few decades. At the core of the SKA Science Data Processor is the graph execution engine, scheduling tens of thousands of algorithmic components to ingest and transform millions of parallel data chunks in order to solve a series of large-scale inverse problems within the power budget. To tackle this challenge, we have developed the Data Activated Liu Graph Engine (DALiuGE) to manage data processing pipelines for several SKA pathfinder projects. In this paper, we discuss the DALiuGE graph scheduling sub-system. By extending previous studies on graph scheduling and partitioning, we lay the foundation on which we can develop polynomial time optimization methods that minimize both workflow execution time and resource footprint while satisfying resource constraints imposed by individual algorithms. We show preliminary results obtained from three radio astronomy data pipelines.


title: Reliable counting of weakly labeled concepts by a single spiking neuron model

abstract: Making an informed, correct and quick decision can be life-saving. It's crucial for animals during an escape behaviour or for autonomous cars during driving. The decision can be complex and may involve an assessment of the amount of threats present and the nature of each threat. Thus, we should expect early sensory processing to supply classification information fast and accurately, even before relying the information to higher brain areas or more complex system components downstream. Today, advanced convolutional artificial neural networks can successfully solve visual detection and classification tasks and are commonly used to build complex decision making systems. However, in order to perform well on these tasks they require increasingly complex, "very deep" model structure, which is costly in inference run-time, energy consumption and number of training samples, only trainable on cloud-computing clusters. A single spiking neuron has been shown to be able to solve recognition tasks for homogeneous Poisson input statistics, a commonly used model for spiking activity in the neocortex. When modeled as leaky integrate and fire with gradient decent learning algorithm it was shown to posses a variety of complex computational capabilities. Here we improve its implementation. We also account for more natural stimulus generated inputs that deviate from this homogeneous Poisson spiking. The improved gradient-based local learning rule allows for significantly better and stable generalization. We also show that with its improved capabilities it can count weakly labeled concepts by applying our model to a problem of multiple instance learning (MIL) with counting where labels are only available for collections of concepts. In this counting MNIST task the neuron exploits the improved implementation and outperforms conventional ConvNet architecture under similar condtions.


title: Physical and Mechatronic Security, Technologies and Future Trends for Vehicular Environment

abstract: Cloning spare parts and entities of mass products is an old and serious unsolved problem for the automotive industry. The economic losses in addition to a loss of know-how and IP theft as well as security and safety threats are huge in all dimensions. This presentation gives an overview of the traditional state of the art on producing clone resistant electronic units in the last two decades. A survey is attempting to demonstrate the techniques so far known as Physically Unclonable Functions PUFs showing their advantages and drawbacks. The necessity for fabricating mechatronic-security in the vehicular environment is emerging to become a vital requirement for new automotive security regulations (legal regulations) in the near future. The automotive industry is facing a challenge to produce low-cost and highly safe and secure networked automotive systems. The emerging networked smart traffic environment is offering new safety services and creating at the same time new needs and threats in a highly networked world. There is a crying need for automotive security that approaches the level of the robust biological security for cars as dominating mobility actors in the modern smart life environment. Possible emerging technologies allowing embedding practical mechatronic-security modules as a low-cost digital alternative are presented. Such digital clone-resistant mechatronic-units (as Electronic Control Units ECUs) may serve as smart security anchors for the automotive environment in the near future. First promising initial results are also presented.


title: Symmetry analysis of an elastic beam with axial load

abstract: We construct the closed form solution of an elastic beam with axial load using Lie symmetry method. A beam with spatially varying physical properties such as mass and second moment of inertia is considered. The governing fourth order partial differential equation with variable coefficients which is not amenable to simple methods of solution, is solved using Lie symmetry. We incorporate boundary conditions and then compare with the numerical solution.


title: Gate-tuned quantum Hall states in Dirac semimetal (Cd1-xZnx)3As2

abstract: The recent discovery of topological Dirac semimetals (DSM) has provoked intense curiosity not only on Weyl physics in solids, but also on topological phase transitions originating from DSM. One example is controlling the dimensionality to realize two-dimensional quantum phases such as quantum Hall and quantum spin Hall states. For investigating these phases, the Fermi level is a key controlling parameter. From this perspective, we report here the carrier-density control of quantum Hall states realized in thin films of DSM Cd3As2. Chemical doping of Zn combined with electrostatic gating has enabled us to tune the carrier density over a wide range and continuously even across the charge neutrality point. Comprehensive analyses of the gate-tuned quantum transport have revealed Landau level formation from linearly dispersed sub-bands and its contribution to the quantum Hall states. Our achievements pave the way also for investigating the low energy physics near the Dirac points of DSM.


title: Conditional Carleson measures and related operators on Bergman spaces

abstract: In this paper first we define generalized Carleson mea- sure. Then we consider a special case of it, named conditional Carleson measure on the Bergman spaces. After that we give a characterization of conditional Carleson measures on Bergman spaces. Moreover, by using this characterization we find an equiv- alent condition to boundedness of weighted conditional expectation operators on Bergman spaces.


title: Chief complaint classification with recurrent neural networks

abstract: Syndromic surveillance detects and monitors individual and population health indicators through sources such as emergency department records. Automated classification of these records can improve outbreak detection speed and diagnosis accuracy. Current syndromic systems rely on hand-coded keyword-based methods to parse written fields and may benefit from the use of modern supervised-learning classifier models. In this paper we implement two recurrent neural network models based on long short-term memory (LSTM) and gated recurrent unit (GRU) cells and compare them to two traditional bag-of-words classifiers: multinomial naive Bayes (MNB) and a support vector machine (SVM). The MNB classifier is one of only two machine learning algorithms currently being used for syndromic surveillance. All four models are trained to predict diagnostic code groups as defined by Clinical Classification Software, first to predict from discharge diagnosis, then from chief complaint fields. The classifiers are trained on 3.6 million de-identified emergency department records from a single United States jurisdiction. We compare performance of these models primarily using the F1 score. Using discharge diagnoses, the LSTM classifier performs best, though all models exhibit an F1 score above 96.00. The GRU performs best on chief complaints (F1=47.38), and MNB with bigrams performs worst (F1=39.40). Certain syndrome types are easier to detect than others. For examples, chief complaints using the GRU model predicts alcohol-related disorders well (F1=78.91) but predicts influenza poorly (F1=14.80). In all instances, the RNN models outperformed the bag-of-word classifiers, suggesting deep learning models could substantially improve the automatic classification of unstructured text for syndromic surveillance.


title: Sequential adaptive elastic net approach for single-snapshot source localization

abstract: This paper proposes efficient algorithms for accurate recovery of direction-of-arrival (DoA) of sources from single-snapshot measurements using compressed beamforming (CBF). In CBF, the conventional sensor array signal model is cast as an underdetermined complex-valued linear regression model and sparse signal recovery methods are used for solving the DoA finding problem. We develop a complex-valued pathwise weighted elastic net (c-PW-WEN) algorithm that finds solutions at knots of penalty parameter values over a path (or grid) of EN tuning parameter values. c-PW-WEN also computes Lasso or weighted Lasso in its path. We then propose a sequential adaptive EN (SAEN) method that is based on c-PW-WEN algorithm with adaptive weights that depend on the previous solution. Extensive simulation studies illustrate that SAEN improves the probability of exact recovery of true support compared to conventional sparse signal recovery approaches such as Lasso, elastic net or orthogonal matching pursuit in several challenging multiple target scenarios. The effectiveness of SAEN is more pronounced in the presence of high mutual coherence.

categories: stat.ME cs.IT cs.LG math.CV math.IT math.OC stat.AP


title: Structure of Cubic Lehman Matrices

abstract: A pair $(A,B)$ of square $(0,1)$-matrices is called a \emph{Lehman pair} if $AB^T=J+kI$ for some integer $k\in\{-1,1,2,3,\ldots\}$. In this case $A$ and $B$ are called \emph{Lehman matrices}. This terminology arises because Lehman showed that the rows with the fewest ones in any non-degenerate minimally nonideal (mni) matrix $M$ form a square Lehman submatrix of $M$. Lehman matrices with $k=-1$ are essentially equivalent to \emph{partitionable graphs} (also known as $(\alpha,\omega)$-graphs), so have been heavily studied as part of attempts to directly classify minimal imperfect graphs. In this paper, we view a Lehman matrix as the bipartite adjacency matrix of a regular bipartite graph, focusing in particular on the case where the graph is cubic. From this perspective, we identify two constructions that generate cubic Lehman graphs from smaller Lehman graphs. The most prolific of these constructions involves repeatedly replacing suitable pairs of edges with a particular $6$-vertex subgraph that we call a $3$-rung ladder segment. Two decades ago, L\"{u}tolf \& Margot initiated a computational study of mni matrices and constructed a catalogue containing (among other things) a listing of all cubic Lehman matrices with $k =1$ of order up to $17 \times 17$. We verify their catalogue (which has just one omission), and extend the computational results to $20 \times 20$ matrices. Of the $908$ cubic Lehman matrices (with $k=1$) of order up to $20 \times 20$, only two do not arise from our $3$-rung ladder construction. However these exceptions can be derived from our second construction, and so our two constructions cover all known cubic Lehman matrices with $k=1$.


title: On a new approach to the problem of the zero distribution of Hermite-Pad\'e polynomials for a Nikishin system

abstract: A new approach to the problem of the zero distribution of Hermite-Pad\'e polynomials of type I for a pair of functions $f_1,f_2$ forming a Nikishin system is discussed. Unlike the traditional vector approach, we give an answer in terms of a scalar equilibrium problem with harmonic external field, which is posed on a two-sheeted Riemann surface.


title: Energy preserving methods on Riemannian manifolds

abstract: The energy preserving discrete gradient methods are generalized to finite-dimensional Riemannian manifolds by definition of a discrete approximation to the Riemannian gradient, a retraction, and a coordinate center function. The resulting schemes are intrinsic and do not depend on a particular choice of coordinates, nor on embedding of the manifold in a Euclidean space. Generalizations of well-known discrete gradient methods, such as the average vector field method and the Itoh--Abe method are obtained. It is shown how methods of higher order can be constructed via a collocation-like approach. Local and global error bounds are derived in terms of the Riemannian distance function and the Levi-Civita connection. Some numerical results on spin system problems are presented.


title: Dynamically assisted Schwinger effect beyond the spatially-uniform-field approximation

abstract: We investigate the phenomenon of electron-positron pair production from vacuum in the presence of a strong electric field superimposed by a weak but fast varying pulse which substantially increases the total particle yield. We employ a nonperturbative numerical technique and perform the calculations beyond the spatially-uniform-field approximation, i.e. dipole approximation, taking into account the coordinate dependence of the fast component. The analysis of the main characteristics of the pair-production process (momentum spectra of particles and total amount of pairs) reveals a number of important features which are absent within the previously used approximation. In particular, the structure of the momentum distribution is modified both qualitatively and quantitatively, and the total number of pairs created as well as the enhancement factor due to dynamical assistance become significantly smaller.


title: Analytic moment and Laplace transform formulae for the quasi-stationary distribution of the Shiryaev diffusion on an interval

abstract: We derive analytic closed-form moment and Laplace transform formulae for the quasi-stationary distribution of the classical Shiryaev diffusion restricted to the interval $[0,A]$ with absorption at a given $A>0$.


title: New stellar encounters discovered in the second Gaia data release

abstract: Passing stars may play an important role in the evolution of our solar system. We search for close stellar encounters to the Sun among all 7.2 million stars in Gaia-DR2 that have six-dimensional phase space data. We characterize encounters by integrating their orbits through a Galactic potential and propagating the correlated uncertainties via a Monte Carlo resampling. After filtering to remove spurious data, we find 694 stars that have median (over uncertainties) closest encounter distances within 5 pc, all occurring within 15 Myr from now. 26 of these have at least a 50% chance of coming closer than 1 pc (and 7 within 0.5 pc), all but one of which are newly discovered here. We further confirm some and refute several other previously-identified encounters, confirming suspicions about their data. The closest encounter in the sample is Gl 710, which has a 95% probability of coming closer than 0.08 pc (17 000 AU). Taking mass estimates from Gaia astrometry and multiband photometry for essentially all encounters, we find that Gl 710 also has the largest impulse on the Oort cloud. Using a Galaxy model, we compute the completeness of the Gaia-DR2 encountering sample as a function of perihelion time and distance. Only 15% of encounters within 5 pc occurring within +/- 5 Myr of now have been identified, mostly due to the lack of radial velocities for faint and/or cool stars. Accounting for the incompleteness, we infer the present rate of encounters within 1 pc to be 19.7 +/- 2.2 per Myr, a quantity expected to scale quadratically with the encounter distance out to at least several pc. Spuriously large parallaxes in our sample from imperfect filtering would tend to inflate both the number of encounters found and this inferred rate. The magnitude of this effect is hard to quantify.


title: Fast Object Classification in Single-pixel Imaging

abstract: In single-pixel imaging (SPI), the target object is illuminated with varying patterns sequentially and an intensity sequence is recorded by a single-pixel detector without spatial resolution. A high quality object image can only be computationally reconstructed after a large number of illuminations, with disadvantages of long imaging time and high cost. Conventionally, object classification is performed after a reconstructed object image with good fidelity is available. In this paper, we propose to classify the target object with a small number of illuminations in a fast manner for Fourier SPI. A naive Bayes classifier is employed to classify the target objects based on the single-pixel intensity sequence without any image reconstruction and each sequence element is regarded as an object feature in the classifier. Simulation results demonstrate our proposed scheme can classify the number digit object images with high accuracy (e.g. 80% accuracy using only 13 illuminations, at a sampling ratio of 0.3%).


title: Kleene algebras, adjunction and structural control

abstract: In the present paper, we introduce a multi-type calculus for the logic of measurable Kleene algebras, for which we prove soundness, completeness, conservativity, cut elimination and subformula property. Our proposal imports ideas and techniques developed in formal linguistics around the notion of structural control.


title: A Proof-Theoretic Semantic Analysis of Dynamic Epistemic Logic

abstract: The present paper provides an analysis of the existing proof systems for dynamic epistemic logic from the viewpoint of proof-theoretic semantics. Dynamic epistemic logic is one of the best known members of a family of logical systems which have been successfully applied to diverse scientific disciplines, but the proof theoretic treatment of which presents many difficulties. After an illustration of the proof-theoretic semantic principles most relevant to the treatment of logical connectives, we turn to illustrating the main features of display calculi, a proof-theoretic paradigm which has been successfully employed to give a proof-theoretic semantic account of modal and substructural logics. Then, we review some of the most significant proposals of proof systems for dynamic epistemic logics, and we critically reflect on them in the light of the previously introduced proof-theoretic semantic principles. The contributions of the present paper include a generalisation of Belnap's cut elimination metatheorem for display calculi, and a revised version of the display-style calculus D.EAK. We verify that the revised version satisfies the previously mentioned proof-theoretic semantic principles, and show that it enjoys cut elimination as a consequence of the generalised metatheorem.


title: Auslander Correspondence for Triangulated Categories

abstract: We give analogues of the Auslander correspondence for two classes of triangulated categories satisfying certain finiteness conditions. The first class is triangulated categories with additive generators and we consider their endomorphism algebras as the Auslander algebras. For the second one, we introduce the notion of $[1]$-additive generators and consider their graded endormorphism algebras as the Auslander algebras. We give a homological characterization of the Auslander algebras for each class. Along the way, we also show that the algebraic triangle structures on the homotopy categories are unique up to equivalence.


title: Multi-type Display Calculus for Dynamic Epistemic Logic

abstract: In the present paper, we introduce a multi-type display calculus for dynamic epistemic logic, which we refer to as Dynamic Calculus. The display-approach is suitable to modularly chart the space of dynamic epistemic logics on weaker-than-classical propositional base. The presence of types endows the language of the Dynamic Calculus with additional expressivity, allows for a smooth proof-theoretic treatment, and paves the way towards a general methodology for the design of proof systems for the generality of dynamic logics, and certainly beyond dynamic epistemic logic. We prove that the Dynamic Calculus adequately captures Baltag-Moss-Solecki's dynamic epistemic logic, and enjoys Belnap-style cut elimination.


title: Practical computation with linear groups over infinite domains

abstract: We survey recent progress in computing with finitely generated linear groups over infinite fields, describing the mathematical background of a methodology applied to design practical algorithms for these groups. Implementations of the algorithms have been used to perform extensive computer experiments.


title: Robust Optimization over Multiple Domains

abstract: In this work, we study the problem of learning a single model for multiple domains. Unlike the conventional machine learning scenario where each domain can have the corresponding model, multiple domains (i.e., applications/users) may share the same machine learning model due to maintenance loads in cloud computing services. For example, a digit-recognition model should be applicable to hand-written digits, house numbers, car plates, etc. Therefore, an ideal model for cloud computing has to perform well at each applicable domain. To address this new challenge from cloud computing, we develop a framework of robust optimization over multiple domains. In lieu of minimizing the empirical risk, we aim to learn a model optimized to the adversarial distribution over multiple domains. Hence, we propose to learn the model and the adversarial distribution simultaneously with the stochastic algorithm for efficiency. Theoretically, we analyze the convergence rate for convex and non-convex models. To our best knowledge, we first study the convergence rate of learning a robust non-convex model with a practical algorithm. Furthermore, we demonstrate that the robustness of the framework and the convergence rate can be further enhanced by appropriate regularizers over the adversarial distribution. The empirical study on real-world fine-grained visual categorization and digits recognition tasks verifies the effectiveness and efficiency of the proposed framework.


title: Revealing the Basis: Ordinal Embedding Through Geometry

abstract: Ordinal Embedding places n objects into R^d based on comparisons such as "a is closer to b than c." Current optimization-based approaches suffer from scalability problems and an abundance of low quality local optima. We instead consider a computational geometric approach based on selecting comparisons to discover points close to nearly-orthogonal "axes" and embed the whole set by their projections along each axis. We thus also estimate the dimensionality of the data. Our embeddings are of lower quality than the global optima of optimization-based approaches, but are more scalable computationally and more reliable than local optima often found via optimization. Our method uses \Theta(n d \log n) comparisons and \Theta(n^2 d^2) total operations, and can also be viewed as selecting constraints for an optimizer which, if successful, will produce an almost-perfect embedding for sufficiently dense datasets.


title: Alma Survey Of Circumstellar Disks In The Young Stellar Cluster IC 348

abstract: We present a 1.3 mm continuum survey of the young (2-3 Myr) stellar cluster IC 348, which lies at a distance of 310 pc, and is dominated by low-mass stars (M$_{\star}$ $\sim$ 0.1-0.6 M$_{\odot}$). We observed 136 Class II sources (disks that are optically thick in the infrared) at 0.8$''$ (200 au) resolution with a 3$\sigma$ sensitivity of $\sim$ 0.45 mJy (M$_{\rm dust}$ $\sim$ 1.3 M$_{\oplus}$). We detect 40 of the targets and construct a mm-continuum luminosity function. We compare the disk mass distribution in IC 348 to those of younger and older regions, taking into account the dependence on stellar mass. We find a clear evolution in disk masses from 1 to 5-10 Myr. The disk masses in IC 348 are significantly lower than those in Taurus (1-3 Myr) and Lupus (1-3 Myr), similar to those of Chamaleon~I, (2-3 Myr) and $\sigma$ Ori (3-5 Myr) and significantly higher than in Upper Scorpius (5$-$10 Myr). About 20 disks in our sample ($\sim$5$\%$ of the cluster members) have estimated masses (dust $+$ gas) $>$1 M$_{\rm Jup}$ and hence might be the precursors of giant planets in the cluster. Some of the most massive disks include transition objects with inner opacity holes based on their infrared SEDs. From a stacking analysis of the 96 non-detections, we find that these disks have a typical dust mass of just $\lesssim$ 0.4 M$_{\oplus}$, even though the vast majority of their infrared SEDs remain optically thick and show little signs of evolution. Such low-mass disks may be the precursors of the small rocky planets found by \emph{Kepler} around M-type stars.


title: Entity-Duet Neural Ranking: Understanding the Role of Knowledge Graph Semantics in Neural Information Retrieval

abstract: This paper presents the Entity-Duet Neural Ranking Model (EDRM), which introduces knowledge graphs to neural search systems. EDRM represents queries and documents by their words and entity annotations. The semantics from knowledge graphs are integrated in the distributed representations of their entities, while the ranking is conducted by interaction-based neural ranking networks. The two components are learned end-to-end, making EDRM a natural combination of entity-oriented search and neural information retrieval. Our experiments on a commercial search log demonstrate the effectiveness of EDRM. Our analyses reveal that knowledge graph semantics significantly improve the generalization ability of neural ranking models.


title: Adaptively Pruning Features for Boosted Decision Trees

abstract: Boosted decision trees enjoy popularity in a variety of applications; however, for large-scale datasets, the cost of training a decision tree in each round can be prohibitively expensive. Inspired by ideas from the multi-arm bandit literature, we develop a highly efficient algorithm for computing exact greedy-optimal decision trees, outperforming the state-of-the-art Quick Boost method. We further develop a framework for deriving lower bounds on the problem that applies to a wide family of conceivable algorithms for the task (including our algorithm and Quick Boost), and we demonstrate empirically on a wide variety of data sets that our algorithm is near-optimal within this family of algorithms. We also derive a lower bound applicable to any algorithm solving the task, and we demonstrate that our algorithm empirically achieves performance close to this best-achievable lower bound.


title: Solar cycle variation of coronal mass ejections contribution to solar wind mass flux

abstract: Coronal Mass Ejections (CMEs) contributes to the perturbation of solar wind in the heliosphere. Thus, depending on the different phases of the solar cycle and the rate of CME occurrence, contribution of CMEs to solar wind parameters near the Earth changes. In the present study, we examine the long term occurrence rate of CMEs, their speeds, angular widths and masses. We attempt to find correlation between near sun parameters, determined using white light images from coronagraphs, with solar wind measurements near the Earth from in-situ instruments. Importantly, we attempt to find what fraction of the averaged solar wind mass near the Earth is provided by the CMEs during different phases of the solar cycles.


title: Generalizing Point Embeddings using the Wasserstein Space of Elliptical Distributions

abstract: Embedding complex objects as vectors in low dimensional spaces is a longstanding problem in machine learning. We propose in this work an extension of that approach, which consists in embedding objects as elliptical probability distributions, namely distributions whose densities have elliptical level sets. We endow these measures with the 2-Wasserstein metric, with two important benefits: (i) For such measures, the squared 2-Wasserstein metric has a closed form, equal to a weighted sum of the squared Euclidean distance between means and the squared Bures metric between covariance matrices. The latter is a Riemannian metric between positive semi-definite matrices, which turns out to be Euclidean on a suitable factor representation of such matrices, which is valid on the entire geodesic between these matrices. (ii) The 2-Wasserstein distance boils down to the usual Euclidean metric when comparing Diracs, and therefore provides a natural framework to extend point embeddings. We show that for these reasons Wasserstein elliptical embeddings are more intuitive and yield tools that are better behaved numerically than the alternative choice of Gaussian embeddings with the Kullback-Leibler divergence. In particular, and unlike previous work based on the KL geometry, we learn elliptical distributions that are not necessarily diagonal. We demonstrate the advantages of elliptical embeddings by using them for visualization, to compute embeddings of words, and to reflect entailment or hypernymy.


title: On a model of magnetically charged black hole with nonlinear electrodynamics

abstract: The Bronnikov model of nonlinear electrodynamics is investigated in general relativity. The magnetic black hole is considered and we obtain a solution giving corrections to the Reissner-Nordstr\"{o}m solution. In this model spacetime at $r\rightarrow\infty$ becomes Minkowski's spacetime. We calculate the magnetic mass of the black hole and the metric function. At some parameters of the model there can be one, two or no horizons. The Hawking temperature and the heat capacity of black holes are calculated. We show that a second-order phase transition takes place and black holes are thermodynamically stable at some range of parameters.


title: Further refinements of generalized numerical radius inequalities for Hilbert space operators

abstract: In this paper, we show some refinements of generalized numerical radius inequalities involving the Young and Heinz inequalities. In particular, we present \begin{align*} w_{p}^{p}(A_{1}^{*}T_{1}B_{1},...,A_{n}^{*}T_{n}B_{n})\leq\frac{n^{1-\frac{1}{r}}}{2^{\frac{1}{r}}}\Big\|\sum_{i=1}^{n}[B_{i}^{*} f^{2}(|T_{i}|)B_{i}]^{rp}+[A_{i}^{*}g^{2}(|T_{i}^{*}|)A_{i}]^{rp}\Big\|^{\frac{1}{r}} -\inf_{\|x\|=1}\eta(x), \end{align*} where $T_{i}, A_{i}, B_{i} \in {\mathbb B}({\mathscr H})\,\,(1\leq i\leq n)$, $f$ and $g$ are nonnegative continuous functions on $[0, \infty)$ satisfying $f(t)g(t)=t$ for all $t\in [0, \infty)$, $p, r\geq 1$, $N\in {\mathbb N}$ and \begin{align*} \eta(x)= \frac{1}{2}\sum_{i=1}^{n}\sum_{j=1}^{N} \Big(\sqrt[2^{j}]{ \langle (A_{i}^{*}g^{2}(|T_{i}^{*}|)A_{i})^{p}x, x\rangle^{2^{j-1}-k_{j}} \langle (B_{i}^{*} f^{2}(|T_{i}|)B_{i})^{p}x, x\rangle^{k_j}}\quad-\sqrt[2^{j}]{ \langle (B_{i}^{*}f^{2}(|T_{i}|)B_{i})^{p}x, x\rangle^{k_{j}+1} \langle (A_{i}^{*} g^{2}(|T_{i}^{*}|)A_{i})^{p}x, x\rangle^{2^{j-1}-k_{j}-1}}\Big)^{2}. \end{align*}


title: Discrete dislocation dynamics simulations of dislocation-$\theta'$ precipitate interaction in Al-Cu alloys

abstract: The mechanisms of dislocation/precipitate interaction were studied by means of discrete dislocation dynamics within a multiscale approach. Simulations were carried out using the discrete continuous method in combination with a fast Fourier transform solver to compute the mechanical fields. The original simulation strategy was modified to include straight dislocation segments by means of the field dislocation mechanics method and was applied to simulate the interaction of an edge dislocation with a $\theta'$ precipitate in an Al-Cu alloy. It was found that the elastic mismatch has a negligible influence on the dislocation/precipitate interaction in the Al-Cu system. Moreover, the influence of the precipitate aspect ratio and orientation was reasonably well captured by the simple Orowan model in the absence of the stress-free transformation strain. Nevertheless, the introduction of the stress-free transformation strain led to dramatic changes in the dislocation/precipitate interaction and in the critical resolved shear stress to overcome the precipitate, particularly in the case of precipitates with small aspect ratio. The new multiscale approach to study the dislocation/precipitate interactions opens the possibility to obtain quantitative estimations of the strengthening provided by precipitates in metallic alloys taking into account the microstructural details.


title: On Portrait of a Specialist in Open Data

abstract: The article is written to identify the requirements for Open Data Specialist. The ability to use and work with open data affects many areas: sociology, urban studies, geography, statistics, public administration, data journalism, etc. It is especially important to develop and implement training courses on open data for non-IT students. Typically, the specialization of these students contains insufficient number of lessons on working with data and with open data. Students (hereinafter - researchers) feel a great need to eliminate "digital illiteracy" and to master the skills of working with open data. The development of a specialty on open data is designed to solve the problem of lack of knowledge and skills in working with open data. In this paper, the authors attempt to generalize the requirements for an expert in open data and offer an overview of information sources on the topic of hiring such specialists. The authors justify the need to create a specialty on open data for non-core students as well. It is supposed that the specialty will be read in English, a non-native language for students.


title: A hybrid index model for efficient spatio-temporal search in HBase

abstract: With advances in geo-positioning technologies and geo-location services, there are a rapidly growing massive amount of spatio-temporal data collected in many applications such as location-aware devices and wireless communication, in which an object is described by its spatial location and its timestamp. Consequently, the study of spatio-temporal search which explores both geo-location information and temporal information of the data has attracted significant concern from research organizations and commercial communities. This work study the problem of spatio-temporal \emph{k}-nearest neighbors search (ST$k$NNS), which is fundamental in the spatial temporal queries. Based on HBase, a novel index structure is proposed, called \textbf{H}ybrid \textbf{S}patio-\textbf{T}emporal HBase \textbf{I}ndex (\textbf{HSTI} for short), which is carefully designed and takes both spatial and temporal information into consideration to effectively reduce the search space. Based on HSTI, an efficient algorithm is developed to deal with spatio-temporal \emph{k}-nearest neighbors search. Comprehensive experiments on real and synthetic data clearly show that HSTI is three to five times faster than the state-of-the-art technique.


title: Practical Location Validation in Participatory Sensing Through Mobile WiFi Hotspots

abstract: The reliability of information in participatory sensing (PS) systems largely depends on the accuracy of the location of the participating users. However, existing PS applications are not able to efficiently validate the position of users in large-scale outdoor environments. In this paper, we present an efficient and scalable Location Validation System (LVS) to secure PS systems from location-spoofing attacks. In particular, the user location is verified with the help of mobile WiFi hot spots (MHSs), which are users activating the WiFi hotspot capability of their smartphones and accepting connections from nearby users, thereby validating their position inside the sensing area. The system also comprises a novel verification technique called Chains of Sight, which tackles collusion-based attacks effectively. LVS also includes a reputation-based algorithm that rules out sensing reports of location-spoofing users. The feasibility and efficiency of the WiFi-based approach of LVS is demonstrated by a set of indoor and outdoor experiments conducted using off-the-shelf smartphones, while the energy-efficiency of LVS is demonstrated by experiments using the Power Monitor energy tool. Finally, the security properties of LVS are analyzed by simulation experiments. Results indicate that the proposed LVS system is energy-efficient, applicable to most of the practical PS scenarios, and efficiently secures existing PS systems from location-spoofing attacks.


title: Deep Generative Markov State Models

abstract: We propose a deep generative Markov State Model (DeepGenMSM) learning framework for inference of metastable dynamical systems and prediction of trajectories. After unsupervised training on time series data, the model contains (i) a probabilistic encoder that maps from high-dimensional configuration space to a small-sized vector indicating the membership to metastable (long-lived) states, (ii) a Markov chain that governs the transitions between metastable states and facilitates analysis of the long-time dynamics, and (iii) a generative part that samples the conditional distribution of configurations in the next time step. The model can be operated in a recursive fashion to generate trajectories to predict the system evolution from a defined starting state and propose new configurations. The DeepGenMSM is demonstrated to provide accurate estimates of the long-time kinetics and generate valid distributions for molecular dynamics (MD) benchmark systems. Remarkably, we show that DeepGenMSMs are able to make long time-steps in molecular configuration space and generate physically realistic structures in regions that were not seen in training data.

categories: stat.ML cs.LG math.DS math.PR physics.data-an


title: SALT HRS discovery of the binary nucleus of the Etched Hourglass Nebula MyCn 18

abstract: The shaping of various morphological features of planetary nebulae (PNe) is increasingly linked to the role of binary central stars. Identifying a binary within a PN offers a powerful tool with which to directly investigate the formation mechanisms behind these features. The Etched Hourglass Nebula, MyCn 18, is the archetype for several binary-linked morphological features, yet it has no identified binary nucleus. It has the fastest jets seen in a PN of 630 km s$^{-1}$, a central star position offset from the nebula centre, and a bipolar nebula with a very narrow waist. Here we report on the Southern African Large Telescope (SALT) High Resolution Spectrograph (HRS) detection of radial velocity variability in the nucleus of MyCn 18 with an orbital period of $18.15\pm0.04$ days and a semi-amplitude of $11.0\pm0.3$ km s$^{-1}$. Adopting an orbital inclination of $38\pm5$ deg and a primary mass of $0.6\pm0.1$ $M_\odot$ yields a secondary mass of $0.19\pm0.05$ $M_\odot$ corresponding to an M5V companion. The detached nature of the binary rules out a classical nova (CN) as the origin of the jets or the offset central star as hypothesised in the literature. Furthermore, scenarios that produce the offset central star during the AGB and that form narrow waist bipolar nebulae result in orbital separations 80--800 times larger than observed in MyCn 18. The inner hourglass and jets may have formed from part of the common envelope ejecta that remained bound to the binary system in a circumbinary disk, whereas the offset central star position may best be explained by proper motion. Detailed simulations of MyCn 18 are encouraged that are compatible with the binary nucleus to further investigate its complex formation history.


title: Episodic Memory Deep Q-Networks

abstract: Reinforcement learning (RL) algorithms have made huge progress in recent years by leveraging the power of deep neural networks (DNN). Despite the success, deep RL algorithms are known to be sample inefficient, often requiring many rounds of interaction with the environments to obtain satisfactory performance. Recently, episodic memory based RL has attracted attention due to its ability to latch on good actions quickly. In this paper, we present a simple yet effective biologically inspired RL algorithm called Episodic Memory Deep Q-Networks (EMDQN), which leverages episodic memory to supervise an agent during training. Experiments show that our proposed method can lead to better sample efficiency and is more likely to find good policies. It only requires 1/5 of the interactions of DQN to achieve many state-of-the-art performances on Atari games, significantly outperforming regular DQN and other episodic memory based RL algorithms.


title: A note on global existence for the Zakharov system on $\mathbb{T}$

abstract: We show that the one-dimensional periodic Zakharov system is globally well-posed in a class of low-regularity Fourier-Lebesgue spaces. The result is obtained by combining the I-method with Bourgain's high-low decomposition method. As a corollary, we obtain probabilistic global existence results in $L^2$-based Sobolev spaces. We also obtain global well-posedness in $H^{\frac12+} \times L^2$, which is sharp (up to endpoints) in the class of $L^2$-based Sobolev spaces.


title: In-Orbit Instrument Performance Study and Calibration for POLAR Polarization Measurements

abstract: POLAR is a compact space-borne detector designed to perform reliable measurements of the polarization for transient sources like Gamma-Ray Bursts in the energy range 50-500keV. The instrument works based on the Compton Scattering principle with the plastic scintillators as the main detection material along with the multi-anode photomultiplier tube. POLAR has been launched successfully onboard the Chinese space laboratory TG-2 on 15th September, 2016. In order to reliably reconstruct the polarization information a highly detailed understanding of the instrument is required for both data analysis and Monte Carlo studies. For this purpose a full study of the in-orbit performance was performed in order to obtain the instrument calibration parameters such as noise, pedestal, gain nonlinearity of the electronics, threshold, crosstalk and gain, as well as the effect of temperature on the above parameters. Furthermore the relationship between gain and high voltage of the multi-anode photomultiplier tube has been studied and the errors on all measurement values are presented. Finally the typical systematic error on polarization measurements of Gamma-Ray Bursts due to the measurement error of the calibration parameters are estimated using Monte Carlo simulations.


title: Predicting Strategic Voting Behavior with Poll Information

abstract: The question of how people vote strategically under uncertainty has attracted much attention in several disciplines. Theoretical decision models have been proposed which vary in their assumptions on the sophistication of the voters and on the information made available to them about others' preferences and their voting behavior. This work focuses on modeling strategic voting behavior under poll information. It proposes a new heuristic for voting behavior that weighs the success of each candidate according to the poll score with the utility of the candidate given the voters' preferences. The model weights can be tuned individually for each voter. We compared this model with other relevant voting models from the literature on data obtained from a recently released large scale study. We show that the new heuristic outperforms all other tested models. The prediction errors of the model can be partly explained due to inconsistent voters that vote for (weakly) dominated candidates.


title: Cahn-Hilliard diffuse interface simulations of bubble-wall collisions

abstract: The collision of a rising bubble with a superhydrophilic horizontal surface is studied numerically using the Cahn-Hilliard diffuse-interface method. For the studied systems, the Bond number, $Bo=\rho R^2 g/\sigma$, varies between 0.25 to 1.5, and the Galileo number, $Ga=\rho (R^3 g)^{1/2}/\mu$, changes between 8.5 to 50. We assume that the viscosity and density of the bubble are negligible compared to the surrounding medium. We show that our computations reproduce experimentally observed dynamics for the collision of a bubble with a solid surface. Furthermore, for the studied range of parameters, the bubble-wall collision is mainly in the inertial regime. Our simulations show that even in the absence of substantial viscous dissipation, the ratio of rebound-to-collision velocity, the so-called coefficient of restitution, is much smaller than one for the studied systems. More importantly, the coefficient of restitution best scales with the Froude number, $Fr=U_{t}/\sqrt{g R}$, the ratio of inertial to gravitational forces.


title: The Meniscus on the Outside of a Circular Cylinder: from Microscopic to Macroscopic Scales

abstract: We systematically study the meniscus on the outside of a small circular cylinder vertically immersed in a liquid bath in a cylindrical container that is coaxial with the cylinder. The cylinder has a radius $R$ much smaller than the capillary length, $\kappa^{-1}$, and the container radius, $L$, is varied from a small value comparable to $R$ to $\infty$. In the limit of $L \ll \kappa^{-1}$, we analytically solve the general Young-Laplace equation governing the meniscus profile and show that the meniscus height, $\Delta h$, scales approximately with $R\ln (L/R)$. In the opposite limit where $L \gg \kappa^{-1}$, $\Delta h$ becomes independent of $L$ and scales with $R\ln (\kappa^{-1}/R)$. We implement a numerical scheme to solve the general Young-Laplace equation for an arbitrary $L$ and demonstrate the crossover of the meniscus profile between these two limits. The crossover region has been determined to be roughly $0.4\kappa^{-1} \lesssim L \lesssim 4\kappa^{-1}$. An approximate analytical expression has been found for $\Delta h$, enabling its accurate prediction at any values of $L$ that ranges from microscopic to macroscopic scales.


title: Complexity in Mathematics Education

abstract: This chapter presents a brief review of complexity research in mathematics education. We argue how research on complexity, as it pertains to mathematics education, can be viewed as an epistemological discourse, an historical discourse, a disciplinary discourse, and a pragmatic discourse.


title: Bitcoin price and its marginal cost of production: support for a fundamental value

abstract: This study back-tests a marginal cost of production model proposed to value the digital currency bitcoin. Results from both conventional regression and vector autoregression (VAR) models show that the marginal cost of production plays an important role in explaining bitcoin prices, challenging recent allegations that bitcoins are essentially worthless. Even with markets pricing bitcoin in the thousands of dollars each, the valuation model seems robust. The data show that a price bubble that began in the Fall of 2017 resolved itself in early 2018, converging with the marginal cost model. This suggests that while bubbles may appear in the bitcoin market, prices will tend to this bound and not collapse to zero.


title: Dual RG flows in 4D

abstract: We present a prescription for using the a central charge to determine the flow of a strongly coupled supersymmetric theory from its weakly coupled dual. The approach is based on the equivalence of the scale-dependent a-parameter derived from the four-dilaton amplitude with the a-parameter determined from the Lagrange multiplier method with scale-dependent R-charges. We explicitly demonstrate this equivalence for massive free N=1 superfields and for weakly coupled SQCD.


title: Neumann Domains on Graphs and Manifolds

abstract: The nodal set of a Laplacian eigenfunction forms a partition of the underlying manifold or graph. Another natural partition is based on the gradient vector field of the eigenfunction (on a manifold) or on the extremal points of the eigenfunction (on a graph). The submanifolds (or subgraphs) of this partition are called Neumann domains. This paper reviews the subject, as appears in a few recent works and points out some open questions and conjectures. The paper concerns both manifolds and metric graphs and the exposition allows for a comparison between the results obtained for each of them.


title: MAC Address De-Anonymisation

abstract: This project is an exploration into analysing WiFi probe requests, a management frame described as part of the IEEE 802.11 protocol which publicly broadcasts the senders MAC address. The intention was to collect these probe requests to use as a basis to link people's information to the MAC of their device. This would enable people to be identified in future by the presence of their device near a probe request detector. Due to data protection and privacy issues preventing access to real data of people's names and locations, this project was divided into two parts. Firstly, an identification algorithm was developed and tested on simulated data sets of MAC addresses and names, to prove MAC address identification is possible. And secondly, a distributed system of probe request detectors coupled with a centralised MAC address database was developed to demonstrate that these simulated MAC addresses are obtainable in the real world. The capturing software was initially developed for Unix systems and uses a Django-powered web server to store data from multiple capturing devices. Python was used to model and test the identification algorithm.


title: Predictive Estimation of the Optimal Signal Strength from Unmanned Aerial Vehicle over Internet of Things Using ANN

abstract: This paper proposes an intelligent technique for maximizing the network connectivity and provisioning desired quality of service (QoS) of integration of internet of things (IoT) and unmanned aerial vehicle (UAV). Prediction of the signal strength and fading channel conditions enable adaptive data transmission which turn enhances the QoS for the end users/ devices with reducing the power consumption for data transmissions. UAV is data gathering robot from the difficult or impossible area for humans to reach. Hence, Atmospheric dynamics and environment influence the signal strength during traveling in space among UAV, IoT devices, and humankind. Therefore, Signal moving from the smart UAV is sensitive to the effects of attenuation, reflection, diffraction, scattering, and shadowing. We analysis the ability ANN to predictively estimate the signal strength and channel propagation from the drone and physical medium parameters, using ANN. Moreover, the results show that the distortion of the signal can be reduced and enhanced significantly.


title: Generative Creativity: Adversarial Learning for Bionic Design

abstract: Bionic design refers to an approach of generative creativity in which a target object (e.g. a floor lamp) is designed to contain features of biological source objects (e.g. flowers), resulting in creative biologically-inspired design. In this work, we attempt to model the process of shape-oriented bionic design as follows: given an input image of a design target object, the model generates images that 1) maintain shape features of the input design target image, 2) contain shape features of images from the specified biological source domain, 3) are plausible and diverse. We propose DesignGAN, a novel unsupervised deep generative approach to realising bionic design. Specifically, we employ a conditional Generative Adversarial Networks architecture with several designated losses (an adversarial loss, a regression loss, a cycle loss and a latent loss) that respectively constrict our model to meet the corresponding aforementioned requirements of bionic design modelling. We perform qualitative and quantitative experiments to evaluate our method, and demonstrate that our proposed approach successfully generates creative images of bionic design.


title: Do Neural Network Cross-Modal Mappings Really Bridge Modalities?

abstract: Feed-forward networks are widely used in cross-modal applications to bridge modalities by mapping distributed vectors of one modality to the other, or to a shared space. The predicted vectors are then used to perform e.g., retrieval or labeling. Thus, the success of the whole system relies on the ability of the mapping to make the neighborhood structure (i.e., the pairwise similarities) of the predicted vectors akin to that of the target vectors. However, whether this is achieved has not been investigated yet. Here, we propose a new similarity measure and two ad hoc experiments to shed light on this issue. In three cross-modal benchmarks we learn a large number of language-to-vision and vision-to-language neural network mappings (up to five layers) using a rich diversity of image and text features and loss functions. Our results reveal that, surprisingly, the neighborhood structure of the predicted vectors consistently resembles more that of the input vectors than that of the target vectors. In a second experiment, we further show that untrained nets do not significantly disrupt the neighborhood (i.e., semantic) structure of the input vectors.


title: Delocalized eta invariants, algebraicity, and $K$-theory of group $C^*$-algebras

abstract: In this paper, we establish a precise connection between higher rho invariants and delocalized eta invariants. Given an element in a discrete group, if its conjugacy class has polynomial growth, then there is a natural trace map on the $K_0$-group of its group $C^\ast$-algebra. For each such trace map, we construct a determinant map on secondary higher invariants. We show that, under the evaluation of this determinant map, the image of a higher rho invariant is precisely the corresponding delocalized eta invariant of Lott. As a consequence, we show that if the Baum-Connes conjecture holds for a group, then Lott's delocalized eta invariants take values in algebraic numbers. We also generalize Lott's delocalized eta invariant to the case where the corresponding conjugacy class does not have polynomial growth, provided that the strong Novikov conjecture holds for the group.


title: Convexification method for a coefficient inverse problem and its performance for experimental backscatter data for buried targets

abstract: We present in this paper a novel numerical reconstruction method for solving a 3D coefficient inverse problem with scattering data generated by a single direction of the incident plane wave. This inverse problem is well-known to be a highly nonlinear and ill-posed problem. Therefore, optimization-based reconstruction methods for solving this problem would typically suffer from the local-minima trapping and require strong a priori information of the solution. To avoid these problems, in our numerical method, we aim to construct a cost functional with a globally strictly convex property, whose minimizer can provide a good approximation for the exact solution of the inverse problem. The key ingredients for the construction of such functional are an integro-differential formulation of the inverse problem and a Carleman weight function. Under a (partial) finite difference approximation, the global strict convexity is proven using the tool of Carleman estimates. The global convergence of the gradient projection method to the exact solution is proven as well. We demonstrate the efficiency of our reconstruction method via a numerical study of experimental backscatter data for buried objects.


title: Vacuum alignment in a composite 2HDM

abstract: We study in detail the vacuum structure of a composite two Higgs doublet model based on a minimal underlying theory with 3 Dirac fermions in pseudo-real representations of the condensing gauge interactions, leading to the SU(6)/Sp(6) symmetry breaking pattern. We find that, independently on the source of top mass, the most general CP-conserving vacuum is characterised by three non-vanishing angles. A special case occurs if the Yukawas are aligned, leading to a single angle. In the latter case, a Dark Matter candidate arises, protected by a global U(1) symmetry.


title: Winding around Non-Hermitian Singularities: General Theory and Topological Features

abstract: Non-Hermitian singularities are ubiquitous in non-conservative open systems. These singularities are often points of measure zero in the eigenspectrum of the system which make them difficult to access without careful engineering. Despite that, they can remotely induce observable effects when some of the system's parameters are varied along closed trajectories in the parameter space. To date, a general formalism for describing this process beyond simple cases is still lacking. Here, we bridge this gap and develop a general approach for treating this problem by utilizing the power of permutation operators and representation theory. This in turn allows us to reveal the following surprising result which contradicts the common belief in the field: loops that enclose the same singularities starting from the same initial point and traveling in the same direction, do not necessarily share the same end outcome. Interestingly, we find that this equivalence can be formally established only by invoking the topological notion of homotopy. Our findings are general with far reaching implications in various fields ranging from photonics and atomic physics to microwaves and acoustics.


title: CapProNet: Deep Feature Learning via Orthogonal Projections onto Capsule Subspaces

abstract: In this paper, we formalize the idea behind capsule nets of using a capsule vector rather than a neuron activation to predict the label of samples. To this end, we propose to learn a group of capsule subspaces onto which an input feature vector is projected. Then the lengths of resultant capsules are used to score the probability of belonging to different classes. We train such a Capsule Projection Network (CapProNet) by learning an orthogonal projection matrix for each capsule subspace, and show that each capsule subspace is updated until it contains input feature vectors corresponding to the associated class. We will also show that the capsule projection can be viewed as normalizing the multiple columns of the weight matrix simultaneously to form an orthogonal basis, which makes it more effective in incorporating novel components of input features to update capsule representations. In other words, the capsule projection can be viewed as a multi-dimensional weight normalization in capsule subspaces, where the conventional weight normalization is simply a special case of the capsule projection onto 1D lines. Only a small negligible computing overhead is incurred to train the network in low-dimensional capsule subspaces or through an alternative hyper-power iteration to estimate the normalization matrix. Experiment results on image datasets show the presented model can greatly improve the performance of the state-of-the-art ResNet backbones by $10-20\%$ and that of the Densenet by $5-7\%$ respectively at the same level of computing and memory expenses. The CapProNet establishes the competitive state-of-the-art performance for the family of capsule nets by significantly reducing test errors on the benchmark datasets.


title: Bayesian Bootstrap Inference for the ROC Surface

abstract: Accurate diagnosis of disease is of great importance in clinical practice and medical research. The receiver operating characteristic (ROC) surface is a popular tool for evaluating the discriminatory ability of continuous diagnostic test outcomes when there exist three ordered disease classes (e.g., no disease, mild disease, advanced disease). We propose the Bayesian bootstrap, a fully nonparametric method, for conducting inference about the ROC surface and its functionals, such as the volume under the surface. The proposed method is based on a simple, yet interesting, representation of the ROC surface in terms of placement variables. Results from a simulation study demonstrate the ability of our method to successfully recover the true ROC surface and to produce valid inferences in a variety of complex scenarios. An application to data from the Trail Making Test to assess cognitive impairment in Parkinson's disease patients is provided.


title: Induced Dynamics in Hyperspaces of Non-Autonomous Discrete Systems

abstract: In this paper, the interrelations of some dynamical properties of the non-autonomous dynamical system (X, f1;infinity) and its induced non-autonomous dynamical system (K(X), f1;infinity) are studied, where K(X) is the hyperspace of all non-empty compact subsets of X, endowed with Vietoris topology. Various stronger forms of sensitivity and transitivity are considered. Some examples of non-autonomous systems are provided to support the results. A relation between shadowing property of the non- autonomous system (X, f1;infinity) and its induced system (K(X), f1;infinity) is studied.


title: Nonparametric Bayesian Deep Networks with Local Competition

abstract: The aim of this work is to enable inference of deep networks that retain high accuracy for the least possible model complexity, with the latter deduced from the data during inference. To this end, we revisit deep networks that comprise competing linear units, as opposed to nonlinear units that do not entail any form of (local) competition. In this context, our main technical innovation consists in an inferential setup that leverages solid arguments from Bayesian nonparametrics. We infer both the needed set of connections or locally competing sets of units, as well as the required floating-point precision for storing the network parameters. Specifically, we introduce auxiliary discrete latent variables representing which initial network components are actually needed for modeling the data at hand, and perform Bayesian inference over them by imposing appropriate stick-breaking priors. As we experimentally show using benchmark datasets, our approach yields networks with less computational footprint than the state-of-the-art, and with no compromises in predictive accuracy.


title: Stability analysis of orbital modes for a generalized Lane-Emden equation

abstract: We present a stability analysis of the standard nonautonomous systems type for a recently introduced generalized Lane-Emden equation which is shown to explain the presence of some of the structures observed in the atomic spatial distributions of magnetically-trapped ultracold atomic clouds. A Lyapunov function is defined which helps us to prove that stable spatial structures in the atomic clouds exist only for the adiabatic index $\gamma=1+1/n$ with even $n$. In the case when $n$ is odd we provide an instability result indicating the divergence of the density function for the atoms. Several numerical solutions, which according to our stability analysis are stable, are also presented.


title: Micro Water-Energy Nexus: Optimal Demand-Side Management and Quasi-Convex Hull Relaxation

abstract: This paper investigates the water network's potential ability to provide demand response services to the power grid under the framework of a distribution-level water-energy nexus (micro-WEN). In particular, the hidden controllability of water loads, such as irrigation systems, was closely studied to improve the flexibility of electrical grids. A optimization model is developed for the demand-side management (DSM) of micro-WEN, and the simulation results assert that grid flexibility indeed benefits from controllable water loads. Although the proposed optimal DSM model is an intractable mixed-integer nonlinear programming (MINLP) problem, quasi-convex hull techniques were developed to relax the MINLP into a mixed-integer convex programming (MICP) problem. The numerical study shows that the quasi-convex hull relaxation is tight and that the resulting MICP problem is computationally efficient.


title: The derived category of a locally complete intersection ring

abstract: In this paper, we answer a question of Dwyer, Greenlees, and Iyengar by proving a local ring $R$ is a complete intersection if and only if every complex of $R$-modules with finitely generated homology is proxy small. Moreover, we establish that a commutative noetherian ring $R$ is locally a complete intersection if and only if every complex of $R$-modules with finitely generated homology is virtually small.


title: Sparse Architectures for Text-Independent Speaker Verification Using Deep Neural Networks

abstract: Network pruning is of great importance due to the elimination of the unimportant weights or features activated due to the network over-parametrization. Advantages of sparsity enforcement include preventing the overfitting and speedup. Considering a large number of parameters in deep architectures, network compression becomes of critical importance due to the required huge amount of computational power. In this work, we impose structured sparsity for speaker verification which is the validation of the query speaker compared to the speaker gallery. We will show that the mere sparsity enforcement can improve the verification results due to the possible initial overfitting in the network.


title: Imaging soliton dynamics in optical microcavities

abstract: Solitons are self-sustained wavepackets that occur in many physical systems. Their recent demonstration in optical microresonators has provided a new platform for study of nonlinear optical physics with practical implications for miniaturization of time standards, spectroscopy tools and frequency metrology systems. However, despite its importance to understanding of soliton physics as well as development of new applications, imaging the rich dynamical behaviour of solitons in microcavities has not been possible. These phenomena require a difficult combination of high-temporal-resolution and long-record-length in order to capture the evolving trajectories of closely-spaced microcavity solitons. Here, an imaging method is demonstrated that visualizes soliton motion with sub-picosecond resolution over arbitrary time spans. A wide range of complex soliton transient behaviors are characterized in the temporal or spectral domain, including soliton formation, collisions, spectral breathing and soliton decay. This method can serve as a universal visualization tool for understanding complex soliton physics in microcavities.


title: Free quandles and knot quandles are residually finite

abstract: In this note, residual finiteness of quandles is defined and investigated. It is proved that free quandles and knot quandles of tame knots are residually finite and Hopfian. Residual finiteness of quandles arising from residually finite groups (conjugation, core and Alexander quandles) is established. Further, residual finiteness of automorphism groups of some residually finite quandles is also discussed.


title: Learning to Detect

abstract: In this paper we consider Multiple-Input-Multiple-Output (MIMO) detection using deep neural networks. We introduce two different deep architectures: a standard fully connected multi-layer network, and a Detection Network (DetNet) which is specifically designed for the task. The structure of DetNet is obtained by unfolding the iterations of a projected gradient descent algorithm into a network. We compare the accuracy and runtime complexity of the purposed approaches and achieve state-of-the-art performance while maintaining low computational requirements. Furthermore, we manage to train a single network to detect over an entire distribution of channels. Finally, we consider detection with soft outputs and show that the networks can easily be modified to produce soft decisions.


title: Latent Space Non-Linear Statistics

abstract: Given data, deep generative models, such as variational autoencoders (VAE) and generative adversarial networks (GAN), train a lower dimensional latent representation of the data space. The linear Euclidean geometry of data space pulls back to a nonlinear Riemannian geometry on the latent space. The latent space thus provides a low-dimensional nonlinear representation of data and classical linear statistical techniques are no longer applicable. In this paper we show how statistics of data in their latent space representation can be performed using techniques from the field of nonlinear manifold statistics. Nonlinear manifold statistics provide generalizations of Euclidean statistical notions including means, principal component analysis, and maximum likelihood fits of parametric probability distributions. We develop new techniques for maximum likelihood inference in latent space, and adress the computational complexity of using geometric algorithms with high-dimensional data by training a separate neural network to approximate the Riemannian metric and cometric tensor capturing the shape of the learned data manifold.


title: Heterogeneous Multi-output Gaussian Process Prediction

abstract: We present a novel extension of multi-output Gaussian processes for handling heterogeneous outputs. We assume that each output has its own likelihood function and use a vector-valued Gaussian process prior to jointly model the parameters in all likelihoods as latent functions. Our multi-output Gaussian process uses a covariance function with a linear model of coregionalisation form. Assuming conditional independence across the underlying latent functions together with an inducing variable framework, we are able to obtain tractable variational bounds amenable to stochastic variational inference. We illustrate the performance of the model on synthetic data and two real datasets: a human behavioral study and a demographic high-dimensional dataset.