title: Network Representation of Large-Scale Heterogeneous RNA Sequences with Integration of Diverse Multi-omics, Interactions, and Annotations Data

abstract: Long non-coding RNA, microRNA, and messenger RNA enable key regulations of various biological processes through a variety of diverse interaction mechanisms. Identifying the interactions and cross-talk between these heterogeneous RNA classes is essential in order to uncover the functional role of individual RNA transcripts, especially for unannotated and newly-discovered RNA sequences with no known interactions. Recently, sequence-based deep learning and network embedding methods are becoming promising approaches that can either predict RNA-RNA interactions from a sequence or infer missing interactions from patterns that may exist in the network topology. However, the majority of these methods have several limitations, eg, the inability to perform inductive predictions, to distinguish the directionality of interactions, or to integrate various sequence, interaction, and annotation biological datasets. We proposed a novel deep learning-based framework, rna2rna, which learns from RNA sequences to produce a low-dimensional embedding that preserves the proximities in both the interactions topology and the functional affinity topology. In this proposed embedding space, we have designated a two-part" source and target contexts" to capture the targeting and receptive fields of each RNA transcript, while encapsulating the heterogenous cross-talk interactions between lncRNAs and miRNAs. From experimental results, our method exhibits superior performance in AUPR rates compared to state-of-art approaches at predicting missing interactions in different RNA-RNA interaction databases and was shown to accurately perform link predictions to novel RNA sequences not seen at training time, even without any prior information. Additional results suggest that our proposed framework can capture a manifold for heterogeneous RNA sequences to discover novel functional annotations.


title: Millimeter Wave Beam Recommendation via Tensor Completion

abstract: Accurate and fast beam-alignment is essential to cope with the fast-varying environment in millimeter-wave communications. A data-driven approach is a promising solution to reduce the training overhead by leveraging side information and on-the-field measurements. In this work, a two-stage tensor completion algorithm is proposed to predict the received power on a set of possible users' positions, given received power measurements on a small subset of positions. Based on these predictions and on positional side information, a small subset of beams is recommended to reduce the training overhead of beam-alignment. Numerical results evaluated with the Quadriga channel simulator demonstrate that the proposed algorithm achieves correct alignment with high probability using small training overhead: given power measurement on only 20% of the possible positions when using a discrete coverage area, our algorithm attains a probability of correct alignment of 80%, with only 2% of trained beams, as opposed to a state-of-the-art scheme which achieves 50% correct alignment in the same configuration. To the best of our knowledge, this is the first work to consider the beam recommendation problem based on measurements collected on a small subset of positions.


title: Error Correcting Algorithms for Sparsely Correlated Regressors

abstract: Autonomy and adaptation of machines requires that they be able to measure their own errors. We consider the advantages and limitations of such an approach when a machine has to measure the error in a regression task. How can a machine measure the error of regression sub-components when it does not have the ground truth for the correct predictions? A compressed sensing approach applied to the error signal of the regressors can recover their precision error without any ground truth. It allows for some regressors to be \emph{strongly correlated} as long as not too many are so related. Its solutions, however, are not unique - a property of ground truth inference solutions. Adding $\ell_1$--minimization as a condition can recover the correct solution in settings where error correction is possible. We briefly discuss the similarity of the mathematics of ground truth inference for regressors to that for classifiers.


title: Pyramid Ricci Flow in Higher Dimensions

abstract: In this paper, we construct a pyramid Ricci flow starting with a complete Riemannian manifold $(M^n,g_0)$ that is PIC1, or more generally satisfies a lower curvature bound $K_{IC_1}\geq -\alpha_0$. That is, instead of constructing a flow on $M\times [0,T]$, we construct it on a subset of space-time that is a union of parabolic cylinders $B_{g_0}(x_0,k)\times [0,T_k]$ for each natural number $k$, where $T_k\downarrow 0$, and prove estimates on the curvature and Riemannian distance. More generally, we construct a pyramid Ricci flow starting with any noncollapsed $IC_1$-limit space, and use it to establish that such limit spaces are globally homeomorphic to smooth manifolds via homeomorphisms that are locally bi-H\"older.


title: Multiparticle quantum walk with a gas-like interaction

abstract: We analyze the dynamics of multiparticle discrete-time quantum walk on the two-dimensional lattice, with an interaction inspired on a classical model for gas collision, called HPP model. In this classical model, the direction of motion changes only when the particles collide head-on, preserving momentum and energy. In our quantum model, the dynamics is driven by the usual quantum-walk evolution operator if the particles are on different nodes, and is driven by the HPP rules if the particles are in the same node, linearly extended for superpositions. Using this new form of evolution operator, we numerically analyze three physical quantities for the two-walker case: The probability distribution of the position of one walker, the standard deviation of the position of one walker, and the entanglement between the walkers as a function of the number of steps. The numerical analysis implies that the entanglement between the walkers as a function of the number of steps initially increases and quickly tends to a constant value, which depends on the initial condition. We compare the results obtained using the HPP interaction with the equivalent ones using the phase interaction, which is based on an evolution operator that inverts the sign of the coin operator if the walkers are in the same position.


title: Template Independent Component Analysis: Targeted and Reliable Estimation of Subject-level Brain Networks using Big Data Population Priors

abstract: Large brain imaging databases contain a wealth of information on brain organization in the populations they target, and on individual variability. While such databases have been used to study group-level features of populations directly, they are currently underutilized as a resource to inform single-subject analysis. Here, we propose leveraging the information contained in large functional magnetic resonance imaging (fMRI) databases by establishing population priors to employ in an empirical Bayesian framework. We focus on estimation of brain networks as source signals in independent component analysis (ICA). We formulate a hierarchical "template" ICA model where source signals---including known population brain networks and subject-specific signals---are represented as latent variables. For estimation, we derive an expectation maximization (EM) algorithm having an explicit solution. However, as this solution is computationally intractable, we also consider an approximate subspace algorithm and a faster two-stage approach. Through extensive simulation studies, we assess performance of both methods and compare with dual regression, a popular but ad-hoc method. The two proposed algorithms have similar performance, and both dramatically outperform dual regression. We also conduct a reliability study utilizing the Human Connectome Project and find that template ICA achieves substantially better performance than dual regression, achieving 75-250% higher intra-subject reliability.


title: 4D CNN for semantic segmentation of cardiac volumetric sequences

abstract: We propose a 4D convolutional neural network (CNN) for the segmentation of retrospective ECG-gated cardiac CT, a series of single-channel volumetric data over time. While only a small subset of volumes in the temporal sequence is annotated, we define a sparse loss function on available labels to allow the network to leverage unlabeled images during training and generate a fully segmented sequence. We investigate the accuracy of the proposed 4D network to predict temporally consistent segmentations and compare with traditional 3D segmentation approaches. We demonstrate the feasibility of the 4D CNN and establish its performance on cardiac 4D CCTA.


title: Censored Stable Subordinators and Fractional Derivatives

abstract: Based on the popular Caputo fractional derivative of order $\beta$ in $(0,1)$, we define the censored fractional derivative on the positive half-line $\mathbb R_+$. This derivative proves to be the Feller generator of the censored (or resurrected) decreasing $\beta$-stable process in $\mathbb R_+$. We provide a series representation for the inverse of this censored fractional derivative, which we use to study general censored initial value problems. We are then able to prove that this censored process hits the boundary in a finite time $\tau_\infty$, whose expectation is proportional to that of the first passage time of the $\beta$-stable subordinator. We also show that the censored relaxation equation is solved by the Laplace transform of $\tau_\infty$. This relaxation solution proves to be a completely monotone series, with algebraic decay one order faster than its Caputo counterpart, leading, surprisingly, to a new regime of fractional relaxation models. Lastly, we discuss how this work identifies a new sub-diffusion model.


title: Controlling acoustic waves using magnetoelastic Fano resonances

abstract: We propose and analyze theoretically a class of energy-efficient magneto-elastic devices for analogue signal processing. The signals are carried by transverse acoustic waves while the bias magnetic field controls their scattering from a magneto-elastic slab. By tuning the bias field, one can alter the resonant frequency at which the propagating acoustic waves hybridize with the magnetic modes, and thereby control transmission and reflection coefficients of the acoustic waves. The scattering coefficients exhibit Breit-Wigner/Fano resonant behaviour akin to inelastic scattering in atomic and nuclear physics. Employing oblique incidence geometry, one can effectively enhance the strength of magnetoelastic coupling, and thus countermand the magnetic losses due to the Gilbert damping. We apply our theory to discuss potential benefits and issues in realistic systems and suggest further routes to enhance performance of the proposed devices.


title: Weighted delay-and-sum beamforming guided by visual tracking for human-robot interaction

abstract: This paper describes the integration of weighted delay-and-sum beamforming with speech source localization using image processing and robot head visual servoing for source tracking. We take into consideration the fact that the directivity gain provided by the beamforming depends on the angular distance between its main lobe and the main response axis of the microphone array. A visual servoing scheme is used to reduce the angular distance between the center of the video frame of a robot camera and a target object. Additionally, the beamforming strategy presented combines two information sources: the direction of the target object obtained with image processing and the audio signals provided by a microphone array. These sources of information were integrated by making use of a weighted delay-and-sum beamforming method. Experiments were carried out with a real mobile robotic testbed built with a PR2 robot. Static and dynamic robot head as well as the use of one and two external noise sources were considered. The results presented here show that the appropriate integration of visual source tracking with visual servoing and a beamforming method can lead to a reduction in WER as high as 34% compared to beamforming alone.


title: On combining features for single-channel robust speech recognition in reverberant environments

abstract: This paper addresses the combination of complementary parallel speech recognition systems to reduce the error rate of speech recognition systems operating in real highly-reverberant environments. First, the testing environment consists of recordings of speech in a calibrated real room with reverberation times from 0.47 to 1.77 seconds and speaker-to-microphone distances of 0.16 to 2.56 meters. We combined systems both at the level of the DNN outputs and at the level of the final ASR outputs. Second, recognition experiments with the reverb challenge are also reported. The results presented here show that the combination of features can lead to WER improvements between 7% and 18% with speech recorded in real reverberant environments. Also, the combination at DNN-output level is much more effective than at the system-output level. However, cascading both schemes can still lead to smaller reductions in WER.


title: Linear Lower Bounds and Conditioning of Differentiable Games

abstract: Recent successes of game-theoretic formulations in ML have caused a resurgence of research interest in differentiable games. Overwhelmingly, that research focuses on methods and upper bounds on their speed of convergence. In this work, we approach the question of fundamental iteration complexity by providing lower bounds to complement the linear (i.e. geometric) upper bounds observed in the literature on a wide class of problems. We cast saddle-point and min-max problems as 2-player games. We leverage tools from single-objective convex optimisation to propose new linear lower bounds for convex-concave games. Notably, we give a linear lower bound for $n$-player differentiable games, by using the spectral properties of the update operator. We then propose a new definition of the condition number arising from our lower bound analysis. Unlike past definitions, our condition number captures the fact that linear rates are possible in games, even in the absence of strong convexity or strong concavity in the variables.


title: Standard-Model Extension Constraints on Lorentz and CPT Violation From Optical Polarimetry of Active Galactic Nuclei

abstract: Vacuum birefringence from Lorentz and CPT violation in the Standard-Model Extension can be constrained using ground-based optical polarimetry of extragalactic sources. We describe results from a pilot program with an automated system that can perform simultaneous optical polarimetry in multiple passbands on different telescopes with an effective 0.45 m aperture. Despite the limited collecting area, our polarization measurements of AGN using a wider effective optical passband than previous studies yielded individual line-of-sight constraints for Standard-Model Extension mass dimension $d = 5$ operators within a factor of about one to ten of comparable broadband polarimetric bounds obtained using data from a 3.6 m telescope with roughly 64 times the collecting area. Constraining more general anisotropic Standard-Model Extension coefficients at higher $d$ would require more AGN along different lines of sight. This motivates a future dedicated ground-based, multi-band, optical polarimetry AGN survey with $\gtrsim 1$ m-class telescopes, to obtain state-of-the-art anisotropic Standard-Model Extension $d = 4, 5, 6$ constraints, while also using complementary archival polarimetry. This could happen more quickly and cost-effectively than via spectropolarimetry and long before more competitive constraints from space- or balloon-based x-ray/$\gamma$-ray polarization measurements.


title: Ferromagnetism and superconductivity in twisted double bilayer graphene

abstract: We present a theory of competing ferromagnetic and superconducting orders in twisted double bilayer graphene (TDBG). In our theory, ferromagnetism is induced by Coulomb repulsion, while superconductivity with intervalley equal-spin pairing can be mediated by electron-acoustic phonon interactions. We calculate the transition temperatures for ferromagnetism and superconductivity as a function of moir\'e band filling factor, and find that superconducting domes can appear on both the electron and hole sides of the ferromagnetic insulator at half filling. We show that the ferromagnetic insulating gap has a dome shape dependence on the layer potential difference, which provides an explanation to the experimental observation that the ferromagnetic insulator only develops over a finite range of external displacement field. We also verify the stability of the half-filled ferromagnetic insulator against two types of collective excitations, i.e., spin magnons and valley magnons.


title: First-Order "Hyper-selective" Binding Transition of Multivalent Particles Under Force

abstract: Multivalent particles bind to targets via many independent ligand-receptor bonding interactions. This microscopic design spans length scales in both synthetic and biological systems. Classic examples include interactions between cells, virus binding, synthetic ligand-coated micrometer-scale vesicles or smaller nano-particles, functionalised polymers, and toxins. Equilibrium multivalent binding is a continuous yet super-selective transition with respect to the number of ligands and receptors involved in the interaction. Increasing the ligand or receptor density on the two particles leads to sharp growth in the number of bound particles at equilibrium. Here we present a theory and Monte Carlo simulations to show that applying mechanical force to multivalent particles causes their adsorption/desorption isotherm on a surface to become sharper and more selective, with respect to variation in the number of ligands and receptors on the two objects. When the force is only applied to particles bound to the surface by one or more ligands, then the transition can become infinitely sharp and first-order---a new binding regime which we term "hyper-selective". Force may be imposed by, e.g. flow of solvent around the particles, a magnetic field, chemical gradients, or triggered uncoiling of inert oligomers/polymers tethered to the particles to provide a steric repulsion to the surface. This physical principle is a step towards "all or nothing" binding selectivity in the design of multivalent constructs.


title: Neurally-Guided Structure Inference

abstract: Most structure inference methods either rely on exhaustive search or are purely data-driven. Exhaustive search robustly infers the structure of arbitrarily complex data, but it is slow. Data-driven methods allow efficient inference, but do not generalize when test data have more complex structures than training data. In this paper, we propose a hybrid inference algorithm, the Neurally-Guided Structure Inference (NG-SI), keeping the advantages of both search-based and data-driven methods. The key idea of NG-SI is to use a neural network to guide the hierarchical, layer-wise search over the compositional space of structures. We evaluate our algorithm on two representative structure inference tasks: probabilistic matrix decomposition and symbolic program parsing. It outperforms data-driven and search-based alternatives on both tasks.


title: Phase coherent electron transport in asymmetric cross-like Andreev interferometers

abstract: We present a detailed theoretical description of quantum coherent electron transport in voltage-biased cross-like Andreev interferometers. Making use of the charge conjugation symmetry encoded in the quasiclassical formalism, we elucidate a crucial role played by geometric and electron-hole asymmetries in these structures. We argue that a non-vanishing Aharonov-Bohm-like contribution to the current $I_S$ flowing in the superconducting contour may develop only in geometrically asymmetric interferometers making their behavior qualitatively different from that of symmetric devices. The current $I_N$ in the normal contour -- along with $I_S$ -- is found to be sensitive to phase-coherent effects thereby also acquiring a $2\pi$-periodic dependence on the Josephson phase. In asymmetric structures this current develops an odd-in-phase contribution originating from electron-hole asymmetry. We demonstrate that both phase dependent currents $I_S$ and $I_N$ can be controlled and manipulated by tuning the applied voltage, temperature and system topology, thus rendering Andreev interferometers particularly important for future applications in modern electronics.


title: Frame dependence of transition form factors in light-front dynamics

abstract: We calculate the transition form factor between vector and pseudoscalar quarkonia in both the timelike and the spacelike region using light-front dynamics. We investigate the frame dependence of the form factors for heavy quarkonia with light-front wavefunctions calculated from the valence Fock sector. This dependence could serve as a measure for the Lorentz symmetry violation arising from the Fock-space truncation. We suggest using frames with minimal longitudinal momentum transfer for calculations in the valence Fock sector, namely the Drell-Yan frame for the space-like region and a specific longitudinal frame for the timelike region; at $q^2=0$ these two frames give the same result. We also use the transition form factor in the timelike region to investigate the electromagnetic Dalitz decay $\psi_A\to \psi_B l^+l^-$ ($l = e,\mu$) and predict the effective mass spectrum of the lepton pair.


title: Towards Transfer Learning for End-to-End Speech Synthesis from Deep Pre-Trained Language Models

abstract: Modern text-to-speech (TTS) systems are able to generate audio that sounds almost as natural as human speech. However, the bar of developing high-quality TTS systems remains high since a sizable set of studio-quality <text, audio> pairs is usually required. Compared to commercial data used to develop state-of-the-art systems, publicly available data are usually worse in terms of both quality and size. Audio generated by TTS systems trained on publicly available data tends to not only sound less natural, but also exhibits more background noise. In this work, we aim to lower TTS systems' reliance on high-quality data by providing them the textual knowledge extracted by deep pre-trained language models during training. In particular, we investigate the use of BERT to assist the training of Tacotron-2, a state of the art TTS consisting of an encoder and an attention-based decoder. BERT representations learned from large amounts of unlabeled text data are shown to contain very rich semantic and syntactic information about the input text, and have potential to be leveraged by a TTS system to compensate the lack of high-quality data. We incorporate BERT as a parallel branch to the Tacotron-2 encoder with its own attention head. For an input text, it is simultaneously passed into BERT and the Tacotron-2 encoder. The representations extracted by the two branches are concatenated and then fed to the decoder. As a preliminary study, although we have not found incorporating BERT into Tacotron-2 generates more natural or cleaner speech at a human-perceivable level, we observe improvements in other aspects such as the model is being significantly better at knowing when to stop decoding such that there is much less babbling at the end of the synthesized audio and faster convergence during training.


title: Local Nondeterminism and the Exact Modulus of Continuity for Stochastic Wave Equation

abstract: We consider the linear stochastic wave equation driven by a Gaussian noise. We show that the solution satisfies a certain form of strong local nondeterminism and we use this property to derive the exact uniform modulus of continuity for the solution.


title: Computational Many-Body Physics via $\mathcal M_{2^q}$ Algebra

abstract: The many-body Hamiltonians and other fermionic physical observables are expressed in terms of fermionic creation and annihilation operators, which form the algebra of canonical anti-commutation relations (CAR). In this work we use a canonical isomorphism between CAR and $\mathcal M_{2^\infty}$ algebras to derive analytic matrix representations of many-fermion operators. Code-lines implementing these matrix representations are supplied and Hubbard-type Hamiltonians are worked out explicitly.


title: Counting numerical semigroups by genus and even gaps via Kunz-coordinate vectors

abstract: We contruct a one-to-one correspondence between a subset of numerical semigroups with genus $g$ and $\gamma$ even gaps and the integer points of a rational polytope. In particular, we give an overview to apply this correspondence to try to decide if the sequence $(n_g)$ is increasing, where $n_g$ denotes the number of numerical semigroups with genus $g$.


title: Excavating the Explosion and Progenitor Properties of Type IIP Supernovae via Modelling of their Optical Lightcurves

abstract: The progenitors of Type IIP supernovae (SNe) are known to be red supergiants, but their properties are not well determined. We employ hydrodynamical modelling to investigate the explosion characteristics of eight Type IIP supernovae, and the properties of their progenitor stars. We create evolutionary models using the {\sc MESA} stellar evolution code, explode these models, and simulate the optical lightcurves using the {\sc STELLA} code. We fit the optical lightcurves, Fe II 5169\AA\ velocity, and photospheric velocity, to the observational data. Recent research has suggested that the progenitors of Type IIP SNe have a zero age main sequence (ZAMS) mass not exceeding $\sim18$ M$_{\odot}$. Our fits give a progenitor ZAMS mass $\leq18$ M$_{\odot}$ for seven of the supernovae. Where previous progenitor mass estimates exist, from various sources such as hydrodynamical modelling, multi-wavelength observations, or semi-analytic calculations, our modelling generally tends towards the lower mass values. This result is in contrast to results from previous hydrodynamical modelling, but is consistent with those obtained using general-relativistic radiation-hydrodynamical codes. We do find that one event, SN 2015ba, has a progenitor whose mass is closer to 24 M$_{\odot}$ , although we are unable to fit it well. We also derive the amount of $^{56}$Ni required to reproduce the tail of the lightcurve, and find values generally larger than previous estimates. Overall, we find that it is difficult to characterize the explosion by a single parameter, and that a range of parameters is needed.


title: MultiCloud Resource Management using Apache Mesos for Planned Integration with Apache Airavata

abstract: We discuss initial results and our planned approach for incorporating Apache Mesos based resource management that will enable design and development of scheduling strategies for Apache Airavata jobs so that they can be launched on multiple clouds, wherein several VMs do not have Public IP addresses. We present initial work and next steps on the design of a meta-scheduler using Apache Mesos. Apache Mesos presents a unified view of resources available across several clouds and clusters. Our meta-scheduler can potentially examine and identify the cases where multiple small jobs have been submitted by the same scientists and then redirect job from the same community account or user to different clusters. Our approach uses a NAT firewall to make nodes/VMs, without a Public IP, visible to Mesos for the unified view.


title: Continuous-time Markov-switching GARCH Process with Robust and Efficient State Path and Volatility Estimation

abstract: We propose a continuous-time Markov-switching generalized autoregressive conditional heteroskedasticity (COMS-GARCH) process for handling irregularly spaced time series (TS) with multiple volatilities states. We employ a Gibbs sampler in the Bayesian framework to estimate the COMS-GARCH model parameters, the latent state path and volatilities. To improve the inferential robustness and computational efficiency for obtaining the maximum a posteriori estimates for the state path and volatilities, we suggest a multi-path sampling scheme and incorporate the Bernoulli noise injection in the computational algorithm. We provide theoretical justifications for the improved stability and robustness with the Bernoulli noise injection through the concept of ensemble learning and the low sensitivity of the objective function to external perturbation in the TS. We apply the proposed COMS-GARCH process and the computational procedure to simulated TS, a real currency exchange rate TS, and a real blood volume amplitude TS. The empirical results demonstrate that the COMS-GARCH process and the computational procedure are able to predict volatility regimes and volatilities in a TS with satisfactory accuracy.


title: Anomalous spin-orbit field via Rashba-Edelstein effect at W/Pt interface

abstract: We have studied spin-orbit (SO) field in Ni$_{80}$Fe$_{20}$(Py)/W/Pt trilayer by means of spin-torque ferromagnetic resonance, and demonstrated that the W/Pt interface generates an extra SO field acting on the Py layer. This unprecedented field originates from the following three processes, 1) spin accumulation at W/Pt interface via the Rashba-Edelstein effect, 2) diffusive spin transport in the W layer, and 3) spin absorption into the Py layer through accumulation at the Py/W interface. Our result means that we can create extra SO field away from the ferromagnet/ metal interface and control its strength by a combination of two different metals.


title: Evolutionary Reinforcement Learning for Sample-Efficient Multiagent Coordination

abstract: Many cooperative multiagent reinforcement learning environments provide agents with a sparse team-based reward, as well as a dense agent-specific reward that incentivizes learning basic skills. Training policies solely on the team-based reward is often difficult due to its sparsity. Furthermore, relying solely on the agent-specific reward is sub-optimal because it usually does not capture the team coordination objective. A common approach is to use reward shaping to construct a proxy reward by combining the individual rewards. However, this requires manual tuning for each environment. We introduce Multiagent Evolutionary Reinforcement Learning (MERL), a split-level training platform that handles the two objectives separately through two optimization processes. An evolutionary algorithm maximizes the sparse team-based objective through neuroevolution on a population of teams. Concurrently, a gradient-based optimizer trains policies to only maximize the dense agent-specific rewards. The gradient-based policies are periodically added to the evolutionary population as a way of information transfer between the two optimization processes. This enables the evolutionary algorithm to use skills learned via the agent-specific rewards toward optimizing the global objective. Results demonstrate that MERL significantly outperforms state-of-the-art methods, such as MADDPG, on a number of difficult coordination benchmarks.


title: DeepView: View Synthesis with Learned Gradient Descent

abstract: We present a novel approach to view synthesis using multiplane images (MPIs). Building on recent advances in learned gradient descent, our algorithm generates an MPI from a set of sparse camera viewpoints. The resulting method incorporates occlusion reasoning, improving performance on challenging scene features such as object boundaries, lighting reflections, thin structures, and scenes with high depth complexity. We show that our method achieves high-quality, state-of-the-art results on two datasets: the Kalantari light field dataset, and a new camera array dataset, Spaces, which we make publicly available.


title: Margin Matters: Towards More Discriminative Deep Neural Network Embeddings for Speaker Recognition

abstract: Recently, speaker embeddings extracted from a speaker discriminative deep neural network (DNN) yield better performance than the conventional methods such as i-vector. In most cases, the DNN speaker classifier is trained using cross entropy loss with softmax. However, this kind of loss function does not explicitly encourage inter-class separability and intra-class compactness. As a result, the embeddings are not optimal for speaker recognition tasks. In this paper, to address this issue, three different margin based losses which not only separate classes but also demand a fixed margin between classes are introduced to deep speaker embedding learning. It could be demonstrated that the margin is the key to obtain more discriminative speaker embeddings. Experiments are conducted on two public text independent tasks: VoxCeleb1 and Speaker in The Wild (SITW). The proposed approach can achieve the state-of-the-art performance, with 25% ~ 30% equal error rate (EER) reduction on both tasks when compared to strong baselines using cross entropy loss with softmax, obtaining 2.238% EER on VoxCeleb1 test set and 2.761% EER on SITW core-core test set, respectively.


title: Deep Active Learning for Anchor User Prediction

abstract: Predicting pairs of anchor users plays an important role in the cross-network analysis. Due to the expensive costs of labeling anchor users for training prediction models, we consider in this paper the problem of minimizing the number of user pairs across multiple networks for labeling as to improve the accuracy of the prediction. To this end, we present a deep active learning model for anchor user prediction (DALAUP for short). However, active learning for anchor user sampling meets the challenges of non-i.i.d. user pair data caused by network structures and the correlation among anchor or non-anchor user pairs. To solve the challenges, DALAUP uses a couple of neural networks with shared-parameter to obtain the vector representations of user pairs, and ensembles three query strategies to select the most informative user pairs for labeling and model training. Experiments on real-world social network data demonstrate that DALAUP outperforms the state-of-the-art approaches.


title: Deep Xi as a Front-End for Robust Automatic Speech Recognition

abstract: Current front-ends for robust automatic speech recognition(ASR) include masking- and mapping-based deep learning approaches to speech enhancement. A recently proposed deep learning approach toa prioriSNR estimation, called DeepXi, was able to produce enhanced speech at a higher quality and intelligibility than current masking- and mapping-based approaches. Motivated by this, we investigate Deep Xi as a front-end for robust ASR. Deep Xi is evaluated using real-world non-stationary and coloured noise sources at multiple SNR levels. Our experimental investigation shows that DeepXi as a front-end is able to produce a lower word error rate than recent masking- and mapping-based deep learning front-ends. The results presented in this work show that Deep Xi is a viable front-end, and is able to significantly increase the robustness of an ASR system. Availability: Deep Xi is available at:https://github.com/anicolson/DeepXi


title: Eigenstructure-preserving scheme for a hyperbolic system

abstract: A hyperbolic system must have a set of linearly independent eigenvectors and corresponding real eigenvalues. In numerical simulations, however, the eigenvalues can be complex because truncation errors pollute a characteristic polynomial of the hyperbolic system. Here we propose an eigenstructure-preserving scheme which always generates the real eigenvalues, even in discrete level. Although the eigenstructure is discussed in a non-conservative formulation, the proposed scheme is locally conservative owing to the skew-symmetric operators.


title: Observations of Type Ia Supernova 2014J for Nearly 900 Days and Constraints on Its Progenitor System

abstract: We present extensive ground-based and $Hubble~Space~Telescope$ ($HST$) photometry of the highly reddened, very nearby type Ia supernova (SN Ia) 2014J in M82, covering the phases from 9 days before to about 900 days after the $B$-band maximum. SN 2014J is similar to other normal SNe Ia near the maximum light, but it shows flux excess in the $B$ band in the early nebular phase. This excess flux emission can be due to light scattering by some structures of circumstellar materials located at a few 10$^{17}$ cm, consistent with a single degenerate progenitor system or a double degenerate progenitor system with mass outflows in the final evolution or magnetically driven winds around the binary system. At t$\sim$+300 to $\sim$+500 days past the $B$-band maximum, the light curve of SN 2014J shows a faster decline relative to the $^{56}$Ni decay. Such a feature can be attributed to the significant weakening of the emission features around [Fe III] $\lambda$4700 and [Fe II] $\lambda$5200 rather than the positron escape as previously suggested. Analysis of the $HST$ images taken at t$>$600 days confirms that the luminosity of SN 2014J maintains a flat evolution at the very late phase. Fitting the late-time pseudo-bolometric light curve with radioactive decay of $^{56}$Ni, $^{57}$Ni and $^{55}$Fe isotopes, we obtain the mass ratio $^{57}$Ni/$^{56}$Ni as $0.035 \pm 0.011$, which is consistent with the corresponding value predicted from the 2D and 3D delayed-detonation models. Combined with early-time analysis, we propose that delayed-detonation through single degenerate scenario is most likely favored for SN 2014J.


title: Whole-Body Control with (Self) Collision Avoidance using Vector Field Inequalities

abstract: This work uses vector field inequalities (VFI) to prevent robot self-collisions and collisions with the workspace. Differently from previous approaches, the method is suitable for both velocity and torque-actuated robots. We propose a new distance function and its corresponding Jacobian in order to generate a VFI to limit the angle between two Pl\"ucker lines. This new VFI is used to prevent both undesired end-effector orientations and violation of joints limits. The proposed method is evaluated in a realistic simulation and on a real humanoid robot, showing that all constraints are respected while the robot performs a manipulation task.


title: Dimension Estimates for Non-conformal Repellers and Continuity of Sub-additive Topological Pressure

abstract: Given a non-conformal repeller $\Lambda$ of a $C^{1+\gamma}$ map, we study the Hausdorff dimension of the repeller and continuity of the sub-additive topological pressure for the sub-additive singular valued potentials. Such a potential always possesses an equilibrium state. We then use a substantially modified version of Katok's approximating argument, to construct a compact invariant set on which the corresponding dynamical quantities (such as Lyapunov exponents and metric entropy) are close to that of the equilibrium measure. This allows us to establish continuity of the sub-additive topological pressure and obtain a sharp lower bound of the Hausdorff dimension of the repeller. The latter is given by the zero of the super-additive topological pressure


title: Future Accelerator-Based Neutrino Beams

abstract: High energy and high beam power accelerators are extensively used for the neutrino physics research. At present, the leading operational facilities are the Fermilab Main Injector complex that delivers over 0.75 MW of 120 GeV protons on the neutrino target, and the J-PARC facility in Japan which recently approached 0.5 MW of the 30 GeV proton beam power. Here we present the status and planned upgrades of the Fermilab and J-PARC accelerators and proposals for the next generation accelerator-based facilities, their challenges and required and ongoing accelerator R&D programs aimed to address corresponding cost and performance risks.


title: Correlation effects on the magnetization process of the Kitaev model

abstract: By using the variational Monte Carlo method, we study the magnetization process of the Kitaev honeycomb model in a magnetic field. Our trial wavefunction is a generalized Bardeen-Cooper-Schrieffer wave function with the Jastrow correlation factor, which exactly describes the ground state of the Kitaev model at zero magnetic field using the Jordan-Wigner (JW) transformation. We find that two phase transitions occur for the antiferromagnetic Kitaev coupling, while only one phase transition occurs for the ferromagnetic Kitaev coupling. For the antiferromagnetic Kitaev coupling, we also find that the topology of the momentum distribution of the JW fermions changes at the transition point from the Kitaev spin liquid to an intermediate state. Our numerical results indicate that the intermediate state between the Kitaev spin liquid and the fully polarized phases stably exists in the bulk system on two dimensions for the antiferromagnetic Kitaev coupling against many-body correlations.


title: A discrete-time single-server Poisson queueing game: Equilibria simulated by an agent-based model

abstract: This paper considers a discrete-time single-server queue with a single acceptance period for a Poissonian population of homogeneous customers. Customers are served on a first-come first-served (FCFS) basis, and their service times are independent and identically distributed with a general distribution. We assume that each customer chooses her/his arrival-time slot with the goal of minimizing her/his expected waiting time in competition with other customers. For this queueing game, we derive a symmetric (mixed-strategy) Nash equilibrium; that is, an equilibrium arrival-time distribution of homogeneous customers, where their expected waiting times are identical. We also propose an agent-based model, which simulates the dynamics of customers who try to minimize their waiting times for service. Through numerical experiments, we confirm that this agent-based model achieves, in steady state, an arrival-time distribution similar to the equilibrium arrival-time distribution analytically obtained.


title: SAVIOR: Towards Bug-Driven Hybrid Testing

abstract: Hybrid testing combines fuzz testing and concolic execution. It leverages fuzz testing to test easy-to-reach code regions and uses concolic execution to explore code blocks guarded by complex branch conditions. However, its code coverage-centric design is inefficient in vulnerability detection. First, it blindly selects seeds for concolic execution and aims to explore new code continuously. However, as statistics show, a large portion of the explored code is often bug-free. Therefore, giving equal attention to every part of the code during hybrid testing is a non-optimal strategy. It slows down the detection of real vulnerabilities by over 43%. Second, classic hybrid testing quickly moves on after reaching a chunk of code, rather than examining the hidden defects inside. It may frequently miss subtle vulnerabilities despite that it has already explored the vulnerable code paths. We propose SAVIOR, a new hybrid testing framework pioneering a bug-driven principle. Unlike the existing hybrid testing tools, SAVIOR prioritizes the concolic execution of the seeds that are likely to uncover more vulnerabilities. Moreover, SAVIOR verifies all vulnerable program locations along the executing program path. By modeling faulty situations using SMT constraints, SAVIOR reasons the feasibility of vulnerabilities and generates concrete test cases as proofs. Our evaluation shows that the bug-driven approach outperforms mainstream automated testing techniques, including state-of-the-art hybrid testing systems driven by code coverage. On average, SAVIOR detects vulnerabilities 43.4% faster than DRILLER and 44.3% faster than QSYM, leading to the discovery of 88 and 76 more uniquebugs,respectively.Accordingtotheevaluationon11 well fuzzed benchmark programs, within the first 24 hours, SAVIOR triggers 481 UBSAN violations, among which 243 are real bugs.


title: Losing Confidence in Quality: Unspoken Evolution of Computer Vision Services

abstract: Recent advances in artificial intelligence (AI) and machine learning (ML), such as computer vision, are now available as intelligent services and their accessibility and simplicity is compelling. Multiple vendors now offer this technology as cloud services and developers want to leverage these advances to provide value to end-users. However, there is no firm investigation into the maintenance and evolution risks arising from use of these intelligent services; in particular, their behavioural consistency and transparency of their functionality. We evaluated the responses of three different intelligent services (specifically computer vision) over 11 months using 3 different data sets, verifying responses against the respective documentation and assessing evolution risk. We found that there are: (1) inconsistencies in how these services behave; (2) evolution risk in the responses; and (3) a lack of clear communication that documents these risks and inconsistencies. We propose a set of recommendations to both developers and intelligent service providers to inform risk and assist maintainability.


title: Consistent Lorentz violation features from near-TeV IceCube neutrinos

abstract: A recent proposal to associate 60~TeV to 2~PeV IceCube neutrino events with gamma-ray bursts~(GRBs) indicates the Lorentz violation of cosmic neutrinos and leads further to the $CPT$ symmetry violation between neutrinos and antineutrinos. Here we find that another 12 northern hemisphere track events possibly correlated with GRBs from three-year IceCube data satisfy the same regularity at a lower energy scale around 1~TeV. The combined fitting indicates a Lorentz violation scale ${E}_{\rm LV}=(6.4\pm 1.5)\times10^{17}~{ \rm GeV}$ and an intrinsic time difference ${\Delta {t}_{\rm in}=(-2.8\pm 0.7)\times10^2~{\rm s}}$, from which we find an earlier emission of neutrinos than photons at the GRB source. We also suggest analyzing neutrino events detected a few minutes before the GRB trigger time to test the $CPT$ violation of ultrahigh-energy neutrinos.


title: Boosting CNN beyond Label in Inverse Problems

abstract: Convolutional neural networks (CNN) have been extensively used for inverse problems. However, their prediction error for unseen test data is difficult to estimate a priori since the neural networks are trained using only selected data and their architecture are largely considered a blackbox. This poses a fundamental challenge to neural networks for unsupervised learning or improvement beyond the label. In this paper, we show that the recent unsupervised learning methods such as Noise2Noise, Stein's unbiased risk estimator (SURE)-based denoiser, and Noise2Void are closely related to each other in their formulation of an unbiased estimator of the prediction error, but each of them are associated with its own limitations. Based on these observations, we provide a novel boosting estimator for the prediction error. In particular, by employing combinatorial convolutional frame representation of encoder-decoder CNN and synergistically combining it with the batch normalization, we provide a close form formulation for the unbiased estimator of the prediction error that can be minimized for neural network training beyond the label. Experimental results show that the resulting algorithm, what we call Noise2Boosting, provides consistent improvement in various inverse problems under both supervised and unsupervised learning setting.


title: New Suns in the Cosmos V: Stellar rotation and multifractality in active \textit{Kepler} stars

abstract: In the present study, high-precision time series photometry for the active \emph{Kepler} stars is described in the language of multifractals. We explore the potential of using the rescaled range analysis ($R/S$) and multifractal detrended moving average analysis (MFDMA) methods to characterize the multiscale structure of the observed time series from a sample of $\sim$40 000 active stars. Among these stars, 6486 have surface differential rotation measurement, whereas 1846 have no signature of differential rotation. As a result, the Hurst exponent ($H$) derived from both methods shows a strong correlation with the period derived from rotational modulation. In addition, the variability range $R_{var}$ reveals how this correlation follows a high activity ``line''. We also verify that the $H$-index is an able parameter for distinguishing the different signs of stellar rotation that can exist between the stars with and without differential rotation. In summary, the results indicate that the Hurst exponent is a promising index for estimating photometric magnetic activity.


title: Bo\"otes IV: A New Milky Way Satellite Discovered in the Subaru Hyper Suprime-Cam Survey and Implications for the Missing Satellite Problem

abstract: We report on the discovery of a new Milky Way (MW) satellite in Bo\"otes based on data from the on-going Hyper Suprime-Cam (HSC) Subaru Strategic Program (SSP). This satellite, named Bo\"otes IV, is the third ultra-faint dwarf that we have discovered in the HSC-SSP. We have identified a statistically significant (32.3$\sigma$) overdensity of stars having characteristics of a metal-poor, old stellar population. The distance to this stellar system is $D_{\odot}=209^{+20}_{-18}$ kpc with a $V$-band absolute magnitude of $M_V=-4.53^{+0.23}_{-0.21}$ mag. Bo\"otes IV has a half-light radius of $r_h=462^{+98}_{-84}$ pc and an ellipticity of $0.64^{+0.05}_{-0.05}$, which clearly suggests that this is a dwarf satellite galaxy. We also found another overdensity that appears to be a faint globular cluster with $M_V=-0.20^{+0.59}_{-0.83}$ mag and $r_h=5.9^{+1.5}_{-1.3}$ pc located at $D_{\odot}=46^{+4}_{-4}$ kpc. Adopting the recent prediction for the total population of satellites in a MW-sized halo by Newton et al. (2018), which combined the characteristics of the observed satellites by SDSS and DES with the subhalos obtained in $\Lambda$CDM models, we estimate that there should be about two MW satellites at $M_V\le0$ in the $\sim676$ deg$^2$ covered by HSC-SSP, whereas that area includes six satellites. Thus, the observed number of satellites is larger than the theoretical prediction. On the face of it, we have a problem of too many satellites, instead of the well-known missing satellites problem whereby the $\Lambda$CDM theory overpredicts the number of satellites in a MW-sized halo. This may imply that the models need more refinements for the assignment of subhalos to satellites such as considering those found by the current deeper survey. [abridged]


title: The Quantitative Behavior of Asymptotic Syzygies for Hirzebruch Surfaces

abstract: The goal of this note is to quantitatively study the behavior of asymptotic syzygies for certain toric surfaces, including Hirzebruch surfaces. In particular, we show that the asymptotic linear syzygies of Hirzebruch surfaces embedded by $\mathcal{O}(d,2)$ conform to Ein, Erman, and Lazarsfeld's normality heuristic. We also show that the higher degree asymptotic syzygies are not asymptotically normally distributed.


title: A Dual-level Model Predictive Control Scheme for Multi-timescale Dynamical Systems--Extended Version

abstract: So far, many control algorithms have been developed for singularly perturbed systems. However, in many industrial processes, enforcing closed-loop fast-slow dynamics for peculiarly non-separable ones is a prior request and a crucial issue to be resolved. Aiming at the above problem, this paper presents two dual-level model predictive control (MPC) algorithms for two-timescale dynamical systems with unknown bounded disturbance and input constraint. The proposed algorithms, each one composed of two regulators working in slow and fast time scales, are designed to generate closed-loop separable dynamics at the high and low levels. As a key feature, the proposed algorithms are not only suitable for singularly perturbed systems, but also capable of imposing separable closed-loop performance for dynamics that are non-separable and strongly coupled. The recursive feasibility and convergence properties are proven under suitable assumptions. The simulation results on controlling a Boiler Turbine (BT) system, including the comparisons with other classic controllers are reported, which show the effectiveness of the proposed algorithms.


title: New \textsl{s}-process Mechanism in Rapidly-Rotating Massive Pop II Stars

abstract: We report a new mechanism for the \textsl{s} in rotating massive metal-poor stars. Our models show that above a critical rotation speed, such stars evolve in a quasi-chemically-homogeneous fashion, which gives rise to a prolific \textsl{s}-process. Rotation-induced mixing results in primary production of $^{13}$C, which subsequently makes neutrons via $^{13}\mathrm{C}(\alpha,\mathrm{n})^{16}\mathrm{O}$ during core He burning. Neutron capture can last up to $\sim 10^{13}\,\mathrm{s}$ ($\sim 3\times 10^{5}$~yr) with the peak central neutron density ranging from $\sim10^7$ to $10^{8}\,\mathrm{cm}^{-3}$. Depending on the rotation speed and the mass loss rate, a strong \textsl{s} can occur with production of elements up to Bi for progenitors with initial metallicities of $[Z]\lesssim -1.5$. This result suggests that rapidly-rotating massive metal-poor stars are likely the first site for the main \textsl{s}-process. We find that these stars can potentially explain the early onset of the \textsl{s}-process and some of the carbon-enhanced metal-poor (CEMP-\textsl{s} and CEMP-\textsl{r/s}) stars with strong enrichment attributed to the \textsl{s} or a mixture of the \textsl{r}-process and the \textsl{s}-process.


title: A primal-dual finite element method for first-order transport problems

abstract: This article devises a new numerical method for first-order transport problems by using the primal-dual weak Galerkin (PD-WG) finite element method recently developed in scientific computing. The PD-WG method is based on a variational formulation of the modeling equation for which the differential operator is applied to the test function so that low regularity for the exact solution of the original equation is sufficient for computation. The PD-WG finite element method indeed yields a symmetric system involving both the original equation for the primal variable and its dual for the dual variable (also known as Lagrangian multiplier). For the linear transport problem, it is shown that the PD-WG method offers numerical solutions that conserve mass locally on each element. Optimal order error estimates in various norms are derived for the numerical solutions arising from the PD-WG method with weak regularity assumptions on the modelling equations. A variety of numerical results are presented to demonstrate the accuracy and stability of the new method.


title: Measuring Bias in Contextualized Word Representations

abstract: Contextual word embeddings such as BERT have achieved state of the art performance in numerous NLP tasks. Since they are optimized to capture the statistical properties of training data, they tend to pick up on and amplify social stereotypes present in the data as well. In this study, we (1)~propose a template-based method to quantify bias in BERT; (2)~show that this method obtains more consistent results in capturing social biases than the traditional cosine based method; and (3)~conduct a case study, evaluating gender bias in a downstream task of Gender Pronoun Resolution. Although our case study focuses on gender bias, the proposed technique is generalizable to unveiling other biases, including in multiclass settings, such as racial and religious biases.


title: Real-space observation of skyrmion clusters with mutually orthogonal skyrmion tubes

abstract: We report the discovery and direct visualization of skyrmion clusters with mutually-orthogonal orientations of constituent isolated skyrmions in chiral liquid crystals and ferromagnets. We show that the nascent conical state underlies attracting inter-skyrmion potential, whereas an encompassing homogeneous state leads to the repulsive skyrmion-skyrmion interaction. The crossover between different regimes of skyrmion interaction could be identified upon changing layer thickness and/or the surface anchoring. We develop a phenomenological theory describing two types of skyrmions and the underlying mechanisms of their interaction. We show that isolated horizontal skyrmions with the same polarity may approach a vertical isolated skyrmion from both sides and thus constitute two energetically-different configurations which are also observed experimentally. In an extreme regime of mutual attraction, the skyrmions wind around each other forming compact superstructures with undulations. We also indicate that our numerical simulations on skyrmion clusters are valid in a parameter range corresponding to the A-phase region of cubic helimagnets.


title: Reputation Systems -- Fair allocation of points to the editors in the collaborative community

abstract: In this paper we are trying to determine a scheme for the fair allocation of points to the contributors of the collaborative community. The major problem of fair allocation of points among the contributors is that we have to analyze the improvement in the versions of an article. Lets say there is a contribution of major change in content which is relevant vs the contribution of adding a single comma. Every contributor cannot be given the same points in such a case. There are many ways which can be used like number of changes in a new version. That might seem relevant but it becomes irrelevant in terms of correct content contribution and other significant changes. There is no AI system too which can detect such a change and award the points accordingly. So this problem of allocation of points to the contributors is presented by an algorithm with a theoretical proof. It relies on the interactive interaction of the users in the system which is trivial in case of big system design economies.


title: Prediction of possible exotic states in the $\eta \bar{K}K^*$ system

abstract: We investigate the $\eta \bar{K}K^*$ three body system in order to look for possible $I^G(J^{PC})=0^+(1^{-+})$ exotic states in the framework of the fixed center approximation to the Faddeev equation. We assume the scattering of $\eta$ on a clusterized system $\bar{K}K^*$, which is known to generate the $f_1(1285)$, or a $\bar{K}$ on a clusterized system $\eta K^*$, which is shown to generate the $K_1(1270)$. In the case of the $\eta$-$(\bar{K}K^*)_{f_1(1285)}$ scattering, we find evidence of a bound state $I^G(J^{PC})=0^+(1^{-+})$ below the $\eta{f_1(1285)}$ threshold with mass around 1700 MeV and width about 180 MeV. Considering the $\bar{K}$-$(\eta K^*)_{K_1(1270)}$ scattering, we obtain a bound state $I(J^{P})=0(1^{-})$ just below the $\bar{K}{K_1(1270)}$ threshold with a mass around 1680 MeV and a width about 160 MeV.


title: Learning Personalized Attribute Preference via Multi-task AUC Optimization

abstract: Traditionally, most of the existing attribute learning methods are trained based on the consensus of annotations aggregated from a limited number of annotators. However, the consensus might fail in settings, especially when a wide spectrum of annotators with different interests and comprehension about the attribute words are involved. In this paper, we develop a novel multi-task method to understand and predict personalized attribute annotations. Regarding the attribute preference learning for each annotator as a specific task, we first propose a multi-level task parameter decomposition to capture the evolution from a highly popular opinion of the mass to highly personalized choices that are special for each person. Meanwhile, for personalized learning methods, ranking prediction is much more important than accurate classification. This motivates us to employ an Area Under ROC Curve (AUC) based loss function to improve our model. On top of the AUC-based loss, we propose an efficient method to evaluate the loss and gradients. Theoretically, we propose a novel closed-form solution for one of our non-convex subproblem, which leads to provable convergence behaviors. Furthermore, we also provide a generalization bound to guarantee a reasonable performance. Finally, empirical analysis consistently speaks to the efficacy of our proposed method.


title: Arbitrarily high-order energy-preserving schemes for the Camassa-Holm equation

abstract: In this paper, we develop a novel class of arbitrarily high-order energy-preserving schemes for the Camassa-Holm equation. With the aid of the invariant energy quadratization approach, the Camassa-Holm equation is first reformulated into an equivalent system, which inherits a quadratic energy. {The new system is then discretized} by the standard Fourier pseudo-spectral method, which can exactly preserve the semi-discrete energy conservation law. Subsequently, { a symplectic Runge-Kutta method such as the Gauss collocation method is applied} for the resulting semi-discrete system to arrive at an arbitrarily high-order fully discrete scheme. {We prove that the obtained schemes can conserve the discrete energy conservation law}. Numerical results are addressed to confirm accuracy and efficiency of the proposed schemes.


title: Language as an Abstraction for Hierarchical Deep Reinforcement Learning

abstract: Solving complex, temporally-extended tasks is a long-standing problem in reinforcement learning (RL). We hypothesize that one critical element of solving such problems is the notion of compositionality. With the ability to learn concepts and sub-skills that can be composed to solve longer tasks, i.e. hierarchical RL, we can acquire temporally-extended behaviors. However, acquiring effective yet general abstractions for hierarchical RL is remarkably challenging. In this paper, we propose to use language as the abstraction, as it provides unique compositional structure, enabling fast learning and combinatorial generalization, while retaining tremendous flexibility, making it suitable for a variety of problems. Our approach learns an instruction-following low-level policy and a high-level policy that can reuse abstractions across tasks, in essence, permitting agents to reason using structured language. To study compositional task learning, we introduce an open-source object interaction environment built using the MuJoCo physics engine and the CLEVR engine. We find that, using our approach, agents can learn to solve to diverse, temporally-extended tasks such as object sorting and multi-object rearrangement, including from raw pixel observations. Our analysis reveals that the compositional nature of language is critical for learning diverse sub-skills and systematically generalizing to new sub-skills in comparison to non-compositional abstractions that use the same supervision.


title: Nonabelian M5-brane on $S^6_q$

abstract: We compute the conformal anomaly of a nonabelian M5 brane on $S^1_q\times H^5$ in the large $N$ limit by using the gravity dual of a black hole. We also obtain a general formula for this conformal anomaly for any gauge group by combining various results already present in the literature. From the conformal anomaly we extract the Casimir energy on $\mathbb{R} \times S^5$. We find agreement with the proposal in arXiv:1507.08553.


title: $B$ anomalies in the nonminimal universal extra dimension model

abstract: We investigate the $B$ anomalies in the framework of the nonminimal universal extra dimension models. Newly measured polarization parameters in $B\to D^{(*)}\tau\nu$, $P_\tau(D^{(*)})$ and $F_L(D^*)$ as well as the ratios $R(D^{(*)})$ are considered altogether. The Kaluza-Klein modes of the $W$-boson and charged scalar contributes as the new physics effects. We find that the model parameters fit the global data very well with the minimum $\chi^2/{\rm d.o.f.}$ near unity, rendering $B_c\to\tau\nu$ branching ratios to be a few percents. The best-fit values of $R(D)$ and $R(D^*)$ are still far from ($\gtrsim 2\sigma$) the standard model predictions.


title: Energy Efficiency Maximization for Full-Duplex UAV Secrecy Communication

abstract: This letter proposes a new full-duplex (FD) secrecy communication scheme for the unmanned aerial vehicle (UAV) and investigates its optimal design to achieve the maximum energy efficiency (EE) of the UAV. Specifically, the UAV receives the confidential information from a ground source and meanwhile sends jamming signals to interfere with a potential ground eavesdropper. As the UAV has limited on-board energy in practice, we aim to maximize the EE for its secrecy communication, by jointly optimizing the UAV trajectory and the source/UAV transmit/jamming powers over a finite flight period with given initial and final locations. Although the problem is difficult to solve, we propose an efficient iterative algorithm to obtain its suboptimal solution. Simulation results show that the proposed joint design can significantly improve the EE of UAV secrecy communication, as compared to various benchmark schemes.


title: Cardiac Segmentation from LGE MRI Using Deep Neural Network Incorporating Shape and Spatial Priors

abstract: Cardiac segmentation from late gadolinium enhancement MRI is an important task in clinics to identify and evaluate the infarction of myocardium. The automatic segmentation is however still challenging, due to the heterogeneous intensity distributions and indistinct boundaries in the images. In this paper, we propose a new method, based on deep neural networks (DNN), for fully automatic segmentation. The proposed network, referred to as SRSCN, comprises a shape reconstruction neural network (SRNN) and a spatial constraint network (SCN). SRNN aims to maintain a realistic shape of the resulting segmentation. It can be pre-trained by a set of label images, and then be embedded into a unified loss function as a regularization term. Hence, no manually designed feature is needed. Furthermore, SCN incorporates the spatial information of the 2D slices. It is formulated and trained with the segmentation network via the multi-task learning strategy. We evaluated the proposed method using 45 patients and compared with two state-of-the-art regularization schemes, i.e., the anatomically constraint neural network and the adversarial neural network. The results show that the proposed SRSCN outperformed the conventional schemes, and obtained a Dice score of 0.758(std=0.227) for myocardial segmentation, which compares with 0.757(std=0.083) from the inter-observer variations.


title: Zero-Shot Entity Linking by Reading Entity Descriptions

abstract: We present the zero-shot entity linking task, where mentions must be linked to unseen entities without in-domain labeled data. The goal is to enable robust transfer to highly specialized domains, and so no metadata or alias tables are assumed. In this setting, entities are only identified by text descriptions, and models must rely strictly on language understanding to resolve the new entities. First, we show that strong reading comprehension models pre-trained on large unlabeled data can be used to generalize to unseen entities. Second, we propose a simple and effective adaptive pre-training strategy, which we term domain-adaptive pre-training (DAP), to address the domain shift problem associated with linking unseen entities in a new domain. We present experiments on a new dataset that we construct for this task and show that DAP improves over strong pre-training baselines, including BERT. The data and code are available at https://github.com/lajanugen/zeshel.


title: L1-ROC and R2-ROC: L1- and R2-based Reduced Over-Collocation methods for parametrized nonlinear partial differential equations

abstract: The onerous task of repeatedly resolving certain parametrized partial differential equations (pPDEs) in, e.g. the optimization context, makes it imperative to design vastly more efficient numerical solvers without sacrificing any accuracy. The reduced basis method (RBM) presents itself as such an option. With a mathematically rigorous error estimator, RBM seeks a surrogate solution in a carefully-built subspace of the parameter-induced high fidelity solution manifold. It can improve efficiency by several orders of magnitudes leveraging an offline-online decomposition procedure. However, this decomposition, usually through the empirical interpolation method (EIM) when the PDE is nonlinear or its parameter dependence nonaffine, is either challenging to implement, or severely degrading to the online efficiency. In this paper, we augment and extend the EIM approach in the context of solving pPDEs in two different ways, resulting in the Reduced Over-Collocation methods (ROC). These are stable and capable of avoiding the efficiency degradation inherent to a direct application of EIM. There are two ingredients of these methods. First is a strategy to collocate at about twice as many locations as the number of bases for the surrogate space. The second is an efficient approach for the strategic selection of the parameter values to build the reduced solution space for which we study two choices, a recent empirical L1 approach and a new indicator based on the reduced residual. Together, these two ingredients render the schemes, L1-ROC and R2-ROC, online efficient and immune from the efficiency degradation of EIM for nonlinear and nonaffine problems offline and online. Numerical tests on three different families of nonlinear problems demonstrate the high efficiency and accuracy of these new algorithms and their superior stability performance.


title: A Koll\'{a}r-type vanishing theorem

abstract: Let $f:X\rightarrow Y$ be a smooth fibration between two complex manifolds $X$ and $Y$, and let $L$ be a pseudo-effective line bundle on $X$. We obtain a sufficient condition for $R^{q}f_{\ast}(K_{X/Y}\otimes L)$ to be reflexive and hence derive a Koll\'{a}r-type vanishing theorem.


title: Demonstration of Si based InAs/GaSb type-II superlattice p-i-n photodetector

abstract: In this paper, mid-wave infrared photodetection based on an InAs/GaSb type-II superlattice p-i-n photodetector grown directly on Si substrate is demonstrated and characterized. Excitation power dependence on integrated intensity from the photoluminescence measurements reveals a power coefficient of P~I0.74, indicating that defects related process is playing an important role in the predominant recombination channel for photogenerated carriers. At 70 K, the device exhibits a dark current density of 2.3 A/cm2 under -0.1 V bias. Arrhenius analysis of dark current shows activation energies much less than half of the active layer bandgap, which suggests that the device is mainly limited by surface leakage and defect-assisted tunneling, consistent with the photoluminescence analysis. The detector shows 50% cutoff wavelength at ~5.5 um at 70 K under bias of -0.1 V. The corresponding peak responsivity and specific detectivity are 1.2 A/W and 1.3*10e9 cm*Hz1/2/W, respectively. Based on these optoelectronics characterization results, reduction of defects by optimizing the III/V-Si interface, and suppression of surface leakage channels are argued to be the main factors for performance improvement in this Si-based T2SL detector towards low cost, large-format MWIR detection system on Si photonics platform.


title: Deep levels analysis in wavelength extended InGaAsBi photodetector

abstract: InP based dilute Bismide InGaAsBi material is emerging as a promising candidate for extending short wavelength infrared detection. One critical factor to limit the performance of these InGaAsBi photodiodes is dark current caused by defects within the material. In this work, low frequency noise spectroscopy (LFNS) and temperature varied photoluminescence was used to characterize the defect levels in the devices. Three deep levels located at Ec -0.33 eV, Ev +0.14 eV, and Ec -0.51 eV were identified from the LFNS spectra, which are consistent with emission peak energy found by photoluminescence spectra of InGaAsBi.


title: Radiative decays of $h_{c}$ to the light mesons $\eta^{(\prime)}$: A perturbative QCD calculation

abstract: We study the radiative decays $h_{c}\rightarrow\gamma\eta^{(\prime)}$ in the framework of perturbative QCD and evaluate analytically the one-loop integrals with the light quark masses kept. Interestingly, the branching ratios $\mathcal{B}(h_{c}\rightarrow\gamma\eta^{(\prime)})$ are insensitive to both the light quark masses and the shapes of $\eta^{(\prime)}$ distribution amplitudes. And it is noticed that the contribution of the gluonic content of $\eta^{(\prime)}$ is almost equal to that of the quark-antiquark content of $\eta^{(\prime)}$ in the radiative decays $h_{c} \rightarrow \gamma\eta^{(\prime)}$. By employing the ratio $R_{h_{c}}=\mathcal{B}(h_{c}\rightarrow\gamma\eta)/\mathcal{B}(h_{c}\rightarrow\gamma\eta^{\prime})$, we extract the mixing angle $\phi=33.8^{\circ}\pm2.5^{\circ}$, which is in clear disagreement with the Feldmann-Kroll-Stech result $\phi=39.0^{\circ}\pm1.6^{\circ}$ extracted from the ratio $R_{J/\psi}$ with nonperturbative matrix elements $\langle 0\mid G^{a}_{\mu\nu}\tilde{G}^{a,\mu\nu}\mid\eta^{(\prime)}\rangle$, but in consistent with $\phi=33.5^{\circ}\pm0.9^{\circ}$ extracted from the asymptotic limit of the $\gamma^{\ast}\gamma-\eta^{\prime}$ transition form factor and $\phi=33.9^{\circ}\pm0.6^{\circ}$ extracted from $R_{J/\psi}$ in perturbative QCD. We also briefly discuss possible reasons for the difference in the determinations of the mixing angle.


title: Bayesian fusion and multimodal DCM for EEG and fMRI

abstract: This paper asks whether integrating multimodal EEG and fMRI data offers a better characterisation of functional brain architectures than either modality alone. This evaluation rests upon a dynamic causal model that generates both EEG and fMRI data from the same neuronal dynamics. We introduce the use of Bayesian fusion to provide informative (empirical) neuronal priors - derived from dynamic causal modelling (DCM) of EEG data - for subsequent DCM of fMRI data. To illustrate this procedure, we generated synthetic EEG and fMRI timeseries for a mismatch negativity (or auditory oddball) paradigm, using biologically plausible model parameters (i.e., posterior expectations from a DCM of empirical, open access, EEG data). Using model inversion, we found that Bayesian fusion provided a substantial improvement in marginal likelihood or model evidence, indicating a more efficient estimation of model parameters, in relation to inverting fMRI data alone. We quantified the benefits of multimodal fusion with the information gain pertaining to neuronal and haemodynamic parameters - as measured by the Kullback-Leibler divergence between their prior and posterior densities. Remarkably, this analysis suggested that EEG data can improve estimates of haemodynamic parameters; thereby furnishing proof-of-principle that Bayesian fusion of EEG and fMRI is necessary to resolve conditional dependencies between neuronal and haemodynamic estimators. These results suggest that Bayesian fusion may offer a useful approach that exploits the complementary temporal (EEG) and spatial (fMRI) precision of different data modalities. We envisage the procedure could be applied to any multimodal dataset that can be explained by a DCM with a common neuronal parameterisation.


title: Escaping from saddle points on Riemannian manifolds

abstract: We consider minimizing a nonconvex, smooth function $f$ on a Riemannian manifold $\mathcal{M}$. We show that a perturbed version of Riemannian gradient descent algorithm converges to a second-order stationary point (and hence is able to escape saddle points on the manifold). The rate of convergence depends as $1/\epsilon^2$ on the accuracy $\epsilon$, which matches a rate known only for unconstrained smooth minimization. The convergence rate depends polylogarithmically on the manifold dimension $d$, hence is almost dimension-free. The rate also has a polynomial dependence on the parameters describing the curvature of the manifold and the smoothness of the function. While the unconstrained problem (Euclidean setting) is well-studied, our result is the first to prove such a rate for nonconvex, manifold-constrained problems.


title: Dark Matter Induced Brownian Motion

abstract: We discuss a novel approach for directional, light dark matter searches inspired by the high precision position measurements achieved in gravitational wave detectors. If dark matter interacts with ordinary matter, movable masses are subject to an effect similar to Brownian motion induced by the scattering with dark matter particles which exhibits certain characteristics and could be observed. We provide estimates for the sensitivity of a hypothetical experiment looking for that motion. Interestingly, if successful, our approach would allow to constrain the local distribution of dark matter momentum.


title: Neural Multi-Scale Self-Supervised Registration for Echocardiogram Dense Tracking

abstract: Echocardiography has become routinely used in the diagnosis of cardiomyopathy and abnormal cardiac blood flow. However, manually measuring myocardial motion and cardiac blood flow from echocardiogram is time-consuming and error-prone. Computer algorithms that can automatically track and quantify myocardial motion and cardiac blood flow are highly sought after, but have not been very successful due to noise and high variability of echocardiography. In this work, we propose a neural multi-scale self-supervised registration (NMSR) method for automated myocardial and cardiac blood flow dense tracking. NMSR incorporates two novel components: 1) utilizing a deep neural net to parameterize the velocity field between two image frames, and 2) optimizing the parameters of the neural net in a sequential multi-scale fashion to account for large variations within the velocity field. Experiments demonstrate that NMSR yields significantly better registration accuracy than state-of-the-art methods, such as advanced normalization tools (ANTs) and VoxelMorph, for both myocardial and cardiac blood flow dense tracking. Our approach promises to provide a fully automated method for fast and accurate analyses of echocardiograms.


title: Knowledge Network System (KNS) by Evolutionary Collective Intelligence (ECI): Model, Algorithm and Applications

abstract: Aiming at overcoming some inherent drawbacks and bottlenecks encountered by the conventional Knowledge, Recommendation, Search, and Social Systems, in this article we introduce the Knowledge Network System (KNS), a novel type of knowledge graph which is constructed by a new proposed algorithm, the Evolutionary Collective Intelligence (ECI) algorithm. The ECI, an agent-machine interactive algorithm, constructs the KNS by iteratively recommending interesting/matched samples/files to the agents, and meanwhile taking advantages of the collective intelligence of the agents. The ECI based KNS, to the best of our knowledge, is the first attempt in literature that integrates the functions of knowledge network construction, high-quality recommendation, new types of search and social in a same framework. Some real and potential applications of KNS and ECI are discussed, and a real system named VISVA is provided to demonstrate their efficacy. Some open problems for future works are also summarized in the end.


title: On the Tractability of Public Persuasion with No Externalities

abstract: Persuasion studies how a principal can influence agents' decisions via strategic information revelation --- often described as a signaling scheme --- in order to yield the most desirable equilibrium outcome. Recently, there has been a large body of algorithmic study of designing optimal public signaling schemes, a.k.a., public persuasion, which however is rifle with computational intractability results. In this paper, we design efficient and tight algorithms for public persuasion, and focus on a fundamental multi-agent persuasion model with no inter-agent externalities and binary actions introduced by Arieli and Babichenko. En route, we develop new algorithmic techniques which may be of independent interests. First, we prove that optimal public persuasion is fixed parameter tractable. Our main result here relies on an interesting connection to a basic question in combinatorial geometry: how many cells can $n$ hyperplanes divide $R^d$ into? We use this connection to show a new characterization of public persuasion, which then enables efficient algorithm design. Second, we relax agent incentives and show that optimal public persuasion admits a bi-criteria PTAS for monotone submodular objectives and this approximation is tight. To prove this result, we establish an intriguing "noise stability" property of submodular functions which strictly generalizes the key result of Cheraghchi et al., originally motivated by applications of learning submodular functions and differential privacy. Finally, motivated by automated persuasion implemented as software, we consider relaxing the equilibrium concept of the model to coarse correlated equilibrium. Here we use a sophisticated primal-dual analysis to establish the polynomial-time equivalence between optimal public persuasion and the combinatorial problem of directly maximizing the sender's objective minus any linear function.


title: Non-Volatile Superconductivity in an Insulating Copper Oxide Induced via Ionic Liquid Gating

abstract: Manipulating the superconducting states of high-T_c cuprate superconductors in an efficient and reliable way is of great importance for their applications in next-generation electronics. Traditional methods are mostly based on a trial-and-error method that is difficult to implement and time consuming. Here, employing ionic liquid gating, a selective control of volatile and non-volatile superconductivity is achieved in pristine insulating Pr_2CuO_{4\pm\delta} film, based on two distinct mechanisms: 1) with positive electric fields, the film can be reversibly switched between non-superconducting and superconducting states, attributed to the carrier doping effect. 2) The film becomes more resistive by applying negative bias voltage up to -4 V, but strikingly, a non-volatile superconductivity is achieved once the gate voltage is removed. Such a persistent superconducting state represents a novel phenomenon in copper oxides, resulting from the doping healing of oxygen vacancies in copper-oxygen planes as unraveled by high-resolution scanning transmission electron microscope and in-situ x-ray diffraction experiments. The effective manipulation and mastering of volatile/non-volatile superconductivity in the same parent cuprate opens the door to more functionalities for superconducting electronics, as well as supplies flexible samples for investigating the nature of quantum phase transitions in high-T_c superconductors.


title: A Novel Feature Representation for Single-Channel Heartbeat Classification based on Adaptive Fourier Decomposition

abstract: This paper proposes a novel approach for heartbeat classification from single-lead electrocardiogram (ECG) signals based on the novel adaptive Fourier decomposition (AFD). AFD is a recently developed signal processing tool that provides useful morphological features, referred to as AFD-derived instantaneous frequency (IF) features, that are different from those provided by traditional tools. A support vector machine (SVM) classifier is trained with the AFD-derived IF features, ECG landmark features, and RR interval features. To evaluate the performance of the trained classifier, the Association for the Advancement of Medical Instrumentation (AAMI) standard is applied to the publicly available benchmark databases, including MIT-BIH arrhythmia database and MIT-BIH supraventricular arrhythmia database, to classify heartbeats from single-lead ECG. The overall performance in terms of sensitivities and positive predictive values is comparable to the state-of-the-art automatic heartbeat classification algorithms based on two-leads ECG.


title: Plasmon effect on the Coulomb pseudopotential $\mu^*$ in the McMillan equation

abstract: We examine the Coulomb pseudopotential $\mu^*$ in the McMillan equation applying to the superconductivity of heavily doped semiconductors. Systematic calculation using the first-principles calculation suggests that $\mu^*$ should be considered as a variable quantity depending on carrier density $n$ in semiconductors, although it is usually considered as a constant about 0.1. To clarify $n-$dependence of $\mu^*$, we solve the McMillan equation inversely for $\mu^*$ by combining the result of the first-principles calculation and that of experiments. It indicates that $\mu^*$ decreases with $n$ and becomes negative under $n \sim 5 \times 10^{-21}[{\rm cm^{-3}}]$. This reduction is explained by the effect of plasmon which may play an important role in the superconductivity of low carrier systems such as heavily doped semiconductors.


title: Bounds for zeros of a polynomial using numerical radius of Hilbertian space operators

abstract: We obtain bounds for the numerical radius of $2 \times 2$ operator matrices which improve on the existing bounds. We also show that the inequalities obtained here generalize the existing ones. As an application of the results obtained here we estimate the bounds for the zeros of a monic polynomial and illustrate with numerical examples that the bounds are better than the existing ones.


title: Magnetohydrodynamic numerical simulation of the outflows driven by magnetic field and radiation force from the corona above a thin disk

abstract: A hot corona is suggested to be above the standard thin disk. The anisotropy of hard X-ray emission in radio-quiet active galactic nuclei implies that the corona is not static and probably moves outwards like winds. We perform two-dimensional magnetohydrodynamical simulations to study the outflowing corona driven by magnetic field and radiation force. In our simulations, as the initial state and the boundary condition at the disk surface, the corona temperature is set to $10^9$ K inside 10 Schwarzschild radius ($r_{\rm s}$) while the corona temperature is set to $10^7$ K a 10 $r_{\rm s}$. We employ a weak poloidal magnetic field as the initial magnetic field. A collimated outflow and a wide-angle ordered outflow are observed in our simulations. The collimated outflow is around the rotational axis and has a bulk velocity of $\sim$0.03--0.3 $c$ ( $c$ is speed of light) at 90 $r_{\rm s}$, while their mass outflow rate is very low. The collimated outflow is a weak jet. The wide-angle ordered outflow is distributed at the middle and high latitudes and moves outwards with a velocity of $10^2$--$10^4$ km s$^{-1}$. The outflow velocity depends on the disk luminosity. The gas around the disk surface is turbulent, especially outside of 10 $r_{\rm s}$. The other properties of outflows are discussed in detail.


title: Consecutive patterns in inversion sequences II: avoiding patterns of relations

abstract: Inversion sequences are integer sequences $e=e_{1}e_{2}\dots e_{n}$ such that $0\leq e_{i}<i$ for each $i$. The study of patterns in inversion sequences was initiated by Corteel--Martinez--Savage--Weselcouch and Mansour--Shattuck in the classical (non-consecutive) case, and later by Auli--Elizalde in the consecutive case, where the entries of a pattern are required to occur in adjacent positions. In this paper we continue this investigation by considering {\em consecutive patterns of relations}, in analogy to the work of Martinez--Savage in the classical case. Specifically, given two binary relations $R_{1},R_2\in\{\leq,\geq,<,>,=,\neq\}$, we study inversion sequences $e$ with no subindex $i$ such that $e_{i}R_{1}e_{i+1}R_{2}e_{i+2}$. By enumerating such inversion sequences according to their length, we obtain well-known quantities such as Catalan numbers, Fibonacci numbers and central polynomial numbers, relating inversion sequences to other combinatorial structures. We also classify consecutive patterns of relations into Wilf equivalence classes, according to the number of inversion sequences avoiding them, and into more restrictive classes that consider the positions of the occurrences of the patterns. As a byproduct of our techniques, we obtain a simple bijective proof of a result of Baxter--Shattuck and Kasraoui about Wilf-equivalence of vincular patterns, and we prove a conjecture of Martinez and Savage, as well as related enumeration formulas for inversion sequences satisfying certain unimodality conditions.


title: Globally simple Heffter arrays $H(n;k)$ when $k\equiv 0,3\mod 4$

abstract: Square Heffter arrays are $n\times n$ arrays such that each row and each column contains $k$ filled cells, each row and column sum is divisible by $2nk+1$ and either $x$ or $-x$ appears in the array for each integer $1\leq x\leq nk$. Archdeacon noted that a Heffter array, satisfying two additional conditions, yields a face $2$-colourable embedding of the complete graph $K_{2nk+1}$ on an orientable surface, where for each colour, the faces give a $k$-cycle system. Moreover, a cyclic permutation on the vertices acts as an automorphism of the embedding. These necessary conditions pertain to cyclic orderings of the entries in each row and each column of the Heffter array and are: (1) for each row and each column the sequential partial sums determined by the cyclic ordering must be distinct modulo $2nk+1$; (2) the composition of the cyclic orderings of the rows and columns is equivalent to a single cycle permutation on the entries in the array. We construct Heffter arrays that satisfy condition (1) whenever (a) $k\equiv 0\mod 4$; or (b) $n\equiv 1\mod 4$ and $k\equiv 3\mod 4$; or (c) $n\equiv 0\mod 4$, $k\equiv3\mod 4$ and $n\gg k$. As corollaries to the above we obtain pairs of orthogonal $k$-cycle decompositions of $K_{2nk+1}$.


title: A sparse annotation strategy based on attention-guided active learning for 3D medical image segmentation

abstract: 3D image segmentation is one of the most important and ubiquitous problems in medical image processing. It provides detailed quantitative analysis for accurate disease diagnosis, abnormal detection, and classification. Currently deep learning algorithms are widely used in medical image segmentation, most algorithms trained models with full annotated datasets. However, obtaining medical image datasets is very difficult and expensive, and full annotation of 3D medical image is a monotonous and time-consuming work. Partially labelling informative slices in 3D images will be a great relief of manual annotation. Sample selection strategies based on active learning have been proposed in the field of 2D image, but few strategies focus on 3D images. In this paper, we propose a sparse annotation strategy based on attention-guided active learning for 3D medical image segmentation. Attention mechanism is used to improve segmentation accuracy and estimate the segmentation accuracy of each slice. The comparative experiments with three different strategies using datasets from the developing human connectome project (dHCP) show that, our strategy only needs 15% to 20% annotated slices in brain extraction task and 30% to 35% annotated slices in tissue segmentation task to achieve comparative results as full annotation.


title: Characterization of subgroup perfect codes in Cayley graphs

abstract: A subset $C$ of the vertex set of a graph $\Gamma$ is called a perfect code in $\Gamma$ if every vertex of $\Gamma$ is at distance no more than $1$ to exactly one vertex of $C$. A subset $C$ of a group $G$ is called a perfect code of $G$ if $C$ is a perfect code in some Cayley graph of $G$. In this paper we give sufficient and necessary conditions for a subgroup $H$ of a finite group $G$ to be a perfect code of $G$. Based on this, we determine the finite groups that have no nontrivial subgroup as a perfect code, which answers a question by Ma, Walls, Wang and Zhou.


title: Noninertial and spin effects on the 2D Dirac oscillator in the magnetic cosmic string background

abstract: In this work, we analyze the influence of noninertial and spin effects on the dynamics of the 2D Dirac oscillator in the magnetic cosmic string background. To model this background, we consider a uniform magnetic field, the Aharonov-Bohm effect, and a parameter $\eta$ generated by a cosmic string. Posteriorly, we determine the bound-state solutions of the system: the Dirac spinor and the relativistic energy spectrum. We verified that this spinor is written in terms of the generalized Laguerre polynomials and this spectrum depends on the effective quantum number $N_r$, angular velocity $\Omega$ and parameter $s$ associated to the noninertial and spin effects, magnetic flux $\Phi$, cyclotron frequency $\omega_c$, zero-point energy $E_0$, and on the deficit angle $\eta$. In particular, we note that besides this spectrum to be a periodic function and asymmetric, its values infinitely increase when $\eta\to 0$ or $N_r=\omega_c=\Omega\to\infty$. We also note that the energies of the antiparticle with spin down are larger than of the particle with spin up or down. In the nonrelativistic limit, we get the Schr\"{o}dinger-Pauli oscillator with two types of couplings: the spin-orbit coupling and the spin-rotation coupling, and two Hamiltonians: one quantum harmonic oscillator-type and other Zeeman-type. Finally, we compare our results with other works, where we verified that our problem generalizes some particular cases of the literature when $\Omega$, $\omega_c$, $\Phi$, $s$ or $\eta$ are excluded from the system.


title: Neural Illumination: Lighting Prediction for Indoor Environments

abstract: This paper addresses the task of estimating the light arriving from all directions to a 3D point observed at a selected pixel in an RGB image. This task is challenging because it requires predicting a mapping from a partial scene observation by a camera to a complete illumination map for a selected position, which depends on the 3D location of the selection, the distribution of unobserved light sources, the occlusions caused by scene geometry, etc. Previous methods attempt to learn this complex mapping directly using a single black-box neural network, which often fails to estimate high-frequency lighting details for scenes with complicated 3D geometry. Instead, we propose "Neural Illumination" a new approach that decomposes illumination prediction into several simpler differentiable sub-tasks: 1) geometry estimation, 2) scene completion, and 3) LDR-to-HDR estimation. The advantage of this approach is that the sub-tasks are relatively easy to learn and can be trained with direct supervision, while the whole pipeline is fully differentiable and can be fine-tuned with end-to-end supervision. Experiments show that our approach performs significantly better quantitatively and qualitatively than prior work.


title: Learning to Plan Hierarchically from Curriculum

abstract: We present a framework for learning to plan hierarchically in domains with unknown dynamics. We enhance planning performance by exploiting problem structure in several ways: (i) We simplify the search over plans by leveraging knowledge of skill objectives, (ii) Shorter plans are generated by enforcing aggressively hierarchical planning, (iii) We learn transition dynamics with sparse local models for better generalisation. Our framework decomposes transition dynamics into skill effects and success conditions, which allows fast planning by reasoning on effects, while learning conditions from interactions with the world. We propose a simple method for learning new abstract skills, using successful trajectories stemming from completing the goals of a curriculum. Learned skills are then refined to leverage other abstract skills and enhance subsequent planning. We show that both conditions and abstract skills can be learned simultaneously while planning, even in stochastic domains. Our method is validated in experiments of increasing complexity, with up to 2^100 states, showing superior planning to classic non-hierarchical planners or reinforcement learning methods. Applicability to real-world problems is demonstrated in a simulation-to-real transfer experiment on a robotic manipulator.


title: RIDM: Reinforced Inverse Dynamics Modeling for Learning from a Single Observed Demonstration

abstract: Augmenting reinforcement learning with imitation learning is often hailed as a method by which to improve upon learning from scratch. However, most existing methods for integrating these two techniques are subject to several strong assumptions---chief among them that information about demonstrator actions is available. In this paper, we investigate the extent to which this assumption is necessary by introducing and evaluating reinforced inverse dynamics modeling (RIDM), a novel paradigm for combining imitation from observation (IfO) and reinforcement learning with no dependence on demonstrator action information. Moreover, RIDM requires only a single demonstration trajectory and is able to operate directly on raw (unaugmented) state features. We find experimentally that RIDM performs favorably compared to a baseline approach for several tasks in simulation as well as for tasks on a real UR5 robot arm. Experiment videos can be found at https://sites.google.com/view/ridm-reinforced-inverse-dynami.