title: Evolving Deep Neural Networks by Multi-objective Particle Swarm Optimization for Image Classification

abstract: In recent years, convolutional neural networks (CNNs) have become deeper in order to achieve better classification accuracy in image classification. However, it is difficult to deploy the state-of-the-art deep CNNs for industrial use due to the difficulty of manually fine-tuning the hyperparameters and the trade-off between classification accuracy and computational cost. This paper proposes a novel multi-objective optimization method for evolving state-of-the-art deep CNNs in real-life applications, which automatically evolves the non-dominant solutions at the Pareto front. Three major contributions are made: Firstly, a new encoding strategy is designed to encode one of the best state-of-the-art CNNs; With the classification accuracy and the number of floating point operations as the two objectives, a multi-objective particle swarm optimization method is developed to evolve the non-dominant solutions; Last but not least, a new infrastructure is designed to boost the experiments by concurrently running the experiments on multiple GPUs across multiple machines, and a Python library is developed and released to manage the infrastructure. The experimental results demonstrate that the non-dominant solutions found by the proposed algorithm form a clear Pareto front, and the proposed infrastructure is able to almost linearly reduce the running time.


title: New and Extended Data Processing of Mars Odyssey Neutron Spectrometer Data

abstract: The Los Alamos National Laboratory designed and built Mars Odyssey Neutron Spectrometer (MONS) has been in excellent health operating from February 2002 to the present. MONS measures the neutron leakage albedo from galactic cosmic ray bombardment of Mars. These signals can indicate the presence of near-surface water deposits on Mars, and can also be used to study properties of the seasonal polar CO$_2$ ice caps. This work outlines a new analysis of the MONS data that results in new and extended time-series maps of MONS thermal and epithermal neutron data. The new data are compared to previous publications on the MONS instrument. We then present preliminary results studying the inter-annual variability in the polar regions of Mars based on 8 Mars-Years of MONS data from the new dataset.


title: ProductNet: a Collection of High-Quality Datasets for Product Representation Learning

abstract: ProductNet is a collection of high-quality product datasets for better product understanding. Motivated by ImageNet, ProductNet aims at supporting product representation learning by curating product datasets of high quality with properly chosen taxonomy. In this paper, the two goals of building high-quality product datasets and learning product representation support each other in an iterative fashion: the product embedding is obtained via a multi-modal deep neural network (master model) designed to leverage product image and catalog information; and in return, the embedding is utilized via active learning (local model) to vastly accelerate the annotation process. For the labeled data, the proposed master model yields high categorization accuracy (94.7% top-1 accuracy for 1240 classes), which can be used as search indices, partition keys, and input features for machine learning models. The product embedding, as well as the fined-tuned master model for a specific business task, can also be used for various transfer learning tasks.


title: Leveraging native language information for improved accented speech recognition

abstract: Recognition of accented speech is a long-standing challenge for automatic speech recognition (ASR) systems, given the increasing worldwide population of bi-lingual speakers with English as their second language. If we consider foreign-accented speech as an interpolation of the native language (L1) and English (L2), using a model that can simultaneously address both languages would perform better at the acoustic level for accented speech. In this study, we explore how an end-to-end recurrent neural network (RNN) trained system with English and native languages (Spanish and Indian languages) could leverage data of native languages to improve performance for accented English speech. To this end, we examine pre-training with native languages, as well as multi-task learning (MTL) in which the main task is trained with native English and the secondary task is trained with Spanish or Indian Languages. We show that the proposed MTL model performs better than the pre-training approach and outperforms a baseline model trained simply with English data. We suggest a new setting for MTL in which the secondary task is trained with both English and the native language, using the same output set. This proposed scenario yields better performance with +11.95% and +17.55% character error rate gains over baseline for Hispanic and Indian accents, respectively.


title: Human Motion Prediction via Pattern Completion in Latent Representation Space

abstract: Inspired by ideas in cognitive science, we propose a novel and general approach to solve human motion understanding via pattern completion on a learned latent representation space. Our model outperforms current state-of-the-art methods in human motion prediction across a number of tasks, with no customization. To construct a latent representation for time-series of various lengths, we propose a new and generic autoencoder based on sequence-to-sequence learning. While traditional inference strategies find a correlation between an input and an output, we use pattern completion, which views the input as a partial pattern and to predict the best corresponding complete pattern. Our results demonstrate that this approach has advantages when combined with our autoencoder in solving human motion prediction, motion generation and action classification.


title: Periodicities for Taylor coefficients of half-integral weight modular forms

abstract: Congruences of Fourier coefficients of modular forms have long been an object of central study. By comparison, the arithmetic of other expansions of modular forms, in particular Taylor expansions around points in the upper-half plane, has been much less studied. Recently, Romik made a conjecture about the periodicity of coefficients around $\tau=i$ of the classical Jacobi theta function. Here, we prove this conjecture and generalize the phenomenon observed by Romik to a general class of modular forms of half-integral weight.


title: Optimizing Quantum Programs against Decoherence: Delaying Qubits into Quantum Superposition

abstract: Quantum computing technology has reached a second renaissance in the last decade. However, in the NISQ era pointed out by John Preskill in 2018, quantum noise and decoherence, which affect the accuracy and execution effect of quantum programs, cannot be ignored and corrected by the near future NISQ computers. In order to let users more easily write quantum programs, the compiler and runtime system should consider underlying quantum hardware features such as decoherence. To address the challenges posed by decoherence, in this paper, we propose and prototype QLifeReducer to minimize the qubit lifetime in the input OpenQASM program by delaying qubits into quantum superposition. QLifeReducer includes three core modules, i.e.,the parser, parallelism analyzer and transformer. It introduces the layered bundle format to express the quantum program, where a set of parallelizable quantum operations is packaged into a bundle. We evaluate quantum programs before and after transformed by QLifeReducer on both real IBM Q 5 Tenerife and the self-developed simulator. The experimental results show that QLifeReducer reduces the error rate of a quantum program when executed on IBMQ 5 Tenerife by 11%; and can reduce the longest qubit lifetime as well as average qubit lifetime by more than 20% on most quantum workloads.


title: Inertial particle velocity and distribution in vertical turbulent channel flow: a numerical and experimental comparison

abstract: This study is concerned with the statistics of vertical turbulent channel flow laden with inertial particles for two different volume concentrations ($\Phi_{V} = 3 \times 10^{-6}$ and $\Phi_{V} = 5 \times 10^{-5}$) at a Stokes number of $St^{+} = 58.6$ based on viscous units. Two independent direct numerical simulation models utilizing the point-particle approach are compared to recent experimental measurements, where all relevant nondimensional parameters are directly matched. While both numerical models are built on the same general approach, details of the implementations are different, particularly regarding how two-way coupling is represented. At low volume loading, both numerical models are in general agreement with the experimental measurements, with certain exceptions near the walls for the wall-normal particle velocity fluctuations. At high loading, these discrepancies are increased, and it is found that particle clustering is overpredicted in the simulations as compared to the experimental observations. Potential reasons for the discrepancies are discussed. As this study is among the first to perform one-to-one comparisons of particle-laden flow statistics between numerical models and experiments, it suggests that continued efforts are required to reconcile differences between the observed behavior and numerical predictions.


title: Differentiating Through a Cone Program

abstract: We consider the problem of efficiently computing the derivative of the solution map of a convex cone program, when it exists. We do this by implicitly differentiating the residual map for its homogeneous self-dual embedding, and solving the linear systems of equations required using an iterative method. This allows us to efficiently compute the derivative operator, and its adjoint, evaluated at a vector. These correspond to computing an approximate new solution, given a perturbation to the cone program coefficients (i.e., perturbation analysis), and to computing the gradient of a function of the solution with respect to the coefficients. Our method scales to large problems, with numbers of coefficients in the millions. We present an open-source Python implementation of our method that solves a cone program and returns the derivative and its adjoint as abstract linear maps; our implementation can be easily integrated into software systems for automatic differentiation.


title: NNVA: Neural Network Assisted Visual Analysis of Yeast Cell Polarization Simulation

abstract: Complex computational models are often designed to simulate real-world physical phenomena in many scientific disciplines. However, these simulation models tend to be computationally very expensive and involve a large number of simulation input parameters which need to be analyzed and properly calibrated before the models can be applied for real scientific studies. We propose a visual analysis system to facilitate interactive exploratory analysis of high-dimensional input parameter space for a complex yeast cell polarization simulation. The proposed system can assist the computational biologists, who designed the simulation model, to visually calibrate the input parameters by modifying the parameter values and immediately visualizing the predicted simulation outcome without having the need to run the original expensive simulation for every instance. Our proposed visual analysis system is driven by a trained neural network-based surrogate model as the backend analysis framework. Surrogate models are widely used in the field of simulation sciences to efficiently analyze computationally expensive simulation models. In this work, we demonstrate the advantage of using neural networks as surrogate models for visual analysis by incorporating some of the recent advances in the field of uncertainty quantification, interpretability and explainability of neural network-based models. We utilize the trained network to perform interactive parameter sensitivity analysis of the original simulation at multiple levels-of-detail as well as recommend optimal parameter configurations using the activation maximization framework of neural networks. We also facilitate detail analysis of the trained network to extract useful insights about the simulation model, learned by the network, during the training process.


title: Dense orderings in the space of left-orderings of a group

abstract: Every left-invariant ordering of a group is either discrete, meaning there is a least element greater than the identity, or dense. Corresponding to this dichotomy, the spaces of left, Conradian, and bi-orderings of a group are naturally partitioned into two subsets. This note investigates the structure of this partition, specifically the set of dense orderings of a group and its closure within the space of orderings. We show that for bi-orderable groups this closure will always contain the space of Conradian orderings---and often much more. In particular, the closure of the set of dense orderings of the free group is the entire space of left-orderings.


title: Direct Synthesis of Iterative Algorithms With Bounds on Achievable Worst-Case Convergence Rate

abstract: Iterative first-order methods such as gradient descent and its variants are widely used for solving optimization and machine learning problems. There has been recent interest in analytic or numerically efficient methods for computing worst-case performance bounds for such algorithms, for example over the class of strongly convex loss functions. A popular approach is to assume the algorithm has a fixed size (fixed dimension, or memory) and that its structure is parameterized by one or two hyperparameters, for example a learning rate and a momentum parameter. Then, a Lyapunov function is sought to certify robust stability and subsequent optimization can be performed to find optimal hyperparameter tunings. In the present work, we instead fix the constraints that characterize the loss function and apply techniques from robust control synthesis to directly search over algorithms. This approach yields stronger results than those previously available, since the bounds produced hold over algorithms with an arbitrary, but finite, amount of memory rather than just holding for algorithms with a prescribed structure.


title: Geographical Map Registration and Fusion of Lidar-Aerial Orthoimagery in GIS

abstract: Centimeter level globally accurate and consistent maps for autonomous vehicles navigation has long been achieved by on board real-time kinematic(RTK)-GPS in open areas. However when dealing with urban environments, GPS will experience multipath and blockage in urban canyon, under bridges, inside tunnels and in underground environments. In this paper we present strategies to efficiently register local maps in geographical coordinate systems through the tactical integration of GPS and information extracted from precisely geo-referenced high resolution aerial orthogonal imagery. Dense lidar point clouds obtained from moving vehicle are projected down to horizontal plane, accurately registered and overlaid on aerial orthoimagery. Sparse, robust and long-term pole-like landmarks are used as anchor points to link lidar and aerial image sensing, and constrain the spatial uncertainties of remaining lidar points that cannot be directly measured and identified. We achieved 15-75cm absolute average global accuracy using precisely geo-referenced aerial imagery as ground truth. This is valuable in enabling the fusion of ground vehicle on-board sensor features with features extracted from aerial images such as traffic and lane markings. It is also useful for cooperative sensing to have an unbiased and accurate global reference. Experimental results are presented demonstrating the accuracy and consistency of the maps when operating in large areas.


title: Automated Focal Loss for Image based Object Detection

abstract: Current state-of-the-art object detection algorithms still suffer the problem of imbalanced distribution of training data over object classes and background. Recent work introduced a new loss function called focal loss to mitigate this problem, but at the cost of an additional hyperparameter. Manually tuning this hyperparameter for each training task is highly time-consuming. With automated focal loss we introduce a new loss function which substitutes this hyperparameter by a parameter that is automatically adapted during the training progress and controls the amount of focusing on hard training examples. We show on the COCO benchmark that this leads to an up to 30% faster training convergence. We further introduced a focal regression loss which on the more challenging task of 3D vehicle detection outperforms other loss functions by up to 1.8 AOS and can be used as a value range independent metric for regression.


title: An Investigation of End-to-End Multichannel Speech Recognition for Reverberant and Mismatch Conditions

abstract: Sequence-to-sequence (S2S) modeling is becoming a popular paradigm for automatic speech recognition (ASR) because of its ability to jointly optimize all the conventional ASR components in an end-to-end (E2E) fashion. This report investigates the ability of E2E ASR from standard close-talk to far-field applications by encompassing entire multichannel speech enhancement and ASR components within the S2S model. There have been previous studies on jointly optimizing neural beamforming alongside E2E ASR for denoising. It is clear from both recent challenge outcomes and successful products that far-field systems would be incomplete without solving both denoising and dereverberation simultaneously. This report uses a recently developed architecture for far-field ASR by composing neural extensions of dereverberation and beamforming modules with the S2S ASR module as a single differentiable neural network and also clearly defining the role of each subnetwork. The original implementation of this architecture was successfully applied to the noisy speech recognition task (CHiME-4), while we applied this implementation to noisy reverberant tasks (DIRHA and REVERB). Our investigation shows that the method achieves better performance than conventional pipeline methods on the DIRHA English dataset and comparable performance on the REVERB dataset. It also has additional advantages of being neither iterative nor requiring parallel noisy and clean speech data.


title: Prediction of Stoner-Type Magnetism in Low-Dimensional Electrides

abstract: Electrides are special ionic solids with excess cavity-trapped electrons serving as anions. Despite the extensive studies on electrides, the interplay between electrides and magnetism is not well understood due to the lack of stable magnetic electrides, particularly the lack of inorganic magnetic electrides. Here, based on the mechanism of Stoner-type magnetic instability, we propose that in certain electrides the low-dimensionality can facilitate the formation of magnetic ground state because of the enhanced density of states near the Fermi level. To be specific, A5B3 (A = Ca, Sr, Ba; B = As, Sb, Bi) (1D), Sr11Mg2Si10 (0D), Ba7Al10 (0D) and Ba4Al5 (0D) have been identified as stable magnetic electrides with spin-polarization energies of tens to hundreds of meV per formula unit. Especially for Ba5As3, the spin-polarization energy can reach up to 220 meV. Furthermore, we demonstrate that the magnetic moment and spin density mainly derive from the interstitial anionic electrons near the Fermi level. Our work paves a way to the searching of stable magnetic electrides and further exploration of the magnetic properties and related applications in electrides.


title: Query-focused Sentence Compression in Linear Time

abstract: Search applications often display shortened sentences which must contain certain query terms and must fit within the space constraints of a user interface. This work introduces a new transition-based sentence compression technique developed for such settings. Our query-focused method constructs length and lexically constrained compressions in linear time, by growing a subgraph in the dependency parse of a sentence. This theoretically efficient approach achieves an 11X empirical speedup over baseline ILP methods, while better reconstructing gold constrained shortenings. Such speedups help query-focused applications, because users are measurably hindered by interface lags. Additionally, our technique does not require an ILP solver or a GPU.


title: Glassy dynamics of a model of bacterial cytoplasm with metabolic activities

abstract: Recent experiments have revealed that cytoplasms become glassy when their metabolism is suppressed, while they maintain fluidity in a living state. The mechanism of this active fluidization is not clear, especially for bacterial cytoplasms, since they lack traditional motor proteins, which can cause directed motions. We introduce a model of bacterial cytoplasm focusing on the impact of conformational change in proteins due to metabolism. In the model, proteins are treated as particles under thermal agitation, and conformation changes are treated as changes in particle volume. Simulations revealed that a small change in volume fluidizes the glassy state, accompanied by a change in fragility, as observed experimentally.


title: Raychaudhuri equation with zero point length

abstract: The Raychaudhuri equation for a geodesic congruence in the presence of a zero-point length has been investigated. This is directly related to the small-scale structure of spacetime and possibly captures some quantum gravity effects. The existence of such a minimum distance between spacetime events modifies the associated metric structure and hence the expansion as well as its rate of change deviates from standard expectations. This holds true for any kind of geodesic congruences, including time-like and null geodesics. Interestingly, this construction works with generic spacetime geometry without any need of invoking any particular symmetry. In particular, inclusion of a zero-point length results into a non-vanishing cross-sectional area for the geodesic congruences even in the coincidence limit, thus avoiding formation of caustics. This will have implications for both time-like and null geodesic congruences, which may lead to avoidance of singularity formation in the quantum spacetime.


title: Parameter Estimation for Scarce Stellar Populations

abstract: We present a Bayesian method to determine simultaneously the age, metallicity, distance modulus, and interstellar reddening by dust of any resolved stellar population, by comparing the observed and synthetic color magnitude diagrams on a star by star basis, with no need to bin the data into a carefully selected magnitude grid. We test the method with mock stellar populations, and show that it works correctly even for scarce stellar populations with only one or two hundred stars above the main sequence turn off. If the population is the result of two star formation bursts, we can infer the contribution of each event to the total stellar population. The code works automatically and has already been used to study massive amounts of Magellanic clouds photometric data. In this paper we analyze in detail three Large Magellanic Cloud star clusters and 6 Ultra Faint Dwarf Galaxies. For these galaxies we recover physical parameters in agreement with those quoted in the literature, age $\sim13.7$ Gyr and a very low metallicity $log\,Z\sim-4$. Searching for multiple populations in these galaxies, we find, at a very low significance level, signs of a double stellar population for Ursa Major I: a dominant old population and a younger one which contributes $\sim25$% of the stars, in agreement with independent results from other authors.


title: Khovanov-Rozansky homology for infinite multi-colored braids

abstract: We define a limiting $\mathfrak{sl}_N$ Khovanov-Rozansky homology for semi-infinite positive multi-colored braids, and we show that this limiting homology categorifies a highest-weight projector for a large class of such braids. This effectively completes the extension of Cautis' similar result for infinite twist braids, begun in our earlier papers with Islambouli and Abel. We also present several similar results for other families of semi-infinite and bi-infinite multi-colored braids.


title: Disagreement-based Active Learning in Online Settings

abstract: We study online active learning for classifying streaming instances within the framework of statistical learning theory. At each time, the learner either queries the label of the current instance or predicts the label based on past seen examples. The objective is to minimize the number of queries while constraining the number of prediction errors over a horizon of length $T$. We develop a disagreement-based online learning algorithm for a general hypothesis space and under the Tsybakov noise. We show that the proposed algorithm has a label complexity of $O(dT^{\frac{2-2\alpha}{2-\alpha}}\log^2 T)$ under a constraint of bounded regret in terms of classification errors, where $d$ is the VC dimension of the hypothesis space and $\alpha$ is the Tsybakov noise parameter. We further establish a matching (up to a poly-logarithmic factor) lower bound, demonstrating the order optimality of the proposed algorithm. We address the tradeoff between label complexity and regret and show that the algorithm can be modified to operate at a different point on the tradeoff curve.


title: Effects of hole-boring and relativistic transparency on particle acceleration in overdense plasma irradiated by short multi-PW laser pulses

abstract: Propagation of short and ultra-intense laser pulses in a semi-infinite space of overdense hydrogen plasma is analyzed via fully-relativistic, real geometry particle-in-cell (PIC) simulations including radiation friction. The relativistic transparency and hole-boring regimes are found to be sensitive to the transverse plasma field, backward light reflection, and laser pulse filamentation. For laser intensities approaching $I\sim10^{24}$ W/cm$^2$ the direct laser acceleration of protons, along with ion Coulomb explosion, results in their injection into the acceleration phase of the compressed electron wave at the front of the laser pulses. The protons are observed to be accelerated up to 10-20 GeV with densities around a few times the critical density. The effect strongly depends on initial density and laser intensity disappearing with initial density increase and intensity decrease.


title: Feature Fusion for Online Mutual Knowledge Distillation

abstract: We propose a learning framework named Feature Fusion Learning (FFL) that efficiently trains a powerful classifier through a fusion module which combines the feature maps generated from parallel neural networks. Specifically, we train a number of parallel neural networks as sub-networks, then we combine the feature maps from each sub-network using a fusion module to create a more meaningful feature map. The fused feature map is passed into the fused classifier for overall classification. Unlike existing feature fusion methods, in our framework, an ensemble of sub-network classifiers transfers its knowledge to the fused classifier and then the fused classifier delivers its knowledge back to each sub-network, mutually teaching one another in an online-knowledge distillation manner. This mutually teaching system not only improves the performance of the fused classifier but also obtains performance gain in each sub-network. Moreover, our model is more beneficial because different types of network can be used for each sub-network. We have performed a variety of experiments on multiple datasets such as CIFAR-10, CIFAR-100 and ImageNet and proved that our method is more effective than other alternative methods in terms of performance of both sub-networks and the fused classifier.


title: Feature Forwarding for Efficient Single Image Dehazing

abstract: Haze degrades content and obscures information of images, which can negatively impact vision-based decision-making in real-time systems. In this paper, we propose an efficient fully convolutional neural network (CNN) image dehazing method designed to run on edge graphical processing units (GPUs). We utilize three variants of our architecture to explore the dependency of dehazed image quality on parameter count and model design. The first two variants presented, a small and big version, make use of a single efficient encoder-decoder convolutional feature extractor. The final variant utilizes a pair of encoder-decoders for atmospheric light and transmission map estimation. Each variant ends with an image refinement pyramid pooling network to form the final dehazed image. For the big variant of the single-encoder network, we demonstrate state-of-the-art performance on the NYU Depth dataset. For the small variant, we maintain competitive performance on the super-resolution O/I-HAZE datasets without the need for image cropping. Finally, we examine some challenges presented by the Dense-Haze dataset when leveraging CNN architectures for dehazing of dense haze imagery and examine the impact of loss function selection on image quality. Benchmarks are included to show the feasibility of introducing this approach into real-time systems.


title: Helly meets Garside and Artin

abstract: A graph is Helly if every family of pairwise intersecting combinatorial balls has a nonempty intersection. We show that weak Garside groups of finite type and FC-type Artin groups are Helly, that is, they act geometrically on Helly graphs. In particular, such groups act geometrically on spaces with convex geodesic bicombing, equipping them with a nonpositive-curvature-like structure. That structure has many properties of a CAT(0) structure and, additionally, it has a combinatorial flavor implying biautomaticity. As immediate consequences we obtain new results for FC-type Artin groups (in particular braid groups and spherical Artin groups) and weak Garside groups, including e.g.\ fundamental groups of the complements of complexified finite simplicial arrangements of hyperplanes, braid groups of well-generated complex reflection groups, and one-relator groups with non-trivial center. Among the results are: biautomaticity, existence of EZ and Tits boundaries, the Farrell-Jones conjecture, the coarse Baum-Connes conjecture, and a description of higher order homological and homotopical Dehn functions. As a mean of proving the Helly property we introduce and use the notion of a (generalized) cell Helly complex.


title: Random Fragments Classification of Microbial Marker Clades with Multi-class SVM and N-Best Algorithm

abstract: Microbial clades modeling is a challenging problem in biology based on microarray genome sequences, especially in new species gene isolates discovery and category. Marker family genome sequences play important roles in describing specific microbial clades within species, a framework of support vector machine (SVM) based microbial species classification with N-best algorithm is constructed to classify the centroid marker genome fragments randomly generated from marker genome sequences on MetaRef. A time series feature extraction method is proposed by segmenting the centroid gene sequences and mapping into different dimensional spaces. Two ways of data splitting are investigated according to random splitting fragments along genome sequence (DI) , or separating genome sequences into two parts (DII).Two strategies of fragments recognition tasks, dimension-by-dimension and sequence--by--sequence, are investigated. The k-mer size selection, overlap of segmentation and effects of random split percents are also discussed. Experiments on 12390 maker genome sequences belonging to marker families of 17 species from MetaRef show that, both for DI and DII in dimension-by-dimension and sequence-by-sequence recognition, the recognition accuracy rates can achieve above 28\% in top-1 candidate, and above 91\% in top-10 candidate both on training and testing sets overall.


title: Semi-Supervised First-Person Activity Recognition in Body-Worn Video

abstract: Body-worn cameras are now commonly used for logging daily life, sports, and law enforcement activities, creating a large volume of archived footage. This paper studies the problem of classifying frames of footage according to the activity of the camera-wearer with an emphasis on application to real-world police body-worn video. Real-world datasets pose a different set of challenges from existing egocentric vision datasets: the amount of footage of different activities is unbalanced, the data contains personally identifiable information, and in practice it is difficult to provide substantial training footage for a supervised approach. We address these challenges by extracting features based exclusively on motion information then segmenting the video footage using a semi-supervised classification algorithm. On publicly available datasets, our method achieves results comparable to, if not better than, supervised and/or deep learning methods using a fraction of the training data. It also shows promising results on real-world police body-worn video.


title: On a Curious Identity of Ramanujan

abstract: Ramanujan wrote the following identity \begin{align*} \sqrt{2 \left(1 - \frac{1}{3^2}\right) \left(1 - \frac{1}{7^2}\right) \left(1 - \frac{1}{11^2}\right) \left(1 - \frac{1}{19^2}\right)} \ = \ \left(1 + \frac{1}{7}\right) \left(1 + \frac{1}{11}\right) \left(1 + \frac{1}{19}\right). \end{align*} We find necessary and sufficient conditions for the integers in the identity and prove that there are only finitely many such identities, and provide a method to generate many interesting variations.


title: Theory on Hadrons in Nuclear Medium

abstract: After decades-long attempts to measure the mass shift and understand the origin of hadron mass, it became clear that one has to analyze hadrons with small vacuum width. Also, to identify the effect of chiral symmetry breaking, one has to start by looking at chiral partners. In this talk, I will review why such consideration inevitably led us to consider $K^*$ and $K_1$ in nuclear matter [T. Song, T. Hatsuda, S H Lee, PLB792 (2019) 160-169]. With the kaon beam at JPARC, one could observe the mass shift of both particles in a nuclear target experiment. Once the masses and mass difference of $K^*$ and $K_1$ mesons are measured, we will be closer to understanding the origin of the hadron masses and the effects of chiral symmetry breaking in them.


title: Experimental observation of dynamical bulk-surface correspondence for topological phases

abstract: We experimentally demonstrate a dynamical classification approach for investigation of topological quantum phases using a solid-state spin system through nitrogen-vacancy (NV) center in diamond. Similar to the bulkboundary correspondence in real space at equilibrium, we observe a dynamical bulk-surface correspondence in the momentum space from a dynamical quench process. An emergent dynamical topological invariant is precisely measured in experiment by imaging the dynamical spin-textures on the recently defined band-inversion surfaces, with high topological numbers being implemented. Importantly, the dynamical classification approach is shown to be independent of quench ways and robust to the decoherence effects, offering a novel and practical strategy for dynamical topology characterization, especially for high dimensional gapped topological phases.


title: Scattering for the $L^2$ supercritical point NLS

abstract: We consider the 1D nonlinear Schr\"odinger equation with focusing point nonlinearity. "Point" means that the pure-power nonlinearity has an inhomogeneous potential and the potential is the delta function supported at the origin. This equation is used to model a Kerr-type medium with a narrow strip in the optic fibre. There are several mathematical studies on this equation and the local/global existence of solution, blow-up occurrence and blow-up profile have been investigated. In this paper we focus on the asymptotic behavior of the global solution, i.e, we show that the global solution scatters as t tends to minus/plus infinity in the $L^2$ supercritical case. The main argument we use is due to Kenig-Merle, but it is required to make use of an appropriate function space (not Strichartz space) according to the smoothing properties of the associated integral equation.


title: Emergence of Compositional Language with Deep Generational Transmission

abstract: Recent work has studied the emergence of language among deep reinforcement learning agents that must collaborate to solve a task. Of particular interest are the factors that cause language to be compositional -- i.e., express meaning by combining words which themselves have meaning. Evolutionary linguists have found that in addition to structural priors like those already studied in deep learning, the dynamics of transmitting language from generation to generation contribute significantly to the emergence of compositionality. In this paper, we introduce these cultural evolutionary dynamics into language emergence by periodically replacing agents in a population to create a knowledge gap, implicitly inducing cultural transmission of language. We show that this implicit cultural transmission encourages the resulting languages to exhibit better compositional generalization.


title: A Hybrid Retrieval-Generation Neural Conversation Model

abstract: Intelligent personal assistant systems that are able to have multi-turn conversations with human users are becoming increasingly popular. Most previous research has been focused on using either retrieval-based or generation-based methods to develop such systems. Retrieval-based methods have the advantage of returning fluent and informative responses with great diversity. However, the performance of the methods is limited by the size of the response repository. On the other hand, generation-based methods can produce highly coherent responses on any topics. But the generated responses are often generic and not informative due to the lack of grounding knowledge. In this paper, we propose a hybrid neural conversation model that combines the merits of both response retrieval and generation methods. Experimental results on Twitter and Foursquare data show that the proposed model outperforms both retrieval-based methods and generation-based methods (including a recently proposed knowledge-grounded neural conversation model) under both automatic evaluation metrics and human evaluation. We hope that the findings in this study provide new insights on how to integrate text retrieval and text generation models for building conversation systems.


title: Influence of low-lying resonances on reaction rates for n10B capture

abstract: The possibility of description available experimental data for total cross section for reaction of the neutron capture on 10B at energies from 25.3 meV to 1.0 MeV was considered in the frame of the modified potential cluster model with forbidden states, classification of the orbital cluster states according to Young diagrams and taking into account the resonance behavior of phase shifts of the n10B elastic scattering. The obtained results agree with the experimental measurements. The calculated total cross sections are used for obtaining the reaction rate of the neutron capture on 10B at the temperature range from 0.01 to 10 T9. The reaction rate rises essentially at temperatures above 0.3 - 0.4 T9, conditioned by the resonances at the energy above 100 keV.


title: Some definite integrals of Srinivasa Ramanujan and its consequences

abstract: In this paper, we obtain analytical solutions of some definite integrals of Srinivasa Ramanujan [Mess. Math., XLIV, 75-86, 1915] in terms of Meijer's $G$-function by using Laplace transforms of $ \sin(\beta x^{2}),\cos(\beta x^{2}), x\sin(\beta x^{2})$ and $x\cos(\beta x^{2})$. Further, we obtain some infinite summation formulas connected with Meijer's G-function and numeric values of some infinite series


title: On Itzykson-Zuber Ansatz

abstract: We apply the renormalized coupling constants and Virasoro constraints to derive the Itzykson-Zuber Ansatz on the form of the free energy in topological 2D gravity. We also treat the topological 1D gravity and the Hermitian one-matrix models in the same fashion. Some uniform behaviors are discovered in this approach.


title: Identifying Offensive Posts and Targeted Offense from Twitter

abstract: In this paper we present our approach and the system description for Sub-task A and Sub Task B of SemEval 2019 Task 6: Identifying and Categorizing Offensive Language in Social Media. Sub-task A involves identifying if a given tweet is offensive or not, and Sub Task B involves detecting if an offensive tweet is targeted towards someone (group or an individual). Our models for Sub-task A is based on an ensemble of Convolutional Neural Network, Bidirectional LSTM with attention, and Bidirectional LSTM + Bidirectional GRU, whereas for Sub-task B, we rely on a set of heuristics derived from the training data and manual observation. We provide detailed analysis of the results obtained using the trained models. Our team ranked 5th out of 103 participants in Sub-task A, achieving a macro F1 score of 0.807, and ranked 8th out of 75 participants in Sub Task B achieving a macro F1 of 0.695.


title: Integrating Text and Image: Determining Multimodal Document Intent in Instagram Posts

abstract: Computing author intent from multimodal data like Instagram posts requires modeling a complex relationship between text and image. For example, a caption might evoke an ironic contrast with the image, so neither caption nor image is a mere transcript of the other. Instead they combine -- via what has been called meaning multiplication -- to create a new meaning that has a more complex relation to the literal meanings of text and image. Here we introduce a multimodal dataset of 1299 Instagram posts labeled for three orthogonal taxonomies: the authorial intent behind the image-caption pair, the contextual relationship between the literal meanings of the image and caption, and the semiotic relationship between the signified meanings of the image and caption. We build a baseline deep multimodal classifier to validate the taxonomy, showing that employing both text and image improves intent detection by 9.6% compared to using only the image modality, demonstrating the commonality of non-intersective meaning multiplication. The gain with multimodality is greatest when the image and caption diverge semiotically. Our dataset offers a new resource for the study of the rich meanings that result from pairing text and image.


title: Topological semimetal phases manifested in transition metal dichalcogenides intercalated with 3d metals

abstract: In the search for stable topological semimetals with clean band profiles, we have screened all the 3$d$ metal-intercalated transition-metal dichalcogenides (3dI-TMDCs) by performing hybrid-functional-based ab initio calculations. Two classes of topological materials featuring twelve Weyl nodes in the $k_z=0$ plane (without spin-orbit interactions) are identified: (a) time-reversal-breaking Weyl semimetals VT$_3$X$_6$ (ferromagnetic) and (b) spinless Weyl semimetals MnT$_3$X$_6$ (nonmagnetic), where T=Nb, Ta; X=S, Se. VNb$_3$S$_6$, prototypical of class (a), is half-metallic with only two bands crossing at the Fermi level to form Weyl nodes. MnNb$_3$S$_6$ in the nonmagnetic phase is essentially a spinless version of VNb$_3$S$_6$ featuring an equally clean and simple band profile. Although the space group symmetry (P6$_3$22) implies that the degeneracy between the two bands is lifted for $k$ away from the Weyl nodes, the gap remains extremely small ($\ll$ 0.1 meV) along a loop connecting the Weyl nodes. This quasi-nodal-line degeneracy is explained in terms of the quasi-mirror symmetry of the lattice, induced by the in-plane twofold rotation axes, and the specific orbital nature of the bands. 3dI-TMDCs are chemically and thermally stable stoichiometric compounds containing no toxic elements and are a viable platform for the study of topological condensed-matter physics.


title: Advanced Deep Convolutional Neural Network Approaches for Digital Pathology Image Analysis: a comprehensive evaluation with different use cases

abstract: Deep Learning (DL) approaches have been providing state-of-the-art performance in different modalities in the field of medical imagining including Digital Pathology Image Analysis (DPIA). Out of many different DL approaches, Deep Convolutional Neural Network (DCNN) technique provides superior performance for classification, segmentation, and detection tasks. Most of the task in DPIA problems are somehow possible to solve with classification, segmentation, and detection approaches. In addition, sometimes pre and post-processing methods are applied for solving some specific type of problems. Recently, different DCNN models including Inception residual recurrent CNN (IRRCNN), Densely Connected Recurrent Convolution Network (DCRCN), Recurrent Residual U-Net (R2U-Net), and R2U-Net based regression model (UD-Net) have proposed and provide state-of-the-art performance for different computer vision and medical image analysis tasks. However, these advanced DCNN models have not been explored for solving different problems related to DPIA. In this study, we have applied these DCNN techniques for solving different DPIA problems and evaluated on different publicly available benchmark datasets for seven different tasks in digital pathology including lymphoma classification, Invasive Ductal Carcinoma (IDC) detection, nuclei segmentation, epithelium segmentation, tubule segmentation, lymphocyte detection, and mitosis detection. The experimental results are evaluated with different performance metrics such as sensitivity, specificity, accuracy, F1-score, Receiver Operating Characteristics (ROC) curve, dice coefficient (DC), and Means Squired Errors (MSE). The results demonstrate superior performance for classification, segmentation, and detection tasks compared to existing machine learning and DCNN based approaches.


title: Suggestion Mining from Online Reviews using ULMFiT

abstract: In this paper we present our approach and the system description for Sub Task A of SemEval 2019 Task 9: Suggestion Mining from Online Reviews and Forums. Given a sentence, the task asks to predict whether the sentence consists of a suggestion or not. Our model is based on Universal Language Model Fine-tuning for Text Classification. We apply various pre-processing techniques before training the language and the classification model. We further provide detailed analysis of the results obtained using the trained model. Our team ranked 10th out of 34 participants, achieving an F1 score of 0.7011. We publicly share our implementation at https://github.com/isarth/SemEval9_MIDAS


title: Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT

abstract: Pretrained contextual representation models (Peters et al., 2018; Devlin et al., 2018) have pushed forward the state-of-the-art on many NLP tasks. A new release of BERT (Devlin, 2018) includes a model simultaneously pretrained on 104 languages with impressive performance for zero-shot cross-lingual transfer on a natural language inference task. This paper explores the broader cross-lingual potential of mBERT (multilingual) as a zero shot language transfer model on 5 NLP tasks covering a total of 39 languages from various language families: NLI, document classification, NER, POS tagging, and dependency parsing. We compare mBERT with the best-published methods for zero-shot cross-lingual transfer and find mBERT competitive on each task. Additionally, we investigate the most effective strategy for utilizing mBERT in this manner, determine to what extent mBERT generalizes away from language specific features, and measure factors that influence cross-lingual transfer.


title: EmbraceNet: A robust deep learning architecture for multimodal classification

abstract: Classification using multimodal data arises in many machine learning applications. It is crucial not only to model cross-modal relationship effectively but also to ensure robustness against loss of part of data or modalities. In this paper, we propose a novel deep learning-based multimodal fusion architecture for classification tasks, which guarantees compatibility with any kind of learning models, deals with cross-modal information carefully, and prevents performance degradation due to partial absence of data. We employ two datasets for multimodal classification tasks, build models based on our architecture and other state-of-the-art models, and analyze their performance on various situations. The results show that our architecture outperforms the other multimodal fusion architectures when some parts of data are not available.


title: Rattling motion of a single atom in a fullerene cage molecule sensed by terahertz spectroscopy

abstract: Upon the discovery of the superatom states in endohedral metallofullerenes (EMFs), the superatom properties have become attractive, because ultrafast motion of the trapped atom modifies the charge distribution in the fullerene cage. However, the observation of ultrafast atom motion in the fullerene cage is very challenging, since dynamical processes take place in the terahertz (THz) frequency range in a picometer region. Here, we report on the THz spectroscopy of single Ce@C82 EMF molecules by using the single molecule transistor geometry. Due to the vibron-assisted tunneling process, two broad photocurrent peaks are observed in the THz spectra and are ascribed to the bending and stretching motions of the encapsulated single Ce atom. This work demonstrates that THz spectroscopy using nanogap electrodes can detect a motion of a single atom, opening a door to ultrafast THz nanoscience on the picometer-scale.


title: Implicit regularization for deep neural networks driven by an Ornstein-Uhlenbeck like process

abstract: We consider networks, trained via stochastic gradient descent to minimize $\ell_2$ loss, with the training labels perturbed by independent noise at each iteration. We characterize the behavior of the training dynamics near any parameter vector that achieves zero training error, in terms of an implicit regularization term corresponding to the sum over the data points, of the squared $\ell_2$ norm of the gradient of the model with respect to the parameter vector, evaluated at each data point. This holds for networks of any connectivity, width, depth, and choice of activation function. We interpret this implicit regularization term for three simple settings: matrix sensing, two layer ReLU networks trained on one-dimensional data, and two layer networks with sigmoid activations trained on a single datapoint. For these settings, we show why this new and general implicit regularization effect drives the networks towards "simple" models.


title: Hierarchical Meta Learning

abstract: Meta learning is a promising solution to few-shot learning problems. However, existing meta learning methods are restricted to the scenarios where training and application tasks share the same out-put structure. To obtain a meta model applicable to the tasks with new structures, it is required to collect new training data and repeat the time-consuming meta training procedure. This makes them inefficient or even inapplicable in learning to solve heterogeneous few-shot learning tasks. We thus develop a novel and principled HierarchicalMeta Learning (HML) method. Different from existing methods that only focus on optimizing the adaptability of a meta model to similar tasks, HML also explicitly optimizes its generalizability across heterogeneous tasks. To this end, HML first factorizes a set of similar training tasks into heterogeneous ones and trains the meta model over them at two levels to maximize adaptation and generalization performance respectively. The resultant model can then directly generalize to new tasks. Extensive experiments on few-shot classification and regression problems clearly demonstrate the superiority of HML over fine-tuning and state-of-the-art meta learning approaches in terms of generalization across heterogeneous tasks.


title: Detecting regime transitions in time series using dynamic mode decomposition

abstract: We employ the framework of the Koopman operator and dynamic mode decomposition to devise a computationally cheap and easily implementable method to detect transient dynamics and regime changes in time series. We argue that typically transient dynamics experiences the full state space dimension with subsequent fast relaxation towards the attractor. In equilibrium, on the other hand, the dynamics evolves on a slower time scale on a lower dimensional attractor. The reconstruction error of a dynamic mode decomposition is used to monitor the inability of the time series to resolve the fast relaxation towards the attractor as well as the effective dimension of the dynamics. We illustrate our method by detecting transient dynamics in the Kuramoto-Sivashinsky equation. We further apply our method to atmospheric reanalysis data; our diagnostics detects the transition from a predominantly negative North Atlantic Oscillation (NAO) to a predominantly positive NAO around 1970, as well as the recently found regime change in the Southern Hemisphere atmospheric circulation around 1970.


title: On Agemi-type structural conditions for a system of semilinear wave equations

abstract: We consider a two-component system of cubic semilinear wave equations in two space dimensions satisfying the Agemi-type structural condition (Ag) but violating (Ag$_0$) and (Ag$_+$). For this system, we show that small amplitude solutions are asymptotically free as $t\to +\infty$.


title: Gravity surveys using a mobile atom interferometer

abstract: Mobile gravimetry is important in metrology, navigation, geodesy, and geophysics. Atomic gravimeters could be among the most accurate mobile gravimeters, but are currently constrained by being complex and fragile. Here, we demonstrate a mobile atomic gravimeter, measuring tidal gravity variations in the laboratory as well as surveying gravity in the field. The tidal gravity measurements achieve a sensitivity of 37 $\mu$Gal/$\sqrt{\rm Hz}$ and a long-term stability of better than 2 $\mu$Gal, revealing ocean tidal loading effects and recording several distant earthquakes. We survey gravity in the Berkeley Hills with an accuracy of around 0.04 mGal and determine the density of the subsurface rocks from the vertical gravity gradient. With simplicity and sensitivity, our instrument paves the way for bringing atomic gravimeters to field applications.


title: LATTE: Accelerating LiDAR Point Cloud Annotation via Sensor Fusion, One-Click Annotation, and Tracking

abstract: LiDAR (Light Detection And Ranging) is an essential and widely adopted sensor for autonomous vehicles, particularly for those vehicles operating at higher levels (L4-L5) of autonomy. Recent work has demonstrated the promise of deep-learning approaches for LiDAR-based detection. However, deep-learning algorithms are extremely data hungry, requiring large amounts of labeled point-cloud data for training and evaluation. Annotating LiDAR point cloud data is challenging due to the following issues: 1) A LiDAR point cloud is usually sparse and has low resolution, making it difficult for human annotators to recognize objects. 2) Compared to annotation on 2D images, the operation of drawing 3D bounding boxes or even point-wise labels on LiDAR point clouds is more complex and time-consuming. 3) LiDAR data are usually collected in sequences, so consecutive frames are highly correlated, leading to repeated annotations. To tackle these challenges, we propose LATTE, an open-sourced annotation tool for LiDAR point clouds. LATTE features the following innovations: 1) Sensor fusion: We utilize image-based detection algorithms to automatically pre-label a calibrated image, and transfer the labels to the point cloud. 2) One-click annotation: Instead of drawing 3D bounding boxes or point-wise labels, we simplify the annotation to just one click on the target object, and automatically generate the bounding box for the target. 3) Tracking: we integrate tracking into sequence annotation such that we can transfer labels from one frame to subsequent ones and therefore significantly reduce repeated labeling. Experiments show the proposed features accelerate the annotation speed by 6.2x and significantly improve label quality with 23.6% and 2.2% higher instance-level precision and recall, and 2.0% higher bounding box IoU. LATTE is open-sourced at https://github.com/bernwang/latte.


title: Learning Programmatic Idioms for Scalable Semantic Parsing

abstract: Programmers typically organize executable source code using high-level coding patterns or idiomatic structures such as nested loops, exception handlers and recursive blocks, rather than as individual code tokens. In contrast, state of the art (SOTA) semantic parsers still map natural language instructions to source code by building the code syntax tree one node at a time. In this paper, we introduce an iterative method to extract code idioms from large source code corpora by repeatedly collapsing most-frequent depth-2 subtrees of their syntax trees, and train semantic parsers to apply these idioms during decoding. Applying idiom-based decoding on a recent context-dependent semantic parsing task improves the SOTA by 2.2\% BLEU score while reducing training time by more than 50\%. This improved speed enables us to scale up the model by training on an extended training set that is 5$\times$ larger, to further move up the SOTA by an additional 2.3\% BLEU and 0.9\% exact match. Finally, idioms also significantly improve accuracy of semantic parsing to SQL on the ATIS-SQL dataset, when training data is limited.


title: Topological characterization of hierarchical fractional quantum Hall effects in topological flat bands with SU($N$) symmetry

abstract: We study the many-body ground states of SU($N$) symmetric hardcore bosons on the topological flat-band model by using controlled numerical calculations. By introducing strong intracomponent and intercomponent interactions, we demonstrate that a hierarchy of bosonic SU($N$) fractional quantum Hall (FQH) states emerges at fractional filling factors $\nu=N/(MN+1)$ (odd $M=3$). In order to characterize this series of FQH states, we figure the effective $\mathbf{K}$ matrix from the inverse of the Chern number matrix. The topological characterization of the $\mathbf{K}$ matrix also reveals quantized drag Hall responses and fractional charge pumping that could be detected in future experiments. In addition, we address the general one-to-one correspondence to the spinless FQH states in topological flat bands with Chern number $C=N$ at fillings $\widetilde{\nu}=1/(MC+1)$.


title: Simulation-based Value-at-Risk for Nonlinear Portfolios

abstract: Value-at-risk (VaR) has been playing the role of a standard risk measure since its introduction. In practice, the delta-normal approach is usually adopted to approximate the VaR of portfolios with option positions. Its effectiveness, however, substantially diminishes when the portfolios concerned involve a high dimension of derivative positions with nonlinear payoffs; lack of closed form pricing solution for these potentially highly correlated, American-style derivatives further complicates the problem. This paper proposes a generic simulation-based algorithm for VaR estimation that can be easily applied to any existing procedures. Our proposal leverages cross-sectional information and applies variable selection techniques to simplify the existing simulation framework. Asymptotic properties of the new approach demonstrate faster convergence due to the additional model selection component introduced. We have also performed sets of numerical results that verify the effectiveness of our approach in comparison with some existing strategies.


title: Unexpectedly strong effect of supergranulation on the detectability of Earth twins orbiting Sun-like stars with radial velocities

abstract: Magnetic activity and surface flows at different scales pertub radial velocity measurements. This affects the detectability of low-mass exoplanets. In these flows, the effect of supergranulation is not as well characterized as the other flows, and we wish to estimate its effect on the detection of Earth-like planets in the habitable zone of Sun-like stars. We produced time series of radial velocities due to oscillations, granulation, and supergranulation, and estimated the detection limit for a G2 star and a period of 300 days. We also studied in detail the behavior of the power when the signal of a 1 Mearth planet was superposed on the signal from the stellar flows. We find that the detection rate does not reach 100% except for the supergranulation level we assume, which is still optimistic, and for an excellent sampling. We conclude that with current knowledge, it is a very challenging task to find Earth twins around Sun-like stars with our current capabilities.


title: SCANN: Synthesis of Compact and Accurate Neural Networks

abstract: Deep neural networks (DNNs) have become the driving force behind recent artificial intelligence (AI) research. An important problem with implementing a neural network is the design of its architecture. Typically, such an architecture is obtained manually by exploring its hyperparameter space and kept fixed during training. This approach is time-consuming and inefficient. Another issue is that modern neural networks often contain millions of parameters, whereas many applications and devices require small inference models. However, efforts to migrate DNNs to such devices typically entail a significant loss of classification accuracy. To address these challenges, we propose a two-step neural network synthesis methodology, called DR+SCANN, that combines two complementary approaches to design compact and accurate DNNs. At the core of our framework is the SCANN methodology that uses three basic architecture-changing operations, namely connection growth, neuron growth, and connection pruning, to synthesize feed-forward architectures with arbitrary structure. SCANN encapsulates three synthesis methodologies that apply a repeated grow-and-prune paradigm to three architectural starting points. DR+SCANN combines the SCANN methodology with dataset dimensionality reduction to alleviate the curse of dimensionality. We demonstrate the efficacy of SCANN and DR+SCANN on various image and non-image datasets. We evaluate SCANN on MNIST and ImageNet benchmarks. In addition, we also evaluate the efficacy of using dimensionality reduction alongside SCANN (DR+SCANN) on nine small to medium-size datasets. We also show that our synthesis methodology yields neural networks that are much better at navigating the accuracy vs. energy efficiency space. This would enable neural network-based inference even on Internet-of-Things sensors.


title: Petri Nets Based on Lawvere Theories

abstract: We give a definition of $\mathsf{Q}$-net, a generalization of Petri nets based on a Lawvere theory $\mathsf{Q}$, for which many existing variants of Petri nets are a special case. This definition is functorial with respect to change in Lawvere theory, and we exploit this to explore the relationships between different kinds of $\mathsf{Q}$-nets. To justify our definition of $\mathsf{Q}$-net, we construct a family of adjunctions for each Lawvere theory explicating the way in which $\mathsf{Q}$-nets present free models of $\mathsf{Q}$ in $\mathsf{Cat}$. This gives a functorial description of the operational semantics for an arbitrary category of $\mathsf{Q}$-nets. We show how this can be used to construct the semantics for Petri nets, pre-nets, integer nets, and elementary net systems.


title: Weakly Supervised Adversarial Domain Adaptation for Semantic Segmentation in Urban Scenes

abstract: Semantic segmentation, a pixel-level vision task, is developed rapidly by using convolutional neural networks (CNNs). Training CNNs requires a large amount of labeled data, but manually annotating data is difficult. For emancipating manpower, in recent years, some synthetic datasets are released. However, they are still different from real scenes, which causes that training a model on the synthetic data (source domain) cannot achieve a good performance on real urban scenes (target domain). In this paper, we propose a weakly supervised adversarial domain adaptation to improve the segmentation performance from synthetic data to real scenes, which consists of three deep neural networks. To be specific, a detection and segmentation ("DS" for short) model focuses on detecting objects and predicting segmentation map; a pixel-level domain classifier ("PDC" for short) tries to distinguish the image features from which domains; an object-level domain classifier ("ODC" for short) discriminates the objects from which domains and predicts the objects classes. PDC and ODC are treated as the discriminators, and DS is considered as the generator. By adversarial learning, DS is supposed to learn domain-invariant features. In experiments, our proposed method yields the new record of mIoU metric in the same problem.


title: Spin wave dispersion of 3d ferromagnets based on QSGW calculations

abstract: We calculate transverse spin susceptibility in the linear response method based on the ground states determined in the quasi-particle self-consistent $GW$ (QSGW) method. Then we extract spin wave (SW) dispersions from the susceptibility. We treat bcc Fe, hcp Co, fcc Ni, and B2-type FeCo. Because of the better description of the independent-particle picture in QSGW, calculated spin stiffness constants for Fe, Co, and Ni give much better agreement with experiments in QSGW than that in the local density approximation (LDA), where the stiffness for Ni in LDA is two times bigger than the experiment. For Co, both acoustic and optical branches of SWs agree with the experiment. As for FeCo, we have some discrrepancy between the spin stiffness in QSGW and that in the experiment. We may need further theoretical and experimental investigations on the discrepancy.


title: Schur sector of Argyres-Douglas theory and $W$-algebra

abstract: We study the Schur index, the Zhu's $C_2$ algebra, and the Macdonald index of a four dimensional $\mathcal{N}=2$ Argyres-Douglas (AD) theories from the structure of the associated two dimensional $W$-algebra. The Schur index is derived from the vacuum character of the corresponding $W$-algebra and can be rewritten in a very simple form, which can be easily used to verify properties like level-rank dualities, collapsing levels, and S-duality conjectures. The Zhu's $C_2$ algebra can be regarded as a ring associated with the Schur sector, and a surprising connection between certain Zhu's $C_2$ algebra and the Jacobi algebra of a hypersurface singularity is discovered. Finally, the Macdonald index is computed from the Kazhdan filtration of the $W$-algebra.


title: Quasiregular cobordism theorem

abstract: In this article we prove that, for an oriented PL $n$-manifold $M$ with $m$ boundary components and $d_0\in \mathbb N$, there exist mutually disjoint closed Euclidean balls and a $\mathsf K$-quasiregular mapping $M \to \mathbb S^n \setminus \mathrm{int}(B_1\cup \cdots \cup B_m)$ of degree at least $d_0$. The result is quantitative in the sense that the distortion $\mathsf K$ of the mapping does not depend on the degree. As applications of this construction, we obtain Rickman's large local index theorem for quasiregular maps to all dimensions $n\ge 4$. We also construct, in dimension $n=4$, a version of a wildly branching quasiregular map of Heinonen and Rickman, and a uniformly quasiregular map of arbitrarily large degree whose Julia set is a wild Cantor set. The existence of a wildly branching quasiregular map yields an example of a metric $4$-sphere $(\mathbb S^4,d)$, which is not bilipschitz equivalent to the Euclidean $4$-sphere $\mathbb S^4$ but which admits a BLD-map to $\mathbb S^4$. For the proof of the main theorem, we develop a dimension-free deformation method for cubical Alexander maps. For cubical and shellable Alexander maps this completes the $2$-dimensional deformation theory originated by S.~Rickman in 1985.


title: Causal Discovery with General Non-Linear Relationships Using Non-Linear ICA

abstract: We consider the problem of inferring causal relationships between two or more passively observed variables. While the problem of such causal discovery has been extensively studied especially in the bivariate setting, the majority of current methods assume a linear causal relationship, and the few methods which consider non-linear dependencies usually make the assumption of additive noise. Here, we propose a framework through which we can perform causal discovery in the presence of general non-linear relationships. The proposed method is based on recent progress in non-linear independent component analysis and exploits the non-stationarity of observations in order to recover the underlying sources or latent disturbances. We show rigorously that in the case of bivariate causal discovery, such non-linear ICA can be used to infer the causal direction via a series of independence tests. We further propose an alternative measure of causal direction based on asymptotic approximations to the likelihood ratio, as well as an extension to multivariate causal discovery. We demonstrate the capabilities of the proposed method via a series of simulation studies and conclude with an application to neuroimaging data.


title: Temporal variation in the winding number due to dynamical symmetry breaking and associated transport in a driven SSH chain

abstract: Considering a BDI symmetric one-dimensional SSH model, we explore the fate of the bulk topological invariant, namely, the winding number under a generic time dependent perturbation; the effective Hamiltonian, that generates the temporal evolution of the initial (ground) state of the completely symmetric initial Hamiltonian, may have the same or different symmetries. To exemplify, we consider the following protocols, namely (i) a perfectly periodic protocol (ii) a periodic protocol with noisy perturbations and also (iii) sudden changes in the parameters of the initial Hamiltonian. We establish that the topological invariant may change in some cases when the effective Hamiltonian (or the Floquet Hamiltonian in the periodic situation when observed stroboscopically) does not respect all BDI symmetries; this is manifested in the associated particle (polarisation) or heat current in the bulk. Our results establish a strong connection between the time evolution of the winding number (thus, the associated transport of currents) and the symmetry of the Hamiltonian generating the time evolution which has been illustrated considering an exhaustive set of possibilities.


title: Optimal initialization of K-means using Particle Swarm Optimization

abstract: This paper proposes the use of an optimization algorithm, namely PSO to decide the initial centroids in K-means, to eventually get better accuracy. The vectorized notation of the optimal centroids can be thought of as entities in an optimization space, where the accuracy of K-means over a random subset of the data could act as a fitness measure. The resultant optimal vector can be used as the initial centroids for K-means.


title: AMNet: Deep Atrous Multiscale Stereo Disparity Estimation Networks

abstract: In this paper, a new deep learning architecture for stereo disparity estimation is proposed. The proposed atrous multiscale network (AMNet) adopts an efficient feature extractor with depthwise-separable convolutions and an extended cost volume that deploys novel stereo matching costs on the deep features. A stacked atrous multiscale network is proposed to aggregate rich multiscale contextual information from the cost volume which allows for estimating the disparity with high accuracy at multiple scales. AMNet can be further modified to be a foreground-background aware network, FBA-AMNet, which is capable of discriminating between the foreground and the background objects in the scene at multiple scales. An iterative multitask learning method is proposed to train FBA-AMNet end-to-end. The proposed disparity estimation networks, AMNet and FBA-AMNet, show accurate disparity estimates and advance the state of the art on the challenging Middlebury, KITTI 2012, KITTI 2015, and Sceneflow stereo disparity estimation benchmarks.


title: Detecting driver distraction using stimuli-response EEG analysis

abstract: Detecting driver distraction is a significant concern for future intelligent transportation systems. We present a new approach for identifying distracted driving behavior by evaluating a stimulus and response interaction with the brain signals in two ways. First, measuring the driver response through EEG by creating various types of distraction stimuli such as reading, texting, calling and using phone camera (risk odds ratio of these activities determined by NHTSA study). Second, using a survey, comparing driver's order/perception of severity of distraction with the derived distraction index from EEG bands. A 14 electrodes headset was used to record the brain signals while driving in the pilot study with two subjects and a single dry electrode headset with 13 subjects in the main study. We used a naturalistic driving study as opposed to a virtual reality driving simulator to perform the distracted driving maneuvers, consisting of over 100 short duration trials (three to five seconds) for a subject. We overcame a big challenge in EEG analysis - reducing the number of electrodes by isolating one electrode (FC5) from 14 electrode locations to identify certain distractions. Our machine learning methods achieved a mean accuracy (averaged over the subjects and tasks) of 91.54 +/- 5.23% to detect a distracted driving event and 76.99 +/- 8.63% to distinguish between the five distraction cases in our study (read, text, call, and snapshot) using a single electrode. The quantification of distracted driving detailed in this paper is necessary to guide future policies in road safety. Our system addresses the safety concerns resulting from driver distraction and aims to bring about behavioral changes in drivers.


title: Body Lift and Drag for a Legged Millirobot in Compliant Beam Environment

abstract: Much current study of legged locomotion has rightly focused on foot traction forces, including on granular media. Future legged millirobots will need to go through terrain, such as brush or other vegetation, where the body contact forces significantly affect locomotion. In this work, a (previously developed) low-cost 6-axis force/torque sensing shell is used to measure the interaction forces between a hexapedal millirobot and a set of compliant beams, which act as a surrogate for a densely cluttered environment. Experiments with a VelociRoACH robotic platform are used to measure lift and drag forces on the tactile shell, where negative lift forces can increase traction, even while drag forces increase. The drag energy and specific resistance required to pass through dense terrains can be measured. Furthermore, some contact between the robot and the compliant beams can lower specific resistance of locomotion. For small, light-weight legged robots in the beam environment, the body motion depends on both leg-ground and body-beam forces. A shell-shape which reduces drag but increases negative lift, such as the half-ellipsoid used, is suggested to be advantageous for robot locomotion in this type of environment.


title: Minimizing coherent thermal conductance by controlling the periodicity of two-dimensional phononic crystals

abstract: Periodic hole array phononic crystals (PnC) can strongly modify the phonon dispersion relations, and have been shown to influence thermal conductance coherently, especially at low temperatures where scattering is suppressed. One very important parameter influencing this effect is the period of the structure. Here, we measured the sub-Kelvin thermal conductance of nanofabricated PnCs with identical hole filling factors, but three different periodicities, 4, 8, and 16 $\mu$m, using superconducting tunnel junction thermometry. We found that all the measured samples can suppress thermal conductance by an order of magnitude, and have a lower thermal conductance than the previously measured smaller period, 1 $\mu$m and 2.4 $\mu$m structures. The 8 $\mu$m period PnC gives the lowest thermal conductance of all the samples above, and has the lowest specific conductance/unit heater length observed to date in PnCs. In contrast, coherent transport theory predicts that the longest period should have the lowest thermal conductance. Comparison to incoherent simulations suggests that diffusive boundary scattering is likely the mechanism behind the partial breakdown of the coherent theory.


title: Epistasis-based Basis Estimation Method for Simplifying the Problem Space of an Evolutionary Search in Binary Representation

abstract: An evolutionary search space can be smoothly transformed via a suitable change of basis; however, it can be difficult to determine an appropriate basis. In this paper, a method is proposed to select an optimum basis can be used to simplify an evolutionary search space in a binary encoding scheme. The basis search method is based on a genetic algorithm and the fitness evaluation is based on the epistasis, which is an indicator of the complexity of a genetic algorithm. Two tests were conducted to validate the proposed method when applied to two different evolutionary search problems. The first searched for an appropriate basis to apply, while the second searched for a solution to the test problem. The results obtained after the identified basis had been applied were compared to those with the original basis, and it was found that the proposed method provided superior results.


title: Constraints on the small scale curvature perturbation using Planck-2015 data

abstract: The particles emitted from PBHs through the Hawking radiation have interactions with the particles present in the Universe. Due to the interactions, the evolution of the intergalactic medium (IGM) is changed and the changes have imprints on the anisotropies of the cosmic microwave background (CMB). In this paper, we focus on the PBHs with the lifetime in the range of $10^{13}s \lesssim \tau_{\rm PBH} \lesssim 10^{17}s$, corresponding to the mass range of $2.8\times 10^{13}\mathrm{g} \lesssim M_{\mathrm{PBH}} \lesssim 2.5\times 10^{14}\mathrm{g}$. We update the constraints on the initial mass fraction of PBHs using the Plank-2015 data. We find that the optimistic upper limits are $4\times 10^{-29}\lesssim \beta(M_{\mathrm{PBH}}) \lesssim 5\times 10^{-28}$, depending on the mass of PBH. The formation of PBHs is related to the primordial curvature perturbations. Therefore, using the constraints on the initial mass fraction of PBHs, we get the upper limits on the power spectrum of primordial curvature perturbation. For the investigated mass range of PBHs, corresponding to the range of scales $8.9 \times 10^{15}\ \mathrm{Mpc^{-1}}\lesssim k \lesssim 2.8 \times 10^{16}\ \mathrm{Mpc^{-1}}$, we find that the upper limits change slightly with a value of $\mathcal{P}_\mathcal{R}(k) \sim 0.0045$, and the limits are slightly stronger compared with the previous results.


title: Deep Likelihood Network for Image Restoration with Multiple Degradation Levels

abstract: Convolutional neural networks have been proven effective in a variety of image restoration tasks. Most state-of-the-art solutions, however, are trained using images with a single particular degradation level, and their performance deteriorates drastically when applied to other degradation settings. In this paper, we propose deep likelihood network (DL-Net), aiming at generalizing off-the-shelf image restoration networks to succeed over a spectrum of degradation levels. We slightly modify an off-the-shelf network by appending a simple recursive module, which is derived from a fidelity term, for disentangling the computation for multiple degradation levels. Extensive experimental results on image inpainting, interpolation, and super-resolution show the effectiveness of our DL-Net.


title: Automated Segmentation of Pulmonary Lobes using Coordination-Guided Deep Neural Networks

abstract: The identification of pulmonary lobes is of great importance in disease diagnosis and treatment. A few lung diseases have regional disorders at lobar level. Thus, an accurate segmentation of pulmonary lobes is necessary. In this work, we propose an automated segmentation of pulmonary lobes using coordination-guided deep neural networks from chest CT images. We first employ an automated lung segmentation to extract the lung area from CT image, then exploit volumetric convolutional neural network (V-net) for segmenting the pulmonary lobes. To reduce the misclassification of different lobes, we therefore adopt coordination-guided convolutional layers (CoordConvs) that generate additional feature maps of the positional information of pulmonary lobes. The proposed model is trained and evaluated on a few publicly available datasets and has achieved the state-of-the-art accuracy with a mean Dice coefficient index of 0.947 $\pm$ 0.044.


title: Code-Switching for Enhancing NMT with Pre-Specified Translation

abstract: Leveraging user-provided translation to constrain NMT has practical significance. Existing methods can be classified into two main categories, namely the use of placeholder tags for lexicon words and the use of hard constraints during decoding. Both methods can hurt translation fidelity for various reasons. We investigate a data augmentation method, making code-switched training data by replacing source phrases with their target translations. Our method does not change the MNT model or decoding algorithm, allowing the model to learn lexicon translations by copying source-side target words. Extensive experiments show that our method achieves consistent improvements over existing approaches, improving translation of constrained words without hurting unconstrained words.


title: Recognizing the vocabulary of Brazilian popular newspapers with a free-access computational dictionary

abstract: We report an experiment to check the identification of a set of words in popular written Portuguese with two versions of a computational dictionary of Brazilian Portuguese, DELAF PB 2004 and DELAF PB 2015. This dictionary is freely available for use in linguistic analyses of Brazilian Portuguese and other researches, which justifies critical study. The vocabulary comes from the PorPopular corpus, made of popular newspapers Di{\'a}rio Ga{\'u}cho (DG) and Massa! (MA). From DG, we retained a set of texts with 984.465 words (tokens), published in 2008, with the spelling used before the Portuguese Language Orthographic Agreement adopted in 2009. From MA, we examined papers of 2012, 2014 e 2015, with 215.776 words (tokens), all with the new spelling. The checking involved: a) generating lists of words (types) occurring in DG and MA; b) comparing them with the entry lists of both versions of DELAF PB; c) assessing the coverage of this vocabulary; d) proposing ways of incorporating the items not covered. The results of the work show that an average of 19% of the types in DG were not found in DELAF PB 2004 or 2015. In MA, this average is 13%. Switching versions of the dictionary affected slightly the performance in recognizing the words.


title: Shallow Neural Network can Perfectly Classify an Object following Separable Probability Distribution

abstract: Guiding the design of neural networks is of great importance to save enormous resources consumed on empirical decisions of architectural parameters. This paper constructs shallow sigmoid-type neural networks that achieve 100% accuracy in classification for datasets following a linear separability condition. The separability condition in this work is more relaxed than the widely used linear separability. Moreover, the constructed neural network guarantees perfect classification for any datasets sampled from a separable probability distribution. This generalization capability comes from the saturation of sigmoid function that exploits small margins near the boundaries of intervals formed by the separable probability distribution.


title: Hidden variable recurrent fractal interpolation function with four function contractivity factors

abstract: In this paper, we introduce a construction of hidden variable recurrent fractal interpolation functions (HVRFIF) with four function contractivity factors. In the fractal interpolation theory, it is very important to ensure flexibility and diversity of the construction of interpolation function. Recurrent iterated function system (RIFS) produce fractal sets with local self-similarity structure. Therefore the RIFS can describe the irregular and complicated objects in nature better than the iterated function system (IFS). Hidden variable fractal interpolation function (HVFIF) is neither self-similar nor self-affine one. The HVFIF is more complicated, diverse and irregular than the fractal interpolation function (FIF). The contractivity factor is important one that determins characteristics of FIFs. We present a constructions of one variable HVRFIFs and bivariable HVRFIFs using RIFS with four function contractivity factors.


title: Brain Invaders Adaptive versus Non-Adaptive P300 Brain-Computer Interface dataset

abstract: We describe the experimental procedures for a dataset that we have made publicly available at https://doi.org/10.5281/zenodo.1494163 in mat and csv formats. This dataset contains electroencephalographic (EEG) recordings of 24 subjects doing a visual P300 Brain-Computer Interface experiment on PC. The visual P300 is an event-related potential elicited by visual stimulation, peaking 240-600 ms after stimulus onset. The experiment was designed in order to compare the use of a P300-based brain-computer interface on a PC with and without adaptive calibration using Riemannian geometry. The brain-computer interface is based on electroencephalography (EEG). EEG data were recorded thanks to 16 electrodes. Data were recorded during an experiment taking place in the GIPSA-lab, Grenoble, France, in 2013 (Congedo, 2013). Python code for manipulating the data is available at https://github.com/plcrodrigues/py.BI.EEG.2013-GIPSA. The ID of this dataset is BI.EEG.2013-GIPSA.


title: Long-term spectral study of the black hole Cygnus X-1 using INTEGRAL

abstract: We utilize the joint capabilities of IBIS and SPI to perform a state-resolved 20--2000\,keV analysis of the microquasar Cygnus X-1. In both LHS and HSS, the spectral analysis reveals the presence of a high-energy tail above 400\,keV in addition to a standard, Compton-like continuum in the 20--400\,keV range. We study the polarisation properties of the hard X-ray radiation, as well as of the polarisation of this high-energy tail. Polarisation is detected in the LHS in agreement with previous work. We find potential variations of the LHS polarisation with time and no polarisation detection in the HSS.


title: Chiral sound waves in strained Weyl semimetals

abstract: We show that a strained wire of a Weyl semimetal supports a new type of gapless excitation, the chiral sound wave (CSW). It is a longitudinal charge density wave analog to the chiral magnetic wave predicted in the quark-gluon plasma but driven by an elastic axial pseudo-magnetic field. It involves the axial-axial-axial contribution to the chiral anomaly which couples the chiral charge density to the elastic axial gauge field. The chiral sound is unidirectional: it propagates along the elastic magnetic field and not in the opposite direction. The CSW may propagate for long distances as it does not couple directly to quickly dissipating electromagnetic plasmons, while its damping is controlled by the slow chirality flip rate. We propose an experimental setup to directly detect the chiral sound, which is excited by mechanical vibrations of the crystal lattice in the GHz frequency range. Our findings contribute to a new trend, the chiral acoustics, in strained Weyl semimetals.


title: On Markovian semigroups of L\'evy driven SDEs, symbols and pseudo--differential operators

abstract: We analyse analytic properties of nonlocal transition semigroups associated with a class of stochastic differential equations (SDEs) in $\mathbb{R}^d$ driven by pure jump--type L\'evy processes. First, we will show under which conditions the semigroup will be analytic on the Besov space $B_{p,q}^ m(\mathbb{R}^d)$ with $1\le p, q<\infty$ and $m\in\mathbb{R}$. Secondly, we present some applications by proving the strong Feller property and give weak error estimates for approximating schemes of the SDEs over the Besov space $B_{\infty,\infty}^ m(\mathbb{R}^d)$.


title: Listen to the Image

abstract: Visual-to-auditory sensory substitution devices can assist the blind in sensing the visual environment by translating the visual information into a sound pattern. To improve the translation quality, the task performances of the blind are usually employed to evaluate different encoding schemes. In contrast to the toilsome human-based assessment, we argue that machine model can be also developed for evaluation, and more efficient. To this end, we firstly propose two distinct cross-modal perception model w.r.t. the late-blind and congenitally-blind cases, which aim to generate concrete visual contents based on the translated sound. To validate the functionality of proposed models, two novel optimization strategies w.r.t. the primary encoding scheme are presented. Further, we conduct sets of human-based experiments to evaluate and compare them with the conducted machine-based assessments in the cross-modal generation task. Their highly consistent results w.r.t. different encoding schemes indicate that using machine model to accelerate optimization evaluation and reduce experimental cost is feasible to some extent, which could dramatically promote the upgrading of encoding scheme then help the blind to improve their visual perception ability.


title: Enabling Socially Competent navigation through incorporating HRI

abstract: Over the last years, social robots have been deployed in public environments making evident the need of human-aware navigation capabilities. In this regard, the robotics community have made efforts to include proxemics or social conventions within the navigation approaches. Nevertheless, few works have tackled the problem of labelling humans as an interactive agent when blocking the robot motion trajectory. Current state of the art navigation planners will either propose an alternative path or freeze the motion until the path is free. We present the first prototype of a framework designed to enhance social competency of robots while navigating in indoor environments. The implementation is done using Navigation and Object Detection open-source software. Specifically, the Robot Operating System (ROS) navigation stack, and OpenCV with Caffe deep learning models and MobileNet Single Shot Detector (SSD), respectively.


title: SelFlow: Self-Supervised Learning of Optical Flow

abstract: We present a self-supervised learning approach for optical flow. Our method distills reliable flow estimations from non-occluded pixels, and uses these predictions as ground truth to learn optical flow for hallucinated occlusions. We further design a simple CNN to utilize temporal information from multiple frames for better flow estimation. These two principles lead to an approach that yields the best performance for unsupervised optical flow learning on the challenging benchmarks including MPI Sintel, KITTI 2012 and 2015. More notably, our self-supervised pre-trained model provides an excellent initialization for supervised fine-tuning. Our fine-tuned models achieve state-of-the-art results on all three datasets. At the time of writing, we achieve EPE=4.26 on the Sintel benchmark, outperforming all submitted methods.


title: A toolbox for elementary fermions with a dipolar Fermi gas in a 3D optical lattice

abstract: There has been growing interest in investigating properties of elementary particles predicted by the standard model. Examples of such studies include exploring their low-energy analogs in condensed matter system, where they arise as collective states or quasiparticles. Here we show that a toolbox for systematically engineering the emergent elementary fermions, i.e., Dirac, Weyl and Majorana fermions, can be built in a single atomic system composed of a spinless magnetic dipolar Fermi gas in a 3D optical lattice. The designed direction-dependent dipole-dipole interaction leads to both the basic building block, i.e, in-plane p+ip superfluid pairing instability and the manipulating tool, i.e, out-of-plane Peierls instability. It is shown that the Peierls instability provides a natural way of tuning the topological nature of p+ip superfluids and thus transform the fermion's nature between distinct emergent particles. Our scheme should open up a new thrust towards searching for elementary particles through manipulating the topology.


title: Molecular-orbital representation of generic flat-band models

abstract: We develop a framework to describe a wide class of flat-band models, with and without a translational symmetry, by using "molecular orbitals" introduced in the prior work (HATSUGAI Y. and MARUYAMA I., \textit{EPL}, \textbf{95}, (2011) 20003). Using the molecular-orbital representation, we shed new light on the band-touching problem between flat and dispersive bands. We show that the band touching occurs as a result of collapse, or the linearly dependent nature, of molecular orbitals. Conversely, we can gap out the flat bands by modulating the molecular orbitals so that they do not collapse, which provides a simple prescription to construct models having a finite energy gap between flat bands and dispersive bands.


title: Deep Q Learning Driven CT Pancreas Segmentation with Geometry-Aware U-Net

abstract: Segmentation of pancreas is important for medical image analysis, yet it faces great challenges of class imbalance, background distractions and non-rigid geometrical features. To address these difficulties, we introduce a Deep Q Network(DQN) driven approach with deformable U-Net to accurately segment the pancreas by explicitly interacting with contextual information and extract anisotropic features from pancreas. The DQN based model learns a context-adaptive localization policy to produce a visually tightened and precise localization bounding box of the pancreas. Furthermore, deformable U-Net captures geometry-aware information of pancreas by learning geometrically deformable filters for feature extraction. Experiments on NIH dataset validate the effectiveness of the proposed framework in pancreas segmentation.


title: Secondary CMB temperature anisotropies from magnetic reheating

abstract: Spatially fluctuating primordial magnetic fields (PMFs) inhomogeneously reheat the Universe when they dissipate deep inside the horizon before recombination. Such an energy injection turns into an additional photon temperature perturbation. We investigate secondary cosmic microwave background (CMB) temperature anisotropies originated from this mechanism, which we call {\it inhomogeneous magnetic reheating}. We find that it can bring us information about non-linear coupling between PMFs and primordial curvature perturbations parametrized by $b_{\rm NL}$, which should be important for probing the generation mechanism of PMFs. In fact, by using current CMB observations, we obtain an upper bound on the non-linear parameter as $\log (b_{\rm NL} (B_{\lambda}/{\rm nG})^2) \lesssim {-36.5n_{B} - 94.0}$ with $B_{\lambda}$ and $n_{\rm B}$ being a magnetic field amplitude smoothed over $\lambda=1\; {\rm Mpc}$ scale and a spectral index of the PMF power spectrum, respectively. Our constraints are far stronger than a previous forecast based on the future CMB spectral distortion anisotropy measurements because inhomogeneous magnetic reheating covers a much wider range of scales, i.e., $1\; {\rm Mpc}^{-1} \lesssim k\lesssim 10^{15}\; {\rm Mpc}^{-1}$.


title: Zero-Shot Cross-Lingual Opinion Target Extraction

abstract: Aspect-based sentiment analysis involves the recognition of so called opinion target expressions (OTEs). To automatically extract OTEs, supervised learning algorithms are usually employed which are trained on manually annotated corpora. The creation of these corpora is labor-intensive and sufficiently large datasets are therefore usually only available for a very narrow selection of languages and domains. In this work, we address the lack of available annotated data for specific languages by proposing a zero-shot cross-lingual approach for the extraction of opinion target expressions. We leverage multilingual word embeddings that share a common vector space across various languages and incorporate these into a convolutional neural network architecture for OTE extraction. Our experiments with 5 languages give promising results: We can successfully train a model on annotated data of a source language and perform accurate prediction on a target language without ever using any annotated samples in that target language. Depending on the source and target language pairs, we reach performances in a zero-shot regime of up to 77% of a model trained on target language data. Furthermore, we can increase this performance up to 87% of a baseline model trained on target language data by performing cross-lingual learning from multiple source languages.