title: Assessment of Faster R-CNN in Man-Machine collaborative search

abstract: With the advent of modern expert systems driven by deep learning that supplement human experts (e.g. radiologists, dermatologists, surveillance scanners), we analyze how and when do such expert systems enhance human performance in a fine-grained small target visual search task. We set up a 2 session factorial experimental design in which humans visually search for a target with and without a Deep Learning (DL) expert system. We evaluate human changes of target detection performance and eye-movements in the presence of the DL system. We find that performance improvements with the DL system (computed via a Faster R-CNN with a VGG16) interacts with observer's perceptual abilities (e.g., sensitivity). The main results include: 1) The DL system reduces the False Alarm rate per Image on average across observer groups of both high/low sensitivity; 2) Only human observers with high sensitivity perform better than the DL system, while the low sensitivity group does not surpass individual DL system performance, even when aided with the DL system itself; 3) Increases in number of trials and decrease in viewing time were mainly driven by the DL system only for the low sensitivity group. 4) The DL system aids the human observer to fixate at a target by the 3rd fixation. These results provide insights of the benefits and limitations of deep learning systems that are collaborative or competitive with humans.


title: A Catalog of the Most Optically Luminous Galaxies at z<0.3: Super Spirals, Super Lenticulars, Super Post-Mergers, and Giant Ellipticals

abstract: We present a catalog of the 1525 most optically luminous galaxies from the Sloan Digital Sky Survey (SDSS) with r-band luminosity L_r > 8L* and redshift z<0.3, including 84 super spirals, 15 super lenticulars, 14 super post-merger galaxies, and 1400 giant ellipticals. With mass in stars of 10^{11.3}-10^{12} M_sun, super spirals and lenticulars are the most massive disk galaxies currently known. The specific star formation rates of super spirals place them on or below the star-forming main sequence. They must have formed stars at a high rate throughout their history in order to grow their massive, gigantic stellar disks and maintain their blue u-r integrated colors. Their disks are red on the inside and blue on the outside, consistent with inside-out growth. They tend to have small bulge-to-total (B/T) r-band luminosity ratios, characteristic of disk building via minor mergers and cold accretion. A large percentage of super disk galaxies (41%) have double nuclei, double disks, or other signatures of ongoing mergers. Most (72%) are found in moderate to low density environments, while the rest are found at the outskirts of clusters. It is likely that super spirals survive in these environments because they continue to accrete cold gas and experience only minor mergers at late times, by virtue of their enormous masses and angular momenta. We suggest that super post-mergers are the product of super-spiral major mergers and may be the precursors of some giant elliptical galaxies found in low density environments. We present two new gravitational lens candidates in the Appendix.


title: Fluxonic Processing of Photonic Synapse Events

abstract: Much of the information processing performed by a neuron occurs in the dendritic tree. For neural systems using light for communication, it is advantageous to convert signals to the electronic domain at synaptic terminals so dendritic computation can be performed with electrical circuits. Here we present circuits based on Josephson junctions and mutual inductors that act as dendrites, processing signals from synapses receiving single-photon communication events with superconducting detectors. We show simulations of circuits performing basic temporal filtering, logical operations, and nonlinear transfer functions. We further show how the synaptic signal from a single-photon can fan out locally in the electronic domain to enable the dendrites of the receiving neuron to process a photonic synapse event or pulse train in multiple different ways simultaneously. Such a technique makes efficient use of photons, energy, space, and information.


title: Overlap matrix concentration in optimal Bayesian inference

abstract: We consider models of Bayesian inference of signals with vectorial components of finite dimensionality. We show that, under a proper perturbation, these models are replica symmetric in the sense that the overlap matrix concentrates. The overlap matrix is the order parameter in these models and is directly related to error metrics such as minimum mean-square errors. Our proof is valid in the optimal Bayesian inference setting. This means that it relies on the assumption that the model and all its hyper-parameters are known so that the posterior distribution can be written exactly. Examples of important problems in high-dimensional inference and learning to which our results apply are low-rank tensor factorization, the committee machine neural network with a finite number of hidden neurons in the teacher-student scenario, or multi-layer versions of the generalized linear model.


title: Proving tree algorithms for succinct data structures

abstract: Succinct data structures give space-efficient representations of large amounts of data without sacrificing performance. They rely one cleverly designed data representations and algorithms. We present here the formalization in Coq/SSReflect of two different tree-based succinct representations and their accompanying algorithms. One is the Level-Order Unary Degree Sequence, which encodes the structure of a tree in breadth-first order as a sequence of bits, where access operations can be defined in terms of Rank and Select, which work in constant time for static bit sequences. The other represents dynamic bit sequences as binary balanced trees, where Rank and Select present a low logarithmic overhead compared to their static versions, and with efficient insertion and deletion. The two can be stacked to provide a dynamic representation of dictionaries for instance. While both representations are well-known, we believe this to be their first formalization and a needed step towards provably-safe implementations of big data.


title: Construction of the Barrier for Reach-Avoid Differential Games in Three-Dimensional Space with Four Equal-Speed Players

abstract: This paper considers a reach-avoid differential game in three-dimensional space with four equal-speed players. A plane divides the game space into a play subspace and a goal subspace. The evader aims at entering the goal subspace while three pursuers cooperate to prevent that by capturing the evader. A complete, closed-form barrier for this differential game is provided, by which the game winner can be perfectly predicted before the game starts. All possible cooperations among three pursuers are considered and thus the guaranteed winning for each team is a prior. Furthermore, an algorithm is designed to compute the barrier for multiple pursuers of any numbers and any initial configurations. More realistically, since the whole achieved developments are analytical, they require a little memory without computational burden and allow for real-time updates, beyond the capacity of traditional Hamilton-Jacobi-Isaacs method.


title: Video Classification with Channel-Separated Convolutional Networks

abstract: Group convolution has been shown to offer great computational savings in various 2D convolutional architectures for image classification. It is natural to ask: 1) if group convolution can help to alleviate the high computational cost of video classification networks; 2) what factors matter the most in 3D group convolutional networks; and 3) what are good computation/accuracy trade-offs with 3D group convolutional networks. This paper studies the effects of different design choices in 3D group convolutional networks for video classification. We empirically demonstrate that the amount of channel interactions plays an important role in the accuracy of 3D group convolutional networks. Our experiments suggest two main findings. First, it is a good practice to factorize 3D convolutions by separating channel interactions and spatiotemporal interactions as this leads to improved accuracy and lower computational cost. Second, 3D channel-separated convolutions provide a form of regularization, yielding lower training accuracy but higher test accuracy compared to 3D convolutions. These two empirical findings lead us to design an architecture -- Channel-Separated Convolutional Network (CSN) -- which is simple, efficient, yet accurate. On Sports1M, Kinetics, and Something-Something, our CSNs are comparable with or better than the state-of-the-art while being 2-3 times more efficient.


title: Microlocal inversion of a 3-dimensional restricted transverse ray transform of symmetric $m$-tensor fields

abstract: We study the problem of inverting a restricted transverse ray transform to recover a symmetric $m$-tensor field in $\mathbb{R}^3$ using microlocal analysis techniques. More precisely, we prove that a symmetric $m$-tensor field can be recovered up to a known singular term and a smoothing term if its transverse ray transform is known along all lines intersecting a fixed smooth curve satisfying the Kirillov-Tuy condition.


title: Goal-setting And Achievement In Activity Tracking Apps: A Case Study Of MyFitnessPal

abstract: Activity tracking apps often make use of goals as one of their core motivational tools. There are two critical components to this tool: setting a goal, and subsequently achieving that goal. Despite its crucial role in how a number of prominent self-tracking apps function, there has been relatively little investigation of the goal-setting and achievement aspects of self-tracking apps. Here we explore this issue, investigating a particular goal setting and achievement process that is extensive, recorded, and crucial for both the app and its users' success: weight loss goals in MyFitnessPal. We present a large-scale study of 1.4 million users and weight loss goals, allowing for an unprecedented detailed view of how people set and achieve their goals. We find that, even for difficult long-term goals, behavior within the first 7 days predicts those who ultimately achieve their goals, that is, those who lose at least as much weight as they set out to, and those who do not. For instance, high amounts of early weight loss, which some researchers have classified as unsustainable, leads to higher goal achievement rates. We also show that early food intake, self-monitoring motivation, and attitude towards the goal are important factors. We then show that we can use our findings to predict goal achievement with an accuracy of 79% ROC AUC just 7 days after a goal is set. Finally, we discuss how our findings could inform steps to improve goal achievement in self-tracking apps.


title: Superconducting Symmetry Phases and Dominant bands in (Ca-) Intercalated AA- Bilayer Graphene

abstract: Built on a realistic multiband tight-binding model, mirror symmetry is used to map a calcium-intercalated bilayer graphene Hamiltonian into two independent single layer graphene-like Hamiltonians with renormalized hopping. The quasiparticles exhibit two types of chirality. Here a quasi-particle consists of two electrons from opposing layers where possess an additional quantum number called "cone index" which can be regarded as the eigenvalue of mirror symmetry operations. To obtain tight-binding parameters, both effective monolayer Schrodinger equations are solved analytically and fitted to first-principles band structure results. Two quasi-particles (four electrons) can team up to build a Cooper pair with even or odd chirality. Treatment of the pairing Hamiltonian leads to two decoupled gap equations. The pairing of quasi-particles with different cone indexes is forbidden. The decoupled gap equations are solved analytically to obtain all the possible superconducting phases. Two nearly "flat bands" crossing the Fermi energy, each related to the graphene-like structures, are responsible for two distinct superconductivity gaps that emerge. Depending on how much these bands are affected by the intercalant and which is closer to the Fermi energy, distorted s-wave or d-wave superconductivity may become dominant. Numerical calculations reveal that d-wave superconductivity is dominant in both sectors. For these two dominant phases, within the range of 0-6 K which superconductivity has been observed, numerically the transition from single-gap to dual-gap superconductivity is possible. Adopting the two-gap viewpoint of superconductivity in C$_6$CaC$_6$, the dominant $d$-wave states should have the same critical temperature. Around $T_c=2K$ these two relations intersect, otherwise, superconductivity has been realized just in one of these two sectors and disappears in the other one.


title: Topic Spotting using Hierarchical Networks with Self Attention

abstract: Success of deep learning techniques have renewed the interest in development of dialogue systems. However, current systems struggle to have consistent long term conversations with the users and fail to build rapport. Topic spotting, the task of automatically inferring the topic of a conversation, has been shown to be helpful in making a dialog system more engaging and efficient. We propose a hierarchical model with self attention for topic spotting. Experiments on the Switchboard corpus show the superior performance of our model over previously proposed techniques for topic spotting and deep models for text classification. Additionally, in contrast to offline processing of dialog, we also analyze the performance of our model in a more realistic setting i.e. in an online setting where the topic is identified in real time as the dialog progresses. Results show that our model is able to generalize even with limited information in the online setting.


title: Image Reconstruction: From Sparsity to Data-adaptive Methods and Machine Learning

abstract: The field of medical image reconstruction has seen roughly four types of methods. The first type tended to be analytical methods, such as filtered back-projection (FBP) for X-ray computed tomography (CT) and the inverse Fourier transform for magnetic resonance imaging (MRI), based on simple mathematical models for the imaging systems. These methods are typically fast, but have suboptimal properties such as poor resolution-noise trade-off for CT. A second type is iterative reconstruction methods based on more complete models for the imaging system physics and, where appropriate, models for the sensor statistics. These iterative methods improved image quality by reducing noise and artifacts. The FDA-approved methods among these have been based on relatively simple regularization models. A third type of methods has been designed to accommodate modified data acquisition methods, such as reduced sampling in MRI and CT to reduce scan time or radiation dose. These methods typically involve mathematical image models involving assumptions such as sparsity or low-rank. A fourth type of methods replaces mathematically designed models of signals and systems with data-driven or adaptive models inspired by the field of machine learning. This paper focuses on the two most recent trends in medical image reconstruction: methods based on sparsity or low-rank models, and data-driven methods based on machine learning techniques.


title: Unsupervised Domain Adaptation of Contextualized Embeddings for Sequence Labeling

abstract: Contextualized word embeddings such as ELMo and BERT provide a foundation for strong performance across a wide range of natural language processing tasks by pretraining on large corpora of unlabeled text. However, the applicability of this approach is unknown when the target domain varies substantially from the pretraining corpus. We are specifically interested in the scenario in which labeled data is available in only a canonical source domain such as newstext, and the target domain is distinct from both the labeled and pretraining texts. To address this scenario, we propose domain-adaptive fine-tuning, in which the contextualized embeddings are adapted by masked language modeling on text from the target domain. We test this approach on sequence labeling in two challenging domains: Early Modern English and Twitter. Both domains differ substantially from existing pretraining corpora, and domain-adaptive fine-tuning yields substantial improvements over strong BERT baselines, with particularly impressive results on out-of-vocabulary words. We conclude that domain-adaptive fine-tuning offers a simple and effective approach for the unsupervised adaptation of sequence labeling to difficult new domains.


title: Neural Networks for Modeling Source Code Edits

abstract: Programming languages are emerging as a challenging and interesting domain for machine learning. A core task, which has received significant attention in recent years, is building generative models of source code. However, to our knowledge, previous generative models have always been framed in terms of generating static snapshots of code. In this work, we instead treat source code as a dynamic object and tackle the problem of modeling the edits that software developers make to source code files. This requires extracting intent from previous edits and leveraging it to generate subsequent edits. We develop several neural networks and use synthetic data to test their ability to learn challenging edit patterns that require strong generalization. We then collect and train our models on a large-scale dataset of Google source code, consisting of millions of fine-grained edits from thousands of Python developers. From the modeling perspective, our main conclusion is that a new composition of attentional and pointer network components provides the best overall performance and scalability. From the application perspective, our results provide preliminary evidence of the feasibility of developing tools that learn to predict future edits.


title: Tau decays and dark-sector searches at BaBar

abstract: We present some recent measurements performed using 514 fb-1 of $e^+e^-$ collisions collected with the BaBar detector at the PEP-II asymmetric collider at SLAC. First we present a study of the decay tau -> K K_S nu, we measure the branching fraction B(tau -> K K_S nu), the mass spectrum of the K K_S system and obtain the spectral function. Our results are in agreement with and improve previous measurements. We then report a search for a dark boson A' produced in the reaction e+e- -> gamma A' in invisible final states A' -> chi anti-chi . We find no evidence for such processes and set 90% confidence level upper limits on the coupling strength of A' as a function of the A' mass m'. In particular, our limits exclude the values of the A' coupling suggested by the dark-photon interpretation of the muon (g-2) anomaly. Finally we report the search for a light non-Standard Model gauge boson A' coupling only to the second and third lepton families. Our results significantly improve current limits and further constrain the remaining region of the allowed parameter space.


title: A Critical Evaluation of Recent Claims Concerning Solar Rotation

abstract: Fossat et al. (2017) recently reported detecting rotational splitting of g modes indirectly via the interaction with p modes observed directly by the GOLF instrument on SOHO. They concluded that the core of the Sun is rotating 3:8 ? 0:1 times faster than the surrounding radiative envelope. This is startling, partly because such rapid rotation almost contradicts direct inferences from the p-mode rotational splitting inferred from the same data. Moreover, the inferred amplitudes of the g modes appear to exceed the upper bound reported by Appourchaux et al. (2010). It is also suspect because the theory of the procedure implies that the principal modes claimed to have been measured should be undetectable. We point out that there are other interpretations: one leads to a core rotation about twice faster than the surrounding envelope; another, to a core rotating more slowly than the envelope. Here we also report on an independent assessment of the Fossat et al. analysis by applying their procedure to different representations of the GOLF data, expanding on Schunker et al. (2018). We also analyze seismic data obtained from LOI and MDI (both also on SOHO), from HMI (on SDO) and from the ground-based BiSON and GONG, and found the evidence reported by Fossat et al. not to be robust. We also illustrate that merely fitting model spectra to observations, which Fossat et al. do to support their g-mode detections and as Fossat & Schmider (2018) do for extracting additional g-mode splittings, is not necessarily reliable. We are therefore led to doubt the claim.


title: The impact of pair-instability mass loss on the binary black hole mass distribution

abstract: A population of binary black hole mergers has now been observed in gravitational waves by Advanced LIGO and Virgo. The masses of these black holes appear to show evidence for a pile-up between $30$--$45$ $M_\odot$ and a cut-off above $\sim 45$ $M_\odot$. One possible explanation for such a pile-up and subsequent cut-off are pulsational pair-instability supernovae (PPISNe) and pair-instability supernovae (PISNe) in massive stars. We investigate the plausibility of this explanation in the context of isolated massive binaries. We study a population of massive binaries using the rapid population synthesis software COMPAS, incorporating models for PPISNe and PISNe. Our models predict a maximum black hole mass of $40$ $M_\odot$. We expect $\sim 10$\% of all binary black hole mergers at redshift z = 0 will include at least one component that went through a PPISN (with mass $30$--$40$ $M_\odot$), constituting $\sim 20$--$50$\% of binary black hole mergers observed during the first two observing runs of Advanced LIGO and Virgo. Empirical models based on fitting the gravitational-wave mass measurements to a combination of a power law and a Gaussian find a fraction too large to be associated with PPISNe in our models. The rates of PPISNe and PISNe track the low metallicity star formation rate, increasing out to redshift $z = 2$. These predictions may be tested both with future gravitational-wave observations and with observations of superluminous supernovae.


title: Asymptotics with a positive cosmological constant: IV. The `no-incoming radiation' condition

abstract: Consider compact objects --such as neutron star or black hole binaries-- in \emph{full, non-linear} general relativity. In the case with zero cosmological constant $\Lambda$, the gravitational radiation emitted by such systems is described by the well established, 50+ year old framework due to Bondi, Sachs, Penrose and others. However, so far we do not have a satisfactory extension of this framework to include a \emph{positive} cosmological constant --or, more generally, the dark energy responsible for the accelerated expansion of the universe. In particular, we do not yet have an adequate gauge invariant characterization of gravitational waves in this context. As the next step in extending the Bondi et al framework to the $\Lambda >0$ case, in this paper we address the following questions: How do we impose the `no incoming radiation' condition for such isolated systems in a gauge invariant manner? What is the relevant past boundary where these conditions should be imposed, i.e., what is the \emph{physically relevant} analog of past null infinity $\mathcal{I}^{-}_{0}$ used in the $\Lambda=0$ case? What is the symmetry group at this boundary? How is it related to the Bondi-Metzner-Sachs (BMS) group? What are the associated conserved charges? What happens in the $\Lambda \to 0$ limit? Do we systematically recover the Bondi-Sachs-Penrose structure at $\mathcal{I}^{-}_{0}$ of the $\Lambda=0$ theory, or do some differences persist even in the limit? We will find that while there are many close similarities, there are also some subtle but important differences from the asymptotically flat case. Interestingly, to analyze these issues one has to combine conceptual structures and mathematical techniques introduced by Bondi et al with those associated with \emph{quasi-local horizons}.


title: Regularizing Activation Distribution for Training Binarized Deep Networks

abstract: Binarized Neural Networks (BNNs) can significantly reduce the inference latency and energy consumption in resource-constrained devices due to their pure-logical computation and fewer memory accesses. However, training BNNs is difficult since the activation flow encounters degeneration, saturation, and gradient mismatch problems. Prior work alleviates these issues by increasing activation bits and adding floating-point scaling factors, thereby sacrificing BNN's energy efficiency. In this paper, we propose to use distribution loss to explicitly regularize the activation flow, and develop a framework to systematically formulate the loss. Our experiments show that the distribution loss can consistently improve the accuracy of BNNs without losing their energy benefits. Moreover, equipped with the proposed regularization, BNN training is shown to be robust to the selection of hyper-parameters including optimizer and learning rate.


title: Taming the Knight's Tour: Minimizing Turns and Crossings

abstract: We introduce two new metrics of "simplicity" for knight's tours: the number of turns and the number of crossings. We give a novel algorithm that produces tours with $9.25n+O(1)$ turns and $12n+O(1)$ crossings on an $n\times n$ board, and we show lower bounds of $(6-\epsilon)n$ and $4n-O(1)$ on the respective problems of minimizing these metrics. Hence, our algorithm achieves approximation ratios of $9.25/6+o(1)$ and $3+o(1)$. Our algorithm takes linear time and is fully parallelizable, i.e., the tour can be computed in $O(n^2/p)$ time using $p$ processors in the CREW PRAM model. We generalize our techniques to rectangular boards, high-dimensional boards, symmetric tours, odd boards with a missing corner, and tours for $(1,4)$-leapers. In doing so, we show that these extensions also admit a constant approximation ratio on the minimum number of turns, and on the number of crossings in most cases.


title: Recent results of the technological prototypes of the CALICE highly granular calorimeters

abstract: The CALICE Collaboration is conducting R\&D for highly granular calorimeters with an emphasis on detectors for Linear Colliders. This contribution briefly summarises recent tests of large scale technological prototypes of a silicon tungsten electromagnetic calorimeter and hadron calorimeters featuring either a gaseous medium or scintillator with a SiPM readout as active material.


title: What can be estimated? Identifiability, estimability, causal inference and ill-posed inverse problems

abstract: We consider basic conceptual questions concerning the relationship between statistical estimation and causal inference. Firstly, we show how to translate causal inference problems into an abstract statistical formalism without requiring any structure beyond an arbitrarily-indexed family of probability models. The formalism is simple but can incorporate a variety of causal modelling frameworks, including 'structural causal models', but also models expressed in terms of, e.g., differential equations. We focus primarily on the structural/graphical causal modelling literature, however. Secondly, we consider the extent to which causal and statistical concerns can be cleanly separated, examining the fundamental question: 'What can be estimated from data?'. We call this the problem of estimability. We approach this by analysing a standard formal definition of 'can be estimated' commonly adopted in the causal inference literature -- identifiability -- in our abstract statistical formalism. We use elementary category theory to show that identifiability implies the existence of a Fisher-consistent estimator, but also show that this estimator may be discontinuous, and thus unstable, in general. This difficulty arises because the causal inference problem is, in general, an ill-posed inverse problem. Inverse problems have three conditions which must be satisfied to be considered well-posed: existence, uniqueness, and stability of solutions. Here identifiability corresponds to the question of uniqueness; in contrast, we take estimability to mean satisfaction of all three conditions, i.e. well-posedness. Lack of stability implies that naive translation of a causally identifiable quantity into an achievable statistical estimation target may prove impossible. Our article is primarily expository and aimed at unifying ideas from multiple fields, though we provide new constructions and proofs.


title: Geometry of B\"acklund Transformations II: Monge-Amp\`ere Invariants

abstract: This article is concerned with the question: For which pairs of hyperbolic Euler-Lagrange systems in the plane does there exist a rank-$1$ B\"acklund transformation relating them? We express some obstructions to such existence in terms of the local invariants of the Euler-Lagrange systems. In addition, we discover a class of B\"acklund transformations relating two hyperbolic Euler-Lagrange systems of distinct types.


title: Infrared uplink design for visible light communication (VLC) systems with beam steering

abstract: Providing uplink high data rate is one of the big concerns in visible light communication (VLC) systems. This paper introduces an uplink VLC system based on an infrared transmitter with beam steering to provide high data rates. In this work, a 4 branches angle diversity receiver (ADR) is used and the resultant delay spread and SNR are examined. The proposed system achieved data rates up to 3.57 Gb/s using simple on-off-keying (OOK).


title: Enumeration of Stack-Sorting Preimages via a Decomposition Lemma

abstract: We give three applications of a recently-proven "Decomposition Lemma," which allows one to count preimages of certain sets of permutations under West's stack-sorting map $s$. We first enumerate the permutation class $s^{-1}(\text{Av}(231,321))=\text{Av}(2341,3241,45231)$, finding a new example of an unbalanced Wilf equivalence. This result is equivalent to the enumeration of permutations sortable by ${\bf B}\circ s$, where ${\bf B}$ is the bubble sort map. We then prove that the sets $s^{-1}(\text{Av}(231,312))$, $s^{-1}(\text{Av}(132,231))=\text{Av}(2341,1342,\underline{32}41,\underline{31}42)$, and $s^{-1}(\text{Av}(132,312))=\text{Av}(1342,3142,3412,34\underline{21})$ are counted by the so-called "Boolean-Catalan numbers," settling a conjecture of the current author and another conjecture of Hossain. This completes the enumerations of all sets of the form $s^{-1}(\text{Av}(\tau^{(1)},\ldots,\tau^{(r)}))$ for $\{\tau^{(1)},\ldots,\tau^{(r)}\}\subseteq S_3$ with the exception of the set $\{321\}$. We also find an explicit formula for $|s^{-1}(\text{Av}_{n,k}(231,312,321))|$, where $\text{Av}_{n,k}(231,312,321)$ is the set of permutations in $\text{Av}_n(231,312,321)$ with $k$ descents. This allows us to prove a conjectured identity involving Catalan numbers and order ideals in Young's lattice.


title: An Evolutionary Framework for Automatic and Guided Discovery of Algorithms

abstract: This paper presents Automatic Algorithm Discoverer (AAD), an evolutionary framework for synthesizing programs of high complexity. To guide evolution, prior evolutionary algorithms have depended on fitness (objective) functions, which are challenging to design. To make evolutionary progress, instead, AAD employs Problem Guided Evolution (PGE), which requires introduction of a group of problems together. With PGE, solutions discovered for simpler problems are used to solve more complex problems in the same group. PGE also enables several new evolutionary strategies, and naturally yields to High-Performance Computing (HPC) techniques. We find that PGE and related evolutionary strategies enable AAD to discover algorithms of similar or higher complexity relative to the state-of-the-art. Specifically, AAD produces Python code for 29 array/vector problems ranging from min, max, reverse, to more challenging problems like sorting and matrix-vector multiplication. Additionally, we find that AAD shows adaptability to constrained environments/inputs and demonstrates outside-of-the-box problem solving abilities.


title: Non-equilibrium hydrodynamics of the quark-gluon plasma

abstract: My dissertation is about the formulation and application of anisotropic hydrodynamics as a successful non-equilibrium hydrodynamics model for studying the QGP. For this purpose, I introduce the basic conformal anisotropic hydrodynamics formalism and then explain the ways we included realistic features (bulk degree of freedom, quasiparticle implementation of realistic equation of state, more realistic collisional kernel), to make it a suitable hydrodynamics model for studying the QGP generated in heavy-ion collisions. For verification of our model we have compared the evolution of model parameters predicted by aHydro and vHydro, with exact solution of the Boltzmann equation. However, the system is not conformal and the aHydro needed to be improved to include a realistic prescription for the equation of state which takes care of non-ideal effect in the dynamics. I have then designed a novel method for implementing the realistic equation of state (provided by lattice QCD) in the aHydro formalism. This model, called the quasiparticle aHydro model, integrates the non-conformal effects in the aHydro model. The non-conformal effects are due to strong interactions of plasma constituents which leads to temperature-dependence of the particles' effective mass in the system. Based on the quasiparticle picture, we have developed the quasiparticle aHydro (aHydroQP) model. We have then compared the phenomenological predictions of the aHydroQP model with experimental observations. Comparisons illustrate a high level of consistency between our model and the experimental data. Finally, I have calculated the quark self-energy in an anisotropic QGP. The quark self-energy is important because it encodes the way quarks gain interactional mass while in the hot QGP. I also have presented the calculation of gluon self-energy in hard loop approximation in an anisotropic QGP.


title: A Regularization Approach for Instance-Based Superset Label Learning

abstract: Different from the traditional supervised learning in which each training example has only one explicit label, superset label learning (SLL) refers to the problem that a training example can be associated with a set of candidate labels, and only one of them is correct. Existing SLL methods are either regularization-based or instance-based, and the latter of which has achieved state-of-the-art performance. This is because the latest instance-based methods contain an explicit disambiguation operation that accurately picks up the groundtruth label of each training example from its ambiguous candidate labels. However, such disambiguation operation does not fully consider the mutually exclusive relationship among different candidate labels, so the disambiguated labels are usually generated in a nondiscriminative way, which is unfavorable for the instance-based methods to obtain satisfactory performance. To address this defect, we develop a novel regularization approach for instance-based superset label (RegISL) learning so that our instance-based method also inherits the good discriminative ability possessed by the regularization scheme. Specifically, we employ a graph to represent the training set, and require the examples that are adjacent on the graph to obtain similar labels. More importantly, a discrimination term is proposed to enlarge the gap of values between possible labels and unlikely labels for every training example. As a result, the intrinsic constraints among different candidate labels are deployed, and the disambiguated labels generated by RegISL are more discriminative and accurate than those output by existing instance-based algorithms. The experimental results on various tasks convincingly demonstrate the superiority of our RegISL to other typical SLL methods in terms of both training accuracy and test accuracy.


title: A Validated Physical Model For Real-Time Simulation of Soft Robotic Snakes

abstract: In this work we present a framework that is capable of accurately representing soft robotic actuators in a multiphysics environment in real-time. We propose a constraint-based dynamics model of a 1-dimensional pneumatic soft actuator that accounts for internal pressure forces, as well as the effect of actuator latency and damping under inflation and deflation and demonstrate its accuracy a full soft robotic snake with the composition of multiple 1D actuators. We verify our model's accuracy in static deformation and dynamic locomotion open-loop control experiments. To achieve real-time performance we leverage the parallel computation power of GPUs to allow interactive control and feedback.


title: Quantum phase diagram of Shiba impurities from bosonization

abstract: A characteristic feature of Shiba impurities is the existence of a spin- and parity-changing quantum phase transition (known as "0-$\pi$" transition) which has been observed in scanning tunneling microscopy (STM) and transport experiments. Using the Abelian bosonization technique, here we analyze the ground-state properties and the quantum phase diagram of a classical (i.e., Ising-like) Shiba impurity. In particular, we analyze the cases of an impurity in a three- and a one-dimensional superconductor. Within the bosonization framework, the ground-state properties are determined by simple soliton-like solutions of the classical equations of motion of the bosonic fields, whose topological charge is related to the spin and parity quantum numbers. Our results indicate that the quantum phase diagram of the superconductor can be strongly affected by geometrical and dimensional effects. Exploiting this fact, in the one-dimensional case we propose an experimental superconducting nanodevice in which a novel parity-preserving, spin-changing "0-0" transition is predicted.


title: FLightNNs: Lightweight Quantized Deep Neural Networks for Fast and Accurate Inference

abstract: To improve the throughput and energy efficiency of Deep Neural Networks (DNNs) on customized hardware, lightweight neural networks constrain the weights of DNNs to be a limited combination (denoted as $k\in\{1,2\}$) of powers of 2. In such networks, the multiply-accumulate operation can be replaced with a single shift operation, or two shifts and an add operation. To provide even more design flexibility, the $k$ for each convolutional filter can be optimally chosen instead of being fixed for every filter. In this paper, we formulate the selection of $k$ to be differentiable, and describe model training for determining $k$-based weights on a per-filter basis. Over 46 FPGA-design experiments involving eight configurations and four data sets reveal that lightweight neural networks with a flexible $k$ value (dubbed FLightNNs) fully utilize the hardware resources on Field Programmable Gate Arrays (FPGAs), our experimental results show that FLightNNs can achieve 2$\times$ speedup when compared to lightweight NNs with $k=2$, with only 0.1\% accuracy degradation. Compared to a 4-bit fixed-point quantization, FLightNNs achieve higher accuracy and up to 2$\times$ inference speedup, due to their lightweight shift operations. In addition, our experiments also demonstrate that FLightNNs can achieve higher computational energy efficiency for ASIC implementation.


title: A Machine Learning Based Classification Approach for Power Quality Disturbances Exploiting Higher Order Statistics in the EMD Domain

abstract: The aim of this paper is to propose a new approach for the pattern recognition of power quality (PQ) disturbances based on Empirical mode decomposition (EMD) and $k$ Nearest Neighbor ($k$-NN) classifier. Since EMD decomposes a signal into intrinsic mode functions (IMF) in time-domain with same length of the original signal, it preserves the information that is hidden in Fourier domain or in wavelet coefficients. In this proposed method, power signals are decomposed into IMFs in EMD domain. Due to the presence of non-linearity and noise on the original signal, it is hard to analyze them by second order statistics. Thus, an effective feature set is developed considering higher order statistics (HOS) like variance, skewness, and kurtosis from the decomposed first three IMFs. This feature vector is fed into different classifiers like $k$-NN, probabilistic neural network (PNN), and radial basis function (RBF). Among all the classifiers, $k$-NN showed higher classification accuracy and robustness both in training and testing to detect the PQ disturbance events. Simulation results evaluated that the proposed HOS-EMD based method along with $k$-NN classifier outperformed in terms of classification accuracy and computational efficiency in comparison to the other state-of-art methods both in clean and noisy environment.


title: Interference management and capacity analysis for mm-wave picocells in urban canyons

abstract: Millimeter (mm) wave picocellular networks are a promising approach for delivering the 1000-fold capacity increase required to keep up with projected demand for wireless data: the available bandwidth is orders of magnitude larger than that in existing cellular systems, and the small carrier wavelength enables the realization of highly directive antenna arrays in compact form factor, thus drastically increasing spatial reuse. In this paper, we carry out an interference analysis for mm-wave picocells in an urban canyon with a dense deployment of base stations. Each base station sector can serve multiple simultaneous users, which implies that both intra- and inter-cell interference must be managed. We propose a \textit{cross-layer} approach to interference management based on (i) suppressing interference at the physical layer and (ii) managing the residual interference at the medium access control layer. We provide an estimate of network capacity and establish that 1000-fold increase relative to conventional LTE cellular networks is indeed feasible.


title: Transfer Learning for Performance Modeling of Deep Neural Network Systems

abstract: Modern deep neural network (DNN) systems are highly configurable with large a number of options that significantly affect their non-functional behavior, for example inference time and energy consumption. Performance models allow to understand and predict the effects of such configuration options on system behavior, but are costly to build because of large configuration spaces. Performance models from one environment cannot be transferred directly to another; usually models are rebuilt from scratch for different environments, for example different hardware. Recently, transfer learning methods have been applied to reuse knowledge from performance models trained in one environment in another. In this paper, we perform an empirical study to understand the effectiveness of different transfer learning strategies for building performance models of DNN systems. Our results show that transferring information on the most influential configuration options and their interactions is an effective way of reducing the cost to build performance models in new environments.


title: Combining Sentiment Lexica with a Multi-View Variational Autoencoder

abstract: When assigning quantitative labels to a dataset, different methodologies may rely on different scales. In particular, when assigning polarities to words in a sentiment lexicon, annotators may use binary, categorical, or continuous labels. Naturally, it is of interest to unify these labels from disparate scales to both achieve maximal coverage over words and to create a single, more robust sentiment lexicon while retaining scale coherence. We introduce a generative model of sentiment lexica to combine disparate scales into a common latent representation. We realize this model with a novel multi-view variational autoencoder (VAE), called SentiVAE. We evaluate our approach via a downstream text classification task involving nine English-Language sentiment analysis datasets; our representation outperforms six individual sentiment lexica, as well as a straightforward combination thereof.


title: Physics problems and instructional strategies for developing social networks in university classrooms

abstract: In this study, we explored the extent to which problems and instructional strategies affect social cohesion and interactions for information seeking in physics classrooms. Three sections of a mechanics physics course taught at a Chilean University in Coquimbo were investigated. Each section had a weekly problem-solving session using different sets of well and/or ill-structured problems (i.e., algebra-based and open-ended problems respectively), as well as instructional strategies for guiding the problem-solving sessions. Data was collected on networks of information seeking and perceptions of good physics students, during a problem-solving session. We used social network analysis (SNA) for constructing variables while conducting the study. Results suggest that the teaching and learning strategies to guide problem-solving of well and ill-structured problems yield different levels of social interaction among classmates, and significant levels of activity in seeking out information for learning and problem-solving. While strategies for guiding problem-solving lend to significant differences for network connectivity, well and ill-structured physics problems predict similar levels of social activity.


title: Minimum Uncertainty Based Detection of Adversaries in Deep Neural Networks

abstract: Despite their unprecedented performance in various domains, utilization of Deep Neural Networks (DNNs) in safety-critical environments is severely limited in the presence of even small adversarial perturbations. The present work develops a randomized approach to detecting such perturbations based on minimum uncertainty metrics that rely on sampling at the hidden layers during the DNN inference stage. Inspired by Bayesian approaches to uncertainty estimation, the sampling probabilities are designed for effective detection of the adversarially corrupted inputs. Being modular, the novel detector of adversaries can be conveniently employed by any pre-trained DNN at no extra training overhead. Selecting which units to sample per hidden layer entails quantifying the amount of DNN output uncertainty, where the overall uncertainty is expressed in terms of its layer-wise components - what also promotes scalability. Sampling probabilities are then sought by minimizing uncertainty measures layer-by-layer, leading to a novel convex optimization problem that admits an exact solver with superlinear convergence rate. By simplifying the objective function, low-complexity approximate solvers are also developed. In addition to valuable insights, these approximations link the novel approach with state-of-the-art randomized adversarial detectors. The effectiveness of the novel detectors in the context of competing alternatives is highlighted through extensive tests for various types of adversarial attacks with variable levels of strength.


title: Kostant-Toda lattices and the universal centralizer

abstract: To each complex semisimple Lie algebra $\mathfrak{g}$ decorated with appropriate data, one may associate two completely integrable systems. One is the well-studied Kostant-Toda lattice, while the second is an integrable system defined on the universal centralizer $\mathcal{Z}_{\mathfrak{g}}$ of $\mathfrak{g}$. These systems are similar in that each exploits and closely reflects the invariant theory of $\mathfrak{g}$, as developed by Chevalley, Kostant, and others. One also has Kostant's description of level sets in the Kostant-Toda lattice, which turns out to suggest deeper similarities between the two integrable systems in question. We study relationships between the two aforementioned integrable systems, partly to understand and contextualize the similarities mentioned above. Our main result is a canonical open embedding of a flow-invariant open dense subset of the Kostant-Toda lattice into $\mathcal{Z}_{\mathfrak{g}}$. Secondary results include some qualitative features of the integrable system on $\mathcal{Z}_{\mathfrak{g}}$.


title: Deep Learning-based Universal Beamformer for Ultrasound Imaging

abstract: In ultrasound (US) imaging, individual channel RF measurements are back-propagated and accumulated to form an image after applying specific delays. While this time reversal is usually implemented using a hardware- or software-based delay-and-sum (DAS) beamformer, the performance of DAS decreases rapidly in situations where data acquisition is not ideal. Herein, for the first time, we demonstrate that a single data-driven adaptive beamformer designed as a deep neural network can generate high quality images robustly for various detector channel configurations and subsampling rates. The proposed deep beamformer is evaluated for two distinct acquisition schemes: focused ultrasound imaging and planewave imaging. Experimental results showed that the proposed deep beamformer exhibit significant performance gain for both focused and planar imaging schemes, in terms of contrast-to-noise ratio and structural similarity.


title: Application of gradient descent algorithms based on geodesic distances

abstract: In this paper, the Riemannian gradient algorithm and the natural gradient algorithm are applied to solve descent direction problems on the manifold of positive definite Hermitian matrices, where the geodesic distance is considered as the cost function. The first proposed problem is control for positive definite Hermitian matrix systems whose outputs only depend on their inputs. The geodesic distance is adopted as the difference of the output matrix and the target matrix. The controller to adjust the input is obtained such that the output matrix is as close as possible to the target matrix. We show the trajectory of the control input on the manifold using the Riemannian gradient algorithm. The second application is to compute the Karcher mean of a finite set of given Toeplitz positive definite Hermitian matrices, which is defined as the minimizer of the sum of geodesic distances. To obtain more efficient iterative algorithm compared with traditional ones, a natural gradient algorithm is proposed to compute the Karcher mean. Illustrative simulations are provided to show the computational behavior of the proposed algorithms.


title: Helicoidal excitonic phase in an electron-hole double layer system

abstract: We propose helicoidal excitonic phase in a Coulomb-coupled two-dimensional electron-hole double layer (EHDL) system with relativistic spin-orbit interaction. Previously, it was demonstrated that layered InAs/AlSb/GaInSb heterostructure is an ideal experimental platform for searching excitonic condensate phases, while its electron layer has non-negligible Rashba interaction. We clarify that due to the Rashba term, the spin-triplet (spin-1) exciton field in the EHDL system forms a helicoidal structure and the helicoid plane can be controlled by an in-plane Zeeman field. We show that due to small but finite Dirac term in the heavy hole layer the helicoidal structure of the excitonic field under the in-plane field results in a helicoidal {\it magnetic} order in the electron layer. Based on linearization analyses, we further calculate momentum-energy dispersions of low-energy Goldstone modes in the helicoidal excitonic phase. We discuss possible experimental probes of the excitonic phase in the EHDL system.


title: A Bayesian-Based Approach for Public Sentiment Modeling

abstract: Public sentiment is a direct public-centric indicator for the success of effective action planning. Despite its importance, systematic modeling of public sentiment remains untapped in previous studies. This research aims to develop a Bayesian-based approach for quantitative public sentiment modeling, which is capable of incorporating uncertainty and guiding the selection of public sentiment measures. This study comprises three steps: (1) quantifying prior sentiment information and new sentiment observations with Dirichlet distribution and multinomial distribution respectively; (2) deriving the posterior distribution of sentiment probabilities through incorporating the Dirichlet distribution and multinomial distribution via Bayesian inference; and (3) measuring public sentiment through aggregating sampled sets of sentiment probabilities with an application-based measure. A case study on Hurricane Harvey is provided to demonstrate the feasibility and applicability of the proposed approach. The developed approach also has the potential to be generalized to model various types of probability-based measures.


title: GaAs valley photonic crystal waveguide with light-emitting InAs quantum dots

abstract: We report a valley photonic crystal (VPhC) waveguide in a GaAs slab with InAs quantum dots (QDs) as an internal light source exploited for experimental characterization of the waveguide. A topological interface state formed at the interface between two topologically-distinct VPhCs is used as the waveguide mode. We demonstrate robust propagation for near-infrared light emitted from the QDs even under the presence of sharp bends as a consequence of the topological protection of the guided mode. Our work will be of importance for developing robust photonic integrated circuits with small footprints, as well as for exploring active semiconductor topological photonics.


title: Simultaneous inverse design of materials and parameters of core-shell nanoparticle via deep-learning: Demonstration of dipole resonance engineering

abstract: Recent introduction of data-driven approaches based on deep-learning technology has revolutionized the field of nanophotonics by allowing efficient inverse design methods. In this paper, simultaneous inverse design of materials and structure parameters of core-shell nanoparticle is achieved for the first time using deep-learning of a neural network. A neural network to learn correlation between extinction spectra of electric and magnetic dipoles and core-shell nanoparticle designs, which include material information and shell thicknesses, is developed and trained. We demonstrate deep-learning-assisted inverse design of core-shell nanoparticle for 1) spectral tuning electric dipole resonances, 2) finding spectrally isolated pure magnetic dipole resonances, and 3) finding spectrally overlapped electric dipole and magnetic dipole resonances. Our finding paves the way of the rapid development of nanophotonics by allowing a practical utilization of a deep-learning technology for nanophotonic inverse design.


title: THz Superradiance from a GaAs: ErAs Quantum Dot Array at Room Temperature

abstract: We report experimental evidence that an ErAs quantum-dot array in a GaAs matrix under 1550 nm pulsed excitation produces cooperative spontaneous emission-Dicke superradiance-in the terahertz frequency region at room temperature.


title: Hard particle spectra of galactic X-ray sources by relativistic magnetic reconnection in laser lab

abstract: Magnetic reconnection is a process whereby magnetic field lines in different directions "reconnect" with each other, resulting in the rearrangement of magnetic field topology together with the conversion of magnetic field energy into the kinetic energy (K.E.) of energetic particles. This process occurs in magnetized astronomical plasmas, such as those in the solar corona, Earth's magnetosphere, and active galactic nuclei, and accounts for various phenomena, such as solar flares, energetic particle acceleration, and powering of photon emission. In the present study, we report the experimental demonstration of magnetic reconnection under relativistic electron magnetization situation, along with the observation of power-law distributed outflow in both electron and proton energy spectra. Through irradiation of an intense laser on a "micro-coil", relativistically magnetized plasma was produced and magnetic reconnection was performed with maximum magnetic field 3 kT. In the downstream outflow direction, the non-thermal component is observed in the high-energy part of both electron and proton spectra, with a significantly harder power-law slope of the electron spectrum (p = 1.535 +/- 0.015) that is similar to the electron injection model proposed to explain a hard emission tail of Cygnus X-1, a galactic X-ray source with the same order of magnetization. The obtained result showed experimentally that the magnetization condition in the emitting region of a galactic X-ray source is sufficient to build a hard electron population through magnetic reconnection.


title: Planning under non-rational perception of uncertain spatial costs

abstract: This work investigates the design of risk-perception-aware motion-planning strategies that incorporate non-rational perception of risks associated with uncertain spatial costs. Our proposed method employs the Cumulative Prospect Theory (CPT) to generate a perceived risk map over a given environment. CPT-like perceived risks and path-length metrics are then combined to define a cost function that is compliant with the requirements of asymptotic optimality of sampling-based motion planners (RRT*). The modeling power of CPT is illustrated in theory and in simulation, along with a comparison to other risk perception models like Conditional Value at Risk (CVaR). Theoretically, we define a notion of expressiveness for a risk perception model and show that CPT's is higher than that of CVaR and expected risk. We then show that this expressiveness translates to our path planning setting, where we observe that a planner equipped with CPT together with a simultaneous perturbation stochastic approximation (SPSA) method can better approximate arbitrary paths in an environment. Additionally, we show in simulation that our planner captures a rich set of meaningful paths, representative of different risk perceptions in a custom environment. We then compare the performance of our planner with T-RRT* (a planner for continuous cost spaces) and Risk-RRT* (a risk-aware planner for dynamic human obstacles) through simulations in cluttered and dynamic environments respectively, showing the advantage of our proposed planner.


title: Modelling of Sound Events with Hidden Imbalances Based on Clustering and Separate Sub-Dictionary Learning

abstract: This paper proposes an effective modelling of sound event spectra with a hidden data-size-imbalance, for improved Acoustic Event Detection (AED). The proposed method models each event as an aggregated representation of a few latent factors, while conventional approaches try to find acoustic elements directly from the event spectra. In the method, all the latent factors across all events are assigned comparable importance and complexity to overcome the hidden imbalance of data-sizes in event spectra. To extract latent factors in each event, the proposed method employs clustering and performs non-negative matrix factorization to each latent factor, and learns its acoustic elements as a sub-dictionary. Separate sub-dictionary learning effectively models the acoustic elements with limited data-sizes and avoids over-fitting due to hidden imbalances in training data. For the task of polyphonic sound event detection from DCASE 2013 challenge, an AED based on the proposed modelling achieves a detection F-measure of 46.5%, a significant improvement of more than 19% as compared to the existing state-of-the-art methods.


title: A family of integrable and non-integrable difference equations arising from cluster algebras

abstract: The one-parameter family of second order nonlinear difference equations each of which is given by $$ x_{n-1}x_nx_{n+1}=x_{n-1}+(x_n)^{\beta-1}+x_{n+1} \qquad(\beta\in\mathbb{N}) $$ is explored. Since the equation above is arising from seed mutations of a rank 2 cluster algebra, its solution is periodic only when $\beta\leq3$. In order to evaluate the dynamics with $\beta\geq4$, algebraic entropy of the birational map equivalent to the difference equation is investigated; it vanishes when $\beta=4$ but is positive when $\beta\geq5$. This fact suggests that the difference equation with $\beta\leq4$ is integrable but that with $\beta\geq5$ is not. It is moreover shown that the difference equation with $\beta\geq4$ fails the singularity confinement test. This fact is consistent with linearizability of the equation with $\beta=4$ and reinforces non-integrability of the equation with $\beta\geq5$.


title: Contracting asymptotics of the linearized lapse-scalar field sub-system of the Einstein-scalar field equations

abstract: We prove an asymptotic stability result for a linear coupled hyperbolic-elliptic system on a large class of singular background spacetimes in CMC gauge on the n-torus. At each spatial point these background spacetimes are perturbations of Kasner-like solutions of the Einstein-scalar field equations which are not required to be close to the homogeneous and isotropic case. We establish the existence of a homeomorphism between Cauchy data for this system and a set of functions naturally associated with the asymptotics in the contracting direction, which we refer to as asymptotic data. This yields a complete characterization of the degrees of freedom of all solutions of this system in terms of their asymptotics. Spatial derivative terms can in general not be fully neglected which yields a clarification of the notion of asymptotic velocity term dominance (AVTD).


title: Probabilistic Recalibration of Forecasts

abstract: We present a scheme by which a probabilistic forecasting system whose predictions have poor probabilistic calibration may be recalibrated by incorporating past performance information to produce a new forecasting system that is demonstrably superior to the original, in that one may use it to consistently win wagers against someone using the original system. The scheme utilizes Gaussian process (GP) modeling to estimate a probability distribution over the Probability Integral Transform (PIT) of a scalar predictand. The GP density estimate gives closed-form access to information entropy measures associated with the estimated distribution, which allows prediction of winnings in wagers against the base forecasting system. A separate consequence of the procedure is that the recalibrated forecast has a uniform expected PIT distribution. A distinguishing feature of the procedure is that it is appropriate even if the PIT values are not i.i.d. The recalibration scheme is formulated in a framework that exploits the deep connections between information theory, forecasting, and betting. We demonstrate the effectiveness of the scheme in two case studies: a laboratory experiment with a nonlinear circuit and seasonal forecasts of the intensity of the El Ni\~no-Southern Oscillation phenomenon.


title: Graph Pattern Entity Ranking Model for Knowledge Graph Completion

abstract: Knowledge graphs have evolved rapidly in recent years and their usefulness has been demonstrated in many artificial intelligence tasks. However, knowledge graphs often have lots of missing facts. To solve this problem, many knowledge graph embedding models have been developed to populate knowledge graphs and these have shown outstanding performance. However, knowledge graph embedding models are so-called black boxes, and the user does not know how the information in a knowledge graph is processed and the models can be difficult to interpret. In this paper, we utilize graph patterns in a knowledge graph to overcome such problems. Our proposed model, the {\it graph pattern entity ranking model} (GRank), constructs an entity ranking system for each graph pattern and evaluates them using a ranking measure. By doing so, we can find graph patterns which are useful for predicting facts. Then, we perform link prediction tasks on standard datasets to evaluate our GRank method. We show that our approach outperforms other state-of-the-art approaches such as ComplEx and TorusE for standard metrics such as HITS@{\it n} and MRR. Moreover, our model is easily interpretable because the output facts are described by graph patterns.


title: Complementary Vibrational Spectroscopy

abstract: Vibrational spectroscopy, comprised of infrared absorption and Raman scattering spectroscopy, is widely used for label-free optical sensing and imaging in various scientific and industrial fields. The group theory states that the two molecular spectroscopy methods are sensitive to vibrations categorized in different point groups and provide complementary vibrational spectra. Therefore, complete vibrational information cannot be acquired by a single spectroscopic device, which has impeded the full potential of vibrational spectroscopy. Here, we demonstrate simultaneous infrared absorption and Raman scattering spectroscopy that allows us to measure the complete broadband vibrational spectra in the molecular fingerprint region with a single instrument based on an ultrashort pulsed laser. The system is based on dual-modal Fourier-transform spectroscopy enabled by efficient use of nonlinear optical effects. Our proof-of-concept experiment demonstrates rapid, broadband and high spectral resolution measurements of complementary spectra of organic liquids for precise and accurate molecular analysis.


title: A Neurorobotics Approach to Investigating the Emergence of Communication in Robots

abstract: This paper introduces our approach to building a robot with communication capability based on the two key features: stochastic neural dynamics and prediction error minimization (PEM). A preliminary experiment with humanoid robots showed that the robot was able to imitate other's action by means of those key features. In addition, we found that some sorts of communicative patterns emerged between two robots in which the robots inferred the intention of another agent behind the sensory observation.


title: Entanglement dynamics between two-level atoms surrounding a microtoroidal cavity and influences of initial states

abstract: We theoretically investigate how the initial state influence the entanglement dynamics between two and three two-level atoms with dipole-dipole interaction (DDI) coupled to a whispering-gallery-mode (WGM) microtoroidal cavity. Two different cases, where the two atoms are coupled symmetrically or asymmetrically to the two WGMs through evanescent fields, are discussed in detail. Considering two types of initial states between the atoms and the symmetric regime, we show that for the initial entangled state, the sudden death and birth, as well as the freezing of the entanglement, can be obtained by adjusting both the scattering strength between the modes and the DDI, differently from the initial product state. Moreover, we note that the atomic entanglement generation is more susceptible to the scattering strength variation between the modes than to the DDI. In addition, for the asymmetric regime, the entanglement generation is strongly dependent on the atomic location and the scattering strength. Similar results are obtained for the case of three atoms coupled to a microtoroidal cavity, even in the presence of losses.


title: Deep Tree Learning for Zero-shot Face Anti-Spoofing

abstract: Face anti-spoofing is designed to keep face recognition systems from recognizing fake faces as the genuine users. While advanced face anti-spoofing methods are developed, new types of spoof attacks are also being created and becoming a threat to all existing systems. We define the detection of unknown spoof attacks as Zero-Shot Face Anti-spoofing (ZSFA). Previous works of ZSFA only study 1-2 types of spoof attacks, such as print/replay attacks, which limits the insight of this problem. In this work, we expand the ZSFA problem to a wide range of 13 types of spoof attacks, including print attack, replay attack, 3D mask attacks, and so on. A novel Deep Tree Network (DTN) is proposed to tackle the ZSFA. The tree is learned to partition the spoof samples into semantic sub-groups in an unsupervised fashion. When a data sample arrives, being know or unknown attacks, DTN routes it to the most similar spoof cluster, and make the binary decision. In addition, to enable the study of ZSFA, we introduce the first face anti-spoofing database that contains diverse types of spoof attacks. Experiments show that our proposed method achieves the state of the art on multiple testing protocols of ZSFA.


title: Achieving Optimal Backlog in Multi-Processor Cup Games

abstract: The single- and multi- processor cup games can be used to model natural problems in areas such as processor scheduling, deamortization, and buffer management. At the beginning of the single-processor cup game, $n$ cups are initially empty. In each step of the game, a filler distributes $1$ unit of water among the cups, and then an emptier selects a cup and removes $1 + \epsilon$ units from that cup. The goal of the emptier is to minimize the amount of water in the fullest cup, also known as the backlog. It is known that the greedy algorithm (i.e., empty the fullest cup) achieves backlog $O(\log n)$, and that no deterministic algorithm can do better. We show that the performance of the greedy algorithm can be greatly improved with a small amount of randomization: After any step $i$, and for any $k \ge \Omega(\log \epsilon^{-1})$, the emptier achieves backlog at most $O(k)$ with probability at least $1 -O(2^{-2^k})$. Whereas bounds for the single-processor cup game have been known for more than fifteen years, proving nontrivial bounds on backlog for the multi-processor extension has remained open. We present a simple analysis of the greedy algorithm for the multi-processor cup game, establishing a backlog of $O(\epsilon^{-1} \log n)$, as long as $\delta$, the game's other speed-augmentation constant, is at least $1/poly(n)$. Turning to randomized algorithms, we encounter an unexpected phenomenon: When the number of processors $p$ is large, the backlog after each step drops to \emph{constant} with large probability. Specifically, we show that if $\delta$ and $\epsilon$ satisfy reasonable constraints, then there exists an algorithm that bounds the backlog after a given step by three or less with probability at least $1 - O(\exp(-\Omega(\epsilon^2 p))$. We further extend the guarantees of our randomized algorithm to consider larger backlogs.


title: Online Alternating Direction Method of Multipliers for Online Composite Optimization

abstract: In this paper, we investigate regrets of an online semi-proximal alternating direction method of multiplier (Online-spADMM) for solving online linearly constrained convex composite optimization problems. Under mild conditions, we establish ${\rm O}(\sqrt{N})$ objective regret and ${\rm O}(\sqrt{N})$ constraint violation regret at round $N$ when the dual step-length is taken in $(0,(1 +\sqrt{5})/2)$ and penalty parameter $\sigma$ is taken as $\sqrt{N}$. We explain that the optimal value of parameter $\sigma$ is of order ${\rm O}(\sqrt{N})$. Like the semi-proximal alternating direction method of multiplier (spADMM), Online-spADMM has the advantage to resolve the potentially non-solvability issue of the subproblems efficiently. We show the usefulness of the obtained results when applied to different types of online optimization problems and verify the theoretical result by numerical experiments}. The inequalities established for Online-spADMM are also used to develop iteration complexity of the average update of spADMM for solving linearly constrained convex composite optimization problems.


title: Parallelized Inference for Gravitational-Wave Astronomy

abstract: Bayesian inference is the workhorse of gravitational-wave astronomy, for example, determining the mass and spins of merging black holes, revealing the neutron star equation of state, and unveiling the population properties of compact binaries. The science enabled by these inferences comes with a computational cost that can limit the questions we are able to answer. This cost is expected to grow. As detectors improve, the detection rate will go up, allowing less time to analyze each event. Improvement in low-frequency sensitivity will yield longer signals, increasing the number of computations per event. The growing number of entries in the transient catalog will drive up the cost of population studies. While Bayesian inference calculations are not entirely parallelizable, key components are embarrassingly parallel: calculating the gravitational waveform and evaluating the likelihood function. Graphical processor units (GPUs) are adept at such parallel calculations. We report on progress porting gravitational-wave inference calculations to GPUs. Using a single code - which takes advantage of GPU architecture if it is available - we compare computation times using modern GPUs (NVIDIA P100) and CPUs (Intel Gold 6140). We demonstrate speed-ups of $\sim 50 \times$ for compact binary coalescence gravitational waveform generation and likelihood evaluation and more than $100\times$ for population inference within the lifetime of current detectors. Further improvement is likely with continued development. Our python-based code is publicly available and can be used without familiarity with the parallel computing platform, CUDA.


title: A note on the sensitivity of semiows

abstract: In this note, it is shown that there exist two non-syndetically sensitive cascades defined on complete metric spaces whose product is syndetically sensitive, answering negatively the Question 9.2 posed in [12, Miller, A., Money, C., Turk. J. Math., 41 (2017): 1323{1336]. Moreover, it is shown that there exists a syndetically sensitive semiflow (G;X) defined on a complete metric space X such that (G1;X) is not sensitive for some syndetic closed submonoid G1 of G, answering negatively the Open question 3 posed in [13, Money, C., PhD thesis, University of Louisville, 2015] and Question 43 posed in [8, Miller, A., Real Anal. Exchange, 42 (2017): 9{24].


title: Actively Seeking and Learning from Live Data

abstract: One of the key limitations of traditional machine learning methods is their requirement for training data that exemplifies all the information to be learned. This is a particular problem for visual question answering methods, which may be asked questions about virtually anything. The approach we propose is a step toward overcoming this limitation by searching for the information required at test time. The resulting method dynamically utilizes data from an external source, such as a large set of questions/answers or images/captions. Concretely, we learn a set of base weights for a simple VQA model, that are specifically adapted to a given question with the information specifically retrieved for this question. The adaptation process leverages recent advances in gradient-based meta learning and contributions for efficient retrieval and cross-domain adaptation. We surpass the state-of-the-art on the VQA-CP v2 benchmark and demonstrate our approach to be intrinsically more robust to out-of-distribution test data. We demonstrate the use of external non-VQA data using the MS COCO captioning dataset to support the answering process. This approach opens a new avenue for open-domain VQA systems that interface with diverse sources of data.


title: The nature of the animacy organization in human ventral temporal cortex

abstract: The principles underlying the animacy organization of the ventral temporal cortex (VTC) remain hotly debated, with recent evidence pointing to an animacy continuum rather than a dichotomy. What drives this continuum? According to the visual categorization hypothesis, the continuum reflects the degree to which animals contain animal-diagnostic features. By contrast, the agency hypothesis posits that the continuum reflects the degree to which animals are perceived as (social) agents. Here, we tested both hypotheses with a stimulus set in which visual categorizability and agency were dissociated based on representations in convolutional neural networks and behavioral experiments. Using fMRI, we found that visual categorizability and agency explained independent components of the animacy continuum in VTC. Modeled together, they fully explained the animacy continuum. Finally, clusters explained by visual categorizability were localized posterior to clusters explained by agency. These results show that multiple organizing principles, including agency, underlie the animacy continuum in VTC.


title: Wavefunctions and Yukawa Couplings on Resolutions of $T^2/\mathbb{Z}_N$ Orbifolds

abstract: We propose matter wavefunctions on resolutions of $T^2/\mathbb{Z}_N$ singularities with constant magnetic fluxes. In the blow-down limit, the obtained wavefunctions of chiral zero-modes result in those on the magnetized $T^2/\mathbb{Z}_N$ orbifold models, but the wavefunctions of $\mathbb{Z}_N$-invariant zero-modes receive the blow-up effects around fixed points of $T^2/\mathbb{Z}_N$ orbifolds. Such blow-up effects change the selection rules and Yukawa couplings among the chiral zero-modes as well as the modular symmetry, in contrast to those on the magnetized $T^2/\mathbb{Z}_N$ orbifold models.


title: Data Shapley: Equitable Valuation of Data for Machine Learning

abstract: As data becomes the fuel driving technological and economic growth, a fundamental challenge is how to quantify the value of data in algorithmic predictions and decisions. For example, in healthcare and consumer markets, it has been suggested that individuals should be compensated for the data that they generate, but it is not clear what is an equitable valuation for individual data. In this work, we develop a principled framework to address data valuation in the context of supervised machine learning. Given a learning algorithm trained on $n$ data points to produce a predictor, we propose data Shapley as a metric to quantify the value of each training datum to the predictor performance. Data Shapley value uniquely satisfies several natural properties of equitable data valuation. We develop Monte Carlo and gradient-based methods to efficiently estimate data Shapley values in practical settings where complex learning algorithms, including neural networks, are trained on large datasets. In addition to being equitable, extensive experiments across biomedical, image and synthetic data demonstrate that data Shapley has several other benefits: 1) it is more powerful than the popular leave-one-out or leverage score in providing insight on what data is more valuable for a given learning task; 2) low Shapley value data effectively capture outliers and corruptions; 3) high Shapley value data inform what type of new data to acquire to improve the predictor.


title: Inferring source properties of monoenergetic electron precipitation from kappa and Maxwellian moment-voltage relationships

abstract: We present two case studies of FAST electrostatic analyzer measurements of both highly nonthermal ($\kappa \lesssim$~2.5) and weakly nonthermal/thermal monoenergetic electron precipitation at $\sim$4000~km, from which we infer the properties of the magnetospheric source distributions via comparison of experimentally determined number density--, current density--, and energy flux--voltage relationships with corresponding theoretical relationships. We also discuss the properties of the two new theoretical number density--voltage relationships that we employ. Moment uncertainties, which are calculated analytically via application of the \citet{Gershman2015} moment uncertainty framework, are used in Monte Carlo simulations to infer ranges of magnetospheric source population densities, temperatures, $\kappa$ values, and altitudes. We identify the most likely ranges of source parameters by requiring that the range of $\kappa$ values inferred from fitting experimental moment-voltage relationships correspond to the range of $\kappa$ values inferred from directly fitting observed electron distributions with two-dimensional kappa distribution functions. Observations in the first case study, which are made over $\sim$78--79$^\circ$ invariant latitude (ILAT) in the Northern Hemisphere and 4.5--5.5 magnetic local time (MLT), are consistent with a magnetospheric source population density $n_m =$~0.7--0.8~cm$^{-3}$, source temperature $T_m \approx$~70~eV, source altitude $h =$~6.4--7.7~$R_E$, and $\kappa =$~2.2--2.8. Observations in the second case study, which are made over 76--79$^\circ$~ILAT in the Southern Hemisphere and $\sim$21~MLT, are consistent with a magnetospheric source population density $n_m =$~0.07--0.09~cm$^{-3}$, source temperature $T_m \approx$~95~eV, source altitude $h \gtrsim$~6~$R_E$, and $\kappa =$~2--6.


title: Fast Spatio-Temporal Residual Network for Video Super-Resolution

abstract: Recently, deep learning based video super-resolution (SR) methods have achieved promising performance. To simultaneously exploit the spatial and temporal information of videos, employing 3-dimensional (3D) convolutions is a natural approach. However, straight utilizing 3D convolutions may lead to an excessively high computational complexity which restricts the depth of video SR models and thus undermine the performance. In this paper, we present a novel fast spatio-temporal residual network (FSTRN) to adopt 3D convolutions for the video SR task in order to enhance the performance while maintaining a low computational load. Specifically, we propose a fast spatio-temporal residual block (FRB) that divide each 3D filter to the product of two 3D filters, which have considerably lower dimensions. Furthermore, we design a cross-space residual learning that directly links the low-resolution space and the high-resolution space, which can greatly relieve the computational burden on the feature fusion and up-scaling parts. Extensive evaluations and comparisons on benchmark datasets validate the strengths of the proposed approach and demonstrate that the proposed network significantly outperforms the current state-of-the-art methods.


title: Supersymmetric domain walls in 7D maximal gauged supergravity

abstract: We give a large class of supersymmetric domain walls in maximal seven-dimensional gauged supergravity with various types of gauge groups. Gaugings are described by components of the embedding tensor transforming in representations $\mathbf{15}$ and $\overline{\mathbf{40}}$ of the global symmetry $SL(5)$. The embedding tensor in $\mathbf{15}$ representation leads to $CSO(p,q,5-p-q)$ gauge groups while gaugings in $\overline{\mathbf{40}}$ representation describes $CSO(p,q,4-p-q)$ gauge groups. These gaugings admit half-supersymmetric domain walls as vacuum solutions. On the other hand, gaugings involving both $\mathbf{15}$ and $\overline{\mathbf{40}}$ components lead to $\frac{1}{4}$-supersymmetric domain walls. In this case, the gauge groups under consideration are $SO(2,1)\ltimes \mathbf{R}^4$ and $CSO(2,0,2)\sim SO(2)\ltimes \mathbf{R}^4$. All of the domain wall solutions are analytically obtained. For $SO(5)$ gauge group, the gauged supergravity admits an $N=4$ supersymmetric $AdS_7$ vacuum dual to $N=(2,0)$ SCFT in six dimensions. The corresponding domain walls can be interpreted as holographic RG flows from the $N=(2,0)$ SCFT to non-conformal $N=(2,0)$ field theories in the IR. The solutions can be uplifted to eleven dimensions by using a truncation ansatz on $S^4$. Furthermore, the gauged supergravity with $CSO(4,0,1)\sim SO(4)\ltimes \mathbf{R}^4$ gauge group can be embedded in type IIA theory via a truncation on $S^3$. The uplifted domain walls, describing NS5-branes of type IIA theory, are also given.


title: Mumford-Shah Loss Functional for Image Segmentation with Deep Learning

abstract: Recent state-of-the-art image segmentation algorithms are mostly based on deep neural networks, thanks to their high performance and fast computation time. However, these methods are usually trained in a supervised manner, which requires large number of high quality ground-truth segmentation masks. On the other hand, classical image segmentation approaches such as level-set methods are formulated in a self-supervised manner by minimizing energy functions such as Mumford-Shah functional, so they are still useful to help generation of segmentation masks without labels. Unfortunately, these algorithms are usually computationally expensive and often have limitation in semantic segmentation. In this paper, we propose a novel loss function based on Mumford-Shah functional that can be used in deep-learning based image segmentation without or with small labeled data. This loss function is based on the observation that the softmax layer of deep neural networks has striking similarity to the characteristic function in the Mumford-Shah functional. We show that the new loss function enables semi-supervised and unsupervised segmentation. In addition, our loss function can be also used as a regularized function to enhance supervised semantic segmentation algorithms. Experimental results on multiple datasets demonstrate the effectiveness of the proposed method.


title: Scalable Planning with Deep Neural Network Learned Transition Models

abstract: In many real-world planning problems with factored, mixed discrete and continuous state and action spaces such as Reservoir Control, Heating Ventilation, and Air Conditioning, and Navigation domains, it is difficult to obtain a model of the complex nonlinear dynamics that govern state evolution. However, the ubiquity of modern sensors allows us to collect large quantities of data from each of these complex systems and build accurate, nonlinear deep neural network models of their state transitions. But there remains one major problem for the task of control -- how can we plan with deep network learned transition models without resorting to Monte Carlo Tree Search and other black-box transition model techniques that ignore model structure and do not easily extend to mixed discrete and continuous domains? In this paper, we introduce two types of nonlinear planning methods that can leverage deep neural network learned transition models: Hybrid Deep MILP Planner (HD-MILP-Plan) and Tensorflow Planner (TF-Plan). In HD-MILP-Plan, we make the critical observation that the Rectified Linear Unit transfer function for deep networks not only allows faster convergence of model learning, but also permits a direct compilation of the deep network transition model to a Mixed-Integer Linear Program encoding. Further, we identify deep network specific optimizations for HD-MILP-Plan that improve performance over a base encoding and show that we can plan optimally with respect to the learned deep networks. In TF-Plan, we take advantage of the efficiency of auto-differentiation tools and GPU-based computation where we encode a subclass of purely continuous planning problems as Recurrent Neural Networks and directly optimize the actions through backpropagation. We compare both planners and show that TF-Plan is able to approximate the optimal plans found by HD-MILP-Plan in less computation time...


title: An Attentive Survey of Attention Models

abstract: Attention Model has now become an important concept in neural networks that has been researched within diverse application domains. This survey provides a structured and comprehensive overview of the developments in modeling attention. In particular, we propose a taxonomy which groups existing techniques into coherent categories. We review salient neural architectures in which attention has been incorporated, and discuss applications in which modeling attention has shown a significant impact. We also describe how attention has been used to improve the interpretability of neural networks. Finally, we discuss some future research directions in attention. We hope this survey will provide a succinct introduction to attention models and guide practitioners while developing approaches for their applications.


title: On Asymptotics of Optimal Stopping Times

abstract: We consider optimal stopping problems, in which a sequence of independent random variables is drawn from a known continuous density. The objective of such problems is to find a procedure which maximizes the expected reward; this is often known as the "full information" problem. In this analysis, we obtain asymptotic expressions for the expectation and variance of the optimal stopping time as the number of drawn variables becomes large. In the case of distributions with infinite upper bound, the asymptotic behaviour of these statistics depends solely on the algebraic power of the probability distribution decay rate in the upper limit. In the case of densities with finite upper bound, the asymptotic behaviour these statistics depend on the algebraic form of the distribution near the finite upper bound. Explicit calculations are provided for several common probability density functions, which are compared to numerical simulations that support the asymptotic predictions.


title: Radio Galaxy Zoo: Knowledge Transfer Using Rotationally Invariant Self-Organising Maps

abstract: With the advent of large scale surveys the manual analysis and classification of individual radio source morphologies is rendered impossible as existing approaches do not scale. The analysis of complex morphological features in the spatial domain is a particularly important task. Here we discuss the challenges of transferring crowdsourced labels obtained from the Radio Galaxy Zoo project and introduce a proper transfer mechanism via quantile random forest regression. By using parallelized rotation and flipping invariant Kohonen-maps, image cubes of Radio Galaxy Zoo selected galaxies formed from the FIRST radio continuum and WISE infrared all sky surveys are first projected down to a two-dimensional embedding in an unsupervised way. This embedding can be seen as a discretised space of shapes with the coordinates reflecting morphological features as expressed by the automatically derived prototypes. We find that these prototypes have reconstructed physically meaningful processes across two channel images at radio and infrared wavelengths in an unsupervised manner. In the second step, images are compared with those prototypes to create a heat-map, which is the morphological fingerprint of each object and the basis for transferring the user generated labels. These heat-maps have reduced the feature space by a factor of 248 and are able to be used as the basis for subsequent ML methods. Using an ensemble of decision trees we achieve upwards of 85.7% and 80.7% accuracy when predicting the number of components and peaks in an image, respectively, using these heat-maps. We also question the currently used discrete classification schema and introduce a continuous scale that better reflects the uncertainty in transition between two classes, caused by sensitivity and resolution limits.


title: Single-Path NAS: Designing Hardware-Efficient ConvNets in less than 4 Hours

abstract: Can we automatically design a Convolutional Network (ConvNet) with the highest image classification accuracy under the runtime constraint of a mobile device? Neural architecture search (NAS) has revolutionized the design of hardware-efficient ConvNets by automating this process. However, the NAS problem remains challenging due to the combinatorially large design space, causing a significant searching time (at least 200 GPU-hours). To alleviate this complexity, we propose Single-Path NAS, a novel differentiable NAS method for designing hardware-efficient ConvNets in less than 4 hours. Our contributions are as follows: 1. Single-path search space: Compared to previous differentiable NAS methods, Single-Path NAS uses one single-path over-parameterized ConvNet to encode all architectural decisions with shared convolutional kernel parameters, hence drastically decreasing the number of trainable parameters and the search cost down to few epochs. 2. Hardware-efficient ImageNet classification: Single-Path NAS achieves 74.96% top-1 accuracy on ImageNet with 79ms latency on a Pixel 1 phone, which is state-of-the-art accuracy compared to NAS methods with similar constraints (<80ms). 3. NAS efficiency: Single-Path NAS search cost is only 8 epochs (30 TPU-hours), which is up to 5,000x faster compared to prior work. 4. Reproducibility: Unlike all recent mobile-efficient NAS methods which only release pretrained models, we open-source our entire codebase at: https://github.com/dstamoulis/single-path-nas.


title: Coexistence of magnetic order and persistent spin dynamics in a quantum kagome antiferromagnet with no intersite mixing

abstract: One of the key questions concerning frustrated lattices that has lately emerged is the role of disorder in inducing spin-liquid-like properties. In this context, the quantum kagome antiferromagnets YCu$_3$(OH)$_6$Cl$_3$, which has been recently reported as the first geometrically perfect realization of the kagome lattice with negligible magnetic/non-magnetic intersite mixing and a possible quantum-spin-liquid ground state, is of particular interest. However, contrary to previous conjectures, here we show clear evidence of bulk magnetic ordering in this compound below $T_N=15$\,K by combining bulk magnetization and heat capacity measurements, and local-probe muon spin relaxation measurements. The magnetic ordering in this material is rather unconventional in several respects. Firstly, a crossover regime where the ordered state coexists with the paramagnetic state extends down to $T_N/3$ and, secondly, the fluctuation crossover is shifted far below $T_N$. Moreover, a reduced magnetic-entropy release at $T_N$ and persistent spin dynamics that is observed at temperatures as low as $T/T_N=1/300$ could be a sign of emergent excitations of correlated spin-loops or, alternatively, a sign of fragmentation of each magnetic moment into an ordered and a fluctuating part.


title: Note on Coleman's formula for the absolute Frobenius on Fermat curves

abstract: Coleman calculated the absolute Frobenius on Fermat curves explicitly. In this paper we show that a kind of $p$-adic continuity implies a large part of his formula. To do this, we study a relation between functional equations of the ($p$-adic) gamma function and monomial relations on ($p$-adic) CM-periods.


title: Predictive density estimation under the Wasserstein loss

abstract: We investigate predictive density estimation under the $L^2$ Wasserstein loss for location families and location-scale families. We show that plug-in densities form a complete class and that the Bayesian predictive density is given by the plug-in density with the posterior mean of the location and scale parameters. We provide Bayesian predictive densities that dominate the best equivariant one in normal models.


title: Lopsided texture compatible with thermal leptogenesis in partially composite Pati--Salam unification

abstract: In this paper, we consider a lopsided flavor texture compatible with thermal leptogenesis in partially composite Pati--Salam unification. The Davidson--Ibarra bound $M_{\nu R1} \gtrsim 10^9$ GeV for the successful thermal leptogenesis can be recast to the Froggatt--Nielsen (FN) charge of the lopsided texture. We found the FN charge $n_{\nu1}$ of the lightest right-handed neutrino $\nu_{R1}$ can not be larger than a upper bound, $n_{\nu1} \lesssim 4.5$. From the viewpoint of unification, the FN charges of the neutrinos $n_{\nu i}$ should be the same to that of other SM fermions. Then, two cases $n_{\nu i} = n_{qi} = (3,2,0)$ and $ n_{\nu i} = n_{l i} = (n+1,n,n)$ are considered. Observations of PS model shows that the case of $n=0$, $n_{li} = n_{di} = (1,0,0)$ will be the simplest realization. To decrease the FN charges of these fermions from the GUT invariant FN charges $n_{qi} = (3,2,0)$, we utilize the partial compositeness. In this picture, the hierarchies of Yukawa matrices are a consequence of mixings between massless chiral fermions $f_{L}, f'_{R}$ and massive vector fermions $F_{L,R}, F'_{L,R}$. This is induced by the linear mixing terms $\lambda^{f} \bar f_{L} F_{R}$ and $\lambda^{f'} \bar F'_{L} f'_{R}$. As a result of the partial compositeness, the decreases of FN charges require fine-tunings between mass and Yukawa matrices either for the increases of $\lambda^{f, f'}$ or for the decreases of $M_{F,F'}$. Therefore, the case for $n=2$ and $n_{di} = n_{li} = (3,2,2)$, which requires only increases of FN charges will be appropriate to build a natural model.


title: LibriTTS: A Corpus Derived from LibriSpeech for Text-to-Speech

abstract: This paper introduces a new speech corpus called "LibriTTS" designed for text-to-speech use. It is derived from the original audio and text materials of the LibriSpeech corpus, which has been used for training and evaluating automatic speech recognition systems. The new corpus inherits desired properties of the LibriSpeech corpus while addressing a number of issues which make LibriSpeech less than ideal for text-to-speech work. The released corpus consists of 585 hours of speech data at 24kHz sampling rate from 2,456 speakers and the corresponding texts. Experimental results show that neural end-to-end TTS models trained from the LibriTTS corpus achieved above 4.0 in mean opinion scores in naturalness in five out of six evaluation speakers. The corpus is freely available for download from http://www.openslr.org/60/.


title: On missing label patterns in semi-supervised learning

abstract: We investigate model based classification with partially labelled training data. In many biostatistical applications, labels are manually assigned by experts, who may leave some observations unlabelled due to class uncertainty. We analyse semi-supervised learning as a missing data problem and identify situations where the missing label pattern is non-ignorable for the purposes of maximum likelihood estimation. In particular, we find that a relationship between classification difficulty and the missing label pattern implies a non-ignorable missingness mechanism. We examine a number of real datasets and conclude the pattern of missing labels is related to the difficulty of classification. We propose a joint modelling strategy involving the observed data and the missing label mechanism to account for the systematic missing labels. Full likelihood inference including the missing label mechanism can improve the efficiency of parameter estimation, and increase classification accuracy.