title: The converse envelope theorem

abstract: I prove an envelope theorem with a converse: the envelope formula is equivalent to a first-order condition. Like Milgrom and Segal's (2002) envelope theorem, my result requires no structure on the choice set. I use the converse envelope theorem to extend to general outcomes and preferences the canonical result in mechanism design that any increasing allocation is implementable, and apply this to selling information.


title: First Transmission of a 12D Format Across 3 Coupled Spatial Modes of a 3-Core Coupled-Core Fiber at a Spectral Efficiency of 4 bits/s/Hz

abstract: We demonstrate the first transmission of a new twelve-dimensional modulation format over a three-core coupled-core multicore fiber. The format occupies a single time slot spread across all three linearly-coupled spatial modes and shows improved MI and GMI after transmission compared to PDM-QPSK.


title: Contact-Aware Controller Design for Complementarity Systems

abstract: While many robotic tasks, like manipulation and locomotion, are fundamentally based in making and breaking contact with the environment, state-of-the-art control policies struggle to deal with the hybrid nature of multi-contact motion. Such controllers often rely heavily upon heuristics or, due to the combinatoric structure in the dynamics, are unsuitable for real-time control. Principled deployment of tactile sensors offers a promising mechanism for stable and robust control, but modern approaches often use this data in an ad hoc manner, for instance to guide guarded moves. In this work, by exploiting the complementarity structure of contact dynamics, we propose a control framework which can close the loop on rich, tactile sensors. Critically, this framework is non-combinatoric, enabling optimization algorithms to automatically synthesize provably stable control policies. We demonstrate this approach on three different underactuated, multi-contact robotics problems.


title: Arithmetic properties of polynomial solutions of the Diophantine equation $P(x)x^{n+1}+Q(x)(x+1)^{n+1}=1$

abstract: For each integer $n\geq 1$ we consider the unique polynomials $P, Q\in\mathbb{Q}[x]$ of smallest degree $n$ that are solutions of the equation $P(x)x^{n+1}+Q(x)(x+1)^{n+1}=1$. We derive numerous properties of these polynomials and their derivatives, including explicit expansions, differential equations, recurrence relations, generating functions, resultants, discriminants, and irreducibility results. We also consider some related polynomials and their properties.


title: Revealing the Structure of the Inflationary Landscape through Primordial non-Gaussianity

abstract: In this thesis, we show how the structure of the landscape potential of the primordial Universe may be probed through the primordial density perturbations responsible for the origin of the cosmic microwave background anisotropies and the large-scale structure of our Universe. Isocurvature fields may have fluctuated across the barriers separating local minima of the landscape potential during inflation. We analyze how this process could have impacted the evolution of the primordial curvature perturbations. If the typical distance separating consecutive minima of the landscape potential and the height of the potential barriers are smaller than the Hubble expansion rate parametrizing inflation, the probability distribution function of isocurvature fields becomes non-Gaussian due to the appearance of bumps and dips associated with the structure of the potential. We show that this non-Gaussianity can be transferred to the statistics of primordial curvature perturbations. The type of non-Gaussian structure that emerges in the distribution of curvature perturbations cannot be fully probed with the standard methods of polyspectra; instead, the probability distribution function is needed. To substantiate our claims, we offer a concrete model consisting of an isocurvature perturbation with a sinusoidal potential and a linear derivative coupling between the isocurvature and curvature field. This result is generalized to arbitrary potentials and briefly studied beyond first-order perturbation theory. Finally, we undertake a study of primordial non-Gaussianity of the local type, where we use our results to reconstruct and constrain the shape of the landscape potential with the help of Cosmic Microwave Background observations by the Planck telescope and explore prospects for observable quantities in the Large-Scale Structure of our universe towards constraining its primordial statistics.


title: Skyline Queries Over Incomplete Data Streams (Technical Report)

abstract: Nowadays, efficient and effective processing over massive stream data has attracted much attention from the database community, which are useful in many real applications such as sensor data monitoring, network intrusion detection, and so on. In practice, due to the malfunction of sensing devices or imperfect data collection techniques, real-world stream data may often contain missing or incomplete data attributes. In this paper, we will formalize and tackle a novel and important problem, named skyline query over incomplete data stream (Sky-iDS), which retrieves skyline objects (in the presence of missing attributes) with high confidences from incomplete data stream. In order to tackle the Sky-iDS problem, we will design efficient approaches to impute missing attributes of objects from incomplete data stream via differential dependency (DD) rules. We will propose effective pruning strategies to reduce the search space of the Sky-iDS problem, devise cost-model-based index structures to facilitate the data imputation and skyline computation at the same time, and integrate our proposed techniques into an efficient Sky-iDS query answering algorithm. Extensive experiments have been conducted to confirm the efficiency and effectiveness of our Sky-iDS processing approach over both real and synthetic data sets.


title: Improved Summation from Shuffling

abstract: A protocol by Ishai et al.\ (FOCS 2006) showing how to implement distributed $n$-party summation from secure shuffling has regained relevance in the context of the recently proposed \emph{shuffle model} of differential privacy, as it allows to attain the accuracy levels of the curator model at a moderate communication cost. To achieve statistical security $2^{-\sigma}$, the protocol by Ishai et al.\ requires the number of messages sent by each party to {\em grow} logarithmically with $n$ as $O(\log n + \sigma)$. In this note we give an improved analysis achieving a dependency of the form $O(1+\sigma/\log n)$. Conceptually, this addresses the intuitive question left open by Ishai et al.\ of whether the shuffling step in their protocol provides a "hiding in the crowd" amplification effect as $n$ increases. From a practical perspective, our analysis provides explicit constants and shows, for example, that the method of Ishai et al.\ applied to summation of $32$-bit numbers from $n=10^4$ parties sending $12$ messages each provides statistical security $2^{-40}$.


title: Minimal Work: A Grasp Quality Metric for Deformable Hollow Objects

abstract: Robot grasping of deformable hollow objects such as plastic bottles and cups is challenging as the grasp should resist disturbances while minimally deforming the object so as not to damage it or dislodge liquids. We propose minimal work as a novel grasp quality metric that combines wrench resistance and the object deformation. We introduce an efficient algorithm to compute required work to resist an external wrench for a manipulation task by solving a linear program. The algorithm first computes the minimum required grasp force and an estimation of the gripper jaw displacements based on the object deformability at different locations measured with physical experiments. The work done by the jaws is the product of the grasp force and the displacements. The grasp quality metric is computed based on the required work under perturbations of grasp poses to address uncertainties in actuation. We collect 460 physical grasps with a UR5 robot and a Robotiq gripper. Physical experiments suggest the minimal work quality metric reaches 74.2% balanced accuracy and is up to 24.2% higher than classical wrench-based quality metrics, where the balanced accuracy is the raw accuracy normalized by the number of successful and failed real-world grasps.


title: Negotiation-based Human-Robot Collaboration via Augmented Reality

abstract: Effective human-robot collaboration (HRC) requires extensive communication among the human and robot teammates, because their actions can potentially produce conflicts, synergies, or both. We develop a novel augmented reality (AR) interface to bridge the communication gap between human and robot teammates. Building on our AR interface, we develop an AR-mediated, negotiation-based (ARN) framework for HRC. We have conducted experiments both in simulation and on real robots in an office environment, where multiple mobile robots work on delivery tasks. The robots could not complete the tasks on their own, but sometimes need help from their human teammate, rendering human-robot collaboration necessary. Results suggest that ARN significantly reduced the human-robot team's task completion time compared to a non-AR baseline approach.


title: Avoidance Learning Using Observational Reinforcement Learning

abstract: Imitation learning seeks to learn an expert policy from sampled demonstrations. However, in the real world, it is often difficult to find a perfect expert and avoiding dangerous behaviors becomes relevant for safety reasons. We present the idea of \textit{learning to avoid}, an objective opposite to imitation learning in some sense, where an agent learns to avoid a demonstrator policy given an environment. We define avoidance learning as the process of optimizing the agent's reward while avoiding dangerous behaviors given by a demonstrator. In this work we develop a framework of avoidance learning by defining a suitable objective function for these problems which involves the \emph{distance} of state occupancy distributions of the expert and demonstrator policies. We use density estimates for state occupancy measures and use the aforementioned distance as the reward bonus for avoiding the demonstrator. We validate our theory with experiments using a wide range of partially observable environments. Experimental results show that we are able to improve sample efficiency during training compared to state of the art policy optimization and safety methods.


title: Pretraining boosts out-of-domain robustness for pose estimation

abstract: Neural networks are highly effective tools for pose estimation. However, as in other computer vision tasks, robustness to out-of-domain data remains a challenge, especially for small training sets that are common for real-world applications. Here, we probe the generalization ability with three architecture classes (MobileNetV2s, ResNets, and EfficientNets) for pose estimation. We developed a dataset of 30 horses that allowed for both "within-domain" and "out-of-domain" (unseen horse) benchmarking - this is a crucial test for robustness that current human pose estimation benchmarks do not directly address. We show that better ImageNet-performing architectures perform better on both within- and out-of-domain data if they are first pretrained on ImageNet. We additionally show that better ImageNet models generalize better across animal species. Furthermore, we introduce Horse-C, a new benchmark for common corruptions for pose estimation, and confirm that pretraining increases performance in this domain shift context as well. Overall, our results demonstrate that transfer learning is beneficial for out-of-domain robustness.


title: Carving out the low surface brightness universe with NoiseChisel

abstract: NoiseChisel is a program to detect very low signal-to-noise ratio (S/N) features with minimal assumptions on their morphology. It was introduced in 2015 and released within a collection of data analysis programs and libraries known as GNU Astronomy Utilities (Gnuastro). The 10th stable version of Gnuastro was released in August 2019 and NoiseChisel has significantly improved: detecting even fainter signal, enabling better user control over its inner workings, and many bug fixes. The most important change until version 0.10 is that NoiseChisel's segmentation features have been moved into a new program called Segment. Another major change is the final growth strategy of its true detections, for example NoiseChisel is able to detect the outer wings of M51 down to S/N of 0.25, or 25.97 mag/arcsec2 on a single-exposure SDSS image (r-band). Segment is also able to detect the localized HII regions as "clumps" much more successfully. For a detailed list of improvements after version 0.10, see the most recent manual. Finally, to orchestrate a controlled analysis, the concept of reproducibility is discussed: this paper itself is exactly reproducible (commit 751467d).


title: Local cohomology bounds and test ideals

abstract: We find sufficient conditions which imply equality of the finitistic test ideal and test ideal in rings of prime characteristic. Utilizing recent progress from the prime characteristic minimal model program we equate the notions of $F$-regular and strongly $F$-regular for 4-dimensional rings essentially of finite type over a field of prime characteristic $p>5$.


title: Sign Language Recognition Analysis using Multimodal Data

abstract: Voice-controlled personal and home assistants (such as the Amazon Echo and Apple Siri) are becoming increasingly popular for a variety of applications. However, the benefits of these technologies are not readily accessible to Deaf or Hard-ofHearing (DHH) users. The objective of this study is to develop and evaluate a sign recognition system using multiple modalities that can be used by DHH signers to interact with voice-controlled devices. With the advancement of depth sensors, skeletal data is used for applications like video analysis and activity recognition. Despite having similarity with the well-studied human activity recognition, the use of 3D skeleton data in sign language recognition is rare. This is because unlike activity recognition, sign language is mostly dependent on hand shape pattern. In this work, we investigate the feasibility of using skeletal and RGB video data for sign language recognition using a combination of different deep learning architectures. We validate our results on a large-scale American Sign Language (ASL) dataset of 12 users and 13107 samples across 51 signs. It is named as GMUASL51. We collected the dataset over 6 months and it will be publicly released in the hope of spurring further machine learning research towards providing improved accessibility for digital assistants.


title: Teacher-Student Learning Paradigm for Tri-training: An Efficient Method for Unlabeled Data Exploitation

abstract: Given that labeled data is expensive to obtain in real-world scenarios, many semi-supervised algorithms have explored the task of exploitation of unlabeled data. Traditional tri-training algorithm and tri-training with disagreement have shown promise in tasks where labeled data is limited. In this work, we introduce a new paradigm for tri-training, mimicking the real world teacher-student learning process. We show that the adaptive teacher-student thresholds used in the proposed method provide more control over the learning process with higher label quality. We perform evaluation on SemEval sentiment analysis task and provide comprehensive comparisons over experimental settings containing varied labeled versus unlabeled data rates. Experimental results show that our method outperforms other strong semi-supervised baselines, while requiring less number of labeled training samples.


title: Exploring diamond-like lattice thermal conductivity crystals via feature-based transfer learning

abstract: Ultrahigh lattice thermal conductivity materials hold great importance since they play a critical role in the thermal management of electronic and optical devices. Models using machine learning can search for materials with outstanding higher-order properties like thermal conductivity. However, the lack of sufficient data to train a model is a serious hurdle. Herein we show that big data can complement small data for accurate predictions when lower-order feature properties available in big data are selected properly and applied to transfer learning. The connection between the crystal information and thermal conductivity is directly built with a neural network by transferring descriptors acquired through a pre-trained model for the feature property. Successful transfer learning shows the ability of extrapolative prediction and reveals descriptors for lattice anharmonicity. Transfer learning is employed to screen over 60000 compounds to identify novel crystals that can serve as alternatives to diamond.


title: Path Planning in Unknown Environments Using Optimal Transport Theory

abstract: This paper introduces a graph-based, potential-guided method for path planning problems in unknown environments, where obstacles are unknown until the robots are in close proximity to the obstacle locations. Inspired by optimal transport theory, the proposed method generates a graph connecting the initial and target configurations, and then finds a path over the graph using the available environmental information. The graph and path are updated iteratively when newly encountered obstacle information becomes available. The resulting method is a deterministic procedure proven to be complete, i.e., it is guaranteed to find a feasible path, when one exists, in a finite number of iterations. The method is scalable to high-dimensional problems. In addition, our method does not search the entire domain for the path, instead, the algorithm only explores a sub-region that can be described by the evolution of the Fokker-Planck equation. We demonstrate the performance of our algorithm via several numerical examples with different environments and dimensions, including high-dimensional cases.


title: Learning to Seek: Autonomous Source Seeking with Deep Reinforcement Learning Onboard a Nano Drone Microcontroller

abstract: We present fully autonomous source seeking onboard a highly constrained nano quadcopter, by contributing application-specific system and observation feature design to enable inference of a deep-RL policy onboard a nano quadcopter. Our deep-RL algorithm finds a high-performance solution to a challenging problem, even in presence of high noise levels and generalizes across real and simulation environments with different obstacle configurations. We verify our approach with simulation and in-field testing on a Bitcraze CrazyFlie using only the cheap and ubiquitous Cortex-M4 microcontroller unit. The results show that by end-to-end application-specific system design, our contribution consumes almost three times less additional power, as compared to competing learning-based navigation approach onboard a nano quadcopter. Thanks to our observation space, which we carefully design within the resource constraints, our solution achieves a 94% success rate in cluttered and randomized test environments, as compared to the previously achieved 80%. We also compare our strategy to a simple finite state machine (FSM), geared towards efficient exploration, and demonstrate that our policy is more robust and resilient at obstacle avoidance as well as up to 70% more efficient in source seeking. To this end, we contribute a cheap and lightweight end-to-end tiny robot learning (tinyRL) solution, running onboard a nano quadcopter, that proves to be robust and efficient in a challenging task using limited sensory input.


title: Learning Propagation for Arbitrarily-structured Data

abstract: Processing an input signal that contains arbitrary structures, e.g., superpixels and point clouds, remains a big challenge in computer vision. Linear diffusion, an effective model for image processing, has been recently integrated with deep learning algorithms. In this paper, we propose to learn pairwise relations among data points in a global fashion to improve semantic segmentation with arbitrarily-structured data, through spatial generalized propagation networks (SGPN). The network propagates information on a group of graphs, which represent the arbitrarily-structured data, through a learned, linear diffusion process. The module is flexible to be embedded and jointly trained with many types of networks, e.g., CNNs. We experiment with semantic segmentation networks, where we use our propagation module to jointly train on different data -- images, superpixels and point clouds. We show that SGPN consistently improves the performance of both pixel and point cloud segmentation, compared to networks that do not contain this module. Our method suggests an effective way to model the global pairwise relations for arbitrarily-structured data.


title: Design Methodology for Energy Efficient Unmanned Aerial Vehicles

abstract: In this paper, we present a load-balancing approach to analyze and partition the UAV perception and navigation intelligence (PNI) code for parallel execution, as well as assigning each parallel computational task to a processing element in an Network-on-chip (NoC) architecture such that the total communication energy is minimized and congestion is reduced. First, we construct a data dependency graph (DDG) by converting the PNI high level program into Low Level Virtual Machine (LLVM) Intermediate Representation (IR). Second, we propose a scheduling algorithm to partition the PNI application into clusters such that (1) inter-cluster communication is minimized, (2) NoC energy is reduced and (3) the workloads of different cores are balanced for maximum parallel execution. Finally, an energy-aware mapping scheme is adopted to assign clusters onto tile-based NoCs. We validate this approach with a drone self-navigation application and the experimental results show that our optimal 32-core design achieves an average 82% energy savings and 4.7x performance speedup against the state-of-art flight controller.


title: SUGAR: An improved empirical model of Type Ia Supernovae based on spectral features

abstract: Type Ia Supernovae (SNe Ia) are widely used to measure the expansion of the Universe. Improving distance measurements of SNe Ia is one technique to better constrain the acceleration of expansion and determine its physical nature. This document develops a new SNe Ia spectral energy distribution (SED) model, called the SUpernova Generator And Reconstructor (SUGAR), which improves the spectral description of SNe Ia, and consequently could improve the distance measurements. This model is constructed from SNe Ia spectral properties and spectrophotometric data from The Nearby Supernova Factory collaboration. In a first step, a PCA-like method is used on spectral features measured at maximum light, which allows us to extract the intrinsic properties of SNe Ia. Next, the intrinsic properties are used to extract the average extinction curve. Third, an interpolation using Gaussian Processes facilitates using data taken at different epochs during the lifetime of a SN Ia and then projecting the data on a fixed time grid. Finally, the three steps are combined to build the SED model as a function of time and wavelength. This is the SUGAR model. The main advancement in SUGAR is the addition of two additional parameters to characterize SNe Ia variability. The first is tied to the properties of SNe Ia ejecta velocity, the second is correlated with their calcium lines. The addition of these parameters, as well as the high quality the Nearby Supernova Factory data, makes SUGAR an accurate and efficient model for describing the spectra of normal SNe Ia as they brighten and fade. The performance of this model makes it an excellent SED model for experiments like ZTF, LSST or WFIRST.


title: Harish-Chandra pairs in the Verlinde category in positive characteristic

abstract: In this article, we prove that the category of affine group schemes of finite type in the Verlinde category is equivalent to the category of Harish-Chandra pairs in the Verlinde category. Subsequently, we extend this equivalence to an equivalence between corresponding representation categories and then study some consequences of this equivalence to the representation theory of $GL(L)$, with $L$ a simple object in the Verlinde category.


title: Atalaya at TASS 2019: Data Augmentation and Robust Embeddings for Sentiment Analysis

abstract: In this article we describe our participation in TASS 2019, a shared task aimed at the detection of sentiment polarity of Spanish tweets. We combined different representations such as bag-of-words, bag-of-characters, and tweet embeddings. In particular, we trained robust subword-aware word embeddings and computed tweet representations using a weighted-averaging strategy. We also used two data augmentation techniques to deal with data scarcity: two-way translation augmentation, and instance crossover augmentation, a novel technique that generates new instances by combining halves of tweets. In experiments, we trained linear classifiers and ensemble models, obtaining highly competitive results despite the simplicity of our approaches.


title: Implications of the LHCb discovery of CP violation in charm decays

abstract: The recent measurement of $\Delta A_{CP}$ by the LHCb collaboration requires an ${\cal O}(10)$ enhancement coming from hadronic physics in order to be explained within the SM. We examine to what extent can NP models explain $\Delta A_{CP}$ without such enhancements. We discuss the implications in terms of a low energy effective theory as well as in the context of several explicit NP models.


title: The ALMaQUEST Survey: The molecular gas main sequence and the origin of the star forming main sequence

abstract: The origin of the star forming main sequence ( i.e., the relation between star formation rate and stellar mass, globally or on kpc-scales; hereafter SFMS) remains a hotly debated topic in galaxy evolution. Using the ALMA-MaNGA QUEnching and STar formation (ALMaQUEST) survey, we show that for star forming spaxels in the main sequence galaxies, the three local quantities, star-formation rate surface density (\sigsfr), stellar mass surface density (\sigsm), and the \h2~mass surface density (\sigh2), are strongly correlated with one another and form a 3D linear (in log) relation with dispersion. In addition to the two well known scaling relations, the resolved SFMS (\sigsfr~ vs. \sigsm) and the Schmidt-Kennicutt relation (\sigsfr~ vs. \sigh2; SK relation), there is a third scaling relation between \sigh2~ and \sigsm, which we refer to as the `molecular gas main sequence' (MGMS). The latter indicates that either the local gas mass traces the gravitational potential set by the local stellar mass or both quantities follow the underlying total mass distributions. The scatter of the resolved SFMS ($\sigma \sim 0.25$ dex) is the largest compared to those of the SK and MGMS relations ($\sigma \sim$ 0.2 dex). A Pearson correlation test also indicates that the SK and MGMS relations are more strongly correlated than the resolved SFMS. Our result suggests a scenario in which the resolved SFMS is the least physically fundamental and is the consequence of the combination of the SK and the MGMS relations.


title: Complete characterization of qubit masking

abstract: We study the problem of information masking through nonzero linear operators that distribute information encoded in single qubits to the correlations between two qubits. It is shown that a nonzero linear operator cannot mask any nonzero measure set of qubit states. We prove that the maximal maskable set of states on the Bloch sphere with respect to any masker is the ones on a spherical circle. Any states on a spherical circle on the Bloch sphere are maskable, which also proves the conjecture on maskable qubit states given by Modi et al. [Phys. Rev. Lett. 120, 230501 (2018)]. we provide explicitly operational unitary maskers for all maskable sets. As applications, different protocols for secret sharing are introduced.


title: On Locally Decodable Codes in Resource Bounded Channels

abstract: Constructions of locally decodable codes (LDCs) have one of two undesirable properties: low rate or high locality (polynomial in the length of the message). In settings where the encoder/decoder have already exchanged cryptographic keys and the channel is a probabilistic polynomial time (PPT) algorithm, it is possible to circumvent these barriers and design LDCs with constant rate and small locality. However, the assumption that the encoder/decoder have exchanged cryptographic keys is often prohibitive. We thus consider the problem of designing explicit and efficient LDCs in settings where the channel is slightly more constrained than the encoder/decoder with respect to some resource e.g., space or (sequential) time. Given an explicit function $f$ that the channel cannot compute, we show how the encoder can transmit a random secret key to the local decoder using $f(\cdot)$ and a random oracle $H(\cdot)$. This allows bootstrap from the private key LDC construction of Ostrovsky, Pandey and Sahai (ICALP, 2007), thereby answering an open question posed by Guruswami and Smith (FOCS 2010) of whether such bootstrapping techniques may apply to LDCs in weaker channel models than just PPT algorithms. Specifically, in the random oracle model we show how to construct explicit constant rate LDCs with locality of polylog in the security parameter against various resource constrained channels.


title: Jupiter's composition suggests its core assembled exterior to the N2 snowline

abstract: Jupiter's atmosphere is enriched in C, N, S, P, Ar, Kr and Xe with respect to solar abundances by a factor of ~3. Gas Giant envelopes are mainly enriched through the dissolution of solids in the atmosphere, and this constant enrichment factor is puzzling since several of the above elements are not expected to have been in the solid phase in Jupiter's feeding zone; most seriously, Ar and the main carrier of N, N2, only condense at the very low temperatures, 21-26 K, associated with the outer solar nebula. We propose that a plausible solution to the enigma of Jupiter's uniform enrichment pattern is that Jupiter's core formed exterior to the N2 and Ar snowlines, beyond 30 au, resulting in a Solar composition core in all volatiles heavier than Ne. During envelope accretion and planetesimal bombardment, some of the core mixed in with the envelope causing the observed enrichment pattern. We show that this scenario naturally produces the observed atmosphere composition, even with substantial pollution from N-poor pebble and planetesimal accretion in Jupiter's final feeding zone. We note that giant core formation at large nebular radii is consistent with recent models of gas giant core formation through pebble accretion, which requires the core to form exterior to Jupiter's current location to counter rapid inward migration during the core and envelope formation process. If this scenario is common, gas giant core formation may account for many of the gaps observed in protoplanetary disks between 10s and 100 au.


title: DAHAs and skein theory

abstract: We give a skein-theoretic realization of the $\mathfrak{gl}_n$ double affine Hecke algebra of Cherednik using braids and tangles in the punctured torus. We use this to provide evidence of a relationship we conjecture between the classical skein algebra of the punctured torus and the elliptic Hall algebra of Burban and Schiffmann.


title: When to Intervene: Detecting Abnormal Mood using Everyday Smartphone Conversations

abstract: Bipolar disorder (BPD) is a chronic mental illness characterized by extreme mood and energy changes from mania to depression. These changes drive behaviors that often lead to devastating personal or social consequences. BPD is managed clinically with regular interactions with care providers, who assess mood, energy levels, and the form and content of speech. Recent work has proposed smartphones for monitoring mood using speech. However, these works do not predict when to intervene. Predicting when to intervene is challenging because there is not a single measure that is relevant for every person: different individuals may have different levels of symptom severity considered typical. Additionally, this typical mood, or baseline, may change over time, making a single symptom threshold insufficient. This work presents an innovative approach that expands clinical mood monitoring to predict when interventions are necessary using an anomaly detection framework, which we call Temporal Normalization. We first validate the model using a dataset annotated for clinical interventions and then incorporate this method in a deep learning framework to predict mood anomalies from natural, unstructured, telephone speech data. The combination of these approaches provides a framework to enable real-world speech-focused mood monitoring.


title: Mode-locked and tunable fiber laser at the 3.5 ${\mu}$m band using frequency-shifted feedback

abstract: We report on a mid-infrared mode-locked fiber laser that uses an acousto-optic tunable filter to achieve frequency-shifted feedback pulse generation with frequency tuning over a 215 nm range. The laser operates on the 3.5 ${\mu}$m transition in erbium-doped zirconium fluoride-based fiber and utilizes the dual-wavelength pumping scheme. Stable, self-starting mode-locking with a minimum pulse duration of 53 ps was measured using a two-photon absorption autocorrelator. The longest wavelength demonstrated was 3612 nm and a maximum average power of 208 mW was achieved. This is the longest wavelength rare-earth doped mode-locked fiber laser demonstrated to the best of the authors' knowledge. The broad tunability promises potential uses for environmental sensing applications.


title: Dependence of Galactic Halo Kinematics on the Adopted Galactic Potential

abstract: We explore differences in Galactic halo kinematic properties derived from two commonly employed Galactic potentials: the St$\ddot{a}$ckel potential and the default Milky Way-like potential used in the "Galpy" package (MWPotential2014), making use of stars with available metallicities, radial velocities, and proper motions from Sloan Digital Sky Survey Data Release 12. Adopting the St$\ddot{a}$ckel potential, we find that the shape of the metallicity distribution function (MDF) and the distribution of orbital rotation abruptly change at $Z_{\rm max}$ = 15 kpc and $r_{\rm max}$ = 30 kpc (where $Z_{\rm max}$ and $r_{\rm max}$ are the maximum distances reached by a stellar orbit from the Galactic plane and from the Galactic center, respectively), indicating that the transition from dominance by the inner-halo stellar population to the outer-halo population occurs at those distances. Stars with $Z_{\rm max}$ $>$ 15 kpc show an average retrograde motion of $V_{\rm \phi}$ = $-$60 km s$^{-1}$, while stars with $r_{\rm max}$ $>$ 30 kpc exhibit an even larger retrograde value, $V_{\rm \phi}$ = $-$150 km s$^{-1}$. This retrograde signal is also confirmed using the sample of stars with radial velocities obtained by $Gaia$ Data Release 2, assuming the St$\ddot{a}$ckel potential. In comparison, when using the shallower Galpy potential, a noticeable change in the MDF occurs only at $Z_{\rm max}$ = 25 kpc, and a much less extreme retrograde motion is derived. This difference arises because stars with highly retrograde motions in the St$\ddot{a}$ckel potential are unbound in the shallower Galpy potential, and stars with lower rotation velocities reach larger $Z_{\rm max}$ and $r_{\rm max}$. The different kinematic characteristics derived from the two potentials suggest that the nature of the adopted Galactic potential can strongly influence interpretation of the properties of the Galactic halo.


title: Online Semi-Supervised Concept Drift Detection with Density Estimation

abstract: Concept drift is formally defined as the change in joint distribution of a set of input variables X and a target variable y. The two types of drift that are extensively studied are real drift and virtual drift where the former is the change in posterior probabilities p(y|X) while the latter is the change in distribution of X without affecting the posterior probabilities. Many approaches on concept drift detection either assume full availability of data labels, y or handle only the virtual drift. In a streaming environment, the assumption of full availability of data labels, y is questioned. On the other hand, approaches that deal with virtual drift failed to address real drift. Rather than improving the state-of-the-art methods, this paper presents a semi-supervised framework to deal with the challenges above. The objective of the proposed framework is to learn from streaming environment with limited data labels, y and detect real drift concurrently. This paper proposes a novel concept drift detection method utilizing the densities of posterior probabilities in partially labeled streaming environments. Experimental results on both synthetic and realworld datasets show that our proposed semi-supervised framework enables the detection of concept drift in such environment while achieving comparable prediction performance to the state-of-the-art methods.


title: Neighborhood-Enhanced and Time-Aware Model for Session-based Recommendation

abstract: Session based recommendation has become one of the research hotpots in the field of recommendation systems due to its highly practical value.Previous deep learning methods mostly focus on the sequential characteristics within the current session,and neglect the context similarity and temporal similarity between sessions which contain abundant collaborative information.In this paper,we propose a novel neural networks framework,namely Neighborhood Enhanced and Time Aware Recommendation Machine(NETA) for session based recommendation. Firstly,we introduce an efficient neighborhood retrieve mechanism to find out similar sessions which includes collaborative information.Then we design a guided attention with time-aware mechanism to extract collaborative representation from neighborhood sessions.Especially,temporal recency between sessions is considered separately.Finally, we design a simple co-attention mechanism to determine the importance of complementary collaborative representation when predicting the next item.Extensive experiments conducted on two real-world datasets demonstrate the effectiveness of our proposed model.


title: Design and performance of the LLRF control system for CSNS LINAC

abstract: The China spallation neutron source (CSNS) linac is designed with beam energy of 81MeV and a peak current of 15mA in the first phase. The RF power system for the 81 MeV Linac requires 8 units of RF power sources, each unit has one independent digital low level RF (LLRF) control system which is used to stabilize the amplitude and phase of the RF accelerating field along the linac, and to minimize beam loss. During beam commissioning, all of 8 on-line units of LLRF control system were operating stably and reliable, the control precision of accelerating fields met requirement of beam commissioning. The amplitude and phase variations of the linac fields are less than $\pm$0.2% and $\pm$0.2$^\circ$ without beam loading, or $\pm$0.5% and $\pm$0.5$^\circ$ with 10mA beam loading, much better than the design requirements of $\pm$1% in amplitude and $\pm$1$^\circ$ in phase.


title: Chemical Cartography. II. The Assembly History of the Galactic Stellar Halo Traced by Carbon-Enhanced Metal-Poor Stars

abstract: We present an analysis of the kinematic properties of stellar populations in the Galactic halo, making use of over 100,000 main sequence turnoff (MSTO) stars observed in the Sloan Digital Sky Survey. After dividing the Galactic halo into an inner-halo region (IHR) and outer-halo region (OHR), based on the spatial variation of carbon-to-iron ratios in the sample, we find that stars in the OHR exhibit a clear retrograde motion of $-$49 $\pm$ 4 km s$^{-1}$ and a more spherical distribution of stellar orbits, while stars in the IHR have zero net rotation ($-$3 $\pm$ 1 km s$^{-1}$) with a much more radially biased distribution of stellar orbits. Furthermore, we classify the carbon-enhanced metal-poor (CEMP) stars among the MSTO sample in each halo component into CEMP-no and CEMP-$s$ sub-classes, based on their absolute carbon abundances, $A$(C), and examine the spatial distributions and kinematics associated with each sub-class. The CEMP-no stars are the majority sub-class of CEMP stars in the OHR ($\sim$ 65%), and the minority sub-class in the IHR ($\sim$ 44%), similar to the results of several previous analyses. The CEMP-no stars in each halo region exhibit slightly higher counter-rotation than the CEMP-$s$ stars, but within statistical errors. The CEMP-no stars also show a more spherical distribution of orbits than the CEMP-$s$ stars in each halo region. These distinct characteristics provide strong evidence that numerous low-mass satellite galaxies (similar to the ultra-faint dwarf galaxies) have donated stars to the OHR, while more-massive dwarf galaxies provided the dominant contribution to the IHR.


title: A New Method of 3D Magnetic Field Reconstruction

abstract: A method is described to model the magnetic field in the vicinity of constellations of multiple satellites using field and plasma current measurements. This quadratic model has the properties that the divergence is zero everywhere and matches the measured values of the magnetic field and its curl (current) at each spacecraft, and thus extends the linear curlometer method to second order. It is able to predict the topology of the field lines near magnetic structures, such as near reconnecting regions or flux ropes, and allows a tracking of the motion of these structures relative to the spacecraft constellation. Comparisons to PIC simulations estimate the model accuracy. Reconstruction of two electron diffusion regions show the expected field line structure. The model can be applied to other small-scale phenomena (bow shock, waves of commensurate wavelength), and can be modified to reconstruct also the electric field, allowing tracing of particle trajectories.


title: Masking Quantum Information on Hyperdisks

abstract: Masking information is a protocol that encodes quantum information into a bipartite entangled state while the information is completely unknown to local systems. This paper explicitly studies the structure of the set of maskable states and its relation to hyperdisks. We prove that although the qubit states which can be masked must locate on a single hyperdisk, the set of maskable states can consist of two or more hyperdisks for high-dimensional cases. Our results may shed light on several research fields of quantum information theory, such as the structure of entangled states and the local discrimination of bipartite states.


title: A digital PID controller for stabilizing large electric currents to the ppm level for Feshbach resonance studies

abstract: Magnetic Feshbach resonances are a key tool in the field of ultracold quantum gases, but their full exploitation requires the generation of large, stable magnetic fields up to 1000 G with fractional stabilities of better than $10^{-4}$. Design considerations for electromagnets producing these fields, such as optical access and fast dynamical response, mean that electric currents in excess of 100 A are often needed to obtain the requisite field strengths. We describe a simple digital proportional-integral-derivative current controller constructed using a field-programmable gate array and off-the-shelf evaluation boards which allows for gain scheduling, enabling optimal control of current sources with non-linear actuators. Our controller can stabilize an electric current of 337.5 A to the level of $7.5\times 10^{-7}$ in an averaging time of 10 minutes and with a control bandwidth of 2 kHz.


title: PaRe: A Paper-Reviewer Matching Approach Using a Common Topic Space

abstract: Finding the right reviewers to assess the quality of conference submissions is a time consuming process for conference organizers. Given the importance of this step, various automated reviewer-paper matching solutions have been proposed to alleviate the burden. Prior approaches, including bag-of-words models and probabilistic topic models have been inadequate to deal with the vocabulary mismatch and partial topic overlap between a paper submission and the reviewer's expertise. Our approach, the common topic model, jointly models the topics common to the submission and the reviewer's profile while relying on abstract topic vectors. Experiments and insightful evaluations on two datasets demonstrate that the proposed method achieves consistent improvements compared to available state-of-the-art implementations of paper-reviewer matching.


title: Strong Aharonov-Bohm quantum interference in simply-connected LaAlO$_3$/SrTiO$_3$ structures

abstract: We report Aharonov-Bohm (AB)-type quantum interference in simply-connected devices created at the LaAlO$_3$/SrTiO$_3$ interface using conductive-atomic force microscope (c-AFM) lithography. The oscillations are multi-periodic functions of magnetic field strength, and they exhibit a substantial magnetic hysteresis with frequencies that depends on the magnetic sweep direction. The oscillation amplitude for the lowest two frequencies approaches $e^2/h$, consistent with the theoretical maximum for the AB effect, and harmonics up to third order are observable. Broadband quasiperiodic behavior is reported in a fraction of simply-connected electron waveguide devices that exhibit magnetic asymmetries. Curiously, nanoscale ring devices that are multiply-connected lack signatures of AB quantum interference. The interference phenomena are associated with an inhomogeneous magnetic landscape within the LaAlO$_3$/SrTiO$_3$ nanostructures.


title: Dwarf Galaxy Discoveries from the KMTNet Supernova Program II. The NGC 3585 Group and Its Dynamical State

abstract: We present our discovery and analysis of dwarf galaxies in the NGC 3585 galaxy group by the KMTNet Supernova Program. Using deep stack images reaching $\simeq$ 28 mag arcsec$^{-2}$ in $BVI$, we discovered 46 dwarf galaxy candidates distributed in a 7 square degree field. The dwarf galaxy candidates exhibit central surface brightness as faint as $\mu_{0,V} = 26.2$ mag arcsec$^{-2}$, with effective radii larger than 150 pc and total absolute magnitudes brighter than $M_V \approx -10$ mag, if at the distance of NGC 3585. The dwarf galaxy surface number density decreases with projected distance from NGC 3585. We estimate the background contamination to be about 20% based both on the number density profile and on diffuse galaxy counts in a control field. The dwarf galaxy colors and Sersic structural parameters are consistent with those found for other dwarf galaxies. Unusually, there is no indication of a change of color or brightness in the dwarf galaxy candidates with projected distance from the group center. Approximately 20% of them contain an unresolved nucleus. The nucleated fraction is larger for brighter (and redder) galaxies but is independent of distance from the group center. We identify four ultra-diffuse galaxy candidates, all near the group center. We interpret these spatial properties as suggesting that the NGC 3585 group might be dynamically younger than the typical group. The galaxy luminosity function of the NGC 3585 group has a faint-end slope of $\alpha\approx -1.39$, which is roughly consistent with the slopes found for other nearby groups. The possible dependence of the slope on global group properties is still unclear, and continues to motivate our homogeneous deep survey of dozens of nearby groups.


title: Practical Low Latency Proof of Work Consensus

abstract: Bitcoin is the first fully-decentralized permissionless blockchain protocol to achieve a high level of security, but at the expense of poor throughput and latency. Scaling the performance of Bitcoin has a been a major recent direction of research. One successful direction of work has involved replacing proof of work (PoW) by proof of stake (PoS). Proposals to scale the performance in the PoW setting itself have focused mostly on parallelizing the mining process, scaling throughput; the few proposals to improve latency have either sacrificed throughput or the latency guarantees involve large constants rendering it practically useless. Our first contribution is to design a new PoW blockchain Prism++ that has provably low latency and high throughput; the design retains the parallel-chain approach espoused in Prism but invents a new confirmation rule to infer the permanency of a block by combining information across the parallel chains. We show security at the level of Bitcoin with very small confirmation latency (a small constant factor of block interarrival time). A key aspect to scaling the performance is to use a large number of parallel chains, which puts significant strain on the system. Our second contribution is the design and evaluation of a practical system to efficiently manage the memory, computation, and I/O imperatives of a large number of parallel chains. Our implementation of Prism++ achieves a throughput of over 80,000 transactions per second and confirmation latency of tens of seconds on networks of up to 900 EC2 Virtual Machines.


title: Three-body Description of $2n$-Halo and Unbound $2n$-Systems: $^{22}$C and $^{26}$O

abstract: We study the two-neutron correlations in the ground state of the weakly-bound two-neutron halo nucleus $^{22}$C sitting at the edge of the neutron-drip line and also in the unbound nucleus $^{26}$O sitting beyond the neutron dripline. For the present study, we employ a three-body (core$+n+n$) structure model designed for describing the two-neutron halo system by explicit inclusion of unbound continuum states of the subsystem (core$+n$). We use either a density-independent or a density-dependent contact-delta interaction to describe the neutron-neutron interaction and its strength is varied to fix the binding energy. We report the configuration mixing in the ground state of these systems for different choices of pairing interactions.


title: Riemann-Hilbert problem for the modified Landau-Lifshitz equation with nonzero boundary conditions

abstract: We study systematically a matrix Riemann-Hilbert problem for the modified Landau-Lifshitz (mLL) equation with nonzero boundary conditions at infinity. Unlike the zero boundary conditions case, there occur double-valued functions during the process of the direct scattering. In order to establish the Riemann-Hilbert (RH) problem, it is necessary to make appropriate modification, that is, to introduce an affine transformation that can convert the Riemann surface into a complex plane. In the direct scattering problem, the analyticity, symmetries, asymptotic behaviors of Jost functions and scattering matrix are presented in detail. Furthermore, the discrete spectrum, residual conditions, trace foumulae and theta conditions are established with simple and double poles. The inverse problems are solved via a matrix RH problem formulated by Jost function and scattering coefficients. Finally, the dynamic behavior of some typical soliton solutions of the mLL equation with reflection-less potentials are given to further study the structure of the soliton waves. In addition, some remarkable characteristics of these soliton solutions are analyzed graphically. According to analytic solutions, the influences of each parameters on dynamics of the soliton waves and breather waves are discussed, and the method of how to control such nonlinear phenomena are suggested.


title: The Three Quasistatic Limits of the Maxwell Equations

abstract: It is shown that the Galilean limit (V << c, or L/T <<c)) of the Maxwell equations admits three different limits: the magneto-quasi-static, electro-quasi-static, and electromagnetic-quasi-static limits, in addition to the two obvious static limits. The first two quasi-static limits have been previously identified as Galilean Electromagnetics, while the latter is also known as the Darwin approximation. Using a perturbation expansion, a generalization of Rappetti and Rousseaux [Applied Numerical Mathematics, 79, 92] orders the vacuum Maxwell equations and obtains all three limits. To order the equations, the dimensionless version of the Maxwell equations are derived using a modification of Jackson's review of EM unit systems [Jackson, Classical Electrodynamics, Wiley, 1999, 3rd ed.] The perturbation expansion is repeated for the potential form of the Maxwell equations to emphasize the importance of gauge conditions. The integral solutions of the potentials are derived for the three limits, and the generalized Coulomb and Biot-Savart equations are derived from these solutions. It is shown that although the forms are the same as the static equations, the quasi-static forms of the Maxwell equations are recovered. The induction term is recovered when the time derivative of the vector potential is kept. The displacement current is recovered when the Lorenz gauge is used. The equivalence of this approach and Jackson's derivation [Amer. J. of Phys., 70, 917 (2002)] of the Darwin approximation is shown. The regions of applicability of the quasi-static forms of the Maxwell equations are discussed in terms of macroscopic media.


title: Quantum Entanglement in Time for a Distributed Ledger

abstract: Distributed Ledger Technology (DLT) is a shared, synchronized and replicated data spread spatially and temporally with no centralized administration and/or storage. Each node has a complete and identical set of records. All participants contribute to building and maintaining the distributed ledger. Current DLT technologies fall into two broad categories. Those that use block-chains such as in Bitcoin or Ethereum, and newer approaches which reduce computational loads for verification. All current approaches though difficult to crack can be vulnerable to quantum algorithms using Quantum Information Technologies (QIT). This effort joins the 2 technologies, constructing a Quantum Distributed Ledger (QDL) which provides a higher level of security using QIT and a decentralized data depository using DLT. This enhanced security prevents middleman attacks with quantum computers yet retains the advantages of a decentralized ledger of data.


title: Gradient-Based Multi-Area Distribution System State Estimation

abstract: The increasing distributed and renewable energy resources and controllable devices in distribution systems make fast distribution system state estimation (DSSE) crucial in system monitoring and control. We consider a large multi-phase distribution system and formulate DSSE as a weighted least squares (WLS) problem. We divide the large distribution system into smaller areas of subtree structure, and by jointly exploring the linearized power flow model and the network topology, we propose a gradient-based multi-area algorithm to exactly and efficiently solve the WLS problem. The proposed algorithm enables distributed and parallel computation of the state estimation problem without compromising any performance. Numerical results on a 4,521-node test feeder show that the designed algorithm features fast convergence and accurate estimation results. Comparison with traditional Gauss-Newton method shows that the proposed method has much better performance in distribution systems with a limited amount of reliable measurement. The real-time implementation of the algorithm tracks time-varying system states with high accuracy.


title: Search for ultralight bosons in Cygnus X-1 with Advanced LIGO

abstract: Ultralight scalars, if they exist as theorized, could form clouds around rapidly rotating black holes. Such clouds are expected to emit continuous, quasimonochromatic gravitational waves that could be detected by LIGO and Virgo. Here we present results of a directed search for such signals from the Cygnus X-1 binary, using data from Advanced LIGO's second observing run. We find no evidence of gravitational waves in the 250-750 Hz band. Without incorporating existing measurements of the Cygnus X-1 black hole spin, our results disfavor boson masses in $6.4 \leq \mu/(10^{-13} {\rm eV}) \leq 8.0$, assuming that the black hole was born $5 \times 10^6$ years ago with a nearly-extremal spin. We then focus on a string axiverse scenario, in which self-interactions enable a cloud for high black-hole spins consistent with measurements for Cygnus X-1. In that model, we constrain the boson masses in $9.6 \leq \mu/(10^{-13} {\rm eV}) \leq 15.5$ for a decay constant $f_a\sim 10^{15}$ GeV. Future application of our methods to other sources will yield improved constraints.


title: Rescan: Inductive Instance Segmentation for Indoor RGBD Scans

abstract: In depth-sensing applications ranging from home robotics to AR/VR, it will be common to acquire 3D scans of interior spaces repeatedly at sparse time intervals (e.g., as part of regular daily use). We propose an algorithm that analyzes these "rescans" to infer a temporal model of a scene with semantic instance information. Our algorithm operates inductively by using the temporal model resulting from past observations to infer an instance segmentation of a new scan, which is then used to update the temporal model. The model contains object instance associations across time and thus can be used to track individual objects, even though there are only sparse observations. During experiments with a new benchmark for the new task, our algorithm outperforms alternate approaches based on state-of-the-art networks for semantic instance segmentation.


title: Automated identification of neural cells in the multi-photon images using deep-neural networks

abstract: The advancement of the neuroscientific imaging techniques has produced an unprecedented size of neural cell imaging data, which calls for automated processing. In particular, identification of cells from two photon images demands segmentation of neural cells out of various materials and classification of the segmented cells according to their cell types. To automatically segment neural cells, we used U-Net model, followed by classification of excitatory and inhibitory neurons and glia cells using a transfer learning technique. For transfer learning, we tested three public models of resnet18, resnet50 and inceptionv3, after replacing the fully connected layer with that for three classes. The best classification performance was found for the model with inceptionv3. The proposed application of deep learning technique is expected to provide a critical way to cell identification in the era of big neuroscience data.


title: Cohesive Regolith on Fast Rotating Asteroids

abstract: The migration of cohesive regolith on the surface of an otherwise monolithic or strong asteroid is studied using theoretical and simulation models. The theory and simulations show that under an increasing spin rate (such as due to the YORP effect), the regolith covering is preferentially lost across certain regions of the body. For regolith with little or no cohesive strength, failure occurs by landsliding from the mid latitudes of the body at high enough spin rates. As the cohesive strength of the regolith increases, failure occurs by fission of grains (or coherent chunks of grains) across a greater extent of latitudes and eventually will first occur at the equator. As the spin rate is further increased, failure regions migrate from the first failure point to higher and lower latitudes. Eventually failure will encompass the equatorial region, however there always remains a region of high latitudes (around the poles) that will not undergo failure for arbitrarily high spin rates (unless disturbed by some other phenomenon). With these results a scaling law is derived that can be used to determine whether observed asteroids could retain surface regolith grains of a given size. The implications of this for the interpretation of spectral observations of small asteroids and boulder migration on large asteroids are discussed.


title: Neutrino decoherence in a fermion and scalar background

abstract: We consider the decoherence effects in the propagation of neutrinos in a background composed of a scalar particle and a fermion due to the non-forward neutrino scattering processes. Using a simple model for the coupling of the form $\bar f_R\nu_L\phi$ we calculate the contribution to the imaginary part of the neutrino self-energy arising from the non-forward neutrino scattering processes in such backgrounds, from which the damping terms are determined. In the case we are considering, in which the initial neutrino state is depleted but does not actually disappear (the initial neutrino transitions into a neutrino of a different flavor but does not decay into a $f\phi$ pair, for example), we associate the damping terms with decoherence effects. For this purpose we give a precise prescription to identify the decoherence terms, as used in the context of the master or Linblad equation, in terms of the damping terms we have obtained from the calculation of the imaginary part of the neutrino self-energy from the non-forward neutrino scattering processes. The results can be directly useful in the context of Dark Matter-neutrino interaction models in which the scalar and/or fermion constitute the dark-matter, and can also serve to guide the generalizations to other models and/or situations in which the decoherence effects in the propagation of neutrinos originate from the non-forward scattering processes may be important. As a guide to estimating such decoherence effects, the contributions to the absorptive part of the self-energy and the corresponding damping terms are computed explicitly in the context of the model we consider, for several limiting cases of the momentum distribution functions of the background particles.


title: TalkDown: A Corpus for Condescension Detection in Context

abstract: Condescending language use is caustic; it can bring dialogues to an end and bifurcate communities. Thus, systems for condescension detection could have a large positive impact. A challenge here is that condescension is often impossible to detect from isolated utterances, as it depends on the discourse and social context. To address this, we present TalkDown, a new labeled dataset of condescending linguistic acts in context. We show that extending a language-only model with representations of the discourse improves performance, and we motivate techniques for dealing with the low rates of condescension overall. We also use our model to estimate condescension rates in various online communities and relate these differences to differing community norms.


title: Rainbow Pancyclicity in Graph Systems

abstract: Let $G_1,...,G_n$ be graphs on the same vertex set of size $n$, each graph with minimum degree $\delta(G_i)\ge n/2$. A recent conjecture of Aharoni asserts that there exists a rainbow Hamiltonian cycle i.e. a cycle with edge set $\{e_1,...,e_n\}$ such that $e_i\in E(G_i)$ for $1\leq i \leq n$. This can be viewed as a rainbow version of the well-known Dirac theorem. In this paper, we prove this conjecture asymptotically by showing that for every $\varepsilon>0$, there exists an integer $N>0$, such that when $n>N$ for any graphs $G_1,...,G_n$ on the same vertex set of size $n$ with $\delta(G_i)\ge (\frac{1}{2}+\varepsilon)n$, there exists a rainbow Hamiltonian cycle. Our main tool is the absorption technique. Additionally, we prove that with $\delta(G_i)\geq \frac{n+1}{2}$ for each $i$, one can find rainbow cycles of length $3,...,n-1$.


title: Compression based bound for non-compressed network: unified generalization error analysis of large compressible deep neural network

abstract: One of the biggest issues in deep learning theory is the generalization ability of networks with huge model size. The classical learning theory suggests that overparameterized models cause overfitting. However, practically used large deep models avoid overfitting, which is not well explained by the classical approaches. To resolve this issue, several attempts have been made. Among them, the compression based bound is one of the promising approaches. However, the compression based bound can be applied only to a compressed network, and it is not applicable to the non-compressed original network. In this paper, we give a unified frame-work that can convert compression based bounds to those for non-compressed original networks. The bound gives even better rate than the one for the compressed network by improving the bias term. By establishing the unified frame-work, we can obtain a data dependent generalization error bound which gives a tighter evaluation than the data independent ones.


title: Switched linear projections for neural network interpretability

abstract: We introduce switched linear projections for expressing the activity of a neuron in a deep neural network in terms of a single linear projection in the input space. The method works by isolating the active subnetwork, a series of linear transformations, that determine the entire computation of the network for a given input instance. With these projections we can decompose activity in any hidden layer into patterns detected in a given input instance. We also propose that in ReLU networks it is instructive and meaningful to examine patterns that deactivate the neurons in a hidden layer, something that is implicitly ignored by the existing interpretability methods tracking solely the active aspect of the network's computation.


title: Non-Markovian Models of Environmentally-driven Disentanglement in Molecular Charge Qubits

abstract: Models of quantum disentanglement are developed for nanometer-scale molecular charge qubits (MCQs). Two MCQs, $A$ and $B$, are prepared in a Bell state and separated for negligible $A$-$B$ interactions. Interactions between the local environment and each MCQ unravels $A$-$B$ entanglement during coherent system+environment evolution. Three models are used for dynamics: (1) a previously-developed, numerical model, in which both $AB$ and environment $\mathcal{E}$ are modeled explicitly; (2) an exact, semi-analytic model, in which only the dynamics of $AB$ are calculated, and (3) an approximate model developed from the semi-analytic model and assumptions about randomness in $\mathcal{E}$. In the approximate model, the non-zero coherences of the density operator for $AB$ decay with a Gaussian time dependence. This provides a time scale for system dynamics in the exact models as well. This time scale is related directly to the strength of AB-$\mathcal{E}$ interaction. This time scale describes cases where environmental interaction with one target MCQ is dominant, generalizing a previous time scale applicable only when both MCQs have roughly the same strength of interaction with the local environment. Entanglement is measured using two-qubit correlation functions, the dynamics of which are used to demonstrate the effectiveness of the time scale. The early-time decay of coherences and the loss of entanglement is well-characterized as Gaussian, a behavior that Markovian models for memoryless environments cannot capture. The approximate Gaussian model may be used to describe the dynamics of MCQ disentanglement under the influence of environments modeled here, as well as other environments where randomness is present.


title: Towards Automated Biometric Identification of Sea Turtles (Chelonia mydas)

abstract: Passive biometric identification enables wildlife monitoring with minimal disturbance. Using a motion-activated camera placed at an elevated position and facing downwards, we collected images of sea turtle carapace, each belonging to one of sixteen Chelonia mydas juveniles. We then learned co-variant and robust image descriptors from these images, enabling indexing and retrieval. In this work, we presented several classification results of sea turtle carapaces using the learned image descriptors. We found that a template-based descriptor, i.e., Histogram of Oriented Gradients (HOG) performed exceedingly better during classification than keypoint-based descriptors. For our dataset, a high-dimensional descriptor is a must due to the minimal gradient and color information inside the carapace images. Using HOG, we obtained an average classification accuracy of 65%.


title: Simplicity of reduced group Banach algebras

abstract: Let G be a discrete group. Suppose that the reduced group C*-algebra of G is simple. We use results of Kalantar-Kennedy and Haagerup, and Banach space interpolation, to prove that, for p in (1,infinity), the reduced group L^p operator algebra F^p_r(G) and its *-analog B^{p,*}_r(G) are simple. If G is countable, we prove that the Banach algebras generated by the left regular representations on reflexive Orlicz sequence spaces and certain Lorentz sequence spaces are also simple. We prove analogous results with simplicity replaced by the unique trace property. For use in the Orlicz sequence space case, we prove that if p is in (1,infinity), then any reflexive Orlicz sequence space is isomorphic (not necessarily isometrically) to a space gotten by interpolation between l^p and some other Orlicz sequence space.


title: Quantifying Bore-bore Capture on Natural Beaches

abstract: Bore-bore capture occurs when a faster moving bore captures a slower moving bore whilst both are propagating shoreward in the surf or swash zones. This phenomenon occurs frequently on natural beaches, but has not yet been quantified in the literature. Novel application of wave tracking methods allowed for investigation of this phenomenon at seven sandy, micro-tidal, wave-dominated Australian beaches. The results showed that, for the locations where beach slope and environmental conditions allowed for bore-bore capture to occur, there was a high probability 40% of one bore capturing another bore in the surf or swash zones. The landward-most 10% of the nearshore region (i.e., the time-varying surf-swash extent) was found to be the most likely location for a bore-bore capture event. Amplitude and frequency dispersion and the interaction between bores and infragravity waves are (indirectly) shown to to be equally important for driving bore-bore capture. Capture events infrequently led to extreme horizontal shoreline maxima (approximately 20% of the cases), however, most extreme shoreline maxima were directly driven by bore-bore capture events >97% of the cases). For the analysed data, there was a direct relation between the probability of bore-bore capture driving extreme shoreline maxima and the Iribarren Number and beach morphodynamic state: the steeper or more reflective the beach, the higher the probability of a bore-bore capture event causing an extreme shoreline maxima event. Such correlation has direct importance for the future development of predictive runup models, which currently do not account for this phenomenon.


title: Human-in-the-loop Robotic Manipulation Planning for Collaborative Assembly

abstract: This paper develops a robotic manipulation planner for human-robot collaborative assembly. Unlike previous methods which study an independent and fully AI-equipped autonomous system, this paper explores the subtask distribution between a robot and a human and studies a human-in-the-loop robotic system for collaborative assembly. The system distributes the subtasks of an assembly to robots and humans by exploiting their advantages and avoiding their disadvantages. The robot in the system will work on pick-and-place tasks and provide workpieces to humans. The human collaborator will work on fine operations like aligning, fixing, screwing, etc. A constraint based incremental manipulation planning method is proposed to generate the motion for the robots. The performance of the proposed system is demonstrated by asking a human and the dual-arm robot to collaboratively assemble a cabinet. The results showed that the proposed system and planner are effective, efficient, and can assist humans in finishing the assembly task comfortably.


title: Structural Balance via Gradient Flows over Signed Graphs

abstract: Structural balance is a classic property of signed graphs satisfying Heider's seminal axioms. Mathematical sociologists have studied balance theory since its inception in the 1040s. Recent research has focused on the development of dynamic models explaining the emergence of structural balance. In this paper, we introduce a novel class of parsimonious dynamic models for structural balance based on an interpersonal influence process. Our proposed models are gradient flows of an energy function, called the dissonance function, which captures the cognitive dissonance arising from violations of Heider's axioms. Thus, we build a new connection with the literature on energy landscape minimization. This gradient flow characterization allows us to study the transient and asymptotic behaviors of our model. We provide mathematical and numerical results describing the critical points of the dissonance function.


title: Constructing Laplacian matrices with Soules vectors: inverse eigenvalue problem and applications

abstract: The symmetric nonnegative inverse eigenvalue problem (SNIEP) asks which sets of numbers (counting multiplicities) can be the eigenvalues of a symmetric matrix with nonnegative entries. While examples of such matrices are abundant in linear algebra and various applications, this question is still open for matrices of dimension $N\geq 5$. One of the approaches to solve the SNIEP was proposed by George W. Soules, relying on a specific type of eigenvectors (Soules vectors) to derive sufficient conditions for this problem. Elsner et al. later showed a canonical way to construct all Soules vectors, based on binary rooted trees. While Soules vectors are typically treated as a totally ordered set of vectors, we propose in this article to consider a relaxed alternative: a partially ordered set of Soules vectors. We show that this perspective enables a more complete characterization of the sufficient conditions for the SNIEP. In particular, we show that the set of eigenvalues that satisfy these sufficient conditions is a convex cone, with symmetries corresponding to the automorphisms of the binary rooted tree from which the Soules vectors were constructed. As a second application, we show how Soules vectors can be used to construct graph Laplacian matrices with a given spectrum and describe a number of interesting connections with the concepts of hierarchical random graphs, equitable partitions and effective resistance.


title: Constructing Auxiliary Dynamics for Nonequilibrium Stationary States by Variance Minimization

abstract: We present a strategy to construct guiding distribution functions (GDFs) based on variance minimization. Auxiliary dynamics via GDFs mitigates the exponential growth of variance as a function of bias in Monte Carlo estimators of large deviation functions. The variance minimization technique exploits the exact properties of eigenstates of the tilted operator that defines the biased dynamics in the nonequilibrium system. We demonstrate our techniques in two classes of problems. In the continuum, we show that GDFs can be optimized to study interacting driven diffusive systems where the efficiency is systematically improved by incorporating higher correlations into the GDF. On the lattice, we use a correlator product state ansatz to study the 1D WASEP. We show that with modest resources we can capture the features of the susceptibility in large systems that marks the phase transition from uniform transport to a traveling wave state. Our work extends the repertoire of tools available to study nonequilibrium properties in realistic systems.

categories: cond-mat.stat-mech cond-mat.soft physics.chem-ph physics.comp-ph


title: Perpetual floating drops

abstract: The stability of floating drops on the liquid surface of the same liquid is considered in terms of viscous drainage theory. We have expressed the minimal thickness of the air film, separating the drop from the liquid surface, and the lifetime of the drop through the Hamaker constant, characterizing the intensity of van-der-Waals forces which make the air film unstable. It is shown that a horizontally moving or just rotating drop can have an infinite lifetime when the drop surface velocity exceeds some critical value. A spectacular example of a long-living rotating paraffin droplet on a burning candle is given. Results obtained can help to control a liquid surface in situ with the use of floating/rotating drops.


title: A Dictionary Approach to Domain-Invariant Learning in Deep Networks

abstract: In this paper, we consider domain-invariant deep learning by explicitly modeling domain shifts with only a small amount of domain-specific parameters in a Convolutional Neural Network (CNN). By exploiting the observation that a convolutional filter can be well approximated as a linear combination of a small set of dictionary atoms, we show for the first time, both empirically and theoretically, that domain shifts can be effectively handled by decomposing a convolutional layer into a domain-specific atom layer and a domain-shared coefficient layer, while both remain convolutional. An input channel will now first convolve spatially only with each respective domain-specific dictionary atom to "absorb" domain variations, and then output channels are linearly combined using common decomposition coefficients trained to promote shared semantics across domains. We use toy examples, rigorous analysis, and real-world examples with diverse datasets and architectures, to show the proposed plug-in framework's effectiveness in cross and joint domain performance and domain adaptation. With the proposed architecture, we need only a small set of dictionary atoms to model each additional domain, which brings a negligible amount of additional parameters, typically a few hundred.


title: Stochastic Conditional Generative Networks with Basis Decomposition

abstract: While generative adversarial networks (GANs) have revolutionized machine learning, a number of open questions remain to fully understand them and exploit their power. One of these questions is how to efficiently achieve proper diversity and sampling of the multi-mode data space. To address this, we introduce BasisGAN, a stochastic conditional multi-mode image generator. By exploiting the observation that a convolutional filter can be well approximated as a linear combination of a small set of basis elements, we learn a plug-and-played basis generator to stochastically generate basis elements, with just a few hundred of parameters, to fully embed stochasticity into convolutional filters. By sampling basis elements instead of filters, we dramatically reduce the cost of modeling the parameter space with no sacrifice on either image diversity or fidelity. To illustrate this proposed plug-and-play framework, we construct variants of BasisGAN based on state-of-the-art conditional image generation networks, and train the networks by simply plugging in a basis generator, without additional auxiliary components, hyperparameters, or training objectives. The experimental success is complemented with theoretical results indicating how the perturbations introduced by the proposed sampling of basis elements can propagate to the appearance of generated images.


title: Task-Oriented Conversation Generation Using Heterogeneous Memory Networks

abstract: How to incorporate external knowledge into a neural dialogue model is critically important for dialogue systems to behave like real humans. To handle this problem, memory networks are usually a great choice and a promising way. However, existing memory networks do not perform well when leveraging heterogeneous information from different sources. In this paper, we propose a novel and versatile external memory networks called Heterogeneous Memory Networks (HMNs), to simultaneously utilize user utterances, dialogue history and background knowledge tuples. In our method, historical sequential dialogues are encoded and stored into the context-aware memory enhanced by gating mechanism while grounding knowledge tuples are encoded and stored into the context-free memory. During decoding, the decoder augmented with HMNs recurrently selects each word in one response utterance from these two memories and a general vocabulary. Experimental results on multiple real-world datasets show that HMNs significantly outperform the state-of-the-art data-driven task-oriented dialogue models in most domains.


title: Annotated Guidelines and Building Reference Corpus for Myanmar-English Word Alignment

abstract: Reference corpus for word alignment is an important resource for developing and evaluating word alignment methods. For Myanmar-English language pairs, there is no reference corpus to evaluate the word alignment tasks. Therefore, we created the guidelines for Myanmar-English word alignment annotation between two languages over contrastive learning and built the Myanmar-English reference corpus consisting of verified alignments from Myanmar ALT of the Asian Language Treebank (ALT). This reference corpus contains confident labels sure (S) and possible (P) for word alignments which are used to test for the purpose of evaluation of the word alignments tasks. We discuss the most linking ambiguities to define consistent and systematic instructions to align manual words. We evaluated the results of annotators agreement using our reference corpus in terms of alignment error rate (AER) in word alignment tasks and discuss the words relationships in terms of BLEU scores.


title: Deep learning vessel segmentation and quantification of the foveal avascular zone using commercial and prototype OCT-A platforms

abstract: Automatic quantification of perifoveal vessel densities in optical coherence tomography angiography (OCT-A) images face challenges such as variable intra- and inter-image signal to noise ratios, projection artefacts from outer vasculature layers, and motion artefacts. This study demonstrates the utility of deep neural networks for automatic quantification of foveal avascular zone (FAZ) parameters and perifoveal vessel density of OCT-A images in healthy and diabetic eyes. OCT-A images of the foveal region were acquired using three OCT-A systems: a 1060nm Swept Source (SS)-OCT prototype, RTVue XR Avanti (Optovue Inc., Fremont, CA), and the ZEISS Angioplex (Carl Zeiss Meditec, Dublin, CA). Automated segmentation was then performed using a deep neural network. Four FAZ morphometric parameters (area, min/max diameter, and eccentricity) and perifoveal vessel density were used as outcome measures. The accuracy, sensitivity and specificity of the DNN vessel segmentations were comparable across all three device platforms. No significant difference between the means of the measurements from automated and manual segmentations were found for any of the outcome measures on any system. The intraclass correlation coefficient (ICC) was also good (> 0.51) for all measurements. Automated deep learning vessel segmentation of OCT-A may be suitable for both commercial and research purposes for better quantification of the retinal circulation.


title: Structured random sketching for PDE inverse problems

abstract: For an overdetermined system $\mathsf{A}\mathsf{x} \approx \mathsf{b}$ with $\mathsf{A}$ and $\mathsf{b}$ given, the least-square (LS) formulation $\min_x \, \|\mathsf{A}\mathsf{x}-\mathsf{b}\|_2$ is often used to find an acceptable solution $\mathsf{x}$. The cost of solving this problem depends on the dimensions of $\mathsf{A}$, which are large in many practical instances. This cost can be reduced by the use of random sketching, in which we choose a matrix $\mathsf{S}$ with fewer rows than $\mathsf{A}$ and $\mathsf{b}$, and solve the sketched LS problem $\min_x \, \|\mathsf{S}(\mathsf{A} \mathsf{x}-\mathsf{b})\|_2$ to obtain an approximate solution to the original LS problem. Significant theoretical and practical progress has been made in the last decade in designing the appropriate structure and distribution for the sketching matrix $\mathsf{S}$. When $\mathsf{A}$ and $\mathsf{b}$ arise from discretizations of a PDE-based inverse problem, tensor structure is often present in $\mathsf{A}$ and $\mathsf{b}$. For reasons of practical efficiency, $\mathsf{S}$ should be designed to have a structure consistent with that of $\mathsf{A}$. Can we claim similar approximation properties for the solution of the sketched LS problem with structured $\mathsf{S}$ as for fully-random $\mathsf{S}$? We give estimates that relate the quality of the solution of the sketched LS problem to the size of the structured sketching matrices, for two different structures. Our results are among the first known for random sketching matrices whose structure is suitable for use in PDE inverse problems.


title: Question Answering is a Format; When is it Useful?

abstract: Recent years have seen a dramatic expansion of tasks and datasets posed as question answering, from reading comprehension, semantic role labeling, and even machine translation, to image and video understanding. With this expansion, there are many differing views on the utility and definition of "question answering" itself. Some argue that its scope should be narrow, or broad, or that it is overused in datasets today. In this opinion piece, we argue that question answering should be considered a format which is sometimes useful for studying particular phenomena, not a phenomenon or task in itself. We discuss when a task is correctly described as question answering, and when a task is usefully posed as question answering, instead of using some other format.


title: Thermoelectric transport coefficients of a Dirac electron gas in high magnetic fields

abstract: We study the thermoelectric transport properties of a three-dimensional massive relativistic fermion gas with screened Coulomb impurities in high magnetic fields where only the lowest Landau levels contribute to the transport. Our results can be applied to experimental results of gapless and gapped Dirac materials. We focus on the effects of the mass term and we show the main differences that arise compared to the massless Dirac fermions. The different behavior is shown to be relevant at higher magnetic fields. The calculations are performed in the framework of the linear response theory using the exact quantum mechanical solution of the system in a constant magnetic field. We prove that the Mott formula and the Wiedemann-Franz law are valid at low temperatures and use them to calculate the thermoelectric transport coefficients. We show that the temperature range where the low temperature approximation is valid increases with increasing magnetic fields. The magnetic field dependence of measurable quantities (i.e. conductivity, Seebeck coefficient, Nernst coefficient and thermal conductivity) strongly depend on the magnetic field dependence of the scattering rate, thus the result relies on the proper treatment of the impurities. In this work they are included through the first Born approximation using screened charged impurities as impurity potential. We show that the electric conductivity does not change qualitatively in the case of finite mass term. On the other hand we find that the mass term causes significantly different behavior in the Seebeck and Nernst coefficients.


title: Calibration of the angular momenta of the minor planets in the solar system

abstract: We aim to determine the relative angle between the total angular momentum of the minor planets and that of the Sun-planets system, and to improve the orientation of the invariable plane of the solar system. By utilizing physical parameters available in public domain archives, we assigned reasonable masses to 718041 minor planets throughout the solar system, including near-Earth objects, main belt asteroids, Jupiter trojans, trans-Neptunian objects, scattered-disk objects, and centaurs. Then we combined the orbital data to calibrate the angular momenta of these small bodies, and evaluated the specific contribution of the massive dwarf planets. The effects of uncertainties on the mass determination and the observational incompleteness were also estimated. We determine the total angular momentum of the known minor planets to be $1.7817\times10^{46}$ g $\cdot$ cm$^2$ $\cdot$ s$^{-1}$. The relative angle $\alpha$ between this vector and the total angular momentum of the Sun-planets system is calculated to be 14.74 deg.. By excluding the dwarf planets Eris, Pluto, and Haumea, which have peculiar angular momentum directions, $\alpha$ drops sharply to 1.76 deg.; a similar result applies to each individual minor planet group. This suggests that, without these three most massive bodies, the plane perpendicular to the total angular momentum of the minor planets would be close to the invariable plane of the solar system. On the other hand, the inclusion of Eris, Haumea, and Makemake can produce a difference of 1254 mas in the inclination of the invariable plane, which is much larger than the difference of 9 mas induced by Ceres, Vesta, and Pallas as found previously. By taking into account the angular momentum contributions from all minor planets, including unseen ones, the orientation improvement of the invariable plane is larger than 1000 mas in inclination with a $1\sigma$ error of 50-140 mas.


title: Hierarchical Probabilistic Model for Blind Source Separation via Legendre Transformation

abstract: We present a novel blind source separation (BSS) method, called information geometric blind source separation (IGBSS). Our formulation is based on the log-linear model equipped with a hierarchically structured sample space, which has theoretical guarantees to uniquely recover a set of source signals by minimizing the KL divergence from a set of mixed signals. Source signals, received signals, and mixing matrices are realized as different layers in our hierarchical sample space. Our empirical results have demonstrated on images and time series data that our approach is superior to well established techniques and is able to separate signals with complex interactions.


title: A new formation model for omega Centauri: the crossroad of astrophysical processes

abstract: We investigate the formation processes of the Galactic globular cluster (GC) omega Cen with multiple stellar populations based on our original hydrodynamical simulations with chemical enrichment by Type II supernovae (SNe II), asymptotic giant branch (AGB) stars, and neutron star mergers (NSMs). The principal results are as follows. Multiple stellar populations with a wide range of [Fe/H] can be formed from rather massive and compact molecular cloud with a mass of 2 * 10^7 M_sun in the central region of its dwarf galaxy within less than a few hundred Myr. Gas ejected from SNe II and AGB stars can mix well to form new stars with higher He abundances (Y) and higher [Fe/H]. The He-rich stars are strongly concentrated in the GC's central region so that the GC can show a steep negative gradient of Y. Relative ratios of light elements to Fe show bimodal distributions for a given [Fe/H] owing to star formation from original gas and AGB ejecta. [La/Fe] and [Ba/Fe] can rapidly increase until [Fe/H]~-1.5 and then decrease owing to Fe ejection from SNe II. Although AGB ejecta can be almost fully retained in intra-cluster medium, NSM ejecta can be retained only partially. This difference in the retention capability is responsible for the observed unique [Eu/Fe]-[Fe/H] and [La/Eu]-[Fe/H] relations in omega Cen. Some observational results such as the [O/Na]$-$[Fe/H] relation and radial [Fe/H] gradient are yet to be well reproduced in the present model.


title: Multiple-Rate Channel Codes in $\texttt{GF}(p^{n^{2}})$

abstract: A code $\mathcal{C}(n, k, d)$ defined over $\texttt{GF}(q^{n})$ is conventionally designed to encode a $k$-symbol user data into a codeword of length $n$, resulting in a fixed-rate coding. This paper proposes a coding procedure to derive a multiple-rate code from existing channel codes defined over a composite field $\texttt{GF}(q^{n})$. Formally, by viewing a symbol of $\texttt{GF}(q^{n})$ as an $n$-tuple over the base field $\texttt{GF}(q)$, the proposed coding scheme employs children codes $\mathcal{C}_{1}(n, 1), \mathcal{C}_{2}(n, 2), \ldots, \mathcal{C}_{n}(n, n)$ defined over $\texttt{GF}(q)$ to encode user messages of arbitrary lengths and incorporates a variable-rate feature. In sequel, unlike the conventional block codes of length $n$, the derived multiple-rate code of fixed blocklength $n$ (over $\texttt{GF}(q^{n})$) can be used to encode and decode user messages ${\bf m}$ (over $\texttt{GF}(q)$) of arbitrary lengths $|{\bf m}| = k, k+1, \ldots, kn$, thereby supporting a range of information rates - inclusive of the code rates $1/n, 2/n, \ldots, (k-1)/n$, in addition to the existing code rate $k/n$. The proposed multiple-rate coding scheme is also equipped with a decoding strategy, wherein the identification of children encoded user messages of variable length are carried out through a simple procedure using {\it orthogonal projectors}.


title: Learning to Detect Opinion Snippet for Aspect-Based Sentiment Analysis

abstract: Aspect-based sentiment analysis (ABSA) is to predict the sentiment polarity towards a particular aspect in a sentence. Recently, this task has been widely addressed by the neural attention mechanism, which computes attention weights to softly select words for generating aspect-specific sentence representations. The attention is expected to concentrate on opinion words for accurate sentiment prediction. However, attention is prone to be distracted by noisy or misleading words, or opinion words from other aspects. In this paper, we propose an alternative hard-selection approach, which determines the start and end positions of the opinion snippet, and selects the words between these two positions for sentiment prediction. Specifically, we learn deep associations between the sentence and aspect, and the long-term dependencies within the sentence by leveraging the pre-trained BERT model. We further detect the opinion snippet by self-critical reinforcement learning. Especially, experimental results demonstrate the effectiveness of our method and prove that our hard-selection approach outperforms soft-selection approaches when handling multi-aspect sentences.


title: Classification Logit Two-sample Testing by Neural Networks

abstract: The recent success of generative adversarial networks and variational learning suggests training a classifier network may work well in addressing the classical two-sample problem. Network-based tests have the computational advantage that the algorithm scales to large samples. This paper proposes a two-sample statistic which is the difference of the logit function, provided by a trained classification neural network, evaluated on the testing set split of the two datasets. Theoretically, we prove the testing power to differentiate two sub-exponential densities given that the network is sufficiently parametrized. When the two densities lie on or near to low-dimensional manifolds embedded in possibly high-dimensional space, the needed network complexity is reduced to only scale with the intrinsic dimensionality. Both the approximation and estimation error analysis are based on a new result of near-manifold integral approximation. In experiments, the proposed method demonstrates better performance than previous network-based tests using classification accuracy as the two-sample statistic, and compares favorably to certain kernel maximum mean discrepancy tests on synthetic datasets and hand-written digit datasets.


title: Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models

abstract: In natural language processing, it has been observed recently that generalization could be greatly improved by finetuning a large-scale language model pretrained on a large unlabeled corpus. Despite its recent success and wide adoption, finetuning a large pretrained language model on a downstream task is prone to degenerate performance when there are only a small number of training instances available. In this paper, we introduce a new regularization technique, to which we refer as "mixout", motivated by dropout. Mixout stochastically mixes the parameters of two models. We show that our mixout technique regularizes learning to minimize the deviation from one of the two models and that the strength of regularization adapts along the optimization trajectory. We empirically evaluate the proposed mixout and its variants on finetuning a pretrained language model on downstream tasks. More specifically, we demonstrate that the stability of finetuning and the average accuracy greatly increase when we use the proposed approach to regularize finetuning of BERT on downstream tasks in GLUE.


title: Maps on positive cones in operator algebras preserving power means

abstract: In this paper we consider power means of positive Hilbert space operators both in the conventional and in the Kubo-Ando senses. We describe the corresponding isomorphisms (bijective transformations respecting those means as binary operations) on positive definite cones and on positive semidefinite cones in operator algebras. We also investigate the question when those two sorts of power means can be transformed into each other.


title: Minimum measurement time: lower bound on the frequency cutoff for collapse models

abstract: The CSL model predicts a progressive breakdown of the quantum superposition principle, with a noise randomly driving the state of the system towards a localized one, thus accounting for the emergence of a classical world within a quantum framework. In the original model the noise is supposed to be white, but since white noises do not exist in nature, it becomes relevant to identify some of its spectral properties. Experimental data set an upper bound on its frequencies, while in this paper we bound it from below. We do so in two ways: by considering a 'minimal' measurement setup, requiring that the collapse is completed within the measurement time; and in a measurement modeling-independent way, by requiring that the fluctuations average to zero before the measurement time.