title: Graphon Estimation from Partially Observed Network Data

abstract: We consider estimating the edge-probability matrix of a network generated from a graphon model when the full network is not observed---only some overlapping subgraphs are. We extend the neighbourhood smoothing (NBS) algorithm of Zhang et al. (2017) to this missing-data set-up and show experimentally that, for a wide range of graphons, the extended NBS algorithm achieves significantly smaller error rates than standard graphon estimation algorithms such as vanilla neighbourhood smoothing (NBS), universal singular value thresholding (USVT), blockmodel approximation, matrix completion, etc. We also show that the extended NBS algorithm is much more robust to missing data.


title: Truncated Cauchy Non-negative Matrix Factorization

abstract: Non-negative matrix factorization (NMF) minimizes the Euclidean distance between the data matrix and its low rank approximation, and it fails when applied to corrupted data because the loss function is sensitive to outliers. In this paper, we propose a Truncated CauchyNMF loss that handle outliers by truncating large errors, and develop a Truncated CauchyNMF to robustly learn the subspace on noisy datasets contaminated by outliers. We theoretically analyze the robustness of Truncated CauchyNMF comparing with the competing models and theoretically prove that Truncated CauchyNMF has a generalization bound which converges at a rate of order $O(\sqrt{{\ln n}/{n}})$, where $n$ is the sample size. We evaluate Truncated CauchyNMF by image clustering on both simulated and real datasets. The experimental results on the datasets containing gross corruptions validate the effectiveness and robustness of Truncated CauchyNMF for learning robust subspaces.


title: Endpoint Sobolev continuity of the fractional maximal function in higher dimensions

abstract: We establish continuity mapping properties of the non-centered fractional maximal operator $M_{\beta}$ in the endpoint input space $W^{1,1}(\mathbb{R}^d)$ for $d \geq 2$ in the cases for which its boundedness is known. More precisely, we prove that for $q=d/(d-\beta)$ the map $f \mapsto |\nabla M_\beta f|$ is continuous from $W^{1,1}(\mathbb{R}^d)$ to $L^{q}(\mathbb{R}^d)$ for $ 0 < \beta < 1$ if $f$ is radial and for $1 \leq \beta < d$ for general $f$. The results for $1\leq \beta < d$ extend to the centered counterpart $M_\beta^c$. Moreover, if $d=1$, we show that the conjectured boundedness of that map for $M_\beta^c$ implies its continuity.


title: Stabilization of Filament Production Rate for Screw Extrusion-Based Polymer 3D-Printing

abstract: Polymer 3D-printing has been commercialized rapidly during recent years, however, there remains a matter of improving the manufacturing speed. Screw extrusion has a strong potential to fasten the process through simultaneous operation of the filament production and the deposition. This paper develops a control algorithm for screw extrusion-based 3D printing of thermoplastic materials through an observer-based output feedback design. We consider the thermodynamic model describing the time evolution of the temperature profile of an extruded polymer by means of a partial differential equation (PDE) defined on the time-varying domain. The time evolution of the spatial domain is governed by an ordinary differential equation (ODE) that reflects the dynamics of the position of the phase change interface between polymer granules and molten polymer deposited as a molten filament. Steady-state profile of the distributed temperature along the extruder is obtained when the desired setpoint for the interface position is prescribed. To enhance the feasibility of our previous design, we develop a PDE observer to estimate the temperature profile via measured values of surface temperature and the interface position. An output feedback control law considering a cooling mechanism at the boundary inlet as an actuator is proposed. In extruders the control of raw material temperature is commonly achieved using preconditioners as part of the inlet feeding mechanism. For some given screw speeds that correspond to slow and fast operating modes, numerical simulations are conducted to prove the performance of the proposed controller. The convergence of the interface position to the desired setpoint is achieved under physically reasonable temperature profiles.


title: Constraints on positron annihilation kinematics in the inner Galaxy

abstract: The annihilation of cosmic positrons ($e^+$) with electrons in the interstellar medium (ISM) results in the strongest persistent gamma-ray line signal in the sky. For 50 years, this 511 keV emission has puzzled observers and theoreticians. A key issue for understanding $e^+$-astrophysics is found in cosmic-ray propagation, especially at low kinetic energies (< 10 MeV). We want to shed light on how $e^+$s propagate and the resulting morphology of the emission. We approach this "positron puzzle" by inferring kinematic information of the 511 keV line in the inner radian of the Galaxy. This constrains propagation scenarios and source populations. By dissecting the 511 keV emission as measured with INTEGRAL/SPI, we derive spectra for individual regions in the sky. The centroid energies are converted into Doppler-shifts, representing the line-of-sight velocity along different longitudes. This results in a longitude-velocity diagram of $e^+$-annihilation. We also determine Doppler-broadenings to study annihilation conditions as they vary across the Galaxy. We find line-of-sight velocities in the 511 keV line that are consistent with zero, as well as with galactic rotation from CO measurements, and measurements of radioactive Al-26. The velocity gradient in the inner 60 deg is determined to be $4\pm6$ km/s/deg. The 511 keV line width is constant as a function of longitude at $2.43\pm0.14$ keV. The positronium fraction is found to be 1.0 along the galactic plane. The weak signals in the disk leave open the question whether $e^+$-annihilation is associated with the high velocities seen in Al-26 or rather with ordinarily rotating components of the Galaxy's ISM. We confirm previous results that $e^+$s are slowed down to the 10 eV energy scale before annihilation, and constrain bulk Doppler-broadening contributions to <1.25 keV. Consequently, the true annihilation conditions remain unclear.


title: Budgeted Policy Learning for Task-Oriented Dialogue Systems

abstract: This paper presents a new approach that extends Deep Dyna-Q (DDQ) by incorporating a Budget-Conscious Scheduling (BCS) to best utilize a fixed, small amount of user interactions (budget) for learning task-oriented dialogue agents. BCS consists of (1) a Poisson-based global scheduler to allocate budget over different stages of training; (2) a controller to decide at each training step whether the agent is trained using real or simulated experiences; (3) a user goal sampling module to generate the experiences that are most effective for policy learning. Experiments on a movie-ticket booking task with simulated and real users show that our approach leads to significant improvements in success rate over the state-of-the-art baselines given the fixed budget.


title: A Survey of Natural Language Generation Techniques with a Focus on Dialogue Systems - Past, Present and Future Directions

abstract: One of the hardest problems in the area of Natural Language Processing and Artificial Intelligence is automatically generating language that is coherent and understandable to humans. Teaching machines how to converse as humans do falls under the broad umbrella of Natural Language Generation. Recent years have seen unprecedented growth in the number of research articles published on this subject in conferences and journals both by academic and industry researchers. There have also been several workshops organized alongside top-tier NLP conferences dedicated specifically to this problem. All this activity makes it hard to clearly define the state of the field and reason about its future directions. In this work, we provide an overview of this important and thriving area, covering traditional approaches, statistical approaches and also approaches that use deep neural networks. We provide a comprehensive review towards building open domain dialogue systems, an important application of natural language generation. We find that, predominantly, the approaches for building dialogue systems use seq2seq or language models architecture. Notably, we identify three important areas of further research towards building more effective dialogue systems: 1) incorporating larger context, including conversation context and world knowledge; 2) adding personae or personality in the NLG system; and 3) overcoming dull and generic responses that affect the quality of system-produced responses. We provide pointers on how to tackle these open problems through the use of cognitive architectures that mimic human language understanding and generation capabilities.


title: Re-factorising a QRT map

abstract: A QRT map is the composition of two involutions on a biquadratic curve: one switching the $x$-coordinates of two intersection points with a given horizontal line, and the other switching the $y$-coordinates of two intersections with a vertical line. Given a QRT map, a natural question is to ask whether it allows a decomposition into further involutions. Here we provide new answers to this question and show how they lead to a new class of maps, as well as known HKY maps and quadrirational Yang-Baxter maps.


title: Description of atypical bursts seen slightly off-axis

abstract: The detection of gravitational waves together with their electromagnetic counterpart, in the gamma-ray burst GRB 170817A, marked a new era of multi-messenger astronomy. Several theoretical models have been proposed to explain the atypical behavior of this event. Recently, it was shown that the multi-wavelength afterglow of GRB 170817A was consistent with a synchrotron forward-shock model when the outflow was viewed off-axis, decelerated in a uniform medium and parametrized through a power-law velocity distribution. Motivated by the upper limits on the very-high-energy emission, and the stratified medium in the close vicinity of a binary neutron star merger proposed to explain the gamma-ray flux in the short GRB 150101B, we extend the mechanism proposed to explain GRB 170817A to a more general scenario deriving the synchrotron self-Compton (SSC) and synchrotron forward-shock model when the off-axis outflow is decelerated in a uniform and stratified circumburst density. As particular cases, we show that the delayed and long-lasting afterglow emission observed in GRB 080503, GRB140903A, GRB 150101B, and GRB 160821B could be interpreted by a similar scenario to the one used to describe GRB 170817A. In addition, we show that the proposed scenario agrees with the MAGIC, Fermi-LAT and H.E.S.S upper limits on gamma-ray emission from GRB 160821B and GRB 170817A.


title: Mixed control of vibrational systems

abstract: We consider new performance measures for vibrational systems based on the $H_2$ norm of linear time invariant systems. New measures will be used as an optimization criterion for the optimal damping of vibrational systems. We consider both theoretical and concrete cases in order to show how new measures stack up against the standard measures. The quality and advantages of new measures as well as the behaviour of optimal damping positions and corresponding damping viscosities are illustrated in numerical experiments.


title: Optimality Conditions for Cardinality-Constrained Programs and a SCA Method

abstract: We study a cardinality-constrained optimization problem with nonnegative variables in this paper. This problem is often encountered in practice. Firstly we study some properties on the optimal solutions of this optimization problem under some conditions. An equivalent reformulation of the problem under consideration is proposed. Based on the reformulation, we present a successive convex approximation method for the cardinality constrained optimization problem. We prove that the method converges to a KKT point of the reformulation problem. Under some conditions, the KKT points of the reformulation problem are local optimizers of the original problem. Our numerical results on a limited diversified mean-variance portfolio selection problem demonstrate some promising results.


title: Confidence Intervals for Selected Parameters

abstract: Practical or scientific considerations often lead to selecting a subset of parameters as ``important.'' Inferences about those parameters often are based on the same data used to select them in the first place. That can make the reported uncertainties deceptively optimistic: confidence intervals that ignore selection generally have less than their nominal coverage probability. Controlling the probability that one or more intervals for selected parameters do not cover---the ``simultaneous over the selected'' (SoS) error rate---is crucial in many scientific problems. Intervals that control the SoS error rate can be constructed in ways that take advantage of knowledge of the selection rule. We construct SoS-controlling confidence intervals for parameters deemed the most ``important'' $k$ of $m$ shift parameters because they are estimated (by independent estimators) to be the largest. The new intervals improve substantially over \v{S}id\'{a}k intervals when $k$ is small compared to $m$, and approach the standard Bonferroni-corrected intervals when $k \approx m$. Standard, unadjusted confidence intervals for location parameters have the correct coverage probability for $k=1$, $m=2$ if, when the true parameters are zero, the estimators are exchangeable and symmetric.


title: DAve-QN: A Distributed Averaged Quasi-Newton Method with Local Superlinear Convergence Rate

abstract: In this paper, we consider distributed algorithms for solving the empirical risk minimization problem under the master/worker communication model. We develop a distributed asynchronous quasi-Newton algorithm that can achieve superlinear convergence. To our knowledge, this is the first distributed asynchronous algorithm with superlinear convergence guarantees. Our algorithm is communication-efficient in the sense that at every iteration the master node and workers communicate vectors of size $O(p)$, where $p$ is the dimension of the decision variable. The proposed method is based on a distributed asynchronous averaging scheme of decision vectors and gradients in a way to effectively capture the local Hessian information of the objective function. Our convergence theory supports asynchronous computations subject to both bounded delays and unbounded delays with a bounded time-average. Unlike in the majority of asynchronous optimization literature, we do not require choosing smaller stepsize when delays are huge. We provide numerical experiments that match our theoretical results and showcase significant improvement comparing to state-of-the-art distributed algorithms.


title: A scalable optimal-transport based local particle filter

abstract: Filtering in spatially-extended dynamical systems is a challenging problem with significant practical applications such as numerical weather prediction. Particle filters allow asymptotically consistent inference but require infeasibly large ensemble sizes for accurate estimates in complex spatial models. Localisation approaches, which perform local state updates by exploiting low dependence between variables at distant points, have been suggested as a potential resolution to this issue. Naively applying the resampling step of the particle filter locally however produces implausible spatially discontinuous states. The ensemble transform particle filter replaces resampling with an optimal-transport map and can be localised by computing maps for every spatial mesh node. The resulting local ensemble transport particle filter is however computationally intensive for dense meshes. We propose a new optimal-transport based local particle filter which computes a fixed number of maps independent of the mesh resolution and interpolates these maps across space, reducing the computation required and allowing it to be ensured particles remain spatially smooth. We numerically illustrate that, at a reduced computational cost, we are able to achieve the same accuracy as the local ensemble transport particle filter, and retain its improved robustness to non-Gaussianity and ability to quantify uncertainty when compared to local ensemble Kalman filters.


title: Virtual Resolutions of Monomial Ideals on Toric Varieties

abstract: We use cellular resolutions of monomial ideals to prove an analog of Hilbert's syzygy theorem for virtual resolutions of monomial ideals on smooth toric varieties.


title: An XMCD study of magnetism and valence state in iron-substituted strontium titanate

abstract: Room temperature ferromagnetism was characterized for thin films of SrTi$_{0.6}$Fe$_{0.4}$O$_{3-{\delta}}$ grown by pulsed laser deposition on SrTiO$_{3}$ and Si substrates under different oxygen pressures and after annealing under oxygen and vacuum conditions. X-ray magnetic circular dichroism demonstrated that the magnetization originated from Fe$^{2+}$ cations, whereas Fe$^{3+}$ and Ti$^{4+}$ did not contribute. Films with the highest magnetic moment (0.8 {\mu}B per Fe) had the highest measured Fe$^{2+}$:Fe${^3+}$ ratio of 0.1 corresponding to the largest concentration of oxygen vacancies ({\delta} = 0.19). Post-growth annealing treatments under oxidizing and reducing conditions demonstrated quenching and partial recovery of magnetism respectively, and a change in Fe valence states. The study elucidates the microscopic origin of magnetism in highly Fe-substituted SrTi$_{1-x}$Fe$_x$O$_{3-{\delta}}$ perovskite oxides and demonstrates that the magnetic moment, which correlates with the relative content of Fe$^{2+}$ and Fe$^{3+}$, can be controlled via the oxygen content, either during growth or by post-growth annealing.

categories: cond-mat.mtrl-sci cond-mat.dis-nn cond-mat.mes-hall cond-mat.other cond-mat.str-el


title: Polynomial analogue of the Smarandache function

abstract: In the integer case, the Smarandache function of a positive integer $n$ is defined to be the smallest positive integer $k$ such that $n$ divides the factorial $k!$. In this paper, we first define a natural order for polynomials in $\mathbb{F}_q[t]$ over a finite field $\mathbb{F}_q$ and then define the Smarandache function of a non-zero polynomial $f \in \mathbb{F}_q[t]$, denoted by $S(f)$, to be the smallest polynomial $g$ such that $f$ divides the Carlitz factorial of $g$. In particular, we establish an analogue of a problem of Erd{\H o}s, which implies that for almost all polynomials $f$, $S(f)=t^d$, where $d$ is the maximal degree of the irreducible factors of $f$.


title: Deep learning from wristband sensor data: towards wearable, non-invasive seizure forecasting

abstract: Seizure forecasting may provide patients with timely warnings to adapt their daily activities and help clinicians deliver more objective, personalized treatments. While recent work has convincingly demonstrated that seizure risk assessment is possible, these early approaches relied largely on complex, often invasive setups including intracranial electrocorticography, implanted devices and multi-channel EEG, which limits translation of these methods to broad clinical application. To facilitate broader adaptation of seizure forecasting in clinical practice, non-invasive, easily applicable techniques that reliably assess seizure risk, in combination with clinical information, are crucial. Wristbands that continuously record physiological parameters, including electrodermal activity, body temperature, blood volume pressure and actigraphy, may afford monitoring of autonomous nervous system function and movement relevant for such a task, hence minimizing potential complications associated with invasive monitoring, and avoiding stigma associated with bulky external monitoring devices on the head. Here, we use deep learning to analyze long-term, multi-modal wristband sensor data from 50 patients with epilepsy (total duration $>$1400 hours) to assess its capability to distinguish preictal from interictal states. Prediction performance is assessed using area under the receiver operating charateristic (AUC) and improvement over chance (IoC) based on F1 scores. Using one- and two-dimensional convolutional neural networks, we identified better-than-chance predictability in out-of-sample test data in 60\% of the patients in leave-one-out and 43\% of patients in pseudo-prospective approaches. These results provide a step towards developing easier to apply, non-invasive methods for seizure risk assessments in patients with epilepsy.


title: Stochastic Generalized Adversarial Label Learning

abstract: The usage of machine learning models has grown substantially and is spreading into several application domains. A common need in using machine learning models is collecting the data required to train these models. In some cases, labeling a massive dataset can be a crippling bottleneck, so there is need to develop models that work when training labels for large amounts of data are not easily obtained. A possible solution is weak supervision, which uses noisy labels that are easily obtained from multiple sources. The challenge is how best to combine these noisy labels and train a model to perform well given a task. In this paper, we propose stochastic generalized adversarial label learning (Stoch-GALL), a framework for training machine learning models that perform well when noisy and possibly correlated labels are provided. Our framework allows users to provide different weak labels and multiple constraints on these labels. Our model then attempts to learn parameters for the data by solving a non-zero sum game optimization. The game is between an adversary that chooses labels for the data and a model that minimizes the error made by the adversarial labels. We test our method on three datasets by training convolutional neural network models that learn to classify image objects with limited access to training labels. Our approach is able to learn even in settings where the weak supervision confounds state-of-the-art weakly supervised learning methods. The results of our experiments demonstrate the applicability of this approach to general classification tasks.


title: Generating Question Relevant Captions to Aid Visual Question Answering

abstract: Visual question answering (VQA) and image captioning require a shared body of general knowledge connecting language and vision. We present a novel approach to improve VQA performance that exploits this connection by jointly generating captions that are targeted to help answer a specific visual question. The model is trained using an existing caption dataset by automatically determining question-relevant captions using an online gradient-based method. Experimental results on the VQA v2 challenge demonstrates that our approach obtains state-of-the-art VQA performance (e.g. 68.4% on the Test-standard set using a single model) by simultaneously generating question-relevant captions.


title: Charge transfer statistics and qubit dynamics at tunneling Fermi-edge singularity

abstract: Tunneling of spinless electrons from a single-channel emitter into an empty collector through an interacting resonant level of the quantum dot (QD) is studied, when all Coulomb screening of charge variations on the dot is realized by the emitter channel and the system is mapped onto an exactly solvable model of a dissipative qubit. In this model we describe the qubit density matrix evolution with a generalized Lindblad equation, which permit us to count the tunneling electrons and therefore relate the qubit dynamics to the charge transfer statistics. In particular, the coefficients of its generating function equal to the time dependent probabilities to have the fixed number of electrons tunneled into the collector are expressed through the parameters of a non-Hermitian Hamiltonian evolution of the qubit pure states in between the successive electron tunnelings. From the long time asymptotics of the generating function we calculate Fano factors of the second and third order (skewness) and establish their relation to the extra average and cumulant, respectively, of the charge accumulated in the transient process of the empty QD evolution beyond their linear time dependence. It explains the origin of the sub and super Poisson shot noise in this system and shows that the super Poisson signals existence of a non-monotonous oscillating transient current and the qubit coherent dynamics. The mechanism is illustrated with particular examples of the generating functions, one of which coincides in the large time limit with the $1/3$ fractional Poissonian realized without the real fractional charge tunneling.


title: Scattering below the ground state for the 2$d$ radial nonlinear Schr\"odinger equation

abstract: We revisit the problem of scattering below the ground state threshold for the mass-supercritical focusing nonlinear Schr\"odinger equation in two space dimensions. We present a simple new proof that treats the case of radial initial data. The key ingredient is a localized virial/Morawetz estimate; the radial assumption aids in controlling the error terms resulting from the spatial localization.


title: Accurate Modeling of the Projected Galaxy Clustering in Photometric Surveys: I. Tests with Mock Catalogs

abstract: We develop a novel method to explore the galaxy-halo connection using the galaxy imaging surveys by modeling the projected two-point correlation function measured from the galaxies with reasonable photometric redshift measurements. By assuming a Gaussian form of the photometric redshift errors, we are able to simultaneously constrain the halo occupation distribution (HOD) models and the effective photometric redshift uncertainties. Tests with mock galaxy catalogs demonstrate that this method can successfully recover (within $\sim 1\sigma$) the intrinsic large-scale galaxy bias, as well as the HOD models and the effective photometric redshift uncertainty. This method also works well even for galaxy samples with 10 per cent catastrophic photometric redshift errors.


title: Descent Data and Absolute Kan Extensions

abstract: The fundamental construction underlying descent theory, the lax descent category, comes with a functor that forgets the descent data. We prove that, in any $2$-category $\mathfrak{A} $ with lax descent objects, the forgetful morphisms create all Kan extensions that are preserved by certain morphisms. As a consequence, in the case $\mathfrak{A} = \mathsf{Cat} $, we get a monadicity theorem which says that a right adjoint functor is monadic if and only if it is, up to the composition with an equivalence, (naturally isomorphic to) a functor that forgets descent data. In particular, within the classical context of descent theory, we show that, in a fibred category, the forgetful functor between the category of internal actions of a precategory $a$ and the category of internal actions of the underlying discrete precategory is monadic if and only if it has a left adjoint. More particularly, this shows that one of the implications of the celebrated Benabou-Roubaud theorem does not depend on the so called Beck-Chevalley condition. Namely, we prove that, in indexed categories, whenever an effective descent morphism induces a right adjoint functor, the induced functor is monadic.


title: Stokes Vector Spectroscopy of Nonlinear Depolarized Light

abstract: Experimental Stokes vector spectroscopy characterizes polarization state noise in nonlinear fiber transmission. Noise bandwidths of a few MHz are observed from XPM-blurred receive SOPs using a polarization scrambling interferometer. This method can detect data pattern correlations among WDM channels that contribute to performance degradations in signalling.


title: Ultra-Slow Dynamic Annealing of Neutron-induced Defects in n-type Silicon: Role of Charge Carriers

abstract: Neutron bombardments with equivalent fluence (1$\times$10$^{10}$ cm$^{-2}$) and different fluxes ($2.5\times$10$^5$ cm$^{-2}$s$^{-1}$ to $1\times$10$^7$ cm$^{-2}$s$^{-1}$) have been performed on three kinds of bipolar devices with n-type silicon as active regions. The measured increase of base currents and input bias currents are found to decrease with increasing neutron flux, implying that the strength of the dynamic annealing of divacancy defects in n-type silicon follows a positive flux dependence. Such a flux dependence is the same as that observed in ions implantation using protons, but the evident flux sensitivity in our experiment is 4 orders of magnitude lower than that of proton bombardment, despite the similarity in the masses and energies of the two particles. The huge discrepancy of flux range is attributed to the presence of vast charge carriers in proton bombardments, which strongly accelerate the dynamic annealing of defects by enhancing the diffusion velocity of Si interstitials and dissociation rate of defect clusters. Our work would contribute to the understanding of the defect annealing processes in silicon.


title: Phase Diagrams of Charged Compact Boson Stars

abstract: Compact boson stars, whose scalar field vanishes identically in the exterior region, arise in a theory involving a {\it massless} complex scalar field with a conical potential, when coupled to gravity. Their charged compact generalizations, obtained in the presence of a U(1) gauge field, exhibit further interesting features. On the one hand, charged compact boson shells can arise, whose scalar field vanishes also in the central region, while on the other hand, the domain of existence of charged compact boson stars exhibits bifurcation points. First 2D phase diagrams have been studied before. Here we extend these earlier studies to a larger range of the variables and study additional phase diagrams. We then extend these studies to obtain 3D phase diagrams and present these with a detailed discussion of their various regions with respect to the bifurcation points and argue, that there is an infinite series of such bifurcation points. Thus the theory is seen to contain rich physics in a particular domain of the phase diagrams. We also discuss the dependence of the fields on the dimensionless radial coordinate for some representative points of the phase trajectories in the phase diagrams of the theory.


title: Quantitatively ranking incorrect responses to multiple-choice questions using item response theory

abstract: Research-based assessment instruments (RBAIs) are ubiquitous throughout both physics instruction and physics education research. The vast majority of analyses involving student responses to RBAI questions have focused on whether or not a student selects correct answers and using correctness to measure growth. This approach often undervalues the rich information that may be obtained by examining students' particular choices of incorrect answers. In the present study, we aim to reveal some of this valuable information by quantitatively determining the relative correctness of various incorrect responses. To accomplish this, we propose an assumption that allow us to define relative correctness: students who have a high understanding of Newtonian physics are likely to answer more questions correctly and also more likely to choose better incorrect responses, than students who have a low understanding. Analyses using item response theory align with this assumption, and Bock's nominal response model allows us to uniquely rank each incorrect response. We present results from over 7,000 students' responses to the Force and Motion Conceptual Evaluation.


title: Unique Factorization in Polynomial Rings with Zero Divisors

abstract: Given a certain factorization property of a ring $R$, we can ask if this property extends to the polynomial ring over $R$ or vice versa. For example, it is well known that $R$ is a unique factorization domain if and only if $R[X]$ is a unique factorization domain. If $R$ is not a domain, this is no longer true. In this paper we survey unique factorization in commutative rings with zero divisors, and characterize when a polynomial ring over an arbitrary commutative ring has unique factorization.


title: Extrinsic diameter of immersed flat tori in the 3-sphere II

abstract: We show that the extrinsic diameter of immersed flat tori in the 3-sphere is $\pi$ under a certain topological condition for the projection of their asymptotic curves with respect to the Hopf fibration.


title: Measuring operator size growth in quantum quench experiments

abstract: Operator scrambling denotes the evolution of a simple operator into a complicated one (in the Heisenberg picture), which characterizes quantum chaos in many-body systems. More specifically, a simple operator evolves into a linear superposition of many operators, most of which are many-body operators supported on a region of size much larger than $1$. In general, an operator does not have a definite size but is characterized by a probability distribution of size. The operator size is related to out-of-time-order correlation functions, but these are generically difficult to obtain from experimental observables. In this paper we show that the operator size distribution can be measured in quantum quench experiments. In a quantum spin system, we propose to prepare an ensemble of initial states which are direct product states of random pure states of each spin qudit, and measure a simple physical observable (such as a particular component of spin) at later time $t$. The initial state dependence of the expectation value measures a particular component of the operator size distribution. Furthermore, many other features of the operator size distribution can be measured by analyzing the same data, such as the support of the operator in space.


title: Extremal Behavior in Exponential Random Graphs

abstract: Yin, Rinaldo, and Fadnavis classified the extremal behavior of the edge-triangle exponential random graph model by first taking the network size to infinity, then the parameters diverging to infinity along straight lines. Lubetzky and Zhao proposed an extension to the edge-triangle model by introducing an exponent $\gamma > 0$ on the triangle homomorphism density function. This allows non-trivial behavior in the positive limit, which is absent in the standard edge-triangle model. The present work seeks to classify the limiting behavior of this generalized edge-triangle exponential random graph model. It is shown that for $\gamma \le 1$, the limiting set of graphons come from a special class, known as Tur\'an graphons. For $\gamma > 1$, there are large regions of the parameter space where the limit is not a Tur\'an graphon, but rather has edge density between subsequent Tur\'an graphons. Furthermore, for $\gamma$ large enough, the exact edge density of the limiting set is determined in terms of a nested radical. Utilizing a result of Reiher, intuition is given for the characterization of the extremal behavior in the generalized edge-clique model.


title: Accurate space potential measurements with emissive probe in high pressure plasma and neutral gas

abstract: The accurate measurement of plasma potentials at high pressure is investigated with the emissive probe. The emissive probe I-V characteristic of argon plasma obtained at 100 Pa is interpreted in detail, showing two inflection points in the I-V trace. The accurate plasma potentials at high pressure can be determined from the first inflection point potentials (the higher potential) by the improved inflection point method of the emissive probe, while the second inflection point is a result of the additional ionizing phenomenon caused by the collision between the emitted electrons and the neutral argon atoms. Besides, the accuracy of the plasma potential measurement at high pressure is verified to be 0.3 V by the measurement of space potential distribution between two parallel plates in neutral gas at 100 Pa. The accurate measurement of space potentials in high pressure plasma and neutral gas indicates that the improved inflection point method of the emissive probe is promising in the study of collisional sheath structures and the electrostatic probe diagnostic of high pressure plasmas.


title: Traveling kinks in an infinite array of weakly coupled pendula

abstract: We prove the existence of heteroclinic traveling waves (kinks) in an infinite array of weakly coupled pendula. Our approach is to apply a perturbation argument from the anti-continuum limit.


title: Estimating Time-Varying Causal Excursion Effect in Mobile Health with Binary Outcomes

abstract: Advances in wearables and digital technology now make it possible to deliver behavioral mobile health interventions to individuals in their everyday life. The micro-randomized trial (MRT) is increasingly used to provide data to inform the construction of these interventions. In an MRT, each individual is repeatedly randomized among multiple intervention options, often hundreds or even thousands of times, over the course of the trial. This work is motivated by multiple MRTs that have been conducted, or are currently in the field, in which the primary outcome is a longitudinal binary outcome. The primary aim of such MRTs is to examine whether a particular time-varying intervention has an effect on the longitudinal binary outcome, often marginally over all but a small subset of the individual's data. We propose the definition of causal excursion effect that can be used in such primary aim analysis for MRTs with binary outcomes. Under rather restrictive assumptions one can, based on existing literature, derive a semiparametric, locally efficient estimator of the causal effect. We, starting from this estimator, develop an estimator that can be used as the basis of a primary aim analysis under more plausible assumptions. Simulation studies are conducted to compare the estimators. We illustrate the developed methods using data from the MRT, BariFit. In BariFit, the goal is to support weight maintenance for individuals who received bariatric surgery.


title: Mining Data from the Congressional Record

abstract: We propose a data storage and analysis method for using the US Congressional record as a policy analysis tool. We use Amazon Web Services and the Solr search engine to store and process Congressional record data from 1789 to the present, and then query Solr to find how frequently language related to tax increases and decreases appears. This frequency data is compared to six economic indicators. Our preliminary results indicate potential relationships between incidence of tax discussion and multiple indicators. We present our data storage and analysis procedures, as well as results from comparisons to all six indicators.


title: Fluctuation-Dissipation and Correlation-Propagation Relations in $(1+3)$D Moving Detector-Quantum Field Systems

abstract: The fluctuation-dissipation relations (FDR) are powerful relations which can capture the essence of the interplay between a system and its environment. Challenging problems of this nature which FDRs aid in our understanding include the backreaction of quantum field processes like particle creation on the spacetime dynamics in early universe cosmology or quantum black holes. The less familiar, yet equally important correlation-propagation relations (CPR) relate the correlations of stochastic forces on different detectors to the retarded and advanced parts of the radiation propagated in the field. Here, we analyze a system of $N$ uniformly-accelerated Unruh-DeWitt detectors whose internal degrees of freedom (idf) are minimally coupled to a real, massless, scalar field in 4D Minkowski space, extending prior work in 2D with derivative coupling. Using the influence functional formalism, we derive the stochastic equations describing the nonequilibrium dynamics of the idfs. We show after the detector-field dynamics has reached equilibration the existence of the FDR and the CPR for the detectors, which combine to form a {\it generalized} fluctuation-dissipation matrix relation We show explicitly the energy flows between the constituents of the system of detectors and between the system and the quantum field environment. This power balance anchors the generalized FDR. We anticipate this matrix relation to provide a useful guardrail in expounding some basic issues in relativistic quantum information, such as ensuring the self-consistency of the energy balance and tracking the quantum information transfer in the detector-field system.


title: Model selection for contextual bandits

abstract: We introduce the problem of model selection for contextual bandits, where a learner must adapt to the complexity of the optimal policy while balancing exploration and exploitation. Our main result is a new model selection guarantee for linear contextual bandits. We work in the stochastic realizable setting with a sequence of nested linear policy classes of dimension $d_1 < d_2 < \ldots$, where the $m^\star$-th class contains the optimal policy, and we design an algorithm that achieves $\tilde{O}(T^{2/3}d^{1/3}_{m^\star})$ regret with no prior knowledge of the optimal dimension $d_{m^\star}$. The algorithm also achieves regret $\tilde{O}(T^{3/4} + \sqrt{Td_{m^\star}})$, which is optimal for $d_{m^{\star}}\geq{}\sqrt{T}$. This is the first model selection result for contextual bandits with non-vacuous regret for all values of $d_{m^\star}$, and to the best of our knowledge is the first positive result of this type for any online learning setting with partial information. The core of the algorithm is a new estimator for the gap in the best loss achievable by two linear policy classes, which we show admits a convergence rate faster than the rate required to learn the parameters for either class.


title: Efficient 8-Bit Quantization of Transformer Neural Machine Language Translation Model

abstract: In this work, we quantize a trained Transformer machine language translation model leveraging INT8/VNNI instructions in the latest Intel$^\circledR$ Xeon$^\circledR$ Cascade Lake processors to improve inference performance while maintaining less than 0.5$\%$ drop in accuracy. To the best of our knowledge, this is the first attempt in the industry to quantize the Transformer model. This has high impact as it clearly demonstrates the various complexities of quantizing the language translation model. We present novel quantization techniques directly in TensorFlow to opportunistically replace 32-bit floating point (FP32) computations with 8-bit integers (INT8) and transform the FP32 computational graph. We also present a bin-packing parallel batching technique to maximize CPU utilization. Overall, our optimizations with INT8/VNNI deliver 1.5X improvement over the best FP32 performance. Furthermore, it reveals the opportunities and challenges to boost performance of quantized deep learning inference and establishes best practices to run inference with high efficiency on Intel CPUs.


title: Dynamical Scaling Laws of Out-of-Time-Ordered Correlators

abstract: The out-of-time-ordered correlator (OTOC) is central to the understanding of information scrambling in quantum many-body systems. In this work, we show that the OTOC in a quantum many-body system close to its critical point obeys dynamical scaling laws which are specified by a few universal critical exponents of the quantum critical point. Such scaling laws of the OTOC imply a universal form for the butterfly velocity of a chaotic system in the quantum critical region and allow one to locate the quantum critical point and extract all universal critical exponents of the quantum phase transitions. We numerically confirm the universality of the butterfly velocity in a chaotic model, namely the transverse axial next-nearest-neighbor Ising model, and show the feasibility of extracting the critical properties of quantum phase transitions from OTOC using the Lipkin-Meshkov-Glick (LMG) model.


title: Sentiment Tagging with Partial Labels using Modular Architectures

abstract: Many NLP learning tasks can be decomposed into several distinct sub-tasks, each associated with a partial label. In this paper we focus on a popular class of learning problems, sequence prediction applied to several sentiment analysis tasks, and suggest a modular learning approach in which different sub-tasks are learned using separate functional modules, combined to perform the final task while sharing information. Our experiments show this approach helps constrain the learning process and can alleviate some of the supervision efforts.


title: Towards Interactive Training of Non-Player Characters in Video Games

abstract: There is a high demand for high-quality Non-Player Characters (NPCs) in video games. Hand-crafting their behavior is a labor intensive and error prone engineering process with limited controls exposed to the game designers. We propose to create such NPC behaviors interactively by training an agent in the target environment using imitation learning with a human in the loop. While traditional behavior cloning may fall short of achieving the desired performance, we show that interactivity can substantially improve it with a modest amount of human efforts. The model we train is a multi-resolution ensemble of Markov models, which can be used as is or can be further "compressed" into a more compact model for inference on consumer devices. We illustrate our approach on an example in OpenAI Gym, where a human can help to quickly train an agent with only a handful of interactive demonstrations. We also outline our experiments with NPC training for a first-person shooter game currently in development.


title: Coupled VAE: Improved Accuracy and Robustness of a Variational Autoencoder

abstract: We present a coupled Variational Auto-Encoder (VAE) method that improves the accuracy and robustness of the probabilistic inferences on represented data. The new method models the dependency between input feature vectors (images) and weighs the outliers with a higher penalty by generalizing the original loss function to the coupled entropy function, using the principles of nonlinear statistical coupling. We evaluate the performance of the coupled VAE model using the MNIST dataset. Compared with the traditional VAE algorithm, the output images generated by the coupled VAE method are clearer and less blurry. The visualization of the input images embedded in 2D latent variable space provides a deeper insight into the structure of new model with coupled loss function: the latent variable has a smaller deviation and a more compact latent space generates the output values. We analyze the histogram of the likelihoods of the input images using the generalized mean, which measures the model's accuracy as a function of the relative risk. The neutral accuracy, which is the geometric mean and is consistent with a measure of the Shannon cross-entropy, is improved. The robust accuracy, measured by the -2/3 generalized mean, is also improved.


title: Incorporating Biological Knowledge with Factor Graph Neural Network for Interpretable Deep Learning

abstract: While deep learning has achieved great success in many fields, one common criticism about deep learning is its lack of interpretability. In most cases, the hidden units in a deep neural network do not have a clear semantic meaning or correspond to any physical entities. However, model interpretability and explainability are crucial in many biomedical applications. To address this challenge, we developed the Factor Graph Neural Network model that is interpretable and predictable by combining probabilistic graphical models with deep learning. We directly encode biological knowledge such as Gene Ontology as a factor graph into the model architecture, making the model transparent and interpretable. Furthermore, we devised an attention mechanism that can capture multi-scale hierarchical interactions among biological entities such as genes and Gene Ontology terms. With parameter sharing mechanism, the unrolled Factor Graph Neural Network model can be trained with stochastic depth and generalize well. We applied our model to two cancer genomic datasets to predict target clinical variables and achieved better results than other traditional machine learning and deep learning models. Our model can also be used for gene set enrichment analysis and selecting Gene Ontology terms that are important to target clinical variables.


title: Copula-based functional Bayes classification with principal components and partial least squares

abstract: We present a new functional Bayes classifier that uses principal component (PC) or partial least squares (PLS) scores from the common covariance function, that is, the covariance function marginalized over groups. When the groups have different covariance functions, the PC or PLS scores need not be independent or even uncorrelated. We use copulas to model the dependence. Our method is semiparametric; the marginal densities are estimated nonparametrically by kernel smoothing and the copula is modeled parametrically. We focus on Gaussian and t-copulas, but other copulas could be used. The strong performance of our methodology is demonstrated through simulation, real data examples, and asymptotic properties.


title: Topological Singularity Induced Chiral Kohn Anomaly in a Weyl Semimetal

abstract: The electron-phonon interaction (EPI) is instrumental in a wide variety of phenomena in solid-state physics, such as electrical resistivity in metals, carrier mobility, optical transition and polaron effects in semiconductors, lifetime of hot carriers, transition temperature in BCS superconductors, and even spin relaxation in diamond nitrogen-vacancy centers for quantum information processing. However, due to the weak EPI strength, most phenomena have focused on electronic properties rather than on phonon properties. One prominent exception is the Kohn anomaly, where phonon softening can emerge when the phonon wavevector nests the Fermi surface of metals. Here we report a new class of Kohn anomaly in a topological Weyl semimetal (WSM), predicted by field-theoretical calculations, and experimentally observed through inelastic x-ray and neutron scattering on WSM tantalum phosphide (TaP). Compared to the conventional Kohn anomaly, the Fermi surface in a WSM exhibits multiple topological singularities of Weyl nodes, leading to a distinct nesting condition with chiral selection, a power-law divergence, and non-negligible dynamical effects. Our work brings the concept of Kohn anomaly into WSMs and sheds light on elucidating the EPI mechanism in emergent topological materials.


title: An adaptive finite element method for the sparse optimal control of fractional diffusion

abstract: We propose and analyze an a posteriori error estimator for a PDE-constrained optimization problem involving a nondifferentiable cost functional, fractional diffusion, and control-constraints. We realize fractional diffusion as the Dirichlet-to-Neumann map for a nonuniformly PDE and propose an equivalent optimal control problem with a local state equation. For such an equivalent problem, we design an a posteriori error estimator which can be defined as the sum of four contributions: two contributions related to the approximation of the state and adjoint equations and two contributions that account for the discretization of the control variable and its associated subgradient. The contributions related to the discretization of the state and adjoint equations rely on anisotropic error estimators in weighted Sobolev spaces. We prove that the proposed a posteriori error estimator is locally efficient and, under suitable assumptions, reliable. We design an adaptive scheme that yields, for the examples that we perform, optimal experimental rates of convergence.


title: Encoder-Powered Generative Adversarial Networks

abstract: We present an encoder-powered generative adversarial network (EncGAN) that is able to learn both the multi-manifold structure and the abstract features of data. Unlike the conventional decoder-based GANs, EncGAN uses an encoder to model the manifold structure and invert the encoder to generate data. This unique scheme enables the proposed model to exclude discrete features from the smooth structure modeling and learn multi-manifold data without being hindered by the disconnections. Also, as EncGAN requires a single latent space to carry the information for all the manifolds, it builds abstract features shared among the manifolds in the latent space. For an efficient computation, we formulate EncGAN using a simple regularizer, and mathematically prove its validity. We also experimentally demonstrate that EncGAN successfully learns the multi-manifold structure and the abstract features of MNIST, 3D-chair and UT-Zap50k datasets. Our analysis shows that the learned abstract features are disentangled and make a good style-transfer even when the source data is off the trained distribution.


title: Reduced density matrix of nonlocal identical particles

abstract: We probe the theoretical connection among three different approaches to analyze the entanglement of identical particles, i.e., the first quantization language (1QL), elementary-symmetric/exterior products (which has the mathematical equivalence to no-labeling approaches), and the algebraic approach based on the GNS construction. Among several methods to quantify the entanglement of identical particles, we focus on the computation of reduced density matrices, which can be achieved by the concept of \emph{symmetrized partial trace} defined in 1QL. We show that the symmetrized partial trace corresponds to the interior product in symmetric and exterior algebra (SEA), which also corresponds to the subalgebra restriction in the algebraic approach based on GNS representation. Our research bridges different viewpoints for understanding the quantum correlation of identical particles in a consistent manner.


title: Hybrid beamforming with dynamic subarrays and low-resolution PSs for mmWave MU-MISO systems

abstract: Analog/digital hybrid beamforming architectures with large-scale antenna arrays have been widely considered in millimeter wave (mmWave) communication systems because they can address the tradeoff between performance and hardware efficiency compared with traditional fully-digital beamforming. Most of the prior work on hybrid beamforming focused on fullyconnected architecture or partially-connected scheme with fixedsubarrays, in which the analog beamformers are usually realized by infinite-resolution phase shifters (PSs). In this paper, we introduce a novel hybrid beamforming architecture with dynamic subarrays and hardware-efficient low-resolution PSs for mmWave multiuser multiple-input single-output (MU-MISO) systems. By dynamically connecting each RF chain to a non-overlap subarray via a switch network and PSs, we can exploit multiple-antenna and multiuser diversities to mitigate the performance loss due to the use of practical low-resolution PSs. An iterative hybrid beamformer design algorithm is first proposed based on fractional programming (FP), aiming at maximizing the sum-rate performance of the MU-MISO system. In an effort to reduce the complexity, we also present a simple heuristic hybrid beamformer design algorithm for the dynamic subarray scheme. Extensive simulation results demonstrate the advantages of the proposed hybrid beamforming architecture with dynamic subarrays and low-resolution PSs compared to existing fixed-subarray schemes.


title: 3D Magic Mirror: Automatic Video to 3D Caricature Translation

abstract: Caricature is an abstraction of a real person which distorts or exaggerates certain features, but still retains a likeness. While most existing works focus on 3D caricature reconstruction from 2D caricatures or translating 2D photos to 2D caricatures, this paper presents a real-time and automatic algorithm for creating expressive 3D caricatures with caricature style texture map from 2D photos or videos. To solve this challenging ill-posed reconstruction problem and cross-domain translation problem, we first reconstruct the 3D face shape for each frame, and then translate 3D face shape from normal style to caricature style by a novel identity and expression preserving VAE-CycleGAN. Based on a labeling formulation, the caricature texture map is constructed from a set of multi-view caricature images generated by CariGANs. The effectiveness and efficiency of our method are demonstrated by comparison with baseline implementations. The perceptual study shows that the 3D caricatures generated by our method meet people's expectations of 3D caricature style.


title: Magnetic Field Effect on s-wave Superconductor LaRu4P12 Studied by 31P-NMR

abstract: We have performed 31P-NMR measurements on the s-wave superconductor LaRu4P12 to investigate the magnetic field effect of the nuclear spin-lattice relaxation rate 1/T1 on a conventional full-gap superconductor. With increasing magnetic field, the Hebel-Slichter peak immediately below Tc in 1=T1 was suppressed, and the magnetic field dependence of 1/T1 at 0.8 K, well below Tc, was proportional to H2. These behaviors can be fully understood by the orbital pair-breaking effect in a single-band s-wave superconductor


title: Rethinking Loss Design for Large-scale 3D Shape Retrieval

abstract: Learning discriminative shape representations is a crucial issue for large-scale 3D shape retrieval. In this paper, we propose the Collaborative Inner Product Loss (CIP Loss) to obtain ideal shape embedding that discriminative among different categories and clustered within the same class. Utilizing simple inner product operation, CIP loss explicitly enforces the features of the same class to be clustered in a linear subspace, while inter-class subspaces are constrained to be at least orthogonal. Compared to previous metric loss functions, CIP loss could provide more clear geometric interpretation for the embedding than Euclidean margin, and is easy to implement without normalization operation referring to cosine margin. Moreover, our proposed loss term can combine with other commonly used loss functions and can be easily plugged into existing off-the-shelf architectures. Extensive experiments conducted on the two public 3D object retrieval datasets, ModelNet and ShapeNetCore 55, demonstrate the effectiveness of our proposal, and our method has achieved state-of-the-art results on both datasets.


title: MaxGap Bandit: Adaptive Algorithms for Approximate Ranking

abstract: This paper studies the problem of adaptively sampling from K distributions (arms) in order to identify the largest gap between any two adjacent means. We call this the MaxGap-bandit problem. This problem arises naturally in approximate ranking, noisy sorting, outlier detection, and top-arm identification in bandits. The key novelty of the MaxGap-bandit problem is that it aims to adaptively determine the natural partitioning of the distributions into a subset with larger means and a subset with smaller means, where the split is determined by the largest gap rather than a pre-specified rank or threshold. Estimating an arm's gap requires sampling its neighboring arms in addition to itself, and this dependence results in a novel hardness parameter that characterizes the sample complexity of the problem. We propose elimination and UCB-style algorithms and show that they are minimax optimal. Our experiments show that the UCB-style algorithms require 6-8x fewer samples than non-adaptive sampling to achieve the same error.


title: Harvest-or-Transmit Policy for Cognitive Radio Networks: A Learning Theoretic Approach

abstract: We consider an underlay cognitive radio network where the secondary user (SU) harvests energy from the environment. We consider a slotted-mode of operation where each slot of SU is used for either energy harvesting or data transmission. Considering block fading with memory, we model the energy arrival and fading processes as a stationary Markov process of first order. We propose a harvest-or-transmit policy for the SU along with optimal transmit powers that maximize its expected throughput under three different settings. First, we consider a learning-theoretic approach where we do not assume any apriori knowledge about the underlying Markov processes. In this case, we obtain an online policy using Q-learning. Then, we assume that the full statistical knowledge of the governing Markov process is known apriori. Under this assumption, we obtain an optimal online policy using infinite horizon stochastic dynamic programming. Finally, we obtain an optimal offline policy using the generalized Benders decomposition algorithm. The offline policy assumes that for a given time deadline, the energy arrivals and channel states are known in advance at all the transmitters. Finally, we compare all policies and study the effects of various system parameters on the system performance.


title: Know More about Each Other: Evolving Dialogue Strategy via Compound Assessment

abstract: In this paper, a novel Generation-Evaluation framework is developed for multi-turn conversations with the objective of letting both participants know more about each other. For the sake of rational knowledge utilization and coherent conversation flow, a dialogue strategy which controls knowledge selection is instantiated and continuously adapted via reinforcement learning. Under the deployed strategy, knowledge grounded conversations are conducted with two dialogue agents. The generated dialogues are comprehensively evaluated on aspects like informativeness and coherence, which are aligned with our objective and human instinct. These assessments are integrated as a compound reward to guide the evolution of dialogue strategy via policy gradient. Comprehensive experiments have been carried out on the publicly available dataset, demonstrating that the proposed method outperforms the other state-of-the-art approaches significantly.


title: Global Textual Relation Embedding for Relational Understanding

abstract: Pre-trained embeddings such as word embeddings and sentence embeddings are fundamental tools facilitating a wide range of downstream NLP tasks. In this work, we investigate how to learn a general-purpose embedding of textual relations, defined as the shortest dependency path between entities. Textual relation embedding provides a level of knowledge between word/phrase level and sentence level, and we show that it can facilitate downstream tasks requiring relational understanding of the text. To learn such an embedding, we create the largest distant supervision dataset by linking the entire English ClueWeb09 corpus to Freebase. We use global co-occurrence statistics between textual and knowledge base relations as the supervision signal to train the embedding. Evaluation on two relational understanding tasks demonstrates the usefulness of the learned textual relation embedding. The data and code can be found at https://github.com/czyssrs/GloREPlus


title: HERA: Partial Label Learning by Combining Heterogeneous Loss with Sparse and Low-Rank Regularization

abstract: Partial Label Learning (PLL) aims to learn from the data where each training instance is associated with a set of candidate labels, among which only one is correct. Most existing methods deal with such problem by either treating each candidate label equally or identifying the ground-truth label iteratively. In this paper, we propose a novel PLL approach called HERA, which simultaneously incorporates the HeterogEneous Loss and the SpaRse and Low-rAnk procedure to estimate the labeling confidence for each instance while training the model. Specifically, the heterogeneous loss integrates the strengths of both the pairwise ranking loss and the pointwise reconstruction loss to provide informative label ranking and reconstruction information for label identification, while the embedded sparse and low-rank scheme constrains the sparsity of ground-truth label matrix and the low rank of noise label matrix to explore the global label relevance among the whole training data for improving the learning model. Extensive experiments on both artificial and real-world data sets demonstrate that our method can achieve superior or comparable performance against the state-of-the-art methods.


title: Superlubricity-Based Electrostatic Microgenerators

abstract: Although electrostatic microgenerators (ESMGs) have promised for nearly two decades extensive applications in wireless, self-powered microscale devices and sensors for security, personal health systems, communication, infrastructure and environmental monitoring, commercialized ESMGs are still scarce, mainly due to very low current densities and short product life for most applications. Here we demonstrate that a combination of structural superlubricity, a state of nearly zero friction and wear between two contacted solid surfaces, and nanotechnology can endow ESMGs with superlong life and high performances such as transferred charge, current, and power (at least three orders of magnitude higher than those of conventional ESMGs). Among a few significant advantages of superlubricity-based ESMGs, two are particularly noticeable. First, they can be driven by much lower external loads than conventional ESMGs; second, they can be massively fabricated by using micro-machining processes. The quantitative relationships, experimental proof of concept, and optimization results reported in this Letter can guide future design and facilitate the commercialization of ESMGs.


title: Artificial Intelligence and Big Data in Entrepreneurship: A New Era Has Begun

abstract: While the disruptive potential of artificial intelligence (AI) and Big Data has been receiving growing attention and concern in a variety of research and application fields over the last few years, it has not received much scrutiny in contemporary entrepreneurship research so far. Here we present some reflections and a collection of papers on the role of AI and Big Data for this emerging area in the study and application of entrepreneurship research. While being mindful of the potentially overwhelming nature of the rapid progress in machine intelligence and other Big Data technologies for contemporary structures in entrepreneurship research, we put an emphasis on the reciprocity of the co-evolving fields of entrepreneurship research and practice. How can AI and Big Data contribute to a productive transformation of the research field and the real-world phenomena (e.g., 'smart entrepreneurship')? We also discuss, however, ethical issues as well as challenges around a potential contradiction between entrepreneurial uncertainty and rule-driven AI rationality. The editorial gives researchers and practitioners orientation and showcases avenues and examples for concrete research in this field. At the same time, however, it is not unlikely that we will encounter unforeseeable and currently inexplicable developments in the field soon. We call on entrepreneurship scholars, educators, and practitioners to proactively prepare for future scenarios.


title: Factor Graph Neural Network

abstract: Most of the successful deep neural network architectures are structured, often consisting of elements like convolutional neural networks and gated recurrent neural networks. Recently, graph neural networks have been successfully applied to graph structured data such as point cloud and molecular data. These networks often only consider pairwise dependencies, as they operate on a graph structure. We generalize the graph neural network into a factor graph neural network (FGNN) in order to capture higher order dependencies. We show that FGNN is able to represent Max-Product Belief Propagation, an approximate inference algorithm on probabilistic graphical models; hence it is able to do well when Max-Product does well. Promising results on both synthetic and real datasets demonstrate the effectiveness of the proposed model.


title: Adversarially Robust Generalization Just Requires More Unlabeled Data

abstract: Neural network robustness has recently been highlighted by the existence of adversarial examples. Many previous works show that the learned networks do not perform well on perturbed test data, and significantly more labeled data is required to achieve adversarially robust generalization. In this paper, we theoretically and empirically show that with just more unlabeled data, we can learn a model with better adversarially robust generalization. The key insight of our results is based on a risk decomposition theorem, in which the expected robust risk is separated into two parts: the stability part which measures the prediction stability in the presence of perturbations, and the accuracy part which evaluates the standard classification accuracy. As the stability part does not depend on any label information, we can optimize this part using unlabeled data. We further prove that for a specific Gaussian mixture problem, adversarially robust generalization can be almost as easy as the standard generalization in supervised learning if a sufficiently large amount of unlabeled data is provided. Inspired by the theoretical findings, we further show that a practical adversarial training algorithm that leverages unlabeled data can improve adversarial robust generalization on MNIST and Cifar-10.


title: Fluent Translations from Disfluent Speech in End-to-End Speech Translation

abstract: Spoken language translation applications for speech suffer due to conversational speech phenomena, particularly the presence of disfluencies. With the rise of end-to-end speech translation models, processing steps such as disfluency removal that were previously an intermediate step between speech recognition and machine translation need to be incorporated into model architectures. We use a sequence-to-sequence model to translate from noisy, disfluent speech to fluent text with disfluencies removed using the recently collected `copy-edited' references for the Fisher Spanish-English dataset. We are able to directly generate fluent translations and introduce considerations about how to evaluate success on this task. This work provides a baseline for a new task, the translation of conversational speech with joint removal of disfluencies.


title: Nonlinear preheating with nonminimally coupled scalar fields in the Starobinsky model

abstract: We study the preheating after inflation in the Starobinsky model with a nonminimally coupled scalar field $\chi$. Using the lattice simulation, we analyze the rescattering between the $\chi$ particles and the inflaton condensate, and the backreaction effect of the scalar metric perturbations. We find that the rescattering is an efficient mechanism promoting the growth of the $\chi$ field variance. Meanwhile, copious inflaton particles can be knocked out of the inflaton condensate by rescattering. As a result, the inflaton field can become a nonnegligible gravitational wave source, even comparable with the $\chi$ field in some parameter regions. For the scalar metric perturbations, which are on the sub-Hubble scale in our analysis, our results show that they have negligible effects on the evolution of scalar fields and the production of gravitational waves in the model considered in present paper.


title: Multiplicative Effect Modeling: The General Case

abstract: Generalized linear models, such as logistic regression, are widely used to model the association between a treatment and a binary outcome as a function of baseline covariates. However, the coefficients of a logistic regression model correspond to log odds ratios, while subject-matter scientists are often interested in relative risks. Although odds ratios are sometimes used to approximate relative risks, this approximation is appropriate only when the outcome of interest is rare for all levels of the covariates. Poisson regressions do measure multiplicative treatment effects including relative risks, but with a binary outcome not all combinations of parameters lead to fitted means that are between zero and one. Enforcing this constraint makes the parameters variation dependent, which is undesirable for modeling, estimation and computation. Focusing on the special case where the treatment is also binary, Richardson2017 propose a novel binomial regression model, that allows direct modeling of the relative risk. The model uses a log odds-product nuisance model leading to variation independent parameter spaces. Building on this we present general approaches to modeling the multiplicative effect of a continuous or categorical treatment on a binary outcome. Monte Carlo simulations demonstrate the desirable performance of our proposed methods. A data analysis further exemplifies our methods.


title: Possible s-wave annihilation for MeV dark matter with the 21-cm absorption

abstract: The CMB observation sets stringent constraints on MeV dark matter (DM) annihilating into charged states/photons in s-wave, and the recent observation of the 21-cm absorption at the cosmic dawn reported by EDGES is also very strict for s-wave annihilations of MeV DM. The millicharged DM with p-wave dominant annihilations during the freeze-out period are considered in literatures to give an explanation about the 21-cm absorption, with photon mediated scattering cooling the hydrogen. In this paper, we focus on the annihilation of millicharged DM being s-wave dominant. To explain the 21-cm absorption and meanwhile be compatible with the CMB and 21-cm absorption bounds on DM annihilations, we consider the annihilation close to the resonance, with the new mediator (here is dark photon) mass being slightly above twice of the millicharged DM mass. In this case, the annihilation cross section at the temperature $T \to 0$ could be much smaller than that at $T_f$, which would be tolerated by the bounds on DM annihilations, avoiding the excess heating from DM s-wave annihilations to the hydrogen gas. The beam dump and lepton collider experiments can be employed to hunt for millicharged DM via the production of the invisible dark photon.


title: Revisiting Flow Information for Traffic Prediction

abstract: Traffic prediction is a fundamental task in many real applications, which aims to predict the future traffic volume in any region of a city. In essence, traffic volume in a region is the aggregation of traffic flows from/to the region. However, existing traffic prediction methods focus on modeling complex spatiotemporal traffic correlations and seldomly study the influence of the original traffic flows among regions. In this paper, we revisit the traffic flow information and exploit the direct flow correlations among regions towards more accurate traffic prediction. We introduce a novel flow-aware graph convolution to model dynamic flow correlations among regions. We further introduce an integrated Gated Recurrent Unit network to incorporate flow correlations with spatiotemporal modeling. The experimental results on real-world traffic datasets validate the effectiveness of the proposed method, especially on the traffic conditions with a great change on flows.


title: A note on the Erd\H{o}-Straus Conjecture

abstract: This paper makes a fundamental assertion about the Erd\H{o}s-Straus conjecture. Suppose that for a prime $p$ there exists $x,y,z \in \mathbb{N}$ with $x \leq y \leq z$ so that $$ \frac{4}{p} = \frac{1}{x} + \frac{1}{y} + \frac{1}{z}. $$ The main contribution of this paper is that, under this assumption, the Erd\H{o}s-Straus conjecture can be reduced by one variable. For example, it is necessarily true that $$ z = \frac{xyp}{\gcd(y,p) \gcd \left( xy, x+y \right)}.$$ Considering other reductions of the Erd\H{o}s-Straus conjecture, this paper suggests a method for proof.


title: Learning to Self-Train for Semi-Supervised Few-Shot Classification

abstract: Few-shot classification (FSC) is challenging due to the scarcity of labeled training data (e.g. only one labeled data point per class). Meta-learning has shown to achieve promising results by learning to initialize a classification model for FSC. In this paper we propose a novel semi-supervised meta-learning method called learning to self-train (LST) that leverages unlabeled data and specifically meta-learns how to cherry-pick and label such unsupervised data to further improve performance. To this end, we train the LST model through a large number of semi-supervised few-shot tasks. On each task, we train a few-shot model to predict pseudo labels for unlabeled data, and then iterate the self-training steps on labeled and pseudo-labeled data with each step followed by fine-tuning. We additionally learn a soft weighting network (SWN) to optimize the self-training weights of pseudo labels so that better ones can contribute more to gradient descent optimization. We evaluate our LST method on two ImageNet benchmarks for semi-supervised few-shot classification and achieve large improvements over the state-of-the-art method. Code is at https://github.com/xinzheli1217/learning-to-self-train.


title: Direct Linear Time Construction of Parameterized Suffix and LCP Arrays for Constant Alphabets

abstract: We present the first worst-case linear time algorithm that directly computes the parameterized suffix and LCP arrays for constant sized alphabets. Previous algorithms either required quadratic time or the parameterized suffix tree to be built first. More formally, for a string over static alphabet $\Sigma$ and parameterized alphabet $\Pi$, our algorithm runs in $O(n\pi)$ time and $O(n)$ words of space, where $\pi$ is the number of distinct symbols of $\Pi$ in the string.


title: C2P2: A Collective Cryptocurrency Up/Down Price Prediction Engine

abstract: We study the problem of predicting whether the price of the 21 most popular cryptocurrencies (according to coinmarketcap.com) will go up or down on day d, using data up to day d-1. Our C2P2 algorithm is the first algorithm to consider the fact that the price of a cryptocurrency c might depend not only on historical prices, sentiments, global stock indices, but also on the prices and predicted prices of other cryptocurrencies. C2P2 therefore does not predict cryptocurrency prices one coin at a time --- rather it uses similarity metrics in conjunction with collective classification to compare multiple cryptocurrency features to jointly predict the cryptocurrency prices for all 21 coins considered. We show that our C2P2 algorithm beats out a recent competing 2017 paper by margins varying from 5.1-83% and another Bitcoin-specific prediction paper from 2018 by 16%. In both cases, C2P2 is the winner on all cryptocurrencies considered. Moreover, we experimentally show that the use of similarity metrics within our C2P2 algorithm leads to a direct improvement for 20 out of 21 cryptocurrencies ranging from 0.4% to 17.8%. Without the similarity component, C2P2 still beats competitors on 20 out of 21 cryptocurrencies considered. We show that all these results are statistically significant via a Student's t-test with p<1e-5. Check our demo at https://www.cs.dartmouth.edu/dsail/demos/c2p2


title: Controllable Paraphrase Generation with a Syntactic Exemplar

abstract: Prior work on controllable text generation usually assumes that the controlled attribute can take on one of a small set of values known a priori. In this work, we propose a novel task, where the syntax of a generated sentence is controlled rather by a sentential exemplar. To evaluate quantitatively with standard metrics, we create a novel dataset with human annotations. We also develop a variational model with a neural module specifically designed for capturing syntactic knowledge and several multitask training objectives to promote disentangled representation learning. Empirically, the proposed model is observed to achieve improvements over baselines and learn to capture desirable characteristics.


title: Evaluating Non-aligned Musical Score Transcriptions with MV2H

abstract: The original MV2H metric was designed to evaluate systems which transcribe from an input audio (or MIDI) piece to a complete musical score. However, it requires both the transcribed score and the ground truth score to be time-aligned with the input. Some recent work has begun to transcribe directly from an audio signal into a musical score, skipping the alignment step. This paper introduces an automatic alignment method based on dynamic time warp which allows for MV2H to be used to evaluate such non-aligned transcriptions. This has the additional benefit of allowing non-aligned musical scores---which are significantly more widely available than aligned ones---to be used as ground truth. The code for the improved MV2H, which now also includes a MusicXML parser, and allows for key and time signature changes, is available at www.github.com/apmcleod/MV2H.


title: Generative Adversarial Networks for Distributed Intrusion Detection in the Internet of Things

abstract: To reap the benefits of the Internet of Things (IoT), it is imperative to secure the system against cyber attacks in order to enable mission critical and real-time applications. To this end, intrusion detection systems (IDSs) have been widely used to detect anomalies caused by a cyber attacker in IoT systems. However, due to the large-scale nature of the IoT, an IDS must operate in a distributed manner with minimum dependence on a central controller. Moreover, in many scenarios such as health and financial applications, the datasets are private and IoTDs may not intend to share such data. To this end, in this paper, a distributed generative adversarial network (GAN) is proposed to provide a fully distributed IDS for the IoT so as to detect anomalous behavior without reliance on any centralized controller. In this architecture, every IoTD can monitor its own data as well as neighbor IoTDs to detect internal and external attacks. In addition, the proposed distributed IDS does not require sharing the datasets between the IoTDs, thus, it can be implemented in IoTs that preserve the privacy of user data such as health monitoring systems or financial applications. It is shown analytically that the proposed distributed GAN has higher accuracy of detecting intrusion compared to a standalone IDS that has access to only a single IoTD dataset. Simulation results show that, the proposed distributed GAN-based IDS has up to 20% higher accuracy, 25% higher precision, and 60% lower false positive rate compared to a standalone GAN-based IDS.


title: Stability of edge magnetism against disorder in zigzag MoS$_2$ nanoribbons

abstract: Molybdenum disulfide nanoribbons with zigzag edges show ferromagnetic and metallic properties based on previous \emph{ab-initio} calculations. The investigation of the role of disorder on the magnetic properties is, however, still lacking due to the computational costs of these methods. In this work we fill this gap by studying the magnetic and electronic properties of several nanometer long MoS$_2$ zigzag nanoribbons using tight-binding and Hubbard Hamiltonians. Our results reveal that proper tight-binding parameters for the edge atoms are crucial to obtain quantitatively the metallic states and the magnetic properties of MoS$_2$ nanoribbons. With the help of the fine-tuned parameters, we perform large-scale calculations and predict the spin domain-wall energy along the edges, which is found to be significantly lower compared to that of the zigzag graphene nanoribbons. The tight-binding approach allows us to address the effect of edge disorder on the magnetic properties. Our results open the way for investigating electron-electron effects in realistic-size nanoribbon devices in MoS$_2$ and also provide valuable information for spintronic applications.


title: Distribution oblivious, risk-aware algorithms for multi-armed bandits with unbounded rewards

abstract: Classical multi-armed bandit problems use the expected value of an arm as a metric to evaluate its goodness. However, the expected value is a risk-neutral metric. In many applications like finance, one is interested in balancing the expected return of an arm (or portfolio) with the risk associated with that return. In this paper, we consider the problem of selecting the arm that optimizes a linear combination of the expected reward and the associated Conditional Value at Risk (CVaR) in a fixed budget best-arm identification framework. We allow the reward distributions to be unbounded or even heavy-tailed. For this problem, our goal is to devise algorithms that are entirely distribution oblivious, i.e., the algorithm is not aware of any information on the reward distributions, including bounds on the moments/tails, or the suboptimality gaps across arms. In this paper, we provide a class of such algorithms with provable upper bounds on the probability of incorrect identification. In the process, we develop a novel estimator for the CVaR of unbounded (including heavy-tailed) random variables and prove a concentration inequality for the same, which could be of independent interest. We also compare the error bounds for our distribution oblivious algorithms with those corresponding to standard non-oblivious algorithms. Finally, numerical experiments reveal that our algorithms perform competitively when compared with non-oblivious algorithms, suggesting that distribution obliviousness can be realised in practice without incurring a significant loss of performance.


title: Clustering by Orthogonal NMF Model and Non-Convex Penalty Optimization

abstract: The non-negative matrix factorization (NMF) model with an additional orthogonality constraint on one of the factor matrices, called the orthogonal NMF (ONMF), has been found a promising clustering model and can outperform the classical K-means. However, solving the ONMF model is a challenging optimization problem because the coupling of the orthogonality and non-negativity constraints introduces a mixed combinatorial aspect into the problem due to the determination of the correct status of the variables (positive or zero). Most of the existing methods directly deal with the orthogonality constraint in its original form via various optimization techniques, but are not scalable for large-scale problems. In this paper, we propose a new ONMF based clustering formulation that equivalently transforms the orthogonality constraint into a set of norm-based non-convex equality constraints. We then apply a non-convex penalty (NCP) approach to add them to the objective as penalty terms, leading to a problem that is efficiently solvable. One smooth penalty formulation and one non-smooth penalty formulation are respectively studied. We build theoretical conditions for the penalized problems to provide feasible stationary solutions to the ONMF based clustering problem, as well as proposing efficient algorithms for solving the penalized problems of the two NCP methods. Experimental results based on both synthetic and real datasets are presented to show that the proposed NCP methods are computationally time efficient, and either match or outperform the existing K-means and ONMF based methods in terms of the clustering performance.


title: Deep Reinforcement Learning Architecture for Continuous Power Allocation in High Throughput Satellites

abstract: In the coming years, the satellite broadband market will experience significant increases in the service demand, especially for the mobility sector, where demand is burstier. Many of the next generation of satellites will be equipped with numerous degrees of freedom in power and bandwidth allocation capabilities, making manual resource allocation impractical and inefficient. Therefore, it is desirable to automate the operation of these highly flexible satellites. This paper presents a novel power allocation approach based on Deep Reinforcement Learning (DRL) that represents the problem as continuous state and action spaces. We make use of the Proximal Policy Optimization (PPO) algorithm to optimize the allocation policy for minimum Unmet System Demand (USD) and power consumption. The performance of the algorithm is analyzed through simulations of a multibeam satellite system, which show promising results for DRL to be used as a dynamic resource allocation algorithm.


title: Using a Logarithmic Mapping to Enable Lower Discount Factors in Reinforcement Learning

abstract: In an effort to better understand the different ways in which the discount factor affects the optimization process in reinforcement learning, we designed a set of experiments to study each effect in isolation. Our analysis reveals that the common perception that poor performance of low discount factors is caused by (too) small action-gaps requires revision. We propose an alternative hypothesis that identifies the size-difference of the action-gap across the state-space as the primary cause. We then introduce a new method that enables more homogeneous action-gaps by mapping value estimates to a logarithmic space. We prove convergence for this method under standard assumptions and demonstrate empirically that it indeed enables lower discount factors for approximate reinforcement-learning methods. This in turn allows tackling a class of reinforcement-learning problems that are challenging to solve with traditional methods.


title: Conditional inference on the asset with maximum Sharpe ratio

abstract: We apply the procedure of Lee et al. to the problem of performing inference on the signal-noise ratio of the asset which displays maximum sample Sharpe ratio over a set of possibly correlated assets. We find a multivariate analogue of the commonly used approximate standard error of the Sharpe ratio to use in this conditional estimation procedure. We also consider several alternative procedures, including the simple Bonferroni correction for multiple hypothesis testing, which we fix for the case of positive common correlation among assets, the chi-bar square test against one-sided alternatives, Follman's test, and Hansen's asymptotic adjustments. Testing indicates the conditional inference procedure achieves nominal type I rate, and does not appear to suffer from non-normality of returns. The conditional estimation test has low power under the alternative where there is little spread in the signal-noise ratios of the assets, and high power under the alternative where a single asset has high signal-noise ratio. Unlike the alternative procedures, it appears to enjoy rejection probabilities montonic in the signal-noise ratio of the selected asset.


title: An overview of memristive cryptography

abstract: Smaller, smarter and faster edge devices in the Internet of things era demands secure data analysis and transmission under resource constraints of hardware architecture. Lightweight cryptography on edge hardware is an emerging topic that is essential to ensure data security in near-sensor computing systems such as mobiles, drones, smart cameras, and wearables. In this article, the current state of memristive cryptography is placed in the context of lightweight hardware cryptography. The paper provides a brief overview of the traditional hardware lightweight cryptography and cryptanalysis approaches. The contrast for memristive cryptography with respect to traditional approaches is evident through this article, and need to develop a more concrete approach to developing memristive cryptanalysis to test memristive cryptographic approaches is highlighted.


title: Jointly Learning Semantic Parser and Natural Language Generator via Dual Information Maximization

abstract: Semantic parsing aims to transform natural language (NL) utterances into formal meaning representations (MRs), whereas an NL generator achieves the reverse: producing a NL description for some given MRs. Despite this intrinsic connection, the two tasks are often studied separately in prior work. In this paper, we model the duality of these two tasks via a joint learning framework, and demonstrate its effectiveness of boosting the performance on both tasks. Concretely, we propose a novel method of dual information maximization (DIM) to regularize the learning process, where DIM empirically maximizes the variational lower bounds of expected joint distributions of NL and MRs. We further extend DIM to a semi-supervision setup (SemiDIM), which leverages unlabeled data of both tasks. Experiments on three datasets of dialogue management and code generation (and summarization) show that performance on both semantic parsing and NL generation can be consistently improved by DIM, in both supervised and semi-supervised setups.


title: Gridless Variational Bayesian Channel Estimation for Antenna Array Systems with Low Resolution ADCs

abstract: Employing low-resolution analog-to-digital converters (ADCs) coupled with large antenna arrays at the receivers has drawn considerable interests in the millimeter wave (mm-wave) system. Since mm-wave channels are sparse in angular dimensions, exploiting the structure could reduce the number of measurements while achieve acceptable performance at the same time. Motivated by the variational Bayesian line spectral estimation (VALSE) algorithm which treats the angles as random parameters, in contrast with previous works which confine the estimate to the set of grid angle points and induce grid mismatch, this paper proposes the grid-less quantized variational Bayesian channel estimation (GL-QVBCE) algorithm for antenna array systems with low resolution ADCs. Compared to the traditional least squares (LS) approach, numerical results show that GL-QVBCE performs significantly better and asymptotically approaches the Cram\`{e}r Rao bound (CRB).


title: Information-Theoretic Privacy through Chaos Synchronization and Optimal Additive Noise

abstract: We study the problem of maximizing privacy of data sets by adding random vectors generated via synchronized chaotic oscillators. In particular, we consider the setup where information about data sets, queries, is sent through public (unsecured) communication channels to a remote station. To hide private features (specific entries) within the data set, we corrupt the response to queries by adding random vectors. We send the distorted query (the sum of the requested query and the random vector) through the public channel. The distribution of the additive random vector is designed to minimize the mutual information (our privacy metric) between private entries of the data set and the distorted query. We cast the synthesis of this distribution as a convex program in the probabilities of the additive random vector. Once we have the optimal distribution, we propose an algorithm to generate pseudo-random realizations from this distribution using trajectories of a chaotic oscillator. At the other end of the channel, we have a second chaotic oscillator, which we use to generate realizations from the same distribution. Note that if we obtain the same realizations on both sides of the channel, we can simply subtract the realization from the distorted query to recover the requested query. To generate equal realizations, we need the two chaotic oscillators to be synchronized, i.e., we need them to generate exactly the same trajectories on both sides of the channel synchronously in time. We force the two chaotic oscillators into exponential synchronization using a driving signal. Simulations are presented to illustrate our results.


title: Pairing symmetries for Euclidean and spherical frameworks

abstract: In this paper we consider the effect of symmetry on the rigidity of bar-joint frameworks, spherical frameworks and point-hyperplane frameworks in $\mathbb{R}^d$. In particular we show that, under forced or incidental symmetry, infinitesimal rigidity for spherical frameworks with vertices in $X$ on the equator and point-hyperplane frameworks with the vertices in $X$ representing hyperplanes are equivalent. We then show, again under forced or incidental symmetry, that infinitesimal rigidity properties under certain symmetry groups can be paired, or clustered, under inversion on the sphere so that infinitesimal rigidity with a given group is equivalent to infinitesimal rigidity under a paired group. The fundamental basic example is that mirror symmetric rigidity is equivalent to half-turn symmetric rigidity on the 2-sphere. With these results in hand we also deduce some combinatorial consequences for the rigidity of symmetric bar-joint and point-line frameworks.


title: Listening while Speaking and Visualizing: Improving ASR through Multimodal Chain

abstract: Previously, a machine speech chain, which is based on sequence-to-sequence deep learning, was proposed to mimic speech perception and production behavior. Such chains separately processed listening and speaking by automatic speech recognition (ASR) and text-to-speech synthesis (TTS) and simultaneously enabled them to teach each other in semi-supervised learning when they received unpaired data. Unfortunately, this speech chain study is limited to speech and textual modalities. In fact, natural communication is actually multimodal and involves both auditory and visual sensory systems. Although the said speech chain reduces the requirement of having a full amount of paired data, in this case we still need a large amount of unpaired data. In this research, we take a further step and construct a multimodal chain and design a closely knit chain architecture that combines ASR, TTS, image captioning, and image production models into a single framework. The framework allows the training of each component without requiring a large number of parallel multimodal data. Our experimental results also show that an ASR can be further trained without speech and text data and cross-modal data augmentation remains possible through our proposed chain, which improves the ASR performance.


title: Massive Styles Transfer with Limited Labeled Data

abstract: Language style transfer has attracted more and more attention in the past few years. Recent researches focus on improving neural models targeting at transferring from one style to the other with labeled data. However, transferring across multiple styles is often very useful in real-life applications. Previous researches of language style transfer have two main deficiencies: dependency on massive labeled data and neglect of mutual influence among different style transfer tasks. In this paper, we propose a multi-agent style transfer system (MAST) for addressing multiple style transfer tasks with limited labeled data, by leveraging abundant unlabeled data and the mutual benefit among the multiple styles. A style transfer agent in our system not only learns from unlabeled data by using techniques like denoising auto-encoder and back-translation, but also learns to cooperate with other style transfer agents in a self-organization manner. We conduct our experiments by simulating a set of real-world style transfer tasks with multiple versions of the Bible. Our model significantly outperforms the other competitive methods. Extensive results and analysis further verify the efficacy of our proposed system.