title: vq-wav2vec: Self-Supervised Learning of Discrete Speech Representations

abstract: We propose vq-wav2vec to learn discrete representations of audio segments through a wav2vec-style self-supervised context prediction task. The algorithm uses either a gumbel softmax or online k-means clustering to quantize the dense representations. Discretization enables the direct application of algorithms from the NLP community which require discrete inputs. Experiments show that BERT pre-training achieves a new state of the art on TIMIT phoneme classification and WSJ speech recognition.


title: Control theorem and functional equation of Selmer groups over $p$-adic Lie extensions

abstract: Let us consider a $p$-adic Lie extension of a number field $K$ which fits into the setting of non-commutative Iwasawa theory formulated by Coates-Fukaya-Kato-Sujatha-Venjakob. For the first main result, we will prove the control theorem of Selmer group associated to a motive, which generalizes previous results by the second author and Greenberg. For the second main result, we prove the functional equation of the dual Selmer groups, which generalizes previous results by Greenberg, Perrin-Riou and Zabradi. Note that our proof of the functional equation is different from the proof of Zabradi even in the case where the Selmer group is associated to an elliptic curve. We also discuss the functional equation for the analytic $p$-adic $L$-functions and check the compatibility with the functional equation of the dual Selmer groups.


title: Complement Face Forensic Detection and Localization with FacialLandmarks

abstract: Recently, Generative Adversarial Networks (GANs) and image manipulating methods are becoming more powerful and can produce highly realistic face images beyond human recognition which have raised significant concerns regarding the authenticity of digital media. Although there have been some prior works that tackle face forensic classification problem, it is not trivial to estimate edited locations from classification predictions. In this paper, we propose, to the best of our knowledge, the first rigorous face forensic localization dataset, which consists of genuine, generated, and manipulated face images. In particular, the pristine parts contain face images from CelebA and FFHQ datasets. The fake images are generated from various GANs methods, namely DCGANs, LSGANs, BEGANs, WGAN-GP, ProGANs, and StyleGANs. Lastly, the edited subset is generated from StarGAN and SEFCGAN based on free-form masks. In total, the dataset contains about 1.3 million facial images labelled with corresponding binary masks. Based on the proposed dataset, we demonstrated that explicit adding facial landmarks information in addition to input images improves the performance. In addition, our proposed method consists of two branches and can coherently predict face forensic detection and localization to outperform the previous state-of-the-art techniques on the newly proposed dataset as well as the faceforecsic++ dataset especially on low-quality videos.


title: Acquisition of Inflectional Morphology in Artificial Neural Networks With Prior Knowledge

abstract: How does knowledge of one language's morphology influence learning of inflection rules in a second one? In order to investigate this question in artificial neural network models, we perform experiments with a sequence-to-sequence architecture, which we train on different combinations of eight source and three target languages. A detailed analysis of the model outputs suggests the following conclusions: (i) if source and target language are closely related, acquisition of the target language's inflectional morphology constitutes an easier task for the model; (ii) knowledge of a prefixing (resp. suffixing) language makes acquisition of a suffixing (resp. prefixing) language's morphology more challenging; and (iii) surprisingly, a source language which exhibits an agglutinative morphology simplifies learning of a second language's inflectional morphology, independent of their relatedness.


title: Spoofing and Anti-Spoofing with Wax Figure Faces

abstract: We have witnessed rapid advances in both face presentation attack models and presentation attack detection (PAD) in recent years. Compared to widely studied 2D face presentation attacks (e.g. printed photos and video replays), 3D face presentation attacks are more challenging because face recognition systems (FRS) is more easily confused by the 3D characteristics of materials similar to real faces. Existing 3D face spoofing databases, mostly based on 3D facial masks, are restricted to small data size and suffer from poor authenticity due to the difficulty and expense of mask production. In this work, we introduce a wax figure face database (WFFD) as a novel and super-realistic 3D face presentation attack. This database contains 2300 image pairs (totally 4600) and 745 subjects including both real and wax figure faces with high diversity from online collections. On one hand, our experiments have demonstrated the spoofing potential of WFFD on three popular FRSs. On the other hand, we have developed a multi-feature voting scheme for wax figure face detection (anti-spoofing), which combines three discriminative features at the decision level. The proposed detection method was compared against several face PAD approaches and found to outperform other competing methods. Surprisingly, our fusion-based detection method achieves an Average Classification Error Rate (ACER) of 11.73\% on the WFFD database, which is even better than human-based detection.


title: Scattering of compactlike structures

abstract: We investigate the collision of a new class of topological defects that tends to become compact as a control parameter increases to larger and larger values These new compactlike defects have, in general, more than one internal discrete mode depending on the value of the control parameter and, as usual, there is a critical velocity above which the defects escape after the collision. We noticed that below the critical velocity there are the windows of escape presenting fractal structure. An interesting novelty is the appearance of metastable structures with the formation of compactlike defects, maintaining a fixed distance from each other. Another new feature is the formation of boosted localized distributions of the scalar field which we called moving oscillons. These oscillons carry away almost all scalar field energy producing a complete disruption of the compactlike defects. The pattern of the moving oscillons depends on the control parameter, and becomes more complex as we increase its value. We conjecture that the new effects may be connected with the presence of more than one vibrational mode in the spectrum of the stability potential of the model under investigation.


title: Large Momentum Transfer Clock Atom Interferometry on the 689 nm Intercombination Line of Strontium

abstract: We report the first realization of large momentum transfer (LMT) clock atom interferometry. Using single-photon interactions on the strontium ${}^1S_0 - {}^3P_1$ transition, we demonstrate Mach-Zehnder interferometers with state-of-the-art momentum separation of up to $141\,\hbar k$ and gradiometers of up to $81\,\hbar k$. Moreover, we circumvent excited state decay limitations and extend the gradiometer duration to 50 times the excited state lifetime. Because of the broad velocity acceptance of the interferometry pulses, all experiments are performed with laser-cooled atoms at a temperature of $3\,\mu \text{K}$. This work has applications in high-precision inertial sensing and paves the way for LMT-enhanced clock atom interferometry on even narrower transitions, a key ingredient in proposals for gravitational wave detection and dark matter searches.


title: Fano effect on the neutron elastic scattering by open-shell nuclei

abstract: By focusing on the asymmetric shape of cross section, we analyze the pairing effect on the partial wave components of cross section for neutron elastic scattering off stable and unstable nuclei within the Hartree-Fock-Bogoliubov (HFB) framework. Explicit expressions for Fano parameters $q_{lj}$ and $\epsilon_{lj}$ have been derived and the pairing effects have been analyzed in term of these parameters, and the Fano effect was found on the neutron elastic scattering off the stable nucleus in terms of the pairing correlation. Fano effect was appeared as the asymmetric line-shape of the cross section caused by the small absolute value of $q_{lj}$ due to the small pairing effect on the deep-lying hole state of the stable nucleus. In the case of the unstable nuclei, the large $q_{lj}$ value is expected because of the small absolute value of the Fermi energy. The quasiparticle resonance with the large $q_{lj}$ forms the Breit-Wigner type shape in the elastic scattering cross section.


title: Two classes of $p$-ary linear codes and their duals

abstract: Let $\mathbb{F}_{p^m}$ be the finite field of order $p^m$, where $p$ is an odd prime and $m$ is a positive integer. In this paper, we investigate a class of subfield codes of linear codes and obtain the weight distribution of \begin{equation*} \begin{split} \mathcal{C}_k=\left\{\left(\left( {\rm Tr}_1^m\left(ax^{p^k+1}+bx\right)+c\right)_{x \in \mathbb{F}_{p^m}}, {\rm Tr}_1^m(a)\right) : \, a,b \in \mathbb{F}_{p^m}, c \in \mathbb{F}_p\right\}, \end{split} \end{equation*} where $k$ is a nonnegative integer. Our results generalize the results of the subfield codes of the conic codes in \cite{Hengar}. Among other results, we study the punctured code of $\mathcal{C}_k$, which is defined as $$\mathcal{\bar{C}}_k=\left\{\left( {\rm Tr}_1^m\left(a x^{{p^k}+1}+bx\right)+c\right)_{x \in \mathbb{F}_{p^m}} : \, a,b \in \mathbb{F}_{p^m}, \,\,c \in \mathbb{F}_p\right\}.$$ The parameters of these linear codes are new in some cases. Some of the presented codes are optimal or almost optimal. Moreover, let $v_2(\cdot)$ denote the 2-adic order function and $v_2(0)=\infty$, the duals of $\mathcal{C}_k$ and $\mathcal{\bar{C}}_k$ are optimal with respect to the Sphere Packing bound if $p>3$, and the dual of $\mathcal{\bar{C}}_k$ is an optimal ternary linear code for the case $v_2(m)\leq v_2(k)$ if $p=3$ and $m>1$.


title: Identifying non-affine softening modes in glassy polymer networks: A pathway to chemical design

abstract: Using molecular simulations and theory, we develop an explicit mapping of the contribution of molecular relaxation modes in glassy thermosets to the shear modulus, where the relaxations were tuned by altering the polarity of side groups. Specifically, motions at the domain, segmental, monomer, and atomic levels are taken from molecular dynamics snapshots and directly linked with the viscoelasticity through a framework based in the lattice dynamics of amorphous solids. This unique approach provides direct insight into the roles of chemical groups in the stress response, including the timescale and spatial extent of relaxations during mechanics. Two thermoset networks with differing concentrations of polar side groups were examined, dicyclopentadiene (DCPD) and 5-norbornene-2-methanol (NBOH). A machine learning method is found to be effective for quantifying large-scale correlated motions while more local chemical relaxations are readily identified by direct inspection. The approach is broadly applicable and enables rapid predictions of the frequency-dependent modulus for any glass.


title: Large Sound Speed in Dense Matter and the Deformability of Neutron Stars

abstract: The historic first detection of the binary neutron star merger GW170817 by the LIGO-Virgo collaboration has set a limit on the gravitational deformability of neutron stars. In contrast, radio observations of PSR J0740+6620 find a very massive neutron star. Tension between the small deformability and the large maximum mass may suggest that the pressure rises rapidly with density and thus the speed of sound in dense matter is likely a large fraction of the speed of light. We use these observations and simple constant sound-speed model equations of state to set a lower bound on the maximum speed of sound in neutron stars. If the tidal deformability of a 1.4$M_\odot$ neutron star is less than 600, as is suggested by subsequent analyses of GW170817, we find that the sound speed in the cores of neutron stars is likely larger than the conformal limit of $c/\sqrt{3}$. Implications of this for our understanding of both hadronic and quark-gluon descriptions of dense matter are discussed.


title: Discovery of an Edge-on Galaxy with X-shaped Bi-cone --- SDSS J171359.00+333625.5

abstract: Using the integral field unit (IFU) data from Mapping Nearby Galaxies at Apache Point Observatory (MaNGA) survey, we study the kinematics of gas and stellar components in an edge-on Seyfert 2 galaxy, SDSS J171359.00+333625.5, with X-shaped bi-conical outflows. The gas and stars therein are found to be counter-rotating, indicating that the collision between the inner and external gas might be an effective way to dissipate the angular momentum, which leads to remarkable gas accretion into the galaxy center. Large [OIII]$\lambda$5007 equivalent width and AGN-like line ratio in the large bi-conical region suggest that the gas is ionized by the central AGN. The gas velocity in the bi-cone region shows that ionized gas is receding relative to the galaxy center, which could be the joint effect of inflows, outflows and disk rotation. We are probably witnessing the case where a great amount of gas in the disk is being efficiently accreted into the central black hole, and the AGN-driven galactic winds are blown out along the bi-cone. The kinematics of oxygen, including rotation velocity and velocity dispersion, is different from other elements, like hydrogen, nitrogen and sulfur. The rotation velocity estimated from oxygen is slower than from other elements. The velocity dispersion of other elements follows galactic gravitational potential, while the velocity dispersion of oxygen stays roughly constant along the galactic major-axis. The further advanced observations, e.g. of cold gas or with an IFU of higher spatial resolution, are required to better understand this object.


title: Independent Dominating Sets in Directed Graphs

abstract: In this paper, we study independent domination in directed graphs, which was recently introduced by Cary, Cary, and Prabhu. We provide a short, algorithmic proof that all directed acyclic graphs contain an independent dominating set. Using linear algebraic tools, we prove that any strongly connected graph with even period has at least two independent dominating sets, generalizing several of the results of Cary, Cary, and Prabhu. We prove that determining the period of the graph is not sufficient to determine the existence of an independent dominating set by constructing a few examples of infinite families of graphs. We show that the direct analogue of Vizing's Conjecture does not hold for independent domination number in directed graphs by providing two infinite families of graphs. We initialize the study of time complexity for independent domination in directed graphs, proving that the existence of an independent dominating set in directed acyclic graphs and strongly connected graphs with even period are in the time complexity class $P$. We also provide an algorithm for determining existence of an independent dominating set for digraphs with period greater than $1$.


title: Third harmonic generation of undoped graphene in Hartree-Fock approximation

abstract: We theoretically investigate the effects of Coulomb interaction, at the level of unscreened Hartree-Fock approximation, on third harmonic generation of undoped graphene in an equation of motion framework. The unperturbed electronic states are described by a widely used two-band tight binding model, and the Coulomb interaction is described by the Ohno potential. The ground state is renormalized by taking into account the Hartree-Fock term, and the optical conductivities are obtained by numerically solving the equations of motion. The absolute values of conductivity for third harmonic generation depend on the photon frequency $\Omega$ as $\Omega^{-n}$ for $\hbar\Omega<1$, and then show a peak as $3\hbar\Omega$ approaches the renormalized energy of the $M$ point. Taking into account the Coulomb interaction, $n$ is found to be $5.5$, which is significantly greater than the value of $4$ found with the neglect of the Coulomb interaction. Therefore the Coulomb interaction enhances third harmonic generation at low photon energies -- for our parameters $\hbar\Omega<0.8$~eV -- and then reduces it until the photon energy reaches about $2.1$~eV. The effect of the background dielectric constant is also considered.


title: Quantification of the Leakage in Federated Learning

abstract: With the growing emphasis on users' privacy, federated learning has become more and more popular. Many architectures have been raised for a better security. Most architecture work on the assumption that data's gradient could not leak information. However, some work, recently, has shown such gradients may lead to leakage of the training data. In this paper, we discuss the leakage based on a federated approximated logistic regression model and show that such gradient's leakage could leak the complete training data if all elements of the inputs are either 0 or 1.


title: On $A_1^2$ restrictions of Weyl arrangements

abstract: Let $\mathcal{A}$ be a Weyl arrangement in an $\ell$-dimensional Euclidean space. The freeness of restrictions of $\mathcal{A}$ was first settled by a case-by-case method by Orlik and the second author (1993), and later by a uniform argument by Douglass (1999). Prior to this, Orlik and Solomon (1983) had completely determined the exponents of these arrangements by exhaustion. A classical result due to Orlik, Solomon and the second author (1986), asserts that the exponents of any $A_1$ restriction, i.e., the restriction of $\mathcal{A}$ to a hyperplane, are given by $\{m_1,\ldots, m_{\ell-1}\}$, where $\exp(\mathcal{A})=\{m_1,\ldots, m_{\ell}\}$ with $m_1 \le \cdots\le m_{\ell}$. As a next step towards conceptual understanding of the restriction exponents we will investigate the $A_1^2$ restrictions, i.e., the restrictions of $\mathcal{A}$ to the subspaces of type $A_1^2$. In this paper, we give a combinatorial description of the exponents and describe bases for the modules of derivations of the $A_1^2$ restrictions in terms of the classical notion of related roots by Kostant (1955).


title: The image of multilinear polynomials evaluated on $3\times 3$ upper triangular matrices

abstract: We describe the images of multilinear polynomials of arbitrary degree evaluated on the $3\times 3$ upper triangular matrix algebra over an infinite field.


title: The Scalability, Efficiency and Complexity of Universities and Colleges: A New Lens for Assessing the Higher Educational System

abstract: The growing need for affordable and accessible higher education is a major global challenge for the 21st century. Consequently, there is a need to develop a deeper understanding of the functionality and taxonomy of universities and colleges and, in particular, how their various characteristics change with size. Scaling has been a powerful tool for revealing systematic regularities in systems across a range of topics from physics and biology to cities, and for understanding the underlying principles of their organization and growth. Here, we apply this framework to institutions of higher learning in the United States and show that, like organisms, ecosystems and cities, they scale in a surprisingly systematic fashion following simple power law behavior. We analyze the entire spectrum encompassing 5,802 institutions ranging from large research universities to small professional schools, organized in seven commonly used sectors, which reveal distinct regimes of institutional scaling behavior. Metrics include variation in expenditures, revenues, graduation rates and estimated economic added value, expressed as functions of total enrollment, our fundamental measure of size. Our results quantify how each regime of institution leverages specific economies of scale to address distinct priorities. Taken together, the scaling of features within a sector and shifts in scaling across sectors implies that there are generic mechanisms and constraints shared by all sectors which lead to tradeoffs between their different societal functions and roles. We particularly highlight the strong complementarity between public and private research universities, and community and state colleges, four sectors that display superlinear returns to scale.


title: Uncertainty Quantification and Exploration for Reinforcement Learning

abstract: We investigate statistical uncertainty quantification for reinforcement learning (RL) and its implications in exploration policy. Despite ever-growing literature on RL applications, fundamental questions about inference and error quantification, such as large-sample behaviors, appear to remain quite open. In this paper, we fill in the literature gap by studying the central limit theorem behaviors of estimated Q-values and value functions under various RL settings. In particular, we explicitly identify closed-form expressions of the asymptotic variances, which allow us to efficiently construct asymptotically valid confidence regions for key RL quantities. Furthermore, we utilize these asymptotic expressions to design an effective exploration strategy, which we call Q-value-based Optimal Computing Budget Allocation (Q-OCBA). The policy relies on maximizing the relative discrepancies among the Q-value estimates. Numerical experiments show superior performances of our exploration strategy than other benchmark policies.


title: Round-trip Slipping Motion of the Circular Flare Ribbon Evidenced in a Fan-spine Jet

abstract: A solar jet on 2014 July 31, which was accompanied by a GOES C1.3 flare and a mini-filament eruption at the jet base, was studied by using observations taken by the New Vacuum Solar Telescope and the Solar Dynamic Observatory. Magnetic field extrapolation revealed that the jet was confined in a fan-spine magnetic system that hosts a null point at the height of about 9 Mm from the solar surface. An inner flare ribbon surrounded by an outer circular ribbon and a remote ribbon were observed to be associated with the eruption, in which the inner and remote ribbons respectively located at the footprints of the inner and outer spines, while the circular one manifested the footprint of the fan structure. It is interesting that the circular ribbon's west part showed an interesting round-trip slipping motion, while the inner ribbon and the circular ribbon's east part displayed a northward slipping motion. Our analysis results indicate that the slipping motions of the inner and the circular flare ribbons reflected the slipping magnetic reconnection process in the fan quasi-separatrix layer, while the remote ribbon was associated with the magnetic reconnection at the null point. In addition, the filament eruption was probably triggered by the magnetic cancellation around its south end, which further drove the slipping reconnection in the fan quasi-separatrix layer and the reconnection at the null point.


title: An Imputation model by Dirichlet Process Mixture of Elliptical Copulas for Data of Mixed Type

abstract: Copula-based methods provide a flexible approach to build missing data imputation models of multivariate data of mixed types. However, the choice of copula function is an open question. We consider a Bayesian nonparametric approach by using an infinite mixture of elliptical copulas induced by a Dirichlet process mixture to build a flexible copula function. A slice sampling algorithm is used to sample from the infinite dimensional parameter space. We extend the work on prior parallel tempering used in finite mixture models to the Dirichlet process mixture model to overcome the mixing issue in multimodal distributions. Using simulations, we demonstrate that the infinite mixture copula model provides a better overall fit compared to their single component counterparts, and performs better at capturing tail dependence features of the data. Simulations further show that our proposed model achieves more accurate imputation especially for continuous variables and better inferential results in some analytic models. The proposed model is applied to a medical data set of acute stroke patients in Australia.


title: Analytical Performance Evaluation of Beamforming Under Transceivers Hardware Imperfections

abstract: In this paper, we provide the mathematical framework to evaluate and quantify the performance of wireless systems, which employ beamforming, in the presence of hardware imperfections at both the basestation and the user equipment. In more detail, by taking a macroscopic view of the joint impact of hardware imperfections, we introduce a general model that accounts for transceiver impairments in beamforming transmissions. In order to evaluate their impact, we present novel closed form expressions for the outage probability and upper bounds for the characterization of the system's capacity. Our analysis reveals that the level of imperfection can significantly constraint the ergodic capacity. Therefore, it is important to take them into account when evaluating and designing beamforming systems.


title: Saliency Guided Self-attention Network for Weakly and Semi-supervised Semantic Segmentation

abstract: Weakly supervised semantic segmentation (WSSS) using only image-level labels can greatly reduce the annotation cost and therefore has attracted considerable research interest. However, its performance is still inferior to the fully supervised counterparts. To mitigate the performance gap, we propose a saliency guided self-attention network (SGAN) to address the WSSS problem. The introduced self-attention mechanism is able to capture rich and extensive contextual information but may mis-spread attentions to unexpected regions. In order to enable this mechanism to work effectively under weak supervision, we integrate class-agnostic saliency priors into the self-attention mechanism and utilize class-specific attention cues as an additional supervision for SGAN. Our SGAN is able to produce dense and accurate localization cues so that the segmentation performance is boosted. Moreover, by simply replacing the additional supervisions with partially labeled ground-truth, SGAN works effectively for semi-supervised semantic segmentation as well. Experiments on the PASCAL VOC 2012 and COCO datasets show that our approach outperforms all other state-of-the-art methods in both weakly and semi-supervised settings.


title: X-ray signatures of the polar dusty gas in AGN

abstract: Recent mid-infrared interferometry observations of nearby active galactic nuclei (AGN) revealed that a significant part of the dust emission extends in the polar direction, rather than the equatorial torus/disk direction as expected by the traditional unification model. We study the X-ray signatures of this polar dusty gas with ray-tracing simulations. Different from those from the ionized gas, the scattered emission from the polar dusty gas produces self-absorption and neutral-like fluorescence lines, which are potentially a unique probe of the kinematics of the polar dusty gas. The anomalously small Fe Ka/Si Ka ratios of type II AGN observed previously can be naturally explained by the polar dusty gas, because the polar emission does not suffer from heavy absorption by the dense equatorial gas. The observed Si Ka lines of the Circinus galaxy and NGC 1068 show blue-shifts with respect to the systemic velocities of the host galaxies, consistent with an outflowing scenario of the Si Ka-emitting gas. The 2.5-3 keV image of the Circinus galaxy is elongated along the polar direction, consistent with an origin of the polar gas. These results show that the polar-gas-scattered X-ray emission of type II AGN is an ideal objective for future X-ray missions, such as Athena.


title: New Insight about the Effective Restoration of U_A(1) Symmetry

abstract: The effective restoration of the U_{A}(1) symmetry is revisited by implementing the functional renormalization group approach combining with the 2+1 flavor Polyakov-loop quark-meson model. A temperature-dependent 't Hooft term is taken to imitate the restoration of the U_{A}(1) symmetry. Order parameters, meson spectrum and mixing angles, especially the pressure and the entropy density of the system are calculated to explore the effects of different U_{A}(1) symmetry restoration patterns. We show then that the temperature for the restoration of the U_{A}(1) symmetry is much higher than that for the chiral symmetry SU_{A}(3).


title: Transversal polynomial of r-fold covers

abstract: We explore the interplay between algebraic combinatorics and algorithmic problems in graph theory by defining a polynomial with connections to correspondence colouring (also known as DP-colouring), a recent generalization of list-colouring, and the Unique Games Conjecture. Like the chromatic polynomial of a graph, we are able to evaluate this polynomial at a point, despite the complexity of computing this polynomial. We construct a cover of a graph $X$ by blowing up each vertex to a set of $r$ vertices and joining each pair of sets corresponding to adjacent vertices by a matching with $r$ edges. To each cover $Y$ of $X$ we associate a polynomial $\xi(Y,t)$, called the transversal polynomial. The coefficient $t^k$ of $\xi(Y,t)$ is the number of $k$-edge induced subgraphs of $Y$ whose vertex set is a transversal of the set system given by the blown-up vertices. We show that $\xi(Y,t)$ satisfies a contraction-deletion formula, and that if $n=|V_X|$ and the cover has index $r$, then $\xi(Y,-(r-1)) \equiv 0 \mod r^n$.


title: Zero-shot Dependency Parsing with Pre-trained Multilingual Sentence Representations

abstract: We investigate whether off-the-shelf deep bidirectional sentence representations trained on a massively multilingual corpus (multilingual BERT) enable the development of an unsupervised universal dependency parser. This approach only leverages a mix of monolingual corpora in many languages and does not require any translation data making it applicable to low-resource languages. In our experiments we outperform the best CoNLL 2018 language-specific systems in all of the shared task's six truly low-resource languages while using a single system. However, we also find that (i) parsing accuracy still varies dramatically when changing the training languages and (ii) in some target languages zero-shot transfer fails under all tested conditions, raising concerns on the 'universality' of the whole approach.


title: First order expansion of convex regularized estimators

abstract: We consider first order expansions of convex penalized estimators in high-dimensional regression problems with random designs. Our setting includes linear regression and logistic regression as special cases. For a given penalty function $h$ and the corresponding penalized estimator $\hat\beta$, we construct a quantity $\eta$, the first order expansion of $\hat\beta$, such that the distance between $\hat\beta$ and $\eta$ is an order of magnitude smaller than the estimation error $\|\hat{\beta} - \beta^*\|$. In this sense, the first order expansion $\eta$ can be thought of as a generalization of influence functions from the mathematical statistics literature to regularized estimators in high-dimensions. Such first order expansion implies that the risk of $\hat{\beta}$ is asymptotically the same as the risk of $\eta$ which leads to a precise characterization of the MSE of $\hat\beta$; this characterization takes a particularly simple form for isotropic design. Such first order expansion also leads to inference results based on $\hat{\beta}$. We provide sufficient conditions for the existence of such first order expansion for three regularizers: the Lasso in its constrained form, the lasso in its penalized form, and the Group-Lasso. The results apply to general loss functions under some conditions and those conditions are satisfied for the squared loss in linear regression and for the logistic loss in the logistic model.


title: The JETSCAPE framework: p+p results

abstract: The JETSCAPE framework is a modular and versatile Monte Carlo software package for the simulation of high energy nuclear collisions. In this work we present a new tune of JETSCAPE, called PP19, and validate it by comparison to jet-based measurements in $p+p$ collisions, including inclusive single jet cross sections, jet shape observables, fragmentation functions, charged hadron cross sections, and dijet mass cross sections. These observables in $p+p$ collisions provide the baseline for their counterparts in nuclear collisions. Quantifying the level of agreement of JETSCAPE results with $p+p$ data is thus necessary for meaningful applications of JETSCAPE to A+A collisions. The calculations use the JETSCAPE PP19 tune, defined in this paper, based on version 1.0 of the JETSCAPE framework. For the observables discussed in this work calculations using JETSCAPE PP19 agree with data over a wide range of collision energies at a level comparable to standard Monte Carlo codes. These results demonstrate the physics capabilities of the JETSCAPE framework and provide benchmarks for JETSCAPE users.


title: ClassyTune: A Performance Auto-Tuner for Systems in the Cloud

abstract: Performance tuning can improve the system performance and thus enable the reduction of cloud computing resources needed to support an application. Due to the ever increasing number of parameters and complexity of systems, there is a necessity to automate performance tuning for the complicated systems in the cloud. The state-of-the-art tuning methods are adopting either the experience-driven tuning approach or the data-driven one. Data-driven tuning is attracting increasing attentions, as it has wider applicability. But existing data-driven methods cannot fully address the challenges of sample scarcity and high dimensionality simultaneously. We present ClassyTune, a data-driven automatic configuration tuning tool for cloud systems. ClassyTune exploits the machine learning model of classification for auto-tuning. This exploitation enables the induction of more training samples without increasing the input dimension. Experiments on seven popular systems in the cloud show that ClassyTune can effectively tune system performance to seven times higher for high-dimensional configuration space, outperforming expert tuning and the state-of-the-art auto-tuning solutions. We also describe a use case in which performance tuning enables the reduction of 33% computing resources needed to run an online stateless service.


title: Frustum VoxNet for 3D object detection from RGB-D or Depth images

abstract: Recently, there have been a plethora of classification and detection systems from RGB as well as 3D images. In this work, we describe a new 3D object detection system from an RGB-D or depth-only point cloud. Our system first detects objects in 2D (either RGB or pseudo-RGB constructed from depth). The next step is to detect 3D objects within the 3D frustums these 2D detections define. This is achieved by voxelizing parts of the frustums (since frustums can be really large), instead of using the whole frustums as done in earlier work. The main novelty of our system has to do with determining which parts (3D proposals) of the frustums to voxelize, thus allowing us to provide high resolution representations around the objects of interest. It also allows our system to have reduced memory requirements. These 3D proposals are fed to an efficient ResNet-based 3D Fully Convolutional Network (FCN). Our 3D detection system is fast and can be integrated into a robotics platform. With respect to systems that do not perform voxelization (such as PointNet), our methods can operate without the requirement of subsampling of the datasets. We have also introduced a pipelining approach that further improves the efficiency of our system. Results on SUN RGB-D dataset show that our system, which is based on a small network, can process 20 frames per second with comparable detection results to the state-of-the-art, achieving a 2 times speedup.


title: Bayesian Optimization using Pseudo-Points

abstract: Bayesian optimization (BO) is a popular approach for expensive black-box optimization, with applications including parameter tuning, experimental design, robotics. BO usually models the objective function by a Gaussian process (GP), and iteratively samples the next data point by maximizing an acquisition function. In this paper, we propose a new general framework for BO by generating pseudo-points (i.e., data points whose objective values are not evaluated) to improve the GP model. With the classic acquisition function, i.e., upper confidence bound (UCB), we prove that the cumulative regret can be generally upper bounded. Experiments using UCB and other acquisition functions, i.e., probability of improvement (PI) and expectation of improvement (EI), on synthetic as well as real-world problems clearly show the advantage of generating pseudo-points.


title: A preference learning framework for multiple criteria sorting with diverse additive value models and valued assignment examples

abstract: We present a preference learning framework for multiple criteria sorting. We consider sorting procedures applying an additive value model with diverse types of marginal value functions (including linear, piecewise-linear, splined, and general monotone ones) under a unified analytical framework. Differently from the existing sorting methods that infer a preference model from crisp decision examples, where each reference alternative is assigned to a unique class, our framework allows to consider valued assignment examples in which a reference alternative can be classified into multiple classes with respective credibility degrees. We propose an optimization model for constructing a preference model from such valued examples by maximizing the credible consistency among reference alternatives. To improve the predictive ability of the constructed model on new instances, we employ the regularization techniques. Moreover, to enhance the capability of addressing large-scale datasets, we introduce a state-of-the-art algorithm that is widely used in the machine learning community to solve the proposed optimization model in a computationally efficient way. Using the constructed additive value model, we determine both crisp and valued assignments for non-reference alternatives. Moreover, we allow the Decision Maker to prioritize importance of classes and give the method a flexibility to adjust classification performance across classes according to the specified priorities. The practical usefulness of the analytical framework is demonstrated on a real-world dataset by comparing it to several existing sorting methods.


title: The Search for Truth through Data: NP Decision Processes, ROC Functions, $P$-Functionals, Knowledge Updating and Sequential Learning

abstract: This paper re-visits the problem of deciding between two simple hypotheses, the setting considered by Neyman and Pearson in developing their fundamental lemma. It studies the decision process induced by the most powerful test and the receiver operating characteristic function associated with this decision process. It addresses the question of how to report the decision arising from the decision function. It also examines the P-functional (the P-value statistic) and its role in the decision-making process. The impetus of this work is the continuing criticisms of statistical decision-making procedures that use the P-functional and a level of significance (LoS) of 0.05. A point made is that if one is going to use the value of the P-functional, then it should be used in an equivalent manner as the most powerful decision function, but if one wants to obtain from its value the degree of support for either hypotheses, then the value of its density under the alternative is the proper quantity to use. Replicability of results are discussed. Knowledge updating through Bayes theorem when given the decision or the value of the P-functional is also discussed, and it is argued that sequential learning is a coherent way of finding the truth. But the impact of publication bias is also demonstrated to be quite serious in the search for truth. It is argued that decision-makers are free to choose their own LoS, since the additional summary measures will automatically take their LoS choices into consideration. Three approaches for choosing an optimal LoS are discussed and a procedure for sample size determination is described. Ideas are illustrated by concrete problems and by the lady tea-tasting experiment of Fisher which ushered null hypothesis significance testing. It is hoped that by considering this fundamental setting of simple hypotheses, a better understanding of more complex settings will ensue.


title: Projective Geometry for Perfectoid Spaces

abstract: To understand the structure of an algebraic variety we often embed it in various projective spaces. This develops the notion of projective geometry which has been an invaluable tool in algebraic geometry. We develop a perfectoid analog of projective geometry, and explore how equipping a perfectoid space with a map to a certain analog of projective space can be a powerful tool to understand its geometric and arithmetic structure. In particular, we show that maps from a perfectoid space $X$ to the perfectoid analog of projective space correspond to line bundles on $X$ together with some extra data, reflecting the classical theory. Along the way we give a complete classification of vector bundles on the perfectoid unit disk, and compute the Picard group of the perfectoid analog of projective space.


title: Rational solutions of (1+1)-dimensional Burgers equation and their asymptotic

abstract: A special initial condition for (1+1)-dimensional Burgers equation is considered. It allows to obtain new analytical solutions for an arbitrary low viscosity as well as for the inviscid case. The viscous solution is written as a rational function provided the Reynolds number (a dimensionless value inversely proportional to the viscosity) is a multiple of two. The inviscid solution is expressed in radicals. Asymptotic expansion of the viscous solution at infinite Reynolds number is compared against the inviscid case. All solutions are finite, tend to zero at infinity and therefore are physically viable.


title: Low-density expansions for the homogeneous dipolar Bose gas at zero temperature

abstract: The low-density expansions for the energy, chemical potential, and condensate depletion of the homogeneous dilute dipolar Bose gas are obtained by regularizing the dipole-dipole interaction at long distances. It is shown that the leading term, proportional to the density, allows a simple physical interpretation and consistently describes the thermodynamic stability of the system. The long-range asymptotics are obtained analytically for the normal and anomalous one-particle correlation functions and the pair distribution function. We discuss the properties of the two-body scattering with zero relative momentum for the dipole-dipole interaction, in particular, we derive the asymptotics of the wave function and a correction to the scattering length for small values of the dipolar range. We show how the density expansions can be derived within the Bogoliubov model of weakly interacting particles without any divergence from the assumption of universality of the expansions at low densities.


title: Optimizing target nodes selection for the control energy of directed complex networks

abstract: The energy needed in controlling a complex network is a problem of practical importance. Recent works have focused on the reduction of control energy either via strategic placement of driver nodes, or by decreasing the cardinality of nodes to be controlled. However, optimizing control energy with respect to target nodes selection has yet been considered. In this work, we propose an iterative method based on Stiefel manifold optimization of selectable target node matrix to reduce control energy. We derive the matrix derivative gradient needed for the search algorithm in a general way, and search for target nodes which result in reduced control energy, assuming that driver nodes placement is fixed. Our findings reveal that the control energy is optimal when the path distances from driver nodes to target nodes are minimized. We corroborate our algorithm with extensive simulations on elementary network topologies, random and scale-free networks, as well as various real networks. The simulation results show that the control energy found using our algorithm outperforms heuristic selection strategies for choosing target nodes by a few orders of magnitude. Our work may be applicable to opinion networks, where one is interested in identifying the optimal group of individuals that the driver nodes can influence.


title: Spectral Efficiency of One-Bit Sigma-Delta Massive MIMO

abstract: We examine the uplink spectral efficiency of a massive MIMO base station employing a one-bit Sigma-Delta sampling scheme implemented in the spatial rather than the temporal domain. Using spatial rather than temporal oversampling, and feedback of the quantization error between adjacent antennas, the method shapes the spatial spectrum of the quantization noise away from an angular sector where the signals of interest are assumed to lie. It is shown that, while a direct Bussgang analysis of the Sigma-Delta approach is not suitable, an alternative equivalent linear model can be formulated to facilitate an analysis of the system performance. The theoretical properties of the spatial quantization noise power spectrum are derived for the Sigma-Delta array, as well as an expression for the spectral efficiency of maximum ratio combining (MRC). Simulations verify the theoretical results and illustrate the significant performance gains offered by the Sigma-Delta approach for both MRC and zero-forcing receivers.


title: Multi-objective Evolutionary Algorithms are Still Good: Maximizing Monotone Approximately Submodular Minus Modular Functions

abstract: As evolutionary algorithms (EAs) are general-purpose optimization algorithms, recent theoretical studies have tried to analyze their performance for solving general problem classes, with the goal of providing a general theoretical explanation of the behavior of EAs. Particularly, a simple multi-objective EA, i.e., GSEMO, has been shown to be able to achieve good polynomial-time approximation guarantees for submodular optimization, where the objective function is only required to satisfy some properties but without explicit formulation. Submodular optimization has wide applications in diverse areas, and previous studies have considered the cases where the objective functions are monotone submodular, monotone non-submodular, or non-monotone submodular. To complement this line of research, this paper studies the problem class of maximizing monotone approximately submodular minus modular functions (i.e., $f=g-c$) with a size constraint, where $g$ is a non-negative monotone approximately submodular function and $c$ is a non-negative modular function, resulting in the objective function $f$ being non-monotone non-submodular. We prove that the GSEMO can achieve the best-known polynomial-time approximation guarantee. Empirical studies on the applications of Bayesian experimental design and directed vertex cover show the excellent performance of the GSEMO.


title: Deep Transfer Learning for Source Code Modeling

abstract: In recent years, deep learning models have shown great potential in source code modeling and analysis. Generally, deep learning-based approaches are problem-specific and data-hungry. A challenging issue of these approaches is that they require training from starch for a different related problem. In this work, we propose a transfer learning-based approach that significantly improves the performance of deep learning-based source code models. In contrast to traditional learning paradigms, transfer learning can transfer the knowledge learned in solving one problem into another related problem. First, we present two recurrent neural network-based models RNN and GRU for the purpose of transfer learning in the domain of source code modeling. Next, via transfer learning, these pre-trained (RNN and GRU) models are used as feature extractors. Then, these extracted features are combined into attention learner for different downstream tasks. The attention learner leverages from the learned knowledge of pre-trained models and fine-tunes them for a specific downstream task. We evaluate the performance of the proposed approach with extensive experiments with the source code suggestion task. The results indicate that the proposed approach outperforms the state-of-the-art models in terms of accuracy, precision, recall, and F-measure without training the models from scratch.


title: Spatio-Temporal Mixed Models to Predict Coverage Error Rates at Local Areas

abstract: Despite of the great efforts during the censuses, occurrence of some nonsampling errors such as coverage error is inevitable. Coverage error which can be classified into two types of under-count and overcount occurs when there is no unique bijective (one-to-one) mapping between the individuals from the census count and the target population -- individuals who usually reside in the country (de jure residences). There are variety of reasons make the coverage error happens including deficiencies in the census maps, errors in the field operations or disinclination of people for participation in the undercount situation and multiple enumeration of individuals or those who do not belong to the scope of the census in the overcount situation. A routine practice for estimating the net coverage error is subtracting the census count from the estimated true population, which obtained from a dual system (or capture-recapture) technique. Estimated coverage error usually suffers from significant uncertainty of the direct estimate of true population or other errors such as matching error. To rectify the above-mentioned problem and predict a more reliable coverage error rate, we propose a set of spatio-temporal mixed models. In an illustrative study on the 2010 census coverage error rate of the U.S. counties with population more than 100,000, we select the best mixed model for prediction by deviance information criteria (DIC) and conditional predictive ordinate (CPO). Our proposed approach for predicting coverage error rate and its measure of uncertainty is a full Bayesian approach, which leads to a reasonable improvement over the direct coverage error rate in terms of mean squared error (MSE) and confidence interval (CI) as provided by the U.S. Census Bureau.


title: Prediction Focused Topic Models via Feature Selection

abstract: Supervised topic models are often sought to balance prediction quality and interpretability. However, when models are (inevitably) misspecified, standard approaches rarely deliver on both. We introduce a novel approach, the prediction-focused topic model, that uses the supervisory signal to retain only vocabulary terms that improve, or at least do not hinder, prediction performance. By removing terms with irrelevant signal, the topic model is able to learn task-relevant, coherent topics. We demonstrate on several data sets that compared to existing approaches, prediction-focused topic models learn much more coherent topics while maintaining competitive predictions.


title: Ancient Solution of Mean Curvature Flow in Space Forms

abstract: In this paper we investigate the rigidity of ancient solutions of the mean curvature flow with arbitrary codimension in space forms. We first prove that under certain sharp asymptotic pointwise curvature pinching condition the ancient solution in a sphere is either a shrinking spherical cap or a totally geodesic sphere. Then we show that under certain pointwise curvature pinching condition the ancient solution in a hyperbolic space is a family of shrinking spheres. We also obtain a rigidity result for ancient solutions in a nonnegatively curved space form under an asymptotic integral curvature pinching condition.


title: Covariant calculation of a two-loop test of nonrelativistic QCD factorization

abstract: We test the nonrelativistic QCD factorization conjecture for inclusive quarkonium production at two loops by carrying out a covariant calculation of the nonrelativistic quantum chromodynamics (NRQCD) long-distance matrix element (LDME) for a heavy-quark pair in an $S$-wave, color-octet state to fragment into a heavy-quark pair in a color-singlet state of arbitrary orbital angular momentum. The NRQCD factorization conjecture for the universality of the LDME requires that infrared divergences that it contains be independent of the direction of the Wilson line that appears in its definition. We find this to be the case in our calculation. The results of our calculation differ in some respects from those of a previous calculation that was carried out by Nayak, Qiu, and Sterman using light-cone methods. We have identified the sources of some of these differences. The results of both calculations are consistent with the NRQCD factorization conjecture. However, the general principle that underlies this confirmation of NRQCD factorization at two-loop order has yet to be revealed.


title: High signal-to-noise ratio reconstruction of low bit-depth optical coherence tomography using deep learning

abstract: Reducing the bit-depth is an effective approach to lower the cost of optical coherence tomography (OCT) systems and increase the transmission efficiency in data acquisition and telemedicine. However, a low bit-depth will lead to the degeneration of the detection sensitivity thus reduce the signal-to-noise ratio (SNR) of OCT images. In this paper, we propose to use deep learning for the reconstruction of the high SNR OCT images from the low bit-depth acquisition. Its feasibility was preliminarily evaluated by applying the proposed method to the quantized $3\sim8$-bit data from native 12-bit interference fringes. We employed a pixel-to-pixel generative adversarial network architecture in the low to high bit-depth OCT image transition. Retinal OCT data of a healthy subject from a homemade spectral-domain OCT system was used in the study. Extensively qualitative and quantitative results show this deep-learning-based approach could significantly improve the SNR of the low bit-depth OCT images especially at the choroidal region. Superior similarity and SNR between the reconstructed images and the original 12-bit OCT images could be derived when the bit-depth $\geq 5$. This work demonstrates the proper integration of OCT and deep learning could benefit the development of healthcare in low-resource settings.


title: The interaction of frictional slip and adhesion for a stiff sphere on a compliant substrate

abstract: How friction affects adhesion is addressed. The problem is considered in the context of a very stiff sphere adhering to a compliant, isotropic, linear elastic substrate, and experiencing adhesion and frictional slip relative to each other. The adhesion is considered to be driven by very large attractive tractions between the sphere and the substrate that can act only at very small distances between them. As a consequence, the adhesion behavior can be represented by the Johnson-Kendall-Roberts model, and this is assumed to prevail also when frictional slip is occurring. Frictional slip is considered to be resisted by a uniform, constant shear traction at the slipping interface, a model that is considered to be valid for small asperities and for compliant elastomers in contact with stiff material. A model for the interaction of friction and adhesion, known to agree with some experimental data, is utilized. This model is due to Johnson, and its adhesion-friction interaction is assumed to stem, upon shrinkage of the contact area, from a postulated reversible energy release associated with frictional slip. This behavior is considered to arise from surface microstructures generated or eliminated by frictional slip, where these microstructures store some elastic strain energy in a reversible manner. The associated reversible energy release rate is derived from the energy exchanges that occur in the system. The Johnson model, and an asymptotic analysis of it for small amounts of frictional slip, is shown to be consistent with the reversible energy release rate that we identify.


title: On Le Jan-Sznitman's stochastic approach to the Navier-Stokes equations

abstract: The paper explores the symbiotic relation between the Navier-Stokes equations and the associated stochastic cascades. Specifically, we examine how some well-known existence and uniqueness results for the Navier-Stokes equations can inform about the probabilistic features of the associated stochastic cascades, and how some probabilistic features of the stochastic cascades can, in turn, inform about the existence and uniqueness (or the lack thereof) of solutions. Our method of incorporating the stochastic explosion gives a simpler and more natural method to construct the solution compared to the original construction by Le Jan and Sznitman. This new stochastic construction is then used to show the finite-time blowup and non-uniqueness of the initial value problem for the Montgomery-Smith equation. We exploit symmetry properties inherent in our construction to give a simple proof of the global well-posedness results for small initial data in scale-critical Fourier-Besov spaces. We also obtain the pointwise convergence of the Picard's iteration associated with the Fourier-transformed Navier-Stokes equations.


title: Global regularity criteria for the Navier-Stokes equations based on one approximate solution

abstract: Considering the three-dimensional incompressible Navier-Stokes equations on the whole space, we address the question: is it possible to infer global regularity of a mild solution from a single approximate solution? Assuming a relatively simple scale-invariant relation involving the size of the approximate solution, the resolution parameter, and the initial energy, we show that the answer is affirmative for a general class of approximate solutions, including Leray's mollified solutions. Two different treatments leading to essentially the same conclusion are presented.


title: Energy Non-collapsing and Refined Blowup for a Semilinear Heat Equation

abstract: Refined structures of blowup for non-collapsing maximal solution to a semilinear parabolic equation are studied. We will prove that the blowup set is empty for non-collapsing blowing-up in subcritical case, and all finite time non-collapsing blowing-up must be type II in critical case. When p>p_S=(N+2)/(N-2) for N>=3, the Hausdorff dimension of the blowup set for maximal solution whose energy is non-collapsing is shown to be no greater than N-2-4/(p-1), which answers a question proposed in [7] positively. At the end of this paper, we also present some new examples of collapsing and non-collapsing blowups.


title: Pulsar glitch activity as a state-dependent Poisson process: parameter estimation and epoch prediction

abstract: Rotational glitches in some rotation-powered pulsars display power-law size and exponential waiting time distributions. These statistics are consistent with a state-dependent Poisson process, where the glitch rate is an increasing function of a global stress variable (e.g. crust-superfluid angular velocity lag), diverges at a threshold stress, increases smoothly while the star spins down, and decreases step-wise at each glitch. A minimal, seven-parameter, maximum likelihood model is calculated for PSR J1740-3015, PSR J0534+2200, and PSR J0631+1036, the three objects with the largest samples whose glitch activity is Poisson-like. The estimated parameters have theoretically reasonable values and contain useful information about the glitch microphysics. It is shown that the maximum likelihood, state-dependent Poisson model is a marginally (23-27 per cent) better post factum "predictor" of historical glitch epochs than a homogeneous Poisson process for PSR J1740-3015 and PSR J0631+1036 and a comparable predictor for PSR J0534+2200. Monte Carlo simulations imply that > 50 glitches are needed to test reliably whether one model outperforms the other. It is predicted that the next glitch will occur at Modified Julian Date (MJD) 57784 +/- 256.8, 60713 +/- 1935, and 57406 +/- 1444 for the above three objects respectively. The analysis does not apply to quasiperiodic glitchers like PSR J0537-6910 and PSR J0835-4510, which are not described accurately by the state-dependent Poisson model in its original form.


title: Nevanlinna theory for holomorphic curves from annuli into semi Abelian varieties

abstract: In this paper, we prove a lemma on logarithmic derivative for holomorphic curves from annuli into K\"{a}hler compact manifold and. As its application, a second main theorem for holomophic curves from annuli into semi abelian varieties intersecting with only one divisor is given.


title: Learning deep linear neural networks: Riemannian gradient flows and convergence to global minimizers

abstract: We study the convergence of gradient flows related to learning deep linear neural networks (where the activation function is the identity map) from data. In this case, the composition of the network layers amounts to simply multiplying the weight matrices of all layers together, resulting in an overparameterized problem. The gradient flow with respect to these factors can be re-interpreted as a Riemannian gradient flow on the manifold of rank-$r$ matrices endowed with a suitable Riemannian metric. We show that the flow always converges to a critical point of the underlying functional. Moreover, we establish that, for almost all initializations, the flow converges to a global minimum on the manifold of rank $k$ matrices for some $k\leq r$.


title: Timescale separation solution of Kadanoff-Baym equations for quantum transport in time-dependent fields

abstract: The interaction with time-dependent external fields, especially the interplay between time-dependent driving and quantum correlations, changes the familiar picture of electron transport through nanoscale systems. Although the exact solution of the problem of AC quantum transport of noninteracting electrons has been known for more than two decades, the treatment of correlated particles presents a significant theoretical challenge. In this paper, using the perturbative separation of fast electron tunnelling and slow driving time-scales, we developed a practical approach for time-dependent quantum transport with nonequilibrium Green's functions. The fast electronic dynamics is associated with relative time whilst the slow driving is related to the central time in the Green's functions. The ratio of characteristic electron tunneling time over the period of harmonic driving is used as a small parameter in the theory to obtain a convergent time-derivative expansions of the Green's functions. This enables the algebraic solution of the Kadanoff-Baym equations in Wigner space. Consequently, we produced analytical expressions for dynamical corrections to advanced, retarded, and lesser Green's functions, as well as an improved expression for AC electric current. The method developed is applicable to the general case of multi-channel electron transport through a correlated central region. The theory is applied to different transport scenarios: time-dependent transport through a driven single-resonant level is compared to exact results; and electron transport through a molecular junction described by the Holstein model with a time-oscillating voltage bias is also investigated.


title: Preparing squeezed spin states in a spin-mechanical hybrid system with silicon-vacancy centers

abstract: We present and analyze an effective scheme for preparing squeezed spin states in a novel spin-mechanical hybrid device, which is realized by a single crystal diamond waveguide with built-in silicon-vacancy (SiV) centers. After studying the strain couplings between the SiV spins and the propagating phonon modes, we show that long-range spin-spin interactions can be achieved under large detuning condition. We model these nonlinear spin-spin couplings with an effective one-axis twisting Hamiltonian, and find that the system can be steered to the squeezed spin states in the practical situations. This work may have interesting applications in high-precision metrology and quantum information.


title: Which information can we derive from historical Far Eastern guest stars for modern research on novae and cataclysmic variables?

abstract: Recently, there have been several studies on the evolution of binary systems using historical data treated as facts in the chain of arguments. In this paper we discuss six case studies of modern dwarf novae with suggested historical counterpart from the historical point of view as well as the derived consequences for the physics of close binary systems (the dwarf novae Z Cam and AT Cnc, the nebula in M22, and the possible Nova 101, Nova 483, and Nova 1437). We consider the historical Far Eastern reports and after a careful re-reading of the text we map the given information on the sky. In some cases, the positions given in modern lists of classical nova-guest star-pairs turn out to be wrong, or they have to be considered highly approximate: The historical position, in most cases, should be transformed into areas at the celestial sphere and not into point coordinates. Based on the correct information we consider the consequences concerning the evolution of close binary systems. However, the result is that none of the cases of cataclysmic variables suggested to have a historical counterpart can be (fully) supported. As the identification of the historical record of observation with the CVs known today turns out to be always uncertain, a potential historical observation alone may not be relied on to draw conclusions on the evolution of binaries. The evolution scenarios should be derived from astrophysical observation and modelling only.


title: A Computational Theory of Robust Localization Verifiability in the Presence of Pure Outlier Measurements

abstract: The problem of localizing a set of nodes from relative pairwise measurements is at the core of many applications such as Structure from Motion (SfM), sensor networks, and Simultaneous Localization And Mapping (SLAM). In practical situations, the accuracy of the relative measurements is marred by noise and outliers; hence, we have the problem of quantifying how much we should trust the solution returned by some given localization solver. In this work, we focus on the question of whether an L1-norm robust optimization formulation can recover a solution that is identical to the ground truth, under the scenario of translation-only measurements corrupted exclusively by outliers and no noise; we call this concept verifiability. On the theoretical side, we prove that the verifiability of a problem depends only on the topology of the graph of measurements, the edge support of the outliers, and their signs, while it is independent of ground truth locations of the nodes, and of any positive scaling of the outliers. On the computational side, we present a novel approach based on the dual simplex algorithm that can check the verifiability of a problem, completely characterize the space of equivalent solutions if they exist, and identify subgraphs that are verifiable. As an application of our theory, we provide a procedure to compute a priori probability of recovering a solution congruent or equivalent to the ground truth given a measurement graph and the probabilities of each edge containing an outlier.


title: Generative Neural Network based Spectrum Sharing using Linear Sum Assignment Problems

abstract: Spectrum management and resource allocation (RA) problems are challenging and critical in a vast number of research areas such as wireless communications and computer networks. The traditional approaches for solving such problems usually consume time and memory, especially for large size problems. Recently different machine learning approaches have been considered as potential promising techniques for combinatorial optimization problems, especially the generative model of the deep neural networks. In this work, we propose a resource allocation deep autoencoder network, as one of the promising generative models, for enabling spectrum sharing in underlay device-to-device (D2D) communication by solving linear sum assignment problems (LSAPs). Specifically, we investigate the performance of three different architectures for the conditional variational autoencoders (CVAE). The three proposed architecture are the convolutional neural network (CVAE-CNN) autoencoder, the feed-forward neural network (CVAE-FNN) autoencoder, and the hybrid (H-CVAE) autoencoder. The simulation results show that the proposed approach could be used as a replacement of the conventional RA techniques, such as the Hungarian algorithm, due to its ability to find solutions of LASPs of different sizes with high accuracy and very fast execution time. Moreover, the simulation results reveal that the accuracy of the proposed hybrid autoencoder architecture outperforms the other proposed architectures and the state-of-the-art DNN techniques.


title: Broadcasting of NPT Entanglement in Two Qutrit Systems

abstract: It is known that beyond $2 \otimes 2$ and $2 \otimes 3$ dimensional quantum systems, Peres-Hordecki criterion is no longer sufficient as an entanglement detection criterion as there are entangled states with both positive and negative partial transpose (PPT and NPT). Further, it is also true that all PPT entangled states are bound entangled states. However, in the class of NPT states, there can exist bound entangled states as well as free entangled states. All free/useful/distillable entanglement is a part of the class of NPT entangled states. In this article, we ask the question that given an NPT entangled state in $3 \otimes3$ dimensional system as a resource, how much entanglement can we broadcast so that resource still remains NPT. We have chosen $3 \otimes 3$ system as a first step to understand broadcasting of NPT states in higher dimensional systems. In particular, we find out the range of broadcasting of NPT entanglement for Two parameter Class of States (TPCS) and Isotropic States (IS). Interestingly, as a derivative of this process we are also able to locate the existence of absolute PPT states (ABPPT) in $3 \otimes 3$ dimensional system. Here we implement the strategy of broadcasting through approximate cloning operations.


title: Influence-Based Multi-Agent Exploration

abstract: Intrinsically motivated reinforcement learning aims to address the exploration challenge for sparse-reward tasks. However, the study of exploration methods in transition-dependent multi-agent settings is largely absent from the literature. We aim to take a step towards solving this problem. We present two exploration methods: exploration via information-theoretic influence (EITI) and exploration via decision-theoretic influence (EDTI), by exploiting the role of interaction in coordinated behaviors of agents. EITI uses mutual information to capture influence transition dynamics. EDTI uses a novel intrinsic reward, called Value of Interaction (VoI), to characterize and quantify the influence of one agent's behavior on expected returns of other agents. By optimizing EITI or EDTI objective as a regularizer, agents are encouraged to coordinate their exploration and learn policies to optimize team performance. We show how to optimize these regularizers so that they can be easily integrated with policy gradient reinforcement learning. The resulting update rule draws a connection between coordinated exploration and intrinsic reward distribution. Finally, we empirically demonstrate the significant strength of our method in a variety of multi-agent scenarios.


title: On Robustness of Neural Ordinary Differential Equations

abstract: Neural ordinary differential equations (ODEs) have been attracting increasing attention in various research domains recently. There have been some works studying optimization issues and approximation capabilities of neural ODEs, but their robustness is still yet unclear. In this work, we fill this important gap by exploring robustness properties of neural ODEs both empirically and theoretically. We first present an empirical study on the robustness of the neural ODE-based networks (ODENets) by exposing them to inputs with various types of perturbations and subsequently investigating the changes of the corresponding outputs. In contrast to conventional convolutional neural networks (CNNs), we find that the ODENets are more robust against both random Gaussian perturbations and adversarial attack examples. We then provide an insightful understanding of this phenomenon by exploiting a certain desirable property of the flow of a continuous-time ODE, namely that integral curves are non-intersecting. Our work suggests that, due to their intrinsic robustness, it is promising to use neural ODEs as a basic block for building robust deep network models. To further enhance the robustness of vanilla neural ODEs, we propose the time-invariant steady neural ODE (TisODE), which regularizes the flow on perturbed data via the time-invariant property and the imposition of a steady-state constraint. We show that the TisODE method outperforms vanilla neural ODEs and also can work in conjunction with other state-of-the-art architectural methods to build more robust deep networks.


title: Multilevel Visualisation of Topic Dependency Models for Assessment Design and Delivery: A Hypergraph Based Approach

abstract: The effective design and delivery of assessments in a wide variety of evolving educational environments remains a challenging problem. Proposals have included the use of learning dashboards, peer learning environments, and grading support systems; these embrace visualisations to summarise and communicate results. In an on-going project, the investigation of graph based visualisation models for assessment design and delivery has yielded promising results. Here, an alternative graph foundation, a two-weighted hypergraph, is considered to represent the assessment material (e.g., questions) and their explicit mapping to one or more learning objective topics. The visualisation approach considers the hypergraph as a collection of levels; the content of these levels can be customized and presented according to user preferences. A case study on generating hypergraph models using commonly available assessment data and a flexible visualisation approach using historical data from an introductory programming course is presented


title: Mutually unbiased bases containing a complex Hadamard matrix of Schmidt rank three

abstract: Constructing four six-dimensional mutually unbiased bases (MUBs) is an open problem in quantum physics and measurement. We investigate the existence of four MUBs including the identity, and a complex Hadamard matrix (CHM) of Schmidt rank three. The CHM is equivalent to a controlled unitary operation on the qubit-qutrit system via local unitary transformation $I_2\otimes V$ and $I_2\otimes W$. We show that $V$ and $W$ have no zero entry, and apply it to exclude examples as members of MUBs. We further show that the maximum of entangling power of controlled unitary operation is $\log_2 3$ ebits. We derive the condition under which the maximum is achieved, and construct concrete examples. Our results describe the phenomenon that if a CHM of Schmidt rank three belongs to an MUB then its entangling power may not reach the maximum.


title: Almost Global Solutions to the Three-dimensional Isentropic Inviscid Flows with Damping in Physical Vacuum Around Barenlatt Solutions

abstract: For the three-dimensional vacuum free boundary problem with physical singularity that the sound speed is $C^{ {1}/{2}}$-H$\ddot{\rm o}$lder continuous across the vacuum boundary of the compressible Euler equations with damping, without any symmetry assumptions, we prove the almost global existence of smooth solutions when the initial data are small perturbations of the Barenblatt self-similar solutions to the corresponding porous media equations simplified via Darcy's law. It is proved that if the initial perturbation is of the size of $\epsilon$, then the existing time for smooth solutions is at least of the order of $\exp(\epsilon^{-2/3})$. The key issue for the analysis is the slow {\em sub-linear} growth of vacuum boundaries of the order of $t^{1/(3\gamma-1)}$, where $\gamma>1$ is the adiabatic exponent for the gas. This is in sharp contrast to the currently available global-in-time existence theory of expanding solutions to the vacuum free boundary problems with physical singularity of compressible Euler equations for which the expanding rate of vacuum boundaries is linear. The results obtained in this paper is closely related to the open question in multiple dimensions since T.-P. Liu's construction of particular solutions in 1996 .


title: On the numerical approximations of the periodic Schr\"odinger equation

abstract: We consider semidiscrete finite differences schemes for the periodic Scr\"odinger equation in dimension one. We analyze whether the space-time integrability properties observed by Bourgain in the continuous case are satisfied at the numerical level uniformly with respect to the mesh size. For the simplest finite differences scheme we show that, as mesh size tends to zero, the blow-up in the $L^4$ time-space norm occurs, a phenomenon due to the presence of numerical spurious high frequencies. To recover the uniformity of this property we introduce two methods: a spectral filtering of initial data and a viscous scheme. For both of them we prove a $L^4$ time-space estimate, uniform with respect to the mesh size. {Warning 2019}: This paper was submitted to M2AN in 2007 and it was assigned the number 2007-29. It passed a first review round ( three reviews :-) ) without decision ("It is only after the consideration of a thoroughly revised version of your manuscript and a new iteration with all the referees that I will be in position to make my final decision.") After completing the PhD, I tried to publish the papers resulting from the thesis and I didn't spent too much time on other related problems (the periodic case for example). It was only recently that I discovered some interest in the subject from other authors and I decided to upload it on arxiv.org. Use with caution as there is no revision of the text in the last twelve years.


title: Combinational Class Activation Maps for Weakly Supervised Object Localization

abstract: Weakly supervised object localization has recently attracted attention since it aims to identify both class labels and locations of objects by using image-level labels. Most previous methods utilize the activation map corresponding to the highest activation source. Exploiting only one activation map of the highest probability class is often biased into limited regions or sometimes even highlights background regions. To resolve these limitations, we propose to use activation maps, named combinational class activation maps (CCAM), which are linear combinations of activation maps from the highest to the lowest probability class. By using CCAM for localization, we suppress background regions to help highlighting foreground objects more accurately. In addition, we design the network architecture to consider spatial relationships for localizing relevant object regions. Specifically, we integrate non-local modules into an existing base network at both low- and high-level layers. Our final model, named non-local combinational class activation maps (NL-CCAM), obtains superior performance compared to previous methods on representative object localization benchmarks including ILSVRC 2016 and CUB-200-2011. Furthermore, we show that the proposed method has a great capability of generalization by visualizing other datasets.


title: Convergence to closed-form distribution for the backward $SLE_{\kappa}$ at some random times and the phase transition at $\kappa=8$

abstract: We study a one-dimensional SDE that we obtain by performing a random time change of the backward Loewner dynamics in $\mathbb{H}$. The stationary measure for this SDE has a closed-form expression. We show the convergence towards its stationary measure for this SDE, in the sense of random ergodic averages. The precise formula of the density of the stationary law gives a phase transition at the value $\kappa=8$ from integrability to non-integrability, that happens at the same value of $\kappa$ as the change in behavior of the $SLE_{\kappa}$ trace from non-space filling to space-filling curve. Using convergence in total variation for the law of this diffusion towards stationarity, we identify families of random times on which the law of the arguments of points under the backward $SLE_{\kappa}$ flow converge to a closed form expression measure. For $\kappa=4,$ this gives precise characterization for the random times on which the law of the arguments of points under the backward $SLE_{\kappa}$ flow converge to the uniform law.


title: Coupling the circadian rhythms of population movement and the immune system in infectious disease modeling

abstract: The dynamics of infectious diseases propagating in populations depends both on human interaction patterns, the contagion process and the pathogenesis within hosts. The immune system follows a circadian rhythm and, consequently, the chance of getting infected varies with the time of day an individual is exposed to the pathogen. The movement and interaction of people also follow 24-hour cycles, which couples these two phenomena. We use a stochastic metapopulation model informed by hourly mobility data for two medium-sized Chinese cities. By this setup, we investigate how the epidemic risk depends on the difference of the clocks governing the population movement and the immune systems. In most of the scenarios we test, we observe circadian rhythms would constrain the pace and extent of disease emergence. The three measures (strength, outward transmission risk and introduction risk) are highly correlated with each other. For example of the Yushu City, outward transmission risk and introduction risk are correlated with a Pearson's correlation coefficient of 0.83, and the risks correlate to strength with coefficients of $-0.85$ and $-0.75$, respectively (all have $p<0.05$), in simulations with no circadian effect and $R_0=1.5$. The relation between the circadian rhythms of the immune system and daily routines in human mobility can affect the pace and extent of infectious disease spreading. Shifting commuting times could mitigate the emergence of outbreaks.


title: Exact Renormalization Group Treatment of the 2D Non Self-Dual Ising Lattices

abstract: In this work, an exact renormalization group treatment of honeycomb lattice leading to an exact relation between the coupling strengths of the honeycomb and the triangular lattices is presented. Using the honeycomb and the triangular duality relation, the critical coupling values of honeycomb and triangular lattices are calculated exactly by the simultaneous solution of the renormalized relation and the duality relation, without using the so-called star-triangular transformation. Apparently, the obtained coupling relation is unique. It, not only takes place the role of the star triangular relation, but also it is the only exact relation obtained from renormalization group theory other than the 1D Ising chain. An exact pair correlation functions expression relating the nearest neighbors and the next nearest neighbor correlation functions are also obtained for the honeycomb lattice. Utilizing this correlation relation, an exact expression of the correlation length of the honeycomb lattice is calculated analytically for the coupling constant values less than the critical value in the realm of the scaling theory. The critical exponents $\nu$ and $\alpha$ are also calculated as $\nu=1$ and $\alpha=0$.


title: RiPPLE: A Crowdsourced Adaptive Platform for Recommendation of Learning Activities

abstract: This paper presents a platform called RiPPLE (Recommendation in Personalised Peer-Learning Environments) that recommends personalized learning activities to students based on their knowledge state from a pool of crowdsourced learning activities that are generated by educators and the students themselves. RiPPLE integrates insights from crowdsourcing, learning sciences, and adaptive learning, aiming to narrow the gap between these large bodies of research while providing a practical platform-based implementation that instructors can easily use in their courses. This paper provides a design overview of RiPPLE, which can be employed as a standalone tool or embedded into any learning management system (LMS) or online platform that supports the Learning Tools Interoperability (LTI) standard. The platform has been evaluated based on a pilot in an introductory course with 453 students at The University of Queensland. Initial results suggest that the use of the \name platform led to measurable learning gains and that students perceived the platform as beneficially supporting their learning.


title: Finite-time localized singularities as a mechanism for turbulent dissipation

abstract: We provide a scenario for a singularity-mediated turbulence based on the self-focusing non-linear Schr\"odinger equation, for which sufficiently smooth initial states leads to blow-up in finite time. Here, by adding dissipation, these singularities are regularized, and the inclusion of an external forcing results in a chaotic fluctuating state. The strong events appear randomly in space and time, making the dissipation rate highly fluctuating. The model shows that: i) dissipation takes place near the singularities only, ii) such intense events are random in space and time, iii) the mean dissipation rate is almost constant as the viscosity varies, and iv) the observation of an Obukhov-Kolmogorov spectrum with a power law dependence together with an intermittent behavior using structure functions correlations, in close correspondence with fluid turbulence.


title: Non-linear isotope-shift effects in Be-like, B-like, and C-like argon

abstract: Violation of linearity of the King plot is investigated for a chain of partially stripped argon isotopes. The nonlinearity originates within the Standard Model from subtle contributions to the isotope shifts from next-to-leading order effects, which have never been systematically studied so far. In light atoms these nonlinear effects are dominated by the quadratic nuclear recoil ($\propto 1/M^2$ where $M$ is the nuclear mass). Large-scale relativistic calculations of the linear and quadratic mass shift and the field shift are performed for the $2P$ fine-structure transitions in Be-like, B-like, and C-like argon ions. Nonlinearities of the King plots from 5 to 30 kHz are found, which is four orders of magnitude larger than previous estimates in comparable systems. Accurate calculations of these effects are vital for identification of possible nonlinearities originating from physics beyond the Standard Model.


title: Polymeric Liquid Layer Densified by Surface Acoustic Wave

abstract: With the application of surface acoustic wave (SAW) of 39.5 MHz to a model polymer liquid film,polyisobutylene, deposited on the solid substrates, the liquid film is densified, proved by the decrease of film thickness and the increase of refractive index, measured by ellipsometry. Rotational motion of fluorescent probes doped inside the liquid film, measured by polarization-resolved single molecule fluorescence microscopy, is retarded and the dynamical heterogeneity is reduced. It is demonstrated that the application of SAW of high frequency makes the thin polymeric liquid film densified and more dynamically homogeneous.


title: Enhanced electron-phonon coupling for charge-density-wave formation in La$_{1.8-x}$Eu$_{0.2}$Sr$_{x}$CuO$_{4+\delta}$

abstract: Charge density wave (CDW) correlations are prevalent in all copper-oxide superconductors. While CDWs in conventional metals are driven by coupling between lattice vibrations and electrons, the role of the electron-phonon coupling (EPC) in cuprate CDWs is strongly debated. Using Cu $L_3$ edge resonant inelastic x-ray scattering (RIXS), we study the CDW and Cu-O bond-stretching phonons in the stripe-ordered cuprate La$_{1.8-x}$Eu$_{0.2}$Sr$_{x}$CuO$_{4+\delta}$. We investigate the interplay between charge order and EPC as a function of doping and temperature, and find that the EPC is enhanced in a narrow momentum region around the CDW wave vector. By detuning the incident photon energy from the absorption resonance, we extract an EPC matrix element at the CDW wave vector of $M\simeq$ 0.36 eV, which decreases to $M\simeq$ 0.30 eV at high temperature in the absence of the CDW. Our results suggest a feedback mechanism in which the CDW enhances the EPC which, in turn, further stabilizes the CDW.


title: Regularizing Model-Based Planning with Energy-Based Models

abstract: Model-based reinforcement learning could enable sample-efficient learning by quickly acquiring rich knowledge about the world and using it to improve behaviour without additional data. Learned dynamics models can be directly used for planning actions but this has been challenging because of inaccuracies in the learned models. In this paper, we focus on planning with learned dynamics models and propose to regularize it using energy estimates of state transitions in the environment. We visually demonstrate the effectiveness of the proposed method and show that off-policy training of an energy estimator can be effectively used to regularize planning with pre-trained dynamics models. Further, we demonstrate that the proposed method enables sample-efficient learning to achieve competitive performance in challenging continuous control tasks such as Half-cheetah and Ant in just a few minutes of experience.


title: Preliminary Systematic Literature Review of Machine Learning System Development Process

abstract: Previous machine learning (ML) system development research suggests that emerging software quality attributes are a concern due to the probabilistic behavior of ML systems. Assuming that detailed development processes depend on individual developers and are not discussed in detail. To help developers to standardize their ML system development processes, we conduct a preliminary systematic literature review on ML system development processes. A search query of 2358 papers identified 7 papers as well as two other papers determined in an ad-hoc review. Our findings include emphasized phases in ML system developments, frequently described practices and tailored traditional software development practices.


title: An optimal dispatch scheme for DSO and prosumers by implementing three-phase distribution locational marginal prices

abstract: Since distribution system operator (DSO) cannot directly control prosumers with controllable resources,this paper proposes an optimal dispatch method of using three-phase distribution locational marginal prices (DLMPs) as effective economic signals to incentivize prosumers' behaviors. In the proposed three-phase DLMP model, DLMPs for both active power and reactive power are calculated. To alleviate the imbalance, congestions and voltage violations in active distribution networks (ADNs),the DSO and prosumers should be coordinated. We develop such a coordinated control scheme for the DSO and prosumers,in which the DSO generates and broadcasts three-phase DLMPs as price signals to induce prosumers' behaviors. We prove that given the DLMPs for active power and reactive power as settlement prices, the optimal dispatch of the ADN will also maximize the surplus of prosumers. Therefore, the power output of rational prosumers will match the optimal dispatch,resulting in better operational conditions of ADNs. Then the three-phase imbalance,congestions and voltage violations will be well reduced. Numerical tests demonstrate the effectiveness of the proposed approach.


title: Quantitative estimates in stochastic homogenization for correlated coefficient fields

abstract: This paper is about the homogenization of linear elliptic operators in divergence form with stationary random coefficients that have only slowly decaying correlations. It deduces optimal estimates of the homogenization error from optimal growth estimates of the (extended) corrector. In line with the heuristics, there are transitions at dimension $d=2$, and for a correlation-decay exponent $\beta=2$; we capture the correct power of logarithms coming from these two sources of criticality. The decay of correlations is sharply encoded in terms of a multiscale logarithmic Sobolev inequality (LSI) for the ensemble under consideration --- the results would fail if correlation decay were encoded in terms of an $\alpha$-mixing condition. Among other ensembles popular in modelling of random media, this class includes coefficient fields that are local transformations of stationary Gaussian fields. The optimal growth of the corrector $\phi$ is derived from bounding the size of spatial averages $F=\int g\cdot\nabla\phi $ of its gradient. This in turn is done by a (deterministic) sensitivity estimate of $F$, that is, by estimating the functional derivative $\frac{\partial F}{\partial a}$ of $F$ w.~r.~t.~the coefficient field $a$. Appealing to the LSI in form of concentration of measure yields a stochastic estimate on $F$. The sensitivity argument relies on a large-scale Schauder theory for the heterogeneous elliptic operator $-\nabla\cdot a\nabla$. The treatment allows for non-symmetric $a$ and for systems like linear elasticity.


title: A hidden integral structure endows Absolute Concentration Robust systems with resilience to dynamical concentration disturbances

abstract: Biochemical systems that express certain chemical species of interest at the same level at any positive equilibrium are called "absolute concentration robust" (ACR). These species behave in a stable, predictable way, in the sense that their expression is robust with respect to sudden changes in the species concentration, regardless the new positive equilibrium reached by the system. Such a property has been proven to be fundamentally important in certain gene regulatory networks and signaling systems. In the present paper, we mathematically prove that a well-known class of ACR systems studied by Shinar and Feinberg in 2010 hides an internal integral structure. This structure confers these systems with a higher degree of robustness that what was previously unknown. In particular, disturbances much more general than sudden changes in the species concentrations can be rejected, and robust perfect adaptation is achieved. Significantly, we show that these properties are maintained when the system is interconnected with other chemical reaction networks. This key feature enables design of insulator devices that are able to buffer the loading effect from downstream systems - a crucial requirement for modular circuit design in synthetic biology.


title: Diagram automorphisms and canonical bases for quantum affine algebras

abstract: Let ${\mathbf U}^-_q$ be the negative part of the quantum enveloping algebra associated to a simply laced Kac-Moody Lie algebra ${\mathfrak g}$, and $\underline{\mathbf U}^-_q$ the algebra corresponding to the fixed point subalgebra of ${\mathfrak g}$ obtained from a diagram automorphism $\sigma$ on ${\mathfrak g}$. Let ${\mathbf B}^{\sigma}$ be the set of $\sigma$-fixed elements in the canonical basis of ${\mathbf U}_q^-$, and $\underline{\mathbf B}$ the canonical basis of $\underline{\mathbf U}_q^-$. Lusztig proved that there exists a canonical bijection ${\mathbf B}^{\sigma} \simeq \underline{\mathbf B}$ based on his geometric construction of canonical bases. In this paper, we prove (the signed bases version of) this fact, in the case where ${\mathfrak g}$ is finite or affine type, in an elementary way, in the sense that we don't appeal to the geometric theory of canonical bases nor Kashiwara's theory of crystal bases. We also discuss the correspondence between PBW-bases, by using a new type of PBW-bases of ${\mathbf U}_q^-$ obtained by Muthiah-Tingley, which is a generalization of PBW-bases constructed by Beck-Nakajima.


title: Characterization and formation of on-disk spicules in the Ca II K and Mg II k spectral lines

abstract: We characterize, for the first time, type-II spicules in Ca II K 3934\AA\ using the CHROMIS instrument at the Swedish 1-m Solar Telescope. We find that their line formation is dominated by opacity shifts with the K$_{3}$ minimum best representing the velocity of the spicules. The K$_{2}$ features are either suppressed by the Doppler-shifted K$_{3}$ or enhanced via an increased contribution from the lower layers, leading to strongly enhanced but un-shifted K$_{2}$ peaks, with widening towards the line-core as consistent with upper-layer opacity removal via Doppler-shift. We identify spicule spectra in concurrent IRIS Mg II k 2796\AA\ observations with very similar properties. Using our interpretation of spicule chromospheric line-formation, we produce synthetic profiles that match observations.


title: Spectral embedding of weighted graphs

abstract: When analyzing weighted networks using spectral embedding, a judicious transformation of the edge weights may produce better results. To formalize this idea, we consider the asymptotic behavior of spectral embedding for different edge-weight representations, under a generic low rank model. We measure the quality of different embeddings -- which can be on entirely different scales -- by how easy it is to distinguish communities, in an information-theoretic sense. For common types of weighted graphs, such as count networks or p-value networks, we find that transformations such as tempering or thresholding can be highly beneficial, both in theory and in practice.


title: From the Paft to the Fiiture: a Fully Automatic NMT and Word Embeddings Method for OCR Post-Correction

abstract: A great deal of historical corpora suffer from errors introduced by the OCR (optical character recognition) methods used in the digitization process. Correcting these errors manually is a time-consuming process and a great part of the automatic approaches have been relying on rules or supervised machine learning. We present a fully automatic unsupervised way of extracting parallel data for training a character-based sequence-to-sequence NMT (neural machine translation) model to conduct OCR error correction.