title: Boundary conditions for the effective-medium description of subwavelength multilayered structures

abstract: Nanostructures with one-dimensional periodicity, such as multilayered structures, are currently in the focus of active research in the context of hyperbolic metamaterials and photonic topological structures. An efficient way to describe the materials with subwavelength periodicity is based on the concept of effective material parameters, which can be rigorously derived incorporating both local and nonlocal responses. However, to provide any predictions relevant for applications, effective material parameters have to be supplemented by appropriate boundary conditions. In this work, we provide a comprehensive treatment of spatially dispersive bulk properties of multilayered metamaterials as well as derive boundary conditions for the averaged fields. We demonstrate that local bianisotropic model does not capture all the features related to second-order nonlocal effects in the bulk of metamaterial. As we prove, while the bulk response of multilayers does not depend on the unit cell choice, effective boundary conditions are strongly sensitive to the sequence of layers and multilayer termination. The developed theory provides a clear interpretation of the recent experiments on the reflectance of all-dielectric deeply subwavelength multilayers suggesting further avenues to experimentally probe electromagnetic nonlocality in metamaterials.


title: Riemann-Hilbert approach and N-soliton solutions for the three-component coupled Hirota equations

abstract: In this work, we consider an integrable three-component coupled Hirota (tcCH) equations in detail via the Riemann-Hilbert (RH) approach. We present some properties of the spectral problems of the tcCH equations with $4\times4$ the Lax pair. Moreover, the RH problem of the equations is established via analyzing the analyticity of the spectrum problem. By studying the symmetry of the spectral problem, we get the spatiotemporal evolution of scattering data. Finally, the $N$-soliton solution is derived by solving the RH problem with reflectionless case. According to the resulting $N$-soliton solution, the influences of each parameters on collision dynamic behaviors between solitons are discussed, and the method of how to control the interactions are suggested by some graphic analysis. In addition, some new phenomenon for soliton collision is presented including localized structures and dynamic behaviors of one- and two- soliton solutions, which can help enrich the nonlinear dynamics of the $N$-component nonlinear Schr\"{o}dinger type equations.


title: Novel non-equilibrium steady states in multiple emulsions

abstract: We numerically investigate the rheological response of a non-coalescing multiple emulsion under a symmetric shear flow. We find that the dynamics significantly depends on the magnitude of the shear rate and on the number of the encapsulated droplets, two key parameters whose control is fundamental to accurately select the resulting non-equilibrium steady states. The double emulsion, for instance, attains a static steady state in which the external droplet stretches under flow and achieves an elliptical shape (closely resembling the one observed in a sheared isolated fluid droplet), while the internal one remains essentially unaffected. Novel non-equilibrium steady states arise in a multiple emulsion. Under a low/moderate shear rates, for instance, the encapsulated droplets display a non-trivial planetary-like motion that considerably affects the shape of the external droplet. Some features of this dynamic behavior are partially captured by the Taylor deformation parameter and the stress tensor. Besides a theoretical interest on its own, our results can potentially stimulate further experiments, as most of the predictions could be tested in the lab by monitoring droplets shapes and position over time.


title: Hierarchical Finite State Controllers for Generalized Planning

abstract: Finite State Controllers (FSCs) are an effective way to represent sequential plans compactly. By imposing appropriate conditions on transitions, FSCs can also represent generalized plans that solve a range of planning problems from a given domain. In this paper we introduce the concept of {\it hierarchical FSCs} for planning by allowing controllers to call other controllers. We show that hierarchical FSCs can represent generalized plans more compactly than individual FSCs. Moreover, our call mechanism makes it possible to generate hierarchical FSCs in a modular fashion, or even to apply recursion. We also introduce a compilation that enables a classical planner to generate hierarchical FSCs that solve challenging generalized planning problems. The compilation takes as input a set of planning problems from a given domain and outputs a single classical planning problem, whose solution corresponds to a hierarchical FSC.


title: This dataset does not exist: training models from generated images

abstract: Current generative networks are increasingly proficient in generating high-resolution realistic images. These generative networks, especially the conditional ones, can potentially become a great tool for providing new image datasets. This naturally brings the question: Can we train a classifier only on the generated data? This potential availability of nearly unlimited amounts of training data challenges standard practices for training machine learning models, which have been crafted across the years for limited and fixed size datasets. In this work we investigate this question and its related challenges. We identify ways to improve significantly the performance over naive training on randomly generated images with regular heuristics. We propose three standalone techniques that can be applied at different stages of the pipeline, i.e., data generation, training on generated data, and deploying on real data. We evaluate our proposed approaches on a subset of the ImageNet dataset and show encouraging results compared to classifiers trained on real images.


title: Towards Better Compressed Representations

abstract: We introduce the problem of computing a parsing where each phrase is of length at most $m$ and which minimizes the zeroth order entropy of parsing. Based on the recent theoretical results we devise a heuristic for this problem. The solution has straightforward application in succinct text representations and gives practical improvements. Moreover the proposed heuristic yields structure whose size can be bounded both by $|S|H_{m-1}(S)$ and by $|S|/m(H_0(S) + \cdots + H_{m-1})$, where $H_{k}(S)$ is the $k$-th order empirical entropy of $S$. We also consider a similar problem in which the first-order entropy is minimized.


title: Where is your field going? A Machine Learning approach to study the relative motion of the domains of Physics

abstract: We propose an original approach to describe the scientific progress in a quantitative way. Using innovative Machine Learning techniques we create a vector representation for the PACS codes and we use them to represent the relative movements of the various domains of Physics in a multi-dimensional space. This methodology unveils about 25 years of scientific trends, enables us to predict innovative couplings of fields, and illustrates how Nobel Prize papers and APS milestones drive the future convergence of previously unrelated fields.


title: Improving Joint Training of Inference Networks and Structured Prediction Energy Networks

abstract: Deep energy-based models are powerful, but pose challenges for learning and inference (Belanger and McCallum, 2016). Tu and Gimpel (2018) developed an efficient framework for energy-based models by training "inference networks" to approximate structured inference instead of using gradient descent. However, their alternating optimization approach suffers from instabilities during training, requiring additional loss terms and careful hyperparameter tuning. In this paper, we contribute several strategies to stabilize and improve this joint training of energy functions and inference networks for structured prediction. We design a compound objective to jointly train both cost-augmented and test-time inference networks along with the energy function. We propose joint parameterizations for the inference networks that encourage them to capture complementary functionality during learning. We empirically validate our strategies on two sequence labeling tasks, showing easier paths to strong performance than prior work, as well as further improvements with global energy terms.


title: Instabilities in modified theories of gravity

abstract: The review is devoted to consideration of possible observational consequences of modified gravity theories, suggested for explanation of the contemporary accelerated expansion of the universe. The major attention is paid to F(R)-models. It is shown that in systems with rising energy density high frequency and large amplitude oscillations of the curvature scalar, R(t), are induced. These oscillations lead to the production of elementary particles, which may be observed in the spectra of energetic cosmic rays. In the background of such oscillating solutions gravitation repulsion between finite-size objects becomes possible. Since the Lagrangian is a non-linear function of curvature, equations of motion become of higher (4th) order and exhibit very rich pattern of new physical effects. In particular, the evolution of density perturbations is strongly different from that in General Relativity, amplified due to both parametric resonance and anti-friction phenomena.


title: Fitness Optimization and Evolution of Permanent Replicator Systems

abstract: In this paper, we discuss the fitness landscape evolution of permanent replicator systems using a hypothesis that the specific time of evolutionary adaptation of the system parameters is much slower than the time of internal evolutionary dynamics. In other words, we suppose that the extreme principle of Darwinian evolution based the Fisher's fundamental theorem of natural selection is valid for the steady-states. Various cases of the evolutionary adaptation for permanent replicator system are considered.


title: Unveiling the electronic transformations in the semi-metallic correlated-electron transitional oxide Mo$_8$O$_{23}$

abstract: Mo$_8$O$_{23}$ is a low-dimensional chemically robust transition metal oxide coming from a prospective family of functional materials, MoO$_{3-x}$, ranging from a wide gap insulator $(x=0)$ to a metal $(x=1)$. The large number of stoichometric compounds with intermediate $x$ have widely different properties. In Mo$_8$O$_{23}$, an unusual charge density wave transition has been suggested to occur above room temperature, but its low temperature behaviour is particularly enigmatic. We present a comprehensive experimental study of the electronic structure associated with various ordering phenomena in this compound, complemented by theory. Density-functional theory (DFT) calculations reveal a cross-over from a semi-metal with vanishing band overlap to narrow-gap semiconductor behaviour with decreasing temperature. A buried Dirac crossing at the zone boundary is confirmed by angle-resolved photoemission spectroscopy (ARPES). Tunnelling spectroscopy (STS) reveals a gradual gap opening corresponding to a metal-to-insulator transition at 343 K in resistivity, consistent with CDW formation and DFT results, but with large non-thermal smearing of the spectra implying strong carrier scattering. At low temperatures, the CDW picture is negated by the observation of a metallic Hall contribution, a non-trivial gap structure in STS below $\sim 170$ K and ARPES spectra, that together represent evidence for the onset of the correlated state at $70$ K and the rapid increase of gap size below $\sim 30$ K. The intricate interplay between electronic correlations and the presence of multiple narrow bands near the Fermi level set the stage for metastability and suggest suitability for memristor applications.


title: Beacon-referenced Pursuit for Collective Motions in Three Dimensions

abstract: Motivated by real-world applications of unmanned aerial vehicles, this paper introduces a decentralized control mechanism to guide steering control of autonomous agents maneuvering in the vicinity of multiple moving entities (e.g. other autonomous agents) and stationary entities (e.g. fixed beacons or points of references) in a three-dimensional environment. The proposed control law, which can be perceived as a modification of the three-dimensional constant bearing (CB) pursuit law, provides a means to allocate simultaneous attention to multiple entities. We investigate the behavior of the closed-loop dynamics for a system with one agent referencing two beacons, as well as a two-agent mutual pursuit system wherein each agent employs the beacon-referenced CB pursuit law with regards to the other agent and a stationary beacon. Under certain assumptions on the associated control parameters, we demonstrate that this problem admits circling equilibria with agents moving on circular orbits with a common radius, in planes perpendicular to a common axis passing through the beacons. As the common radius and distances from the beacon are determined by the choice of parameters in the pursuit law, this approach provides a means to engineer desired formations in a 3-dimensional setting.


title: Contextualized Sparse Representations for Real-Time Open-Domain Question Answering

abstract: Open-domain question answering can be formulated as a phrase retrieval problem, in which we can expect huge scalability and speed benefit but often suffer from low accuracy due to the limitation of existing phrase representation models. In this paper, we aim to improve the quality of each phrase embedding by augmenting it with a contextualized sparse representation (Sparc). Unlike previous sparse vectors that are term-frequency-based (e.g., tf-idf) or directly learned (only few thousand dimensions), we leverage rectified self-attention to indirectly learn sparse vectors in n-gram vocabulary space. By augmenting the previous phrase retrieval model (Seo et al., 2019) with Sparc, we show 4%+ improvement in CuratedTREC and SQuAD-Open. Our CuratedTREC score is even better than the best known retrieve & read model with at least 45x faster inference speed.


title: Efficacy of Pixel-Level OOD Detection for Semantic Segmentation

abstract: The detection of out of distribution samples for image classification has been widely researched. Safety critical applications, such as autonomous driving, would benefit from the ability to localise the unusual objects causing the image to be out of distribution. This paper adapts state-of-the-art methods for detecting out of distribution images for image classification to the new task of detecting out of distribution pixels, which can localise the unusual objects. It further experimentally compares the adapted methods on two new datasets derived from existing semantic segmentation datasets using PSPNet and DeeplabV3+ architectures, as well as proposing a new metric for the task. The evaluation shows that the performance ranking of the compared methods does not transfer to the new task and every method performs significantly worse than their image-level counterparts.


title: The LIG system for the English-Czech Text Translation Task of IWSLT 2019

abstract: In this paper, we present our submission for the English to Czech Text Translation Task of IWSLT 2019. Our system aims to study how pre-trained language models, used as input embeddings, can improve a specialized machine translation system trained on few data. Therefore, we implemented a Transformer-based encoder-decoder neural system which is able to use the output of a pre-trained language model as input embeddings, and we compared its performance under three configurations: 1) without any pre-trained language model (constrained), 2) using a language model trained on the monolingual parts of the allowed English-Czech data (constrained), and 3) using a language model trained on a large quantity of external monolingual data (unconstrained). We used BERT as external pre-trained language model (configuration 3), and BERT architecture for training our own language model (configuration 2). Regarding the training data, we trained our MT system on a small quantity of parallel text: one set only consists of the provided MuST-C corpus, and the other set consists of the MuST-C corpus and the News Commentary corpus from WMT. We observed that using the external pre-trained BERT improves the scores of our system by +0.8 to +1.5 of BLEU on our development set, and +0.97 to +1.94 of BLEU on the test set. However, using our own language model trained only on the allowed parallel data seems to improve the machine translation performances only when the system is trained on the smallest dataset.


title: A robust adaptive model predictive control framework for nonlinear uncertain systems

abstract: In this paper, we present a tube-based framework for robust adaptive model predictive control (RAMPC) for nonlinear systems subject to parametric uncertainty and additive disturbances. Set-membership estimation is used to provide accurate bounds on the parametric uncertainty, which are employed for the construction of the tube in a robust MPC scheme. The resulting RAMPC framework ensures robust recursive feasibility and robust constraint satisfaction, while allowing for less conservative operation compared to robust MPC schemes without model/parameter adaptation. Furthermore, by using an additional mean-squared point estimate in the objective function the framework ensures finite-gain $\mathcal{L}_2$ stability w.r.t. additive disturbances. As a first contribution we derive suitable monotonicity and non-increasing properties on general parameter estimation algorithms and tube/set based RAMPC schemes that ensure robust recursive feasibility and robust constraint satisfaction under recursive model updates. Then, as the main contribution of this paper, we provide similar conditions for a tube based formulation that is parametrized using an incremental Lyapunov function, a scalar contraction rate and a function bounding the uncertainty. With this result, we can provide simple constructive designs for different RAMPC schemes with varying computational complexity and conservatism. As a corollary, we can demonstrate that state of the art formulations for nonlinear RAMPC are a special case of the proposed framework. We provide a numerical example that demonstrates the flexibility of the proposed framework and showcase improvements compared to state of the art approaches.


title: Numerical investigations of the asymptotics of solutions to the evolutionary form of the constraints

abstract: Systematic numerical investigations of the asymptotics of near Schwarzschild vacuum initial data sets is carried out by inspecting solutions to the parabolic-hyperbolic and to the algebraic-hyperbolic forms of the constraints, respectively. One of our most important findings is that the concept of near Schwarzschild configurations, applied previously in [4, 5], is far too restrictive. It is demonstrated that by relaxing the conditions on the freely specifiable part of the data a more appropriate notion of near Schwarzschild initial data configurations can be defined which allows us to generate asymptotically flat initial data configurations.


title: Higgs inflation with non-minimal derivative coupling to gravity

abstract: We consider an extension of Higgs inflation in which the Higgs field is non-minimally coupled to gravity through its kinetic term. We analyzed power-law coupling functions with positive or negative integer power and found that the Higgs boson can drive a successful inflation only for the cases $n=2,1,0,-1$. Theoretical predictions for both tensor to scalar ratio $r$ and scalar spectral index $n_s$ are within the 2018 \textit{Planck} $95\%$ CL. The behavior of the self coupling $\lambda$ with respect to the scalar field at the horizon crossing was obtained, and It was found that it can take values in the interval $\lambda\sim (10^{-7}, 0.3)$.


title: Electric field effect on spin waves and magnetization dynamics: role of magnetic moment current

abstract: We show that a static electric field $E_x$ gives rise to a shift of the spin wave dispersion relation $\omega(q_y-q_E)$ in the direction of the wavenumber $q_y$ of the quantity $q_E=-\gamma_LE_x/c^2$. This effect is caused by the magnetic moment current carried by the spin wave itself that generates an additional phase proportional to the electric field, as in the Aharonov-Casher effect. This effect is independent from the possibly present magneto-electric effects of insulating ferromagnets and superimposes to them. By extending this picture to arbitrary magnetization dynamics, we find that the electric field gives rise to a dynamic interaction term which has the same chiral from of the Dzyaloshinskii-Moriya interaction but is fully tunable with the applied electric field.


title: How Implicit Regularization of ReLU Neural Networks Characterizes the Learned Function -- Part I: the 1-D Case of Two Layers with Random First Layer

abstract: In this paper, we consider one dimensional (shallow) ReLU neural networks in which weights are chosen randomly and only the terminal layer is trained. First, we mathematically show that for such networks L2-regularized regression corresponds in function space to regularizing the estimate's second derivative for fairly general loss functionals. For least squares regression, we show that the trained network converges to the smooth spline interpolation of the training data as the number of hidden nodes tends to infinity. Moreover, we derive a novel correspondence between the early stopped gradient descent (without any explicit regularization of the weights) and the smoothing spline regression.


title: Error Correction for Partially Stuck Memory Cells

abstract: We present code constructions for masking $u$ partially stuck memory cells with $q$ levels and correcting additional random errors. The results are achieved by combining the methods for masking and error correction for stuck cells in [1] with the masking-only results for partially stuck cells in [2]. We present two constructions for masking $u<q$ cells and error correction: one is general and based on a generator matrix of a specific form. The second construction uses cyclic codes and allows to efficiently bound the error-correction capability using the BCH bound. Furthermore, we extend the results to masking $u\geq q$ cells. For $u>1$ and $q>2$, all new constructions require less redundancy for masking partially stuck cells than previous work on stuck cells, which in turn can result in higher code rates at the same masking and error correction capability.


title: The homotopy type of elliptic arrangements

abstract: We give combinatorial models for the homotopy type of complements of elliptic arrangements (i.e., certain sets of abelian subvarieties in a product of elliptic curves). We give a presentation of the fundamental group of such spaces and, as an application, we treat the case of ordered configuration spaces of elliptic curves. Our models are finite polyhedral CW complexes, and our combinatorial tools of choice are acyclic categories (small categories without loops). As a stepping stone, we give a characterization of which acyclic categories arise as face categories of polyhedral CW complexes.


title: Multiple yield curve modelling with CBI processes

abstract: We develop a modelling framework for multiple yield curves driven by continuous-state branching processes with immigration (CBI processes). Exploiting the self-exciting behavior of CBI jump processes, this approach can reproduce the relevant empirical features of spreads between different interbank rates. In particular, we introduce multi-curve models driven by a flow of tempered alpha-stable CBI processes. Such models are especially parsimonious and tractable, and can generate contagion effects among different spreads. We provide a complete analytical framework, including a detailed study of discounted exponential moments of CBI processes. The proposed approach allows for explicit valuation formulae for all linear interest rate derivatives and semi-closed formulae for non-linear derivatives via Fourier techniques and quantization. We show that a simple specification of the model can be successfully calibrated to market data.


title: Triangulation sensing: how cells recover a source from diffusing particles in three dimensions

abstract: How can cells embedded into a gradient concentration triangulate the position of the source and migrate toward their final destination? The source triangulation requires to recover the three dimensional coordinates of the source from the fluxes of diffusing cues at narrow windows (receptors) located on the surface of a cell. We develop here a method to address this question and we show in the limit of fast binding rate to the receptors, that at least three receptors are necessary. We solve the steady-state diffusion equation using an asymptotic approach, which agrees with hybrid stochastic-analytical simulations. Interestingly, with an accuracy of few percent, the source cannot be located if it is located at a distance tens of time the size of the cell. Finally, the precision of the source recovery increases with the number of receptors.


title: Sequential measurement-device-independent entanglement detection by multiple observers

abstract: Violation of a Bell inequality certifies that the underlying state must be entangled in a device-independent way, although there may exist some entangled states which do not violate such an inequality. On the other hand, for every entangled state, it is possible to find a hermitian operator called entanglement witness that can detect entanglement through some local measurements in a device-dependent method. The methods are significantly fragile to lossy detectors. To avoid such difficulties, measurement-device-independent entanglement witness based on a semi-quantum nonlocal game was proposed which turns out to be robust against lossy detectors. We employ here such a measurement-device-independent entanglement witness to detect entanglement in a scenario where half of an entangled pair is possessed by a single observer while the other half is with multiple observers performing measurements sequentially, independently, and preserving entanglement as much as possible. Interestingly, we find that the numbers of successful observers who can detect entanglement measurement device-independently, both with equal and unequal sharpness quotients, are higher than that obtained with standard and Bell inequality-based entanglement detection methods, reflecting its robustness. The entanglement contents of the sequentially shared states are also analyzed. Unlike other scenarios, our investigations also reveal that in this measurement-device-independent situation, states having entanglement in proximity to maximal, remains entangled until two sequential observers even if they measure sharply.


title: Exciton diffusion in monolayer semiconductors with suppressed disorder

abstract: Tightly bound excitons in monolayer semiconductors represent a versatile platform to study two-dimensional propagation of neutral quasiparticles. Their intrinsic properties, however, can be severely obscured by spatial energy fluctuations due to a high sensitivity to the immediate environment. Here, we take advantage of the encapsulation of individual layers in hexagonal boron nitride to strongly suppress environmental disorder. Diffusion of excitons is then directly monitored using time- and spatially-resolved emission microscopy at ambient conditions. We consistently find very efficient propagation with linear diffusion coefficients up to 10\,cm$^2$/s, corresponding to room temperature effective mobilities as high as 400\,cm$^2$/Vs as well as a correlation between rapid diffusion and short population lifetime. At elevated densities we detect distinct signatures of many-particle interactions and consequences of strongly suppressed Auger-like exciton-exciton annihilation. A combination of analytical and numerical theoretical approaches is employed to provide pathways towards comprehensive understanding of the observed linear and non-linear propagation phenomena. We emphasize the role of dark exciton states and present a mechanism for diffusion facilitated by free electron hole plasma from entropy-ionized excitons.


title: A Solution for Controlling and Managing User Profiles based on Data Privacy for IoT Applications

abstract: IoT is an emerging area in which we expect to have billions of devices connected to the Internet by 2020. IoT applications can offer many benefits to environments, society and the economy through the interconnection and cooperation of smart objects. However, there are many privacy challenges, such as authentication, authorization, and confidentiality of personal data. With this in mind, we have developed a solution for managing user profiles based on privacy and evolution. For that, we define the criteria and characteristics for each environment. The contribution of the work also applies to the evolution of the UbiPri Middleware, with a module implemented and tested according to the rules of environments so that they can modify the user's profile over time according to their frequency in the environment. The modified profile can be raised, reduced and blocked. This implementation has been validated using scripts that perform probabilistic simulation and user authentication. From the rules assigned to the environments, it was possible to perceive the high adaptability of the implementation, and it can be easily adjusted to any IoT environment that wants to treat the authentication and privacy of environments and users. The results obtained were satisfactory and could be useful for both the evolution of the UbiPri Middleware and other related works.


title: Extended Formulation Lower Bounds for Refuting Random CSPs

abstract: Random constraint satisfaction problems (CSPs) such as random $3$-SAT are conjectured to be computationally intractable. The average case hardness of random $3$-SAT and other CSPs has broad and far-reaching implications on problems in approximation, learning theory and cryptography. In this work, we show subexponential lower bounds on the size of linear programming relaxations for refuting random instances of constraint satisfaction problems. Formally, suppose $P : \{0,1\}^k \to \{0,1\}$ is a predicate that supports a $t-1$-wise uniform distribution on its satisfying assignments. Consider the distribution of random instances of CSP $P$ with $m = \Delta n$ constraints. We show that any linear programming extended formulation that can refute instances from this distribution with constant probability must have size at least $\Omega\left(\exp\left(\left(\frac{n^{t-2}}{\Delta^2}\right)^{\frac{1-\nu}{k}}\right)\right)$ for all $\nu > 0$. For example, this yields a lower bound of size $\exp(n^{1/3})$ for random $3$-SAT with a linear number of clauses. We use the technique of pseudocalibration to directly obtain extended formulation lower bounds from the planted distribution. This approach bypasses the need to construct Sherali-Adams integrality gaps in proving general LP lower bounds. As a corollary, one obtains a self-contained proof of subexponential Sherali-Adams LP lower bounds for these problems. We believe the result sheds light on the technique of pseudocalibration, a promising but conjectural approach to LP/SDP lower bounds.


title: Priority Quality Attributes for Engineering AI-enabled Systems

abstract: Deploying successful software-reliant systems that address their mission goals and user needs within cost, resource, and expected quality constraints require design trade-offs. These trade-offs dictate how systems are structured and how they behave and consequently can effectively be evolved and sustained. Software engineering practices address this challenge by centering system design and evolution around delivering key quality attributes, such as security, privacy, data centricity, sustainability, and explainability. These concerns are more urgent requirements for software-reliant systems that also include AI components due to the uncertainty introduced by data elements. Moreover, systems employed by the public sector exhibit unique design time and runtime challenges due to the regulatory nature of the domains. We assert that the quality attributes of security, privacy, data centricity, sustainability, and explainability pose new challenges to AI engineering and will drive the success of AI-enabled systems in the public sector. In this position paper, we enumerate with examples from healthcare domain concerns related to these requirements to mitigate barriers to architecting and fielding AI-enabled systems in the public sector.


title: Pomeau-Manneville maps are global-local mixing

abstract: We prove that a large class of expanding maps of the unit interval with a $C^2$-regular indifferent point in 0 and full increasing branches are global-local mixing. This class includes the standard Pomeau-Manneville maps $T(x) = x + x^{p+1}$ mod 1 ($p \ge 1$), the Liverani-Saussol-Vaienti maps (with index $p \ge 1$) and many generalizations thereof.


title: Transformation of Dense and Sparse Text Representations

abstract: Sparsity is regarded as a desirable property of representations, especially in terms of explanation. However, its usage has been limited due to the gap with dense representations. Most NLP research progresses in recent years are based on dense representations. Thus the desirable property of sparsity cannot be leveraged. Inspired by Fourier Transformation, in this paper, we propose a novel Semantic Transformation method to bridge the dense and sparse spaces, which can facilitate the NLP research to shift from dense space to sparse space or to jointly use both spaces. The key idea of the proposed approach is to use a Forward Transformation to transform dense representations to sparse representations. Then some useful operations in the sparse space can be performed over the sparse representations, and the sparse representations can be used directly to perform downstream tasks such as text classification and natural language inference. Then, a Backward Transformation can also be carried out to transform those processed sparse representations to dense representations. Experiments using classification tasks and natural language inference task show that the proposed Semantic Transformation is effective.


title: A Statistically Identifiable Model for Tensor-Valued Gaussian Random Variables

abstract: Real-world signals typically span across multiple dimensions, that is, they naturally reside on multi-way data structures referred to as tensors. In contrast to standard ``flat-view'' multivariate matrix models which are agnostic to data structure and only describe linear pairwise relationships, we introduce the tensor-valued Gaussian distribution which caters for multilinear interactions -- the linear relationship between fibers -- which is reflected by the Kronecker separable structure of the mean and covariance. By virtue of the statistical identifiability of the proposed distribution formulation, whereby different parameter values strictly generate different probability distributions, it is shown that the corresponding likelihood function can be maximised analytically to yield the maximum likelihood estimator. For rigour, the statistical consistency of the estimator is also demonstrated through numerical simulations. The probabilistic framework is then generalised to describe the joint distribution of multiple tensor-valued random variables, whereby the associated mean and covariance exhibit a Khatri-Rao separable structure. The proposed models are shown to serve as a natural basis for gridded atmospheric climate modelling.


title: Coupled transport of phonons and carriers in semiconductors: A case study of n-doped GaAs

abstract: We present a general coupled electron-phonon Boltzmann transport equations (BTEs) scheme designed to capture the mutual drag of the two interacting systems. By combining density functional theory based first principles calculations of anharmonic phonon-phonon interactions with physical models of electron-phonon interactions, we apply our implementation of the coupled BTEs to calculate the thermal conductivity, mobility, Seebeck and Peltier coefficients of n-doped gallium arsenide. The measured low temperature enhancement in the Seebeck coefficient is captured using the solution of the fully coupled electron-phonon BTEs, while the uncoupled electron BTE fails to do so. This work gives insights into the fundamental nature of charge and heat transport in semiconductors and advances predictive ab initio computational approaches. We discuss possible extensions of our work.


title: Polariton surface solitons under a resonant pump

abstract: We address formation of stable dissipative surface solitons in the exciton-polariton condensate in one-dimensional array of microcavity pillars under the action of localized resonant pump acting in the edge resonator. We show that localization degree and peak amplitudes of surface solitons can be effectively controlled by the pump frequency and that the allowed energy gap of periodic structure determines the energy range, where surface solitons can form. One observes bistability at sufficiently large pump amplitudes and nonlinearity-induced shift of the position of resonance peak from the allowed energy band of the periodic array into its forbidden energy gap. Growth of the spatial period of the array reduces coupling between pillars and currents from surface pillar into bulk pillars that leads to the increase of the surface soliton amplitude. Strong expansion into the depth of array occurs for pump frequencies corresponding to the middle of the allowed energy band. Surface solitons can be excited from the broadband Gaussian noise. Above certain threshold noise level solitons from stable upper branch of the bistability curve are excited, while below threshold solitons from the lower branch form.

categories: physics.optics cond-mat.mes-hall cond-mat.quant-gas nlin.PS


title: Behavioral Equivalence of Extensive Game Structures

abstract: Two extensive game structures with imperfect information are said to be behaviorally equivalent if they share the same map (up to relabelings) from profiles of structurally reduced strategies to induced terminal paths. We show that this is the case if and only if one can be transformed into the other through a composition of two elementary transformations, commonly known as \textquotedblleft Interchanging of Simultaneous Moves\textquotedblright\ and \textquotedblleft Coalescing Moves/Sequential Agent Splitting.\textquotedblright


title: Numerically investigating the morphology of the supernova remnant SN 1006 in the ambient medium with a density discontinuity

abstract: Multiband observations on the type Ia supernova remnant SN 1006 indicate peculiar properties in its morphologies of emission in the radio, optical and X-ray bands. In the hard X-rays, the remnant is bilateral with two opposite bright limbs with prominent protrusions. Moreover, a filament has been detected at the radio, optical and soft X-ray wavelengthes. The reason for these peculiar features in the morphologies of the remnant is investigated using 3D HD simulations. With the assumption that the supernova ejecta is evolved in the ambient medium with a density discontinuity, the radius of the remnant's boundary is smaller in the tenuous medium, and the shell consists of two hemispheres with different radiuses. Along particular line of sights, protrusions appear on the periphery of the remnants since the emission from the edge of the hemisphere with a larger radius is located outside that from the shell of the small hemisphere. Furthermore, the northwest filament of SN 1006 arises as a result of the intersection of the line of sight and the shocked material near the edges of the two hemispheres. It can be concluded that the features that the protrusions on the northeast and southwest limbs and the northwest filament in the morphologies of SN 1006 can be reproduced as the remnants interacting with the medium with a density discontinuity.


title: CR submanifolds of the nearly K\" ahler $\mathbb S^3\times\mathbb S^3$ characterised by properties of the almost product structure

abstract: In a previous paper, the authors together with L. Vrancken initiated the study of $3$-dimensional CR submanifolds of the nearly K\" ahler homogeneous $\mathbb S^3\times \mathbb S^3$. As is shown by Butruille this is one of only four homogeneous $6$-dimensional nearly K\"ahler manifolds. Besides its almost complex structure $J$ it also admits a canonical almost product structure $P$. Along a $3$-dimensional CR submanifold the tangent space of $\mathbb S^3\times\mathbb S^3$ can be naturally split as the orthogonal sum of three $2$-dimensional vector bundles $\mathcal D_1$, $\mathcal D_2$ and $\mathcal D_3$. We study the CR submanifolds in relation to the behavior of the almost product structure on these vector bundles.


title: Probabilistic Watershed: Sampling all spanning forests for seeded segmentation and semi-supervised learning

abstract: The seeded Watershed algorithm / minimax semi-supervised learning on a graph computes a minimum spanning forest which connects every pixel / unlabeled node to a seed / labeled node. We propose instead to consider all possible spanning forests and calculate, for every node, the probability of sampling a forest connecting a certain seed with that node. We dub this approach "Probabilistic Watershed". Leo Grady (2006) already noted its equivalence to the Random Walker / Harmonic energy minimization. We here give a simpler proof of this equivalence and establish the computational feasibility of the Probabilistic Watershed with Kirchhoff's matrix tree theorem. Furthermore, we show a new connection between the Random Walker probabilities and the triangle inequality of the effective resistance. Finally, we derive a new and intuitive interpretation of the Power Watershed.


title: Persistent Homology as Stopping-Criterion for Voronoi Interpolation

abstract: In this study the Voronoi interpolation is used to interpolate a set of points drawn from a topological space with higher homology groups on its filtration. The technique is based on Voronoi tessellation, which induces a natural dual map to the Delaunay triangulation. Advantage is taken from this fact calculating the persistent homology on it after each iteration to capture the changing topology of the data. The boundary points are identified as critical. The Bottleneck and Wasserstein distance serve as a measure of quality between the original point set and the interpolation. If the norm of two distances exceeds a heuristically determined threshold, the algorithm terminates. We give the theoretical basis for this approach and justify its validity with numerical experiments.


title: Polaritonic neuromorphic computing outperforms linear classifiers

abstract: Machine learning software applications are nowadays ubiquitous in many fields of science and society for their outstanding capability of solving computationally vast problems like the recognition of patterns and regularities in big datasets. One of the main goals of research is the realization of a physical neural network able to perform data processing in a much faster and energy-efficient way than the state-of-the-art technology. Here we show that lattices of exciton-polariton condensates accomplish neuromorphic computing using fast optical nonlinearities and with lower error rate than any previous hardware implementation. We demonstrate that our neural network significantly increases the recognition efficiency compared to the linear classification algorithms on one of the most widely used benchmarks, the MNIST problem, showing a concrete advantage from the integration of optical systems in reservoir computing architectures.


title: Aerodynamic Data Fusion Towards the Digital Twin Paradigm

abstract: We consider the fusion of two aerodynamic data sets originating from differing fidelity physical or computer experiments. We specifically address the fusion of: 1) noisy and in-complete fields from wind tunnel measurements and 2) deterministic but biased fields from numerical simulations. These two data sources are fused in order to estimate the \emph{true} field that best matches measured quantities that serves as the ground truth. For example, two sources of pressure fields about an aircraft are fused based on measured forces and moments from a wind-tunnel experiment. A fundamental challenge in this problem is that the true field is unknown and can not be estimated with 100\% certainty. We employ a Bayesian framework to infer the true fields conditioned on measured quantities of interest; essentially we perform a \emph{statistical correction} to the data. The fused data may then be used to construct more accurate surrogate models suitable for early stages of aerospace design. We also introduce an extension of the Proper Orthogonal Decomposition with constraints to solve the same problem. Both methods are demonstrated on fusing the pressure distributions for flow past the RAE2822 airfoil and the Common Research Model wing at transonic conditions. Comparison of both methods reveal that the Bayesian method is more robust when data is scarce while capable of also accounting for uncertainties in the data. Furthermore, given adequate data, the POD based and Bayesian approaches lead to \emph{similar} results.


title: Twisting Kuperberg invariants via Fox calculus and Reidemeister torsion

abstract: We study Kuperberg invariants for sutured manifolds in the case of a semidirect product of an involutory Hopf superalgebra $H$ with its automorphism group $\text{Aut}(H)$. These are topological invariants of balanced sutured 3-manifolds endowed with a homomorphism of the fundamental group into $\text{Aut}(H)$ and possibly with a $\text{Spin}^c$ structure and a homology orientation. We show that these invariants are computed via a form of Fox calculus and that, if $H$ is $\mathbb{N}$-graded, they can be extended in a canonical way to polynomial invariants. When $H$ is an exterior algebra, we show that this invariant specializes to a refinement of the twisted relative Reidemeister torsion of sutured 3-manifolds. We also give an explanation of our Fox calculus formulas in terms of a particular Hopf group-algebra.


title: Tracing Network Evolution Using the PARAFAC2 Model

abstract: Characterizing time-evolving networks is a challenging task, but it is crucial for understanding the dynamic behavior of complex systems such as the brain. For instance, how spatial networks of functional connectivity in the brain evolve during a task is not well-understood. A traditional approach in neuroimaging data analysis is to make simplifications through the assumption of static spatial networks. In this paper, without assuming static networks in time and/or space, we arrange the temporal data as a higher-order tensor and use a tensor factorization model called PARAFAC2 to capture underlying patterns (spatial networks) in time-evolving data and their evolution. Numerical experiments on simulated data demonstrate that PARAFAC2 can successfully reveal the underlying networks and their dynamics. We also show the promising performance of the model in terms of tracing the evolution of task-related functional connectivity in the brain through the analysis of functional magnetic resonance imaging data.


title: Gravity, topography, and melt generation rates from simple 3D models of mantle convection

abstract: Convection in fluid layers at high Rayleigh number (Ra $\sim 10^6$) have a spoke pattern planform. Instabilities in the bottom thermal boundary layer develop into hot rising sheets of fluid, with a component of radial flow towards a central upwelling plume. The sheets form the "spokes" of the pattern, and the plumes the "hubs". Such a pattern of flow is expected to occur beneath plate interiors on Earth, but it remains a challenge to use observations to place constraints on the convective planform of the mantle. Here we present predictions of key surface observables (gravity, topography, and rates of melt generation) from simple 3D numerical models of convection in a fluid layer. These models demonstrate that gravity and topography have only limited sensitivity to the spokes, and mostly reflect the hubs (the rising and sinking plumes). By contrast, patterns of melt generation are more sensitive to short wavelength features in the flow. There is the potential to have melt generation along the spokes, but at a rate which is relatively small compared with that at the hubs. Such melting of spokes can only occur when the lithosphere is sufficiently thin ($\lesssim 80$ km) and mantle water contents are sufficiently high ($\gtrsim 100$ ppm). The distribution of volcanism across the Middle East, Arabia and Africa north of equator suggests that it results from such spoke pattern convection.


title: Graph Convolutional Networks Meet with High Dimensionality Reduction

abstract: Recently, Graph Convolutional Networks (GCNs) and their variants have been receiving many research interests for learning graph-related tasks. While the GCNs have been successfully applied to this problem, some caveats inherited from classical deep learning still remain as open research topics in the context of the node classification problem. One such inherited caveat is that GCNs only consider the nodes that are a few propagations away from the labeled nodes to classify them. However, taking only a few propagation steps away nodes into account defeats the purpose of using the graph topological information in the GCNs. To remedy this problem, the-state-of-the-art methods leverage the network diffusion approaches, namely personalized page rank and its variants, to fully account for the graph topology, {\em after} they use the Neural Networks in the GCNs. However, these approaches overlook the fact that the network diffusion methods favour high degree nodes in the graph, resulting in the propagation of labels to unlabeled centralized, hub, nodes. To address this biasing hub nodes problem, in this paper, we propose to utilize a dimensionality reduction technique conjugate with personalized page rank so that we can both take advantage from graph topology and resolve the hub node favouring problem for GCNs. Here, our approach opens a new holistic road for message passing phase of GCNs by suggesting the usage of other proximity matrices instead of well-known Laplacian. Testing on two real-world networks that are commonly used in benchmarking GCNs' performance for the node classification context, we systematically evaluate the performance of the proposed methodology and show that our approach outperforms existing methods for wide ranges of parameter values with very limited deep learning training {\em epochs}.


title: How Can BERT Help Lexical Semantics Tasks?

abstract: Contextualized embeddings such as BERT can serve as strong input representations to NLP tasks, outperforming their static embeddings counterparts such as skip-gram, CBOW and GloVe. However, such embeddings are dynamic, calculated according to a sentence-level context, which limits their use in lexical semantics tasks. We address this issue by making use of dynamic embeddings as word representations in training static embeddings, thereby leveraging their strong representation power for disambiguating context information. Results show that this method leads to improvements over traditional static embeddings on a range of lexical semantics tasks, obtaining the best reported results on seven datasets.


title: Nonlinear system identification in Sobolev spaces

abstract: We consider the problem of deriving from experimental data an approximation of an unknown function, whose derivatives also approximate the unknown function derivatives. Solving this problem is useful, for instance, in the context of nonlinear system identification for obtaining models that are more accurate and reliable than the traditional ones, based on plain function approximation. Indeed, models identified by accounting for the derivatives can provide a better performance in several tasks, such as multi-step prediction, simulation, Nonlinear Model Predictive Control, and control design in general. In this paper, we propose a novel approach based on convex optimization, allowing us to solve the aforementioned identification problem. We develop an optimality analysis, showing that models derived using this approach enjoy suitable optimality properties in Sobolev spaces. The optimality analysis also leads to the derivation of tight uncertainty bounds on the unknown function and its derivatives. We demonstrate the effectiveness of the approach with two numerical examples. The first one is concerned with approximation of an univariate function, the second one with multi-step prediction of the Chua chaotic circuit.


title: Deriving pairwise transfer entropy from network structure and motifs

abstract: Transfer entropy is an established method for quantifying directed statistical dependencies in neuroimaging and complex systems datasets. The pairwise (or bivariate) transfer entropy from a source to a target node in a network does not depend solely on the local source-target link weight, but on the wider network structure that the link is embedded in. This relationship is studied using a discrete-time linearly-coupled Gaussian model, which allows us to derive the transfer entropy for each link from the network topology. It is shown analytically that the dependence on the directed link weight is only a first approximation, valid for weak coupling. More generally, the transfer entropy increases with the in-degree of the source and decreases with the in-degree of the target, indicating an asymmetry of information transfer between hubs and low-degree nodes. In addition, the transfer entropy is directly proportional to weighted motif counts involving common parents or multiple walks from the source to the target, which are more abundant in networks with a high clustering coefficient than in random networks. Our findings also apply to Granger causality, which is equivalent to transfer entropy for Gaussian variables. Moreover, similar empirical results on random Boolean networks suggest that the dependence of the transfer entropy on the in-degree extends to nonlinear dynamics.

categories: cs.IT cs.SI math.IT physics.data-an q-bio.NC


title: Helical spin liquid in a triangular XXZ magnet from Chern-Simons theory

abstract: We propose a finite-temperature phase diagram for the 2D spin-$1/2$ $J_1-J_2$ $XXZ$ antiferromagnet on the triangular lattice. Our analysis, based on a composite fermion representation, yields several phases. This includes a zero-temperature helical spin liquid with $N=6$ {\it anisotropic} Dirac cones, and with nonzero vector chirality implying a broken $\mathbb{Z}_2$ symmetry. It is terminated at $T=0$ by a continuous quantum phase transition to $120^\circ$ ordered state around $J_2/J_1\approx0.089$ in the XX limit; these phases share a double degeneracy, which persists to finite $T$ above the helical spin liquid. By contrast, at $J_2/J_1 \simeq 0.116$, the transition into a stripe phase appears as first order. We further discuss experimental and numerical consequences of the helical order and the anisotropic nature of the Dirac dispersion.


title: Change your singer: a transfer learning generative adversarial framework for song to song conversion

abstract: Have you ever wondered how a song might sound if performed by a different artist? In this work, we propose SCM-GAN, an end-to-end non-parallel song conversion system powered by generative adversarial and transfer learning that allows users to listen to a selected target singer singing any song. SCM-GAN first separates songs into vocals and instrumental music using a U-Net network, then converts the vocal segments to the target singer using advanced CycleGAN-VC, before merging the converted vocals with their corresponding background music. SCM-GAN is first initialized with feature representations learned from a state-of-the-art voice-to-voice conversion and then trained on a dataset of non-parallel songs. Furthermore, SCM-GAN is evaluated against a set of metrics including global variance GV and modulation spectra MS on the 24 Mel-cepstral coefficients (MCEPs). Transfer learning improves the GV by 35% and the MS by 13% on average. A subjective comparison is conducted to test the user satisfaction with the quality and the naturalness of the conversion. Results show above par similarity between SCM-GAN's output and the target (70\% on average) as well as great naturalness of the converted songs.


title: QPALM: A Newton-type Proximal Augmented Lagrangian Method for Quadratic Programs

abstract: We present a proximal augmented Lagrangian based solver for general convex quadratic programs (QPs), relying on semismooth Newton iterations with exact line search to solve the inner subproblems. The exact line search reduces in this case to finding the zero of a one-dimensional monotone, piecewise affine function and can be carried out very efficiently. Our algorithm requires the solution of a linear system at every iteration, but as the matrix to be factorized depends on the active constraints, efficient sparse factorization updates can be employed like in active-set methods. Both primal and dual residuals can be enforced down to strict tolerances and otherwise infeasibility can be detected from intermediate iterates. A C implementation of the proposed algorithm is tested and benchmarked against other state-of-the-art QP solvers for a large variety of problem data and shown to compare favorably against these solvers.


title: Universal methods for suppressing the light shift in atomic clocks using power modulation

abstract: We show that the light shift in atomic clocks can be suppressed using time variation of the interrogation field intensity. By measuring the clock output at two intensity levels, error signals can be generated that simultaneously stabilize a local oscillator to an atomic transition and correct for the shift of this transition caused by the interrogating optical field. These methods are suitable for optical clocks using one- and two-photon transitions, as well as for microwave clocks based on coherent population trapping or direct interrogation. The proposed methods can be widely used both for high-precision scientific instruments and for a wide range of commercial clocks, including chip-scale atomic clocks.


title: New neutron transmission supermirror remanent polarizer

abstract: A new neutron transmission supermirror remanent polarizer is proposed. The polarizer is compact. It consists of two solid state polarizing parts. Parts of the polarizer have antiparallel magnetization of magnetic layers of supermirror structures. Both parts of the polarizer have magnetic remanence. This allows it to be used as a polarizer and analyzer in small magnetic fields. The polarizer can be used when working with beams of large cross-section and with a wide angular distribution. Assembly of the device is greatly simplified, because it is not required to bend a large stack of short plates along the radius, but only to compress of its. The width of the angular profile of the beam passed through the polarizer does not change! The polarizer has a high transmittance for the (-) spin component of the beam. The beam passed through the polarizer is highly polarized. Properties of neutron polarizing CoFe/TiZr and Fe/Si remanent supermirrors (m = 2.0 and 2.5) are discussed. A variant of effective use of the proposed polarizer with a spin-flipper for operation in saturating magnetic fields is proposed.


title: Directional dependence of the Unruh effect for spatially extended detectors

abstract: We analyse the response of a spatially extended direction-dependent local quantum system, a detector, moving on the Rindler trajectory of uniform linear acceleration in Minkowski spacetime, and coupled linearly to a quantum scalar field. We consider two spatial profiles: (i) a profile defined in the Fermi-Walker frame of an arbitrarily-accelerating trajectory, generalising the isotropic Lorentz-function profile introduced by Schlicht to include directional dependence; and (ii) a profile defined only for a Rindler trajectory, utilising the associated frame, and confined to a Rindler wedge, but again allowing arbitrary directional dependence. For (i), we find that the transition rate on a Rindler trajectory is non-thermal, and dependent on the direction, but thermality is restored in the low and high frequency regimes, with a direction-dependent temperature, and also in the regime of high acceleration compared with the detector's inverse size. For (ii), the transition rate is isotropic, and thermal in the usual Unruh temperature. We attribute the non-thermality and anisotropy found in (i) to the leaking of the Lorentz-function profile past the Rindler horizon.


title: Abundance of zirconium in the atmospheres of red giants in Galactic globular cluster 47 Tuc

abstract: We determined zirconium abundance in the atmospheres of 327 red giant branch (RGB) stars in the globular cluster 47 Tuc. The 1D LTE abundances were obtained from the archival VLT GIRAFFE spectra, using 1D hydrostatic ATLAS9 stellar model atmospheres and synthetic Zr I line profiles computed with the SYNTHE package. The average zirconium abundance determined in the sample of RGB stars, [Zr/Fe] = +0.38 +/- 0.12, agrees well with zirconium abundances obtained at this metallicity in the Galactic field stars, as well as with those observed in other Galactic globular clusters.


title: New Multivalued Contractions and the Fixed-Circle Problem

abstract: In this paper, we focus on the fixed-circle problem on metric spaces by means of the multivalued mappings. We introduce new multivalued contractions using Wardowski's techniques and obtain new fixed-circle results related to multivalued contractions with some applications to integral type contractions. We verify the validity of our obtained results with illustrative examples.


title: Splitting of two-component solitary waves from collisions with narrow potential barriers

abstract: We consider the interaction of two-component bright-bright solitons with a narrow potential barrier (splitter) in the framework of a system of two Gross-Pitaevskii (nonlinear-Schr\"{o}dinger) equations modeling a binary Bose-Einstein condensate, with self-attraction in each component and cross-attraction between them. The objective is to study splitting of composite solitons, which may be used in the design of two-component soliton-interferometer schemes. We produce approximate analytic results, assuming a weak barrier and applying the perturbation theory in the limit in which the system is integrable and the solitary waves may be considered as exact solitons. We do this in the case of negligible interspecies interactions, and also when the nonlinearities are strongly asymmetric, allowing one to neglect the self-interaction in one of the species. Then, we use systematic simulations to study the transmissions of both components in regions outside these approximations and, in particular, to compare numerical results with their analytical countertparts. We concluded that there is an appreciable parameter range where one component is almost entirely transmitted through the barrier, while the other one is reflected. Excitation of internal vibrations in the passing and rebounding solitons is explored too, with a conclusion that it is weak in the regime of high-quality splitting.


title: Everettian theory as pure wave mechanics plus a no-collapse probability postulate

abstract: Proposed derivations of the Born rule for Everettian theory are controversial. I argue that they are unnecessary but may provide justification for a simplified version of the Principal Principle. It's also unnecessary to replace Everett's idea that a subject splits in measurement contexts with the idea that subjects have linear histories which partition: Deutsch 1985, 2011; Saunders and Wallace 2008; Saunders 2010; Wallace 2012, Chapter 7; Wilson 2013, forthcoming. Linear histories were introduced to provide a concept of pre-measurement uncertainty and I explain why pre-measurement uncertainty for splitting subjects is after all coherent, though not necessary because Everett's original fission interpretation of branching can arguably be rendered coherent without it, via reference to Vaidman 1998; Tappenden 2011; Sebens and Carroll 2018; McQueen and Vaidman 2019. A deterministic and probabilistic quantum mechanics can be made intelligible by replacing the standard collapse postulate with a no-collapse postulate which identifies objective probability with relative branch weight, supplemented by the simplified Principal Principle and some revisionary metaphysics.


title: Efficient Numerical Scheme for Solving (1+1), (2+1)-dimensional and Coupled Burgers Equation

abstract: A numerical scheme based on backward differentiation formula (BDF) and generalized differential quadrature method (GDQM) has been developed. The proposed scheme has been employed to investigate three cases of Burgers equation, one-dimensional, two-dimensional and two-dimensional coupled models. The results showed an effectiveness accuracy in absolute error and error norms


title: Low-frequency radio absorption in Tycho's supernova remnant

abstract: Tycho's SNR is the remnant of the type Ia supernova explosion SN1572. In this work we present new low-frequency radio observations with the LOFAR Low-Band and High-Band Antennae, centred at 58 MHz and 143 MHz, and with an angular resolution of 41'' and 6'' respectively. We compare these maps to VLA maps at 327 MHz and 1420 MHz, and detect the effect of low-frequency absorption in some regions of the remnant due to the presence of free electrons along the line-of-sight. We investigate two origins for the low-frequency free-free absorption that we observe: external absorption from foreground, and internal absorption from Tycho's unshocked ejecta. The external absorption could be due to an ionised thin, diffuse cavity surrounding the SNR (although this cavity would need to be very thin to comply with the neutral fraction required to explain the remnant's optical lines), or it could be due to an over-ionised molecular shell in the vicinity of the remnant. We note that possible ionising sources are the X-ray emission from Tycho, its cosmic rays, or radiation from Tycho's progenitor. For the internal absorption, we are limited by our understanding of the spectral behaviour of the region at unabsorbed radio frequencies. However, the observations are suggestive of free-free absorption from unshocked ejecta inside Tycho's reverse shock.


title: The 2MASS Redshift Survey in the Zone of Avoidance

abstract: The 2MASS Redshift Survey was started two decades ago with the goal of mapping the three-dimensional distribution of an all-sky flux-limited (Ks<11.75 mag) sample of ~45,000 galaxies. Our first data release (Huchra et al. 2012) presented an unprecedented uniform coverage for most of the celestial sphere, with redshifts for ~98% of our sample. However, we were missing redshifts for ~18% of the catalog entries that were located within the "Zone of Avoidance" (|b|<10 deg) -- an important region of the sky for studies of large-scale structure and cosmic flows. In this second and final data release, we present redshifts for all 1041 2MRS galaxies that previously lacked this information, as well as updated measurements for 27 others.


title: J-MoDL: Joint Model-Based Deep Learning for Optimized Sampling and Reconstruction

abstract: Modern MRI schemes, which rely on compressed sensing or deep learning algorithms to recover MRI data from undersampled multichannel Fourier measurements, are widely used to reduce scan time. The image quality of these approaches is heavily dependent on the sampling pattern. We introduce a continuous strategy to jointly optimize the sampling pattern and network parameters. We use a multichannel forward model, consisting of a non-uniform Fourier transform with continuously defined sampling locations, to realize the data consistency block within a model-based deep learning image reconstruction scheme. This approach facilitates the joint and continuous optimization of the sampling pattern and the CNN parameters to improve image quality. We observe that the joint optimization of the sampling patterns and the reconstruction module significantly improves the performance of most deep learning reconstruction algorithms. The source code of the proposed joint learning framework is available at https://github.com/hkaggarwal/J-MoDL.


title: Orbital Properties and Gravitational Wave Signatures of Strange Crystal Planets

abstract: In this paper we consider the possibility that strange quark matter may be manifested in the form of strangelet crystal planets. These planet-like objects are made up of nuggets of strange quark matter (SQM), organized in a crystalline structure. We consider the so--called strange matter hypothesis proposed by Bodmer, Witten and Terazawa, in that, strange quark matter may be the absolutely stable state of matter. In this context, we analyze planets made up entirely of strangelets arranged in a crystal lattice. Furthermore we propose that a solar system with a host compact star may be orbited by strange crystal planets. Under this assumption we calculate the relevant quantities that could potentially be observable, such as the planetary tidal disruption radius, and the gravitational waves signals that may arise from potential star-planet merger events. Our results show that strangelet crystal planets could potentially be used as an indicator for the the existence of SQM.


title: Second order splitting of a class of fourth order PDEs with point constraints

abstract: We formulate a well-posedness and approximation theory for a class of generalised saddle point problems with a specific form of constraints. In this way we develop an approach to a class of fourth order elliptic partial differential equations with point constraints using the idea of splitting into coupled second order equations. An approach is formulated using a penalty method to impose the constraints. Our main motivation is to treat certain fourth order equations involving the biharmonic operator and point Dirichlet constraints for example arising in the modelling of biomembranes on curved and flat surfaces but the approach may be applied more generally. The theory for well-posedness and approximation is presented in an abstract setting. Several examples are described together with some numerical experiments.


title: Optimizing neural network techniques in classifying Fermi-LAT gamma-ray sources

abstract: Machine learning is an automatic technique that is revolutionizing scientific research, with innovative applications and wide use in astrophysics. The aim of this study was to developed an optimized version of an Artificial Neural Network machine learning method for classifying blazar candidates of uncertain type detected by the Fermi Large Area Telescope (LAT) gamma-ray instrument. The initial study used information from gamma-ray light curves present in the LAT 4-year Source Catalog. In this study we used additionally gamma-ray spectra and multiwavelength data, and certain statistical methods in order to improve classification. The final result of this study increased the classification performance by about 80 per cent with respect to previous method, leaving only 15 unclassified blazars instead of 77 out of total 573 in the LAT catalog. Other blazars were classified into BL Lacs and FSRQ in ratio of about two to one, similar to previous study. In both studies a precision value of 90 per cent was used as a threshold for classification.


title: Study of Some Aspects of Astronuclear System

abstract: In this work we have studied the bulk properties of compact stellar object which is largely motivated by the recent work of Potekhin group who studied the structure and evolution of compact star on the basis of unified EoS of Brussels-Montreal group. Here we solved ToV equation of state numerically using three sets of parameter models to compute pressure, baryon density and bulk modulus etc over a wide range of matter density. The computed values of the observables like the stellar interior pressure, bulk modulus and baryon density have been presented as a function of mass density in the tabular form. Graphical analysis of computed observables and their comparison with reference data wherever available have been presented as representative cases.


title: Thermodynamic stability of Borophene, $\mathrm{B_2O_3}$ and other $\mathrm{B_{1-x}O_x}$ sheets

abstract: The recent discovery of borophene, a two-dimensional allotrope of boron, raises many questions about its structure and its chemical and physical properties. Boron has a high chemical affinity to oxygen but little is known about the oxidation behavior of borophene. Here we use first principles calculations to study the phase diagram of free-standing, two-dimensional $\mathrm{B_{1-x}O_x}$ for compositions ranging from $x=0$ to $x=0.6$, which correspond to borophene and $\mathrm{B_2O_3}$ sheets, respectively. Our results indicate that no stable compounds except borophene and $\mathrm{B_2O_3}$ sheets exist. Intermediate compositions are heterogeneous mixtures of borophene and $\mathrm{B_2O_3}$. Other hypothetical crystals such as $\mathrm{B_2O}$ are unstable and some of them were found to undergo spontaneous disproportionation into borophene and $\mathrm{B_2O_3}$. It is also shown that oxidizing borophene inside the flakes is thermodynamically unfavorable over forming $\mathrm{B_2O_3}$ at the edges. All findings can be rationalized by oxygen's preference of two-fold coordination which is incompatible with higher in-plane coordination numbers preferred by boron. These results agree well with recent experiments and pave the way to understand the process of oxidation of borophene and other two-dimensional materials.


title: Dark Energy Survey Year 1 Results: the lensing imprint of cosmic voids on the Cosmic Microwave Background

abstract: Cosmic voids gravitationally lens the cosmic microwave background (CMB) radiation, resulting in a distinct imprint on degree scales. We use the simulated CMB lensing convergence map from the MICE N-body simulation to calibrate our detection strategy for a given void definition and galaxy tracer density. We then identify cosmic voids in DES Year 1 data and stack the Planck 2015 lensing convergence map on their locations, probing the consistency of simulated and observed void lensing signals. When fixing the shape of the stacked convergence profile to that calibrated from simulations, we find imprints at the $3{\sigma}$ significance level for various analysis choices. The best measurement strategies based on the MICE calibration process yield $S/N \sim 4$ for DES Y1, and the best-fit amplitude recovered from the data is consistent with expectations from MICE ($A \sim 1$). Given these results as well as the agreement between them and N-body simulations, we conclude that the previously reported excess integrated Sachs-Wolfe (ISW) signal associated with cosmic voids in DES Y1 has no counterpart in the Planck CMB lensing map.


title: Almost all trees have quantum symmetry

abstract: From the work of Erd\H{o}s and R\'{e}nyi from 1963 it is known that almost all graphs have no symmetry. In 2017, Lupini, Man\v{c}inska and Roberson proved a quantum counterpart: Almost all graphs have no quantum symmetry. Here, the notion of quantum symmetry is phrased in terms of Banica's definition of quantum automorphism groups of finite graphs from 2005, in the framework of Woronowicz's compact quantum groups. Now, Erd\H{o}s and R\'{e}nyi also proved a complementary result in 1963: Almost all trees do have symmetry. The crucial point is the almost sure existence of a cherry in a tree. But even more is true: We almost surely have two cherries in a tree - and we derive that almost all trees have quantum symmetry. We give an explicit proof of this quantum counterpart of Erd\H{o}s and R\'{e}nyi's result on trees.


title: Neutron Production by Muons

abstract: A phenomenological approach for neutron production in fast muon interactions has been considered. Linear approximation for photonuclear production mechanism at shallow depth has been deduced. Present calculations were compared with experimental and theoretical results.


title: Space of quantum states built over metrics of fixed signature

abstract: We construct a space of quantum states and an algebra of quantum observables, over the set of all metrics of arbitrary but fixed signature, defined on a manifold. The construction is diffeomorphism invariant, and unique up to natural isomorphisms.


title: Dark energy as a large scale quantum gravitational phenomenon

abstract: In our recently proposed quantum theory of gravity, the universe is made of `atoms' of space-time-matter (STM). Planck scale foam is composed of STM atoms with Planck length as their associated Compton wave-length. The quantum dispersion and accompanying spontaneous localisation of these STM atoms amounts to a cancellation of the enormous curvature on the Planck length scale. However, an effective dark energy term arises in Einstein equations, of the order required by current observations on cosmological scales. This happens if we propose an extremely light particle having a mass of about $10^{-33} \ {\rm eV/c^2}$, forty-two orders of magnitude lighter than the proton. The holographic principle suggests there are about $10^{122}$ such particles in the observed universe. Their net effect on space-time geometry is equivalent to dark energy, this being a low energy quantum gravitational phenomenon. In this sense, the observed dark energy constitutes evidence for quantum gravity. We then invoke Dirac's large number hypothesis to also propose a dark matter candidate having a mass halfway (on the logarithmic scale) between the proton and the dark energy particle, i.e. about $10^{-12}\ {\rm eV/c^2}$.


title: On contact screen conformal null submanifolds

abstract: First, we prove that indefinite Sasakian manifolds do not admit any screen conformal $r$-null submanifolds, tangent to the structure vector field. We, therefore, define a special class of null submanifolds, called; {\it contact screen conformal} $r$-null submanifold of indefinite Sasakian manifolds. Several characterization results, on the above class of null submanifolds, are proved. In particular, we prove that such null submanifolds exist in indefinite Sasakian space forms of constant holomorphic sectional curvatures of $-3$.


title: Algorithms for finding the gradings of reduced rings

abstract: This work is a Master thesis supervised by Prof. Dr. H.W. Lenstra. Lenstra and Silverberg showed that each reduced order has a universal grading, which can be viewed as the `largest possible grading'. We present an algorithm to compute the universal grading for a given order $R$, which has runtime $n^{O(m)}$, where n is the length of the input and m is the size of the minimal spectrum of $R$. We do this by computing all gradings of the corresponding reduced $\mathbb{Q}$-algebra with cyclic abelian groups of prime-power order. We additionally generalize the result of Lenstra and Silverberg that reduced orders have a universal grading to a broader class of rings.


title: Raman scattering studies of the lateral Mn distribution in MBE-grown Ga1-xMnxN epilayers

abstract: Recent interest in very thin single phase Ga1-xMnxN dilute magnetic layers increased needs for precise, non-destructive, and relatively fast characterization methods with key issues being the macroscopic lateral Mn distribution and the absolute values of Mn concentration x. We report on resonantly enhanced UV Raman scattering studies of high quality Ga1-xMnxN layers grown on GaN templated sapphire by molecular beam epitaxy with 4 < x < 9%. The main advantage of the UV excitation is the restriction of the light penetration depth to nearly a hundred nanometers, eliminating signal from the GaN buffer. Under this conditions we determine the dependence of the 1LO phonon frequency on x, what allows for a fine mapping of its lateral distribution over the entire surface of the samples. Our Raman scanning clearly confirms substantial lateral distribution of Mn atoms across the layer, which is radial with respect to its center. From the established distributions in two deliberately chosen layers the magnitude of the optimal growth temperature for most efficient Mn atoms incorporation in epitaxial GaN has been confirmed. It is shown that the combination of the 1LO line width and its energy provides assessment of the crystalline quality of the investigated layers.


title: Model theory and the DME: a survey

abstract: Recent work using the model theory of differentially closed fields to answer questions having to do with the Dixmier-Moeglin equivalence for (noncommutatve) finitely generated noetherian algebras, and for (commutative) finitely generated Poisson algebras, is here surveyed, with an emphasis on the model-theoretic and differential-algebraic-geometric antecedents.


title: Time-resolved reflectivity and Raman studies of the interplay of enigmatic orders in Mo$_8$O$_{23}$

abstract: Monoclinic semi-metallic Mo$_8$O$_{23}$ belongs to a multifunctional series of compounds showing multiple ordering phenomena that have not achieved much attention till now. Previous X-rays studies of this compound have revealed an incommensurate ordering transition at $T_{\mathrm{IC}}\sim350$ K, followed by a structural transition to commensurate order at $T_{\mathrm{IC-C}}=285$ K. In addition, an enigmatic resistance maximum is observed at $T_{\mathrm{el}}\sim150$ K, whose origin has so far proved elusive. Aiming to disentangle these multiple orders we use the polarized transient optical spectroscopy supplemented by Raman spectroscopy to study the electronic relaxation dynamics and lattice vibrational modes in Mo$_8$O$_{23}$ single crystals. Remarkably, both the coherent vibrational mode response and single particle response display extrema of damping/relaxation times close to $T_{\mathrm{el}}$ with the concurrent appearance of new coherent vibrational modes and a characteristic polarization asymmetry which saturates below $T_{\mathrm{el}}$. The single-particle relaxation data analysis shows the appearance of a temperature-independent gap in the electronic excitation spectrum below $T_{\mathrm{IC}}$ and additional temperature-dependent gap opening near $T_{\mathrm{el}}$. Concurrently, a low frequency vibrational mode shows anomalous softening around $T_{\mathrm{m}}\sim200$ K, far below $T_{\mathrm{IC-C}}$ and $T_{\mathrm{IC}}$. The observations are interpreted in terms of the appearance of a hidden gapped state below $T_{\mathrm{el}}$ that has so far eluded detection by structural analyses.


title: Improved Visual Localization via Graph Smoothing

abstract: Vision based localization is the problem of inferring the pose of the camera given a single image. One solution to this problem is to learn a deep neural network to infer the pose of a query image after learning on a dataset of images with known poses. Another more commonly used approach rely on image retrieval where the query image is compared against the database of images and its pose is inferred with the help of the retrieved images. The latter approach assumes that images taken from the same places consists of the same landmarks and, thus would have similar feature representations. These representation can be learned using full supervision to be robust to different variations in capture conditions like time of the day and weather. In this work, we introduce a framework to enhance the performance of these retrieval based localization methods by taking into account the additional information including GPS coordinates and temporal neighbourhood of the images provided by the acquisition process in addition to the descriptor similarity of pairs of images in the reference or query database which is used traditionally for localization. Our method constructs a graph based on this additional information and use it for robust retrieval by smoothing the feature representation of reference and/or query images. We show that the proposed method is able to significantly improve the localization accuracy on two large scale datasets over the baselines.


title: Long- to short-junction crossover and field-reentrant critical current in Al/Ag-nanowires/Al Josephson junctions

abstract: We have probed the superconducting proximity effect through long high-quality monocrystalline Ag nanowires, by realizing Josephson junctions of different lengths, with different superconducting materials. Thanks to the high number of junctions probed, both the contact resistance and electron diffusion constant could be determined, enabling a comparison of the measured critical current to theoretical expectation, over the entire regime from short to long diffusive junction. Although the length dependence of the critical current is as expected, the amplitude of the $R_{N}I_c$ product is smaller than predicted by theory. We also address the magnetic field dependence of the critical current. The quasi-gaussian decay of the critical current with field expected of a long narrow junction is observed for all superconducting contacts we used except for aluminum. We present the striking non-monotonous effect of field on the critical current of junctions with aluminum contacts, and analyze it in terms of improved quasiparticle thermalization by a magnetic field.


title: Toward AGT for parabolic sheaves

abstract: We construct explicit elements $W_{ij}^k$ in (a completion of) the shifted quantum toroidal algebra of type $A$, and show that these elements act by 0 on the $K$-theory of moduli spaces of parabolic sheaves. We expect that the quotient of the shifted quantum toroidal algebra by the ideal generated by the elements $W_{ij}^k$ will be related to $q$-deformed $W$-algebras of type $A$ for arbitrary nilpotent, which would imply a $q$-deformed version of the AGT correspondence between gauge theory with surface operators and conformal field theory.


title: Small deformations of spherical biomembranes

abstract: In this contribution to the proceedings of the 11th Mathematical Society of Japan (MSJ) Seasonal Institute (July 2018) we give an overview of some recent work on a mathematical model for small deformations of a spherical membrane. The idea is to consider perturbations to minimisers of a surface geometric energy. The model is obtained from consideration of second order approximations to a perturbed energy. In particular, the considered problems involve particle constraints and surface phase field energies.


title: Finding good quantum codes using the Cartan form

abstract: We present a simple and fast numerical procedure to search for good quantum codes for storing logical qubits in the presence of independent per-qubit noise. In a key departure from past work, we use the worst-case fidelity as the figure of merit for quantifying code performance, a much better indicator of code quality than, say, entanglement fidelity. Yet, our algorithm does not suffer from inefficiencies usually associated with the use of worst-case fidelity. Specifically, using a near-optimal recovery map, we are able to reduce the triple numerical optimization needed for the search to a single optimization over the encoding map. We can further reduce the search space using the Cartan decomposition, focusing our search over the nonlocal degrees of freedom resilient against independent per-qubit noise, while not suffering much in code performance.


title: An automated approach for task evaluation using EEG signals

abstract: Critical task and cognition-based environments, such as in military and defense operations, aviation user-technology interaction evaluation on UI, understanding intuitiveness of a hardware model or software toolkit, etc. require an assessment of how much a particular task is generating mental workload on a user. This is necessary for understanding how those tasks, operations, and activities can be improvised and made better suited for the users so that they reduce the mental workload on the individual and the operators can use them with ease and less difficulty. However, a particular task can be gauged by a user as simple while for others it may be difficult. Understanding the complexity of a particular task can only be done on user level and we propose to do this by understanding the mental workload (MWL) generated on an operator while performing a task which requires processing a lot of information to get the task done. In this work, we have proposed an experimental setup which replicates modern day workload on doing regular day job tasks. We propose an approach to automatically evaluate the task complexity perceived by an individual by using electroencephalogram (EEG) data of a user during operation. Few crucial steps that are addressed in this work include extraction and optimization of different features and selection of relevant features for dimensionality reduction and using supervised machine learning techniques. In addition to this, performance results of the classifiers are compared using all features and also using only the selected features. From the results, it can be inferred that machine learning algorithms perform better as compared to traditional approaches for mental workload estimation.


title: A Critique of the Asymptotic Safety Program

abstract: The present practice of Asymptotic Safety in gravity is in conflict with explicit calculations in low energy quantum gravity. This raises the question of whether the present practice meets the Weinberg condition for Asymptotic Safety. I argue, with examples, that the running of $\Lambda$ and $G$ found in Asymptotic Safety are not realized in the real world, with reasons which are relatively simple to understand. A comparison/contrast with quadratic gravity is also given, which suggests a few obstacles that must be overcome before the Lorentzian version of the theory is well behaved. I make a suggestion on how a Lorentzian version of Asymptotic Safety could potentially solve these problems.


title: Observation of optical absorption correlated with surface state of topological insulator

abstract: We performed broadband optical transmission measurements of Bi2Se3 and In-doped Bi(1-x)In(x)2Se3 thin films, where in the latter the spin-orbit coupling (SOC) strength can be tuned by introducing In. Drude and interband transitions exhibit In-dependent changes that are consistent with evolution from metallic (x=0) to insulating (x=1) nature of the end compounds. Most notably, an optical absorption peak located at hw=1eV in Bi2Se3 is completely quenched at x=0.06, the critical concentration where the phase transition from TI into non-TI takes place. For this x, the surface state (SS) is vanished from the band structure as well. The correlation between the 1eV optical peak and the SS in the x-dependences suggests that the peak is associated with the SS. We further show that when Bi2Se3 is electrically gated, the 1eV-peak becomes stronger(weaker) when electron is depleted from (accumulated into) the SS. These observations combined together demonstrate that under the hw=1eV illumination electron is excited from a bulk band into the topological surface band of Bi2Se3. The optical population of surface band is of significant importance not only for fundamental study but also for TI-based optoelectronic device application.


title: BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performance

abstract: If the same neural network architecture is trained multiple times on the same dataset, will it make similar linguistic generalizations across runs? To study this question, we fine-tuned 100 instances of BERT on the Multi-genre Natural Language Inference (MNLI) dataset and evaluated them on the HANS dataset, which evaluates syntactic generalization in natural language inference. On the MNLI development set, the behavior of all instances was remarkably consistent, with accuracy ranging between 83.6% and 84.8%. In stark contrast, the same models varied widely in their generalization performance. For example, on the simple case of subject-object swap (e.g., determining that "the doctor visited the lawyer" does not entail "the lawyer visited the doctor"), accuracy ranged from 0.00% to 66.2%. Such variation is likely due to the presence of many local minima that are equally attractive to a low-bias learner such as a neural network; decreasing the variability may therefore require models with stronger inductive biases.


title: SENSE: Semantically Enhanced Node Sequence Embedding

abstract: Effectively capturing graph node sequences in the form of vector embeddings is critical to many applications. We achieve this by (i) first learning vector embeddings of single graph nodes and (ii) then composing them to compactly represent node sequences. Specifically, we propose SENSE-S (Semantically Enhanced Node Sequence Embedding - for Single nodes), a skip-gram based novel embedding mechanism, for single graph nodes that co-learns graph structure as well as their textual descriptions. We demonstrate that SENSE-S vectors increase the accuracy of multi-label classification tasks by up to 50% and link-prediction tasks by up to 78% under a variety of scenarios using real datasets. Based on SENSE-S, we next propose generic SENSE to compute composite vectors that represent a sequence of nodes, where preserving the node order is important. We prove that this approach is efficient in embedding node sequences, and our experiments on real data confirm its high accuracy in node order decoding.


title: Probing Contextualized Sentence Representations with Visual Awareness

abstract: We present a universal framework to model contextualized sentence representations with visual awareness that is motivated to overcome the shortcomings of the multimodal parallel data with manual annotations. For each sentence, we first retrieve a diversity of images from a shared cross-modal embedding space, which is pre-trained on a large-scale of text-image pairs. Then, the texts and images are respectively encoded by transformer encoder and convolutional neural network. The two sequences of representations are further fused by a simple and effective attention layer. The architecture can be easily applied to text-only natural language processing tasks without manually annotating multimodal parallel corpora. We apply the proposed method on three tasks, including neural machine translation, natural language inference and sequence labeling and experimental results verify the effectiveness.


title: Blockwise Self-Attention for Long Document Understanding

abstract: We present BlockBERT, a lightweight and efficient BERT model for better modeling long-distance dependencies. Our model extends BERT by introducing sparse block structures into the attention matrix to reduce both memory consumption and training/inference time, which also enables attention heads to capture either short- or long-range contextual information. We conduct experiments on language model pre-training and several benchmark question answering datasets with various paragraph lengths. BlockBERT uses 18.7-36.1% less memory and 12.0-25.1% less time to learn the model. During testing, BlockBERT saves 27.8% inference time, while having comparable and sometimes better prediction accuracy, compared to an advanced BERT-based model, RoBERTa.


title: Picard theorems for moduli spaces of polarized varieties

abstract: As a result of our study of the hyperbolicity of the moduli space of polarized manifold, we give a general big Picard theorem for a holomorphic curve on a log-smooth pair $(X,D)$ such that $W=X\setminus D$ admits a Finsler pseudometric that is strongly negatively curved when pulled back to the curve. We show, by some refinements of the classical Viehweg-Zuo construction, that this latter condition holds for the base space $W$, if nonsingular, of any algebraic family of polarized complex projective manifolds with semi-ample canonical bundles whose induced moduli map $\phi$ to the moduli space of such manifolds is generically finite and any $\phi$-horizontal holomorphic curve in $W$. This yields the big Picard theorem for any holomorphic curves in the base space $U$ of such an algebraic family by allowing this base space to be singular but with generically finite moduli map. An immediate and useful corollary is that any holomorphic map from an algebraic variety to such a base space $U$ must be algebraic, i.e., the corresponding holomorphic family must be algebraic. We also show the related algebraic hyperbolicity property of such a base space $U$, which generalizes previous Arakelov inequalities and weak boundedness results for moduli stacks and offers, in addition to the Picard theorem above, another evidence in favor of the hyperbolic embeddability of such an $U$.