title: Program Enhanced Fact Verification with Verbalization and Graph Attention Network

abstract: Performing fact verification based on structured data is important for many real-life applications and is a challenging research problem, particularly when it involves both symbolic operations and informal inference based on language understanding. In this paper, we present a Program-enhanced Verbalization and Graph Attention Network (ProgVGAT) to integrate programs and execution into textual inference models. Specifically, a verbalization with program execution model is proposed to accumulate evidences that are embedded in operations over the tables. Built on that, we construct the graph attention verification networks, which are designed to fuse different sources of evidences from verbalized program execution, program structures, and the original statements and tables, to make the final verification decision. To support the above framework, we propose a program selection module optimized with a new training strategy based on margin loss, to produce more accurate programs, which is shown to be effective in enhancing the final verification results. Experimental results show that the proposed framework achieves the new state-of-the-art performance, a 74.4% accuracy, on the benchmark dataset TABFACT.


title: Homogeneous open quantum walks on the line: criteria for site recurrence and absorption

abstract: In this work, we study open quantum random walks, as described by S. Attal et al. These objects are given in terms of completely positive maps acting on trace-class operators, leading to one of the simplest open quantum versions of the recurrence problem for classical, discrete-time random walks. This work focuses on obtaining criteria for site recurrence of nearest-neighbor, homogeneous walks on the integer line, with the description presented here making use of recent results of the theory of open walks, most particularly regarding reducibility properties of the operators involved. This allows us to obtain a complete criterion for site recurrence in the case for which the internal degree of freedom of each site (coin space) is of dimension 2. We also present the analogous result for irreducible walks with an internal degree of arbitrary finite dimension and the absorption problem for walks on the semi-infinite line.


title: The Monodromy problem for hyperelliptic curves

abstract: We study the Dynkin diagram associated to the monodromy of direct sums of polynomials. The monodromy problem asks under which conditions on a polynomial, the monodromy of a vanishing cycle generates the whole homology of a regular fiber. We consider the case $y^4+g(x)$, which is a generalization of the results of Christopher and Marde$\check{s}$i\'c about the monodromy problem for hyperelliptic curves. Moreover, We solve the monodromy problem for direct sums of fourth degree polynomials.


title: Frustrated Self-Assembly of Non-Euclidean Crystals of Nanoparticles

abstract: Self-organized complex structures in nature, e.g. viral capsids, hierarchical biopolymers, and bacterial flagella, offer efficiency, adaptability, robustness, and multi-functionality. Can we program the self-assembly of three-dimensional (3D) complex structures with simple building blocks, and reach similar or higher level of sophistication in engineered materials? Here we present an analytic theory of tetrahedral nanoparticles (NPs) self-assembling in 3D space, where unavoidable geometrical frustration combined with competing attractive and repulsive inter-particle interactions lead to controllable, high-yield, and enantiopure self-assembly of helicoidal ribbons. This theory, based on crystal structures in non-Euclidean space, predicts morphologies that exhibit qualitative agreement with experimental observations. We expect that this theory will offer a general framework for the self-assembly of simple polyhedral building blocks into complex morphologies with new material capabilities such as tunable optical activity, essential for multiple emerging technologies.


title: Is the Best Better? Bayesian Statistical Model Comparison for Natural Language Processing

abstract: Recent work raises concerns about the use of standard splits to compare natural language processing models. We propose a Bayesian statistical model comparison technique which uses k-fold cross-validation across multiple data sets to estimate the likelihood that one model will outperform the other, or that the two will produce practically equivalent results. We use this technique to rank six English part-of-speech taggers across two data sets and three evaluation metrics.


title: Multi-plane lensing in wave optics

abstract: Wave effects in lensing form a rich phenomenon at the intersection of classical caustic singularities and quantum interference, yet are notoriously difficult to model. A large number of recently observed pulsars and fast radio bursts in radio astronomy and the prospected increase in sensitivity of gravitational wave detectors suggest that wave effects will likely be observed in the near future. The interference fringes are sensitive to physical parameters which cannot be inferred from geometric optics. In particular, for multi-plane lensing, the pattern depends on the redshifts of the lens planes. I present a new method to define and efficiently evaluate multi-plane lensing of coherent electromagnetic waves by plasmas and gravitational lenses in polynomial time. This method will allow the use of radio and gravitational wave sources to probe our universe in novel ways.


title: Validating UTF-8 In Less Than One Instruction Per Byte

abstract: The majority of text is stored in UTF-8, which must be validated on ingestion. We present the lookup algorithm, which outperforms UTF-8 validation routines used in many libraries and languages by more than 10 times using commonly available SIMD instructions. To ensure reproducibility, our work is freely available as open source software.


title: Clustering-based Joint Channel Estimation and Signal Detection for Grant-free NOMA

abstract: We propose a joint channel estimation and signal detection technique for the uplink non-orthogonal multiple access using an unsupervised clustering approach. We apply the Gaussian mixture model to cluster received signals and accordingly optimize the decision regions to enhance the symbol error rate (SER). We show that when the received powers of the users are sufficiently different, the proposed clustering-based approach with no channel state information (CSI) at the receiver achieves an SER performance similar to that of the conventional maximum likelihood detector with full CSI. Since the accuracy of the utilized clustering algorithm depends on the number of the data points available at the receiver, the proposed technique delivers a tradeoff between the accuracy and block length.


title: A time-dependent density functional theory protocol for resonant inelastic X-ray scattering calculations

abstract: We present a time-dependent density functional theory (TDDFT) based approach to compute the light-matter couplings between two different manifolds of excited states relative to a common ground state. These quantities are the necessary ingredients to solve the Kramers--Heisenberg equation for resonant inelastic X-ray scattering (RIXS) and several other types of two-photon spectroscopies. The procedure is based on the pseudo-wavefunction approach, where TDDFT eigenstates are treated as a configuration interaction wavefunction with single excitations, and on the restricted energy window approach, where a manifold of excited states can be rigorously defined based on the energies of the occupied molecular orbitals involved in the excitation process. We illustrate the applicability of the method by calculating the 2p4d RIXS maps of three representative Ruthenium complexes and comparing them to experimental results. The method is able to accurately capture all the experimental features in all three complexes, with relative energies correct to within 0.6 eV at the cost of two independent TDDFT calculations.


title: WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization

abstract: We introduce WikiLingua, a large-scale, multilingual dataset for the evaluation of crosslingual abstractive summarization systems. We extract article and summary pairs in 18 languages from WikiHow, a high quality, collaborative resource of how-to guides on a diverse set of topics written by human authors. We create gold-standard article-summary alignments across languages by aligning the images that are used to describe each how-to step in an article. As a set of baselines for further studies, we evaluate the performance of existing cross-lingual abstractive summarization methods on our dataset. We further propose a method for direct crosslingual summarization (i.e., without requiring translation at inference time) by leveraging synthetic data and Neural Machine Translation as a pre-training step. Our method significantly outperforms the baseline approaches, while being more cost efficient during inference.


title: Correlated Differential Privacy: Feature Selection in Machine Learning

abstract: Privacy preserving in machine learning is a crucial issue in industry informatics since data used for training in industries usually contain sensitive information. Existing differentially private machine learning algorithms have not considered the impact of data correlation, which may lead to more privacy leakage than expected in industrial applications. For example, data collected for traffic monitoring may contain some correlated records due to temporal correlation or user correlation. To fill this gap, we propose a correlation reduction scheme with differentially private feature selection considering the issue of privacy loss when data have correlation in machine learning tasks. %The key to the proposed scheme is to describe the data correlation and select features which leads to less data correlation across the whole dataset. The proposed scheme involves five steps with the goal of managing the extent of data correlation, preserving the privacy, and supporting accuracy in the prediction results. In this way, the impact of data correlation is relieved with the proposed feature selection scheme, and moreover, the privacy issue of data correlation in learning is guaranteed. The proposed method can be widely used in machine learning algorithms which provide services in industrial areas. Experiments show that the proposed scheme can produce better prediction results with machine learning tasks and fewer mean square errors for data queries compared to existing schemes.


title: Gradient-based Causal Structure Learning with Normalizing Flow

abstract: In this paper, we propose a score-based normalizing flow method called DAG-NF to learn dependencies of input observation data. Inspired by Grad-CAM in computer vision, we use jacobian matrix of output on input as causal relationships and this method can be generalized to any neural networks especially for flow-based generative neural networks such as Masked Autoregressive Flow(MAF) and Continuous Normalizing Flow(CNF) which compute the log likelihood loss and divergence of distribution of input data and target distribution. This method extends NOTEARS which enforces a important acylicity constraint on continuous adjacency matrix of graph nodes and significantly reduce the computational complexity of search space of graph.


title: Knowledge-aware Method for Confusing Charge Prediction

abstract: Automatic charge prediction task aims to determine the final charges based on fact descriptions of criminal cases, which is a vital application of legal assistant systems. Conventional works usually depend on fact descriptions to predict charges while ignoring the legal schematic knowledge, which makes it difficult to distinguish confusing charges. In this paper, we propose a knowledge-attentive neural network model, which introduces legal schematic knowledge about charges and exploit the knowledge hierarchical representation as the discriminative features to differentiate confusing charges. Our model takes the textual fact description as the input and learns fact representation through a graph convolutional network. A legal schematic knowledge transformer is utilized to generate crucial knowledge representations oriented to the legal schematic knowledge at both the schema and charge levels. We apply a knowledge matching network for effectively incorporating charge information into the fact to learn knowledge-aware fact representation. Finally, we use the knowledge-aware fact representation for charge prediction. We create two real-world datasets and experimental results show that our proposed model can outperform other state-of-the-art baselines on accuracy and F1 score, especially on dealing with confusing charges.


title: Time-dependent SI model for epidemiology and applications to Covid-19

abstract: A generalisation of the Susceptible-Infectious model is made to include a time-dependent transmission rate, which leads to a close analytical expression in terms of a logistic function. The solution can be applied to any continuous function chosen to describe the evolution of the transmission rate with time. Taking inspiration from real data of the Covid-19, for the case of cumulative confirmed positives and deaths, we propose an exponentially decaying transmission rate with two free parameters, one for its initial amplitude and another one for its decaying rate. The resultant time-dependent SI model, which under extra conditions recovers the standard Gompertz functional form, is then compared with data from selected countries and its parameters fit using Bayesian inference. We make predictions about the asymptotic number of confirmed positives and deaths, and discuss the possible evolution of the disease in each country in terms of our parametrisation of the transmission rate.


title: Free Space Optics for Next-Generation Satellite Networks

abstract: Free space optics (FSO) refers to optical wireless communications in outdoor environments. The aim of this paper is to analyze the role that FSO is envisaged to play in the creation of next-generation satellite networks. To begin with, the reader is introduced to the types of FSO links and functionalities of a basic FSO system. Next, a comparison of FSO and radio frequency (RF) technologies for inter-satellite links (ISLs) is provided, including a comparison between FSO and RF links when employed between low Earth orbit satellites. After that, the types of FSO or laser ISLs are considered, and the challenges in establishing laser ISLs, the properties of laser ISLs, and the capabilities of terminals for laser ISLs are discussed. Then, the parameters of a satellite constellation are highlighted, and different aspects of SpaceX's upcoming mega-constellation Starlink are explored. In addition, the optical wireless satellite network that is created by utilizing laser ISLs is examined. Finally, a use case is investigated for next-generation optical wireless satellite networks that are envisioned by the mid to late 2020s.


title: DiPair: Fast and Accurate Distillation for Trillion-Scale Text Matching and Pair Modeling

abstract: Pre-trained models like BERT (Devlin et al., 2018) have dominated NLP / IR applications such as single sentence classification, text pair classification, and question answering. However, deploying these models in real systems is highly non-trivial due to their exorbitant computational costs. A common remedy to this is knowledge distillation (Hinton et al., 2015), leading to faster inference. However -- as we show here -- existing works are not optimized for dealing with pairs (or tuples) of texts. Consequently, they are either not scalable or demonstrate subpar performance. In this work, we propose DiPair -- a novel framework for distilling fast and accurate models on text pair tasks. Coupled with an end-to-end training strategy, DiPair is both highly scalable and offers improved quality-speed tradeoffs. Empirical studies conducted on both academic and real-world e-commerce benchmarks demonstrate the efficacy of the proposed approach with speedups of over 350x and minimal quality drop relative to the cross-attention teacher BERT model.


title: On $n$-slice Algebras and Related Algebras

abstract: The $n$-slice algebra is introduced as a generalization of path algebra in higher dimensional representation theory. In this paper, we give a classification of $n$-slice algebras via their $(n+1)$-preprojective algebras and the trivial extensions of their quadratic duals. One can always relate tame $n$-slice algebras to the McKay quiver of a finite subgroup of $\mathrm{GL}(n+1, \mathbb C)$. In the case of $n=2$, we describe the relations for the $2$-slice algebras related to the McKay quiver of finite Abelian subgroups of $\mathrm{SL}(3, \mathbb C)$ and of the finite subgroups obtained from embedding $\mathrm{SL}(2, \mathbb C)$ into $\mathrm{SL}(3,\mathbb C)$.


title: Dilepton production through timelike Compton scattering within the $k_T$-factorization approach

abstract: In this work we consider the dilepton production via timelike Compton scattering (TCS) in electron-proton and proton-proton collisions. In particular, the differential cross section in terms of the dilepton invariant mass and rapidity is computed within the $k_T$-factorization approach. Besides, we utilize distinct unintegrated gluon distributions (UGD) in order to compare their impact on the differential cross section of TCS in $pp$ ($ep$) collisions evaluated at the LHC (LHeC), HL-LHC (LHeC), HE-LHC (LHeC) and FCC-hh (eh) center-of-mass energies.


title: Blow-up formulae for twisted cohomologies with supports

abstract: We study twisted cohomologies with paracompactifying families of supports. The Kunneth theorems, Leray-Hirsch theorems and self-intersection formulae are established. Based on these results, we eventually give explicit expressions of complex blow-up formulae for twisted Dolbeault cohomology on arbitrary complex manifolds and the ones of generalized blow-ups formulae for twisted de Rham cohomology on arbitrary oriented smooth manifolds. These expressions are induced by the morphisms of (simple or double) complexes of spaces of forms and currents rather than just the maps between cohomologies, which help us to obtain the corresponding results for twisted Bott-Chern, Aeppli cohomologies and hypercohomologies of truncated twisted holomorphic de Rham complexes.


title: On optimal recovery in $L_2$

abstract: We prove that the optimal error of recovery in the $L_2$ norm of functions from a class $\bF$ can be bounded above by the value of the Kolmogorov width of $\bF$ in the uniform norm. We demonstrate on a number of examples of $\bF$ from classes of functions with mixed smoothness that the obtained inequality provides a powerful tool for estimating errors of optimal recovery.


title: Instance-Dependent Complexity of Contextual Bandits and Reinforcement Learning: A Disagreement-Based Perspective

abstract: In the classical multi-armed bandit problem, instance-dependent algorithms attain improved performance on "easy" problems with a gap between the best and second-best arm. Are similar guarantees possible for contextual bandits? While positive results are known for certain special cases, there is no general theory characterizing when and how instance-dependent regret bounds for contextual bandits can be achieved for rich, general classes of policies. We introduce a family of complexity measures that are both sufficient and necessary to obtain instance-dependent regret bounds. We then introduce new oracle-efficient algorithms which adapt to the gap whenever possible, while also attaining the minimax rate in the worst case. Finally, we provide structural results that tie together a number of complexity measures previously proposed throughout contextual bandits, reinforcement learning, and active learning and elucidate their role in determining the optimal instance-dependent regret. In a large-scale empirical evaluation, we find that our approach often gives superior results for challenging exploration problems. Turning our focus to reinforcement learning with function approximation, we develop new oracle-efficient algorithms for reinforcement learning with rich observations that obtain optimal gap-dependent sample complexity.


title: An Improvement of Reed's Treewidth Approximation

abstract: We present a new approximation algorithm for the treewidth problem which finds an upper bound on the treewidth and constructs a corresponding tree decomposition as well. Our algorithm is a faster variation of Reed's classical algorithm. For the benefit of the reader, and to be able to compare these two algorithms, we start with a detailed time analysis of Reed's algorithm. We fill in many details that have been omitted in Reed's paper. Computing tree decompositions parameterized by the treewidth $k$ is fixed parameter tractable (FPT), meaning that there are algorithms running in time $\mathcal{O}(f(k) g(n))$ where $f$ is a computable function, and $g(n)$ is polynomial in $n$, where $n$ is the number of vertices. An analysis of Reed's algorithm shows $f(k) = 2^{\mathcal{O}(k \log k)}$ and $g(n) = n \log n$ for a 5-approximation. Reed simply claims time $\mathcal{O}(n \log n)$ for bounded $k$ for his constant factor approximation algorithm, but the bound of $2^{\Omega(k \log k)} n \log n$ is well known. From a practical point of view, we notice that the time of Reed's algorithm also contains a term of $\mathcal{O}(k^2 2^{24k} n \log n)$, which for small $k$ is much worse than the asymptotically leading term of $2^{\mathcal{O}(k \log k)} n \log n$. We analyze $f(k)$ more precisely, because the purpose of this paper is to improve the running times for all reasonably small values of $k$. Our algorithm runs in $\mathcal{O}(f(k)n\log{n})$ too, but with a much smaller dependence on $k$. In our case, $f(k) = 2^{\mathcal{O}(k)}$. This algorithm is simple and fast, especially for small values of $k$. We should mention that Bodlaender et al. [2016] have an algorithm with a linear dependence on $n$, and Korhonen [2021] obtains the much better approximation ratio of 2, while the current paper achieves a better dependence on $k$.


title: Structured Logconcave Sampling with a Restricted Gaussian Oracle

abstract: We give algorithms for sampling several structured logconcave families to high accuracy. We further develop a reduction framework, inspired by proximal point methods in convex optimization, which bootstraps samplers for regularized densities to improve dependences on problem conditioning. A key ingredient in our framework is the notion of a "restricted Gaussian oracle" (RGO) for $g: \mathbb{R}^d \rightarrow \mathbb{R}$, which is a sampler for distributions whose negative log-likelihood sums a quadratic and $g$. By combining our reduction framework with our new samplers, we obtain the following bounds for sampling structured distributions to total variation distance $\epsilon$. For composite densities $\exp(-f(x) - g(x))$, where $f$ has condition number $\kappa$ and convex (but possibly non-smooth) $g$ admits an RGO, we obtain a mixing time of $O(\kappa d \log^3\frac{\kappa d}{\epsilon})$, matching the state-of-the-art non-composite bound; no composite samplers with better mixing than general-purpose logconcave samplers were previously known. For logconcave finite sums $\exp(-F(x))$, where $F(x) = \frac{1}{n}\sum_{i \in [n]} f_i(x)$ has condition number $\kappa$, we give a sampler querying $\widetilde{O}(n + \kappa\max(d, \sqrt{nd}))$ gradient oracles to $\{f_i\}_{i \in [n]}$; no high-accuracy samplers with nontrivial gradient query complexity were previously known. For densities with condition number $\kappa$, we give an algorithm obtaining mixing time $O(\kappa d \log^2\frac{\kappa d}{\epsilon})$, improving the prior state-of-the-art by a logarithmic factor with a significantly simpler analysis; we also show a zeroth-order algorithm attains the same query complexity.


title: The anisotropic quasi-static permittivity of single-crystal beta-Ga2O3

abstract: The quasi-static anisotropic permittivity parameters of electrically insulating gallium oxide (beta-Ga2O3) were determined by terahertz spectroscopy. Polarization-resolved frequency domain spectroscopy in the spectral range from 200 GHz to 1 THz was carried out on bulk crystals along different orientations. Principal directions for permittivity were determined along crystallographic axes c, and b, and reciprocal lattice direction a*. No significant frequency dispersion in the real part of dielectric permittivity was observed in the measured spectral range. Our results are in excellent agreement with recent radio-frequency capacitance measurements as well as with extrapolations from recent infrared measurements of phonon mode and high frequency contributions, and close the knowledge gap for these parameters in the terahertz spectral range. Our results are important for applications of beta-Ga2O3 in high-frequency electronic devices


title: Channel Recurrent Attention Networks for Video Pedestrian Retrieval

abstract: Full attention, which generates an attention value per element of the input feature maps, has been successfully demonstrated to be beneficial in visual tasks. In this work, we propose a fully attentional network, termed {\it channel recurrent attention network}, for the task of video pedestrian retrieval. The main attention unit, \textit{channel recurrent attention}, identifies attention maps at the frame level by jointly leveraging spatial and channel patterns via a recurrent neural network. This channel recurrent attention is designed to build a global receptive field by recurrently receiving and learning the spatial vectors. Then, a \textit{set aggregation} cell is employed to generate a compact video representation. Empirical experimental results demonstrate the superior performance of the proposed deep network, outperforming current state-of-the-art results across standard video person retrieval benchmarks, and a thorough ablation study shows the effectiveness of the proposed units.


title: Calibrating microscopic car following models for adaptive cruise control vehicles: a multi-objective approach

abstract: Adaptive cruise control (ACC) vehicles are the first step toward comprehensive vehicle automation. However, the impacts of such vehicles on the underlying traffic flow are not yet clear. Therefore, it is of interest to accurately model vehicle-level dynamics of commercially available ACC vehicles so that they may be used in further modeling efforts to quantify the impact of commercially available ACC vehicles on traffic flow. Importantly, not only model selection but also the calibration approach and error metric used for calibration are critical to accurately model ACC vehicle behavior. In this work, we explore the question of how to calibrate car following models to describe ACC vehicle dynamics. Specifically, we apply a multi-objective calibration approach to understand the tradeoff between calibrating model parameters to minimize speed error vs. spacing error. Three different car-following models are calibrated for data from six vehicles. The results are in line with recent literature and verify that targeting a low spacing error does not compromise the speed accuracy whether the opposite is not true for modeling ACC vehicle dynamics.


title: Causal Curiosity: RL Agents Discovering Self-supervised Experiments for Causal Representation Learning

abstract: Animals exhibit an innate ability to learn regularities of the world through interaction. By performing experiments in their environment, they are able to discern the causal factors of variation and infer how they affect the world's dynamics. Inspired by this, we attempt to equip reinforcement learning agents with the ability to perform experiments that facilitate a categorization of the rolled-out trajectories, and to subsequently infer the causal factors of the environment in a hierarchical manner. We introduce {\em causal curiosity}, a novel intrinsic reward, and show that it allows our agents to learn optimal sequences of actions and discover causal factors in the dynamics of the environment. The learned behavior allows the agents to infer a binary quantized representation for the ground-truth causal factors in every environment. Additionally, we find that these experimental behaviors are semantically meaningful (e.g., our agents learn to lift blocks to categorize them by weight), and are learnt in a self-supervised manner with approximately 2.5 times less data than conventional supervised planners. We show that these behaviors can be re-purposed and fine-tuned (e.g., from lifting to pushing or other downstream tasks). Finally, we show that the knowledge of causal factor representations aids zero-shot learning for more complex tasks. Visit https://sites.google.com/usc.edu/causal-curiosity/home for website.


title: Bayesian Distance Weighted Discrimination

abstract: Distance weighted discrimination (DWD) is a linear discrimination method that is particularly well-suited for classification tasks with high-dimensional data. The DWD coefficients minimize an intuitive objective function, which can solved very efficiently using state-of-the-art optimization techniques. However, DWD has not yet been cast into a model-based framework for statistical inference. In this article we show that DWD identifies the mode of a proper Bayesian posterior distribution, that results from a particular link function for the class probabilities and a shrinkage-inducing proper prior distribution on the coefficients. We describe a relatively efficient Markov chain Monte Carlo (MCMC) algorithm to simulate from the true posterior under this Bayesian framework. We show that the posterior is asymptotically normal and derive the mean and covariance matrix of its limiting distribution. Through several simulation studies and an application to breast cancer genomics we demonstrate how the Bayesian approach to DWD can be used to (1) compute well-calibrated posterior class probabilities, (2) assess uncertainty in the DWD coefficients and resulting sample scores, (3) improve power via semi-supervised analysis when not all class labels are available, and (4) automatically determine a penalty tuning parameter within the model-based framework. R code to perform Bayesian DWD is available at https://github.com/lockEF/BayesianDWD .


title: Diffusion of Fractal Particles in a Fractal Fluid

abstract: Anomalous short- and long-time self-diffusion of non-overlapping fractal particles on a percolation cluster with spreading dimension $1.67(2)$ is studied by dynamic Monte Carlo simulations. As reported in Phys. Rev. Lett. 115, 097801 (2015), the disordered phase formed by these particles is that of an unconfined, homogeneous and monodisperse fluid in fractal space. During particle diffusion in thermodynamic equilibrium, the mean squared chemical displacement increases as a nonlinear power of time, with an exponent of $0.96(1)$ at short times and $0.63(1)$ at long times. At finite packing fractions the steric hindrance among nearest neighbor particles leads to a sub-diffusive regime that separates short-time anomalous diffusion from long-time anomalous diffusion. Particle localization is observed over eight decades in time for packing fractions of $\sim 60\%$ and higher.


title: Apparent Ferromagnetism in Exfoliated Ultra-thin Pyrite Sheets

abstract: Experimental evidence for ferromagnetic ordering in isotropic atomically thin two-dimensional crystals has been missing until a bilayer Cr2Ge2Te6, and a three-atom thick monolayer CrI3 are shown to retain ferromagnetic ordering at finite temperatures. Here, we demonstrate successful isolation of a non-van der Waals type ultra-thin nanosheet of FeS2 derived from naturally occurring pyrite mineral (FeS2) by means of liquid-phase exfoliation. Structural characterizations imply that (111) oriented sheets are predominant and is supported theoretically by means of density functional theory surface energy calculations. Spin-polarized density theory calculations further predicted that (111) oriented three-atom thick pyrite sheet has a stable ferromagnetic ground state different from its diamagnetic bulk counterpart. This theoretical finding is evaluated experimentally employing low temperature superconducting quantum interference device measurements and observed an anomalous ferromagnetic kind of behavior.


title: HIV-prevalence mapping using Small Area Estimation in Kenya, Tanzania, and Mozambique at the first sub-national level

abstract: Local estimates of HIV-prevalence provide information that can be used to target interventions and consequently increase the efficiency of the resources. This closer-to-optimal allocation can lead to better health outcomes, including the control of the disease spread, and for more people. Producing reliable estimates at smaller geographical levels can be challenging and careful consideration of the nature of the data and the epidemiologic rational is needed. In this paper, we use the DHS data phase V to estimate HIV prevalence at the first-subnational level in Kenya, Tanzania, and Mozambique. We fit the data to a spatial random effect intrinsic conditional autoregressive (ICAR) model to smooth the outcome. We also use a sampling specification from a multistage cluster design. We found that Nyanza (P=14.2%) and Nairobi (P=7.8%) in Kenya, Iringa (P=16.2%) and Dar es Salaam (P=10.1%) in Tanzania, and Gaza (P=13.7%) and Maputo City (P=12.7%) in Mozambique are the regions with the highest prevalence of HIV, within country. Our results are based on statistically rigorous methods that allowed us to obtain an accurate visual representation of the HIV prevalence in the subset of African countries we chose. These results can help in identification and targeting of high-prevalent regions to increase the supply of healthcare services to reduce the spread of the disease and increase the health quality of people living with HIV.


title: SLCRF: Subspace Learning with Conditional Random Field for Hyperspectral Image Classification

abstract: Subspace learning (SL) plays an important role in hyperspectral image (HSI) classification, since it can provide an effective solution to reduce the redundant information in the image pixels of HSIs. Previous works about SL aim to improve the accuracy of HSI recognition. Using a large number of labeled samples, related methods can train the parameters of the proposed solutions to obtain better representations of HSI pixels. However, the data instances may not be sufficient enough to learn a precise model for HSI classification in real applications. Moreover, it is well-known that it takes much time, labor and human expertise to label HSI images. To avoid the aforementioned problems, a novel SL method that includes the probability assumption called subspace learning with conditional random field (SLCRF) is developed. In SLCRF, first, the 3D convolutional autoencoder (3DCAE) is introduced to remove the redundant information in HSI pixels. In addition, the relationships are also constructed using the spectral-spatial information among the adjacent pixels. Then, the conditional random field (CRF) framework can be constructed and further embedded into the HSI SL procedure with the semi-supervised approach. Through the linearized alternating direction method termed LADMAP, the objective function of SLCRF is optimized using a defined iterative algorithm. The proposed method is comprehensively evaluated using the challenging public HSI datasets. We can achieve stateof-the-art performance using these HSI sets.


title: DML-GANR: Deep Metric Learning With Generative Adversarial Network Regularization for High Spatial Resolution Remote Sensing Image Retrieval

abstract: With a small number of labeled samples for training, it can save considerable manpower and material resources, especially when the amount of high spatial resolution remote sensing images (HSR-RSIs) increases considerably. However, many deep models face the problem of overfitting when using a small number of labeled samples. This might degrade HSRRSI retrieval accuracy. Aiming at obtaining more accurate HSR-RSI retrieval performance with small training samples, we develop a deep metric learning approach with generative adversarial network regularization (DML-GANR) for HSR-RSI retrieval. The DML-GANR starts from a high-level feature extraction (HFE) to extract high-level features, which includes convolutional layers and fully connected (FC) layers. Each of the FC layers is constructed by deep metric learning (DML) to maximize the interclass variations and minimize the intraclass variations. The generative adversarial network (GAN) is adopted to mitigate the overfitting problem and validate the qualities of extracted high-level features. DML-GANR is optimized through a customized approach, and the optimal parameters are obtained. The experimental results on the three data sets demonstrate the superior performance of DML-GANR over state-of-the-art techniques in HSR-RSI retrieval.


title: Boundary and rigidity of nonsingular Bernoulli actions

abstract: Let $ G $ be a countable discrete group and consider a nonsingular Bernoulli shift action $ G \curvearrowright \prod_{g\in G }(\{0,1\},\mu_g)$ with two base points. When $ G $ is exact, under a certain finiteness assumption on the measures $\{\mu_g\}_{g\in G }$, we construct a boundary for the Bernoulli crossed product C$^*$-algebra that admits some commutativity and amenability in the sense of Ozawa's bi-exactness. As a consequence, we obtain that any such Bernoulli action is solid. This generalizes solidity of measure preserving Bernoulli actions by Ozawa and Chifan--Ioana, and is the first rigidity result in the non measure preserving case. For the proof, we use anti-symmetric Fock spaces and left creation operators to construct the boundary and therefore the assumption of having two base points is crucial.


title: Driving Behavior Modeling using Naturalistic Human Driving Data with Inverse Reinforcement Learning

abstract: Driving behavior modeling is of great importance for designing safe, smart, and personalized autonomous driving systems. In this paper, an internal reward function-based driving model that emulates the human's decision-making mechanism is utilized. To infer the reward function parameters from naturalistic human driving data, we propose a structural assumption about human driving behavior that focuses on discrete latent driving intentions. It converts the continuous behavior modeling problem to a discrete setting and thus makes maximum entropy inverse reinforcement learning (IRL) tractable to learn reward functions. Specifically, a polynomial trajectory sampler is adopted to generate candidate trajectories considering high-level intentions and approximate the partition function in the maximum entropy IRL framework. An environment model considering interactive behaviors among the ego and surrounding vehicles is built to better estimate the generated trajectories. The proposed method is applied to learn personalized reward functions for individual human drivers from the NGSIM highway driving dataset. The qualitative results demonstrate that the learned reward functions are able to explicitly express the preferences of different drivers and interpret their decisions. The quantitative results reveal that the learned reward functions are robust, which is manifested by only a marginal decline in proximity to the human driving trajectories when applying the reward function in the testing conditions. For the testing performance, the personalized modeling method outperforms the general modeling approach, significantly reducing the modeling errors in human likeness (a custom metric to gauge accuracy), and these two methods deliver better results compared to other baseline methods.


title: A Gravitational non-Radiative Memory Effect

abstract: We revisit the issue of memory effects, i.e. effects giving rise to a net cumulative change of the configuration of test particles, using a toy model describing the emission of radiation by a compact source and focusing on the scalar, hence non-radiative, part of the Riemann curvature. Motivated by the well known fact that gravitational radiation is accompanied by a memory effect, i.e. a permanent displacement of the relative separation of test particles, present after radiation has passed, we investigate the existence of an analog effect in the non-radiative part of the gravitational field. While quadrupole and higher multipoles undergo oscillations responsible for gravitational radiation, energy, momentum and angular momentum are conserved charges undergoing non-oscillatory change due to radiation emission. We show how the source re-arrangement due to radiation emission produce time-dependent scalar potentials which induce a time variation in the scalar part of the Riemann curvature tensor. As a result, on general grounds a velocity memory effect appears, depending on the inverse of the square of the distance of the observer from the source, thus making it almost impossible to observe, as shown by comparison to the planned gravitational detector noise spectral densities.


title: The Independence of Distinguishability and the Dimension of the System

abstract: The are substantial studies on distinguishabilities, especially local distinguishability, of quantum states. It is shown that a necessary condition of a local distinguishable state set is the total Schmidt rank not larger than the system dimension. However, if we view states in a larger system, the restriction will be invalid. Hence, a nature problem is that can indistinguishable states become distinguishable by viewing them in a larger system without employing extra resources. In this paper, we consider this problem for (perfect or unambiguous) LOCC$_{1}$, PPT and SEP distinguishabilities. We demonstrate that if a set of states is indistinguishable in $\otimes _{k=1}^{K} C^{d _{k}}$, then it is indistinguishable even being viewed in $\otimes _{k=1}^{K} C^{d _{k}+h _{k}}$, where $K, d _{k}\geqslant2, h _{k}\geqslant0$ are integers. This shows that such distinguishabilities are properties of states themselves and independent of the dimension of quantum system. Our result gives the maximal numbers of LOCC$_{1}$ distinguishable states and can be employed to construct a LOCC indistinguishable product basis in general systems. Our result is suitable for general states in general systems. For further discussions, we define the local-global indistinguishable property and present a conjecture.


title: In how many distinct ways can flocks be formed? A problem in sheep combinatorics

abstract: In this short paper, we extend the concept of the strict order polynomial $\Omega_{P}^{\circ}(n)$, which enumerates the number of strict order-preserving maps $\phi:P\rightarrow\boldsymbol{n}$ for a poset $P$, to the extended strict order polynomial $\text{E}_{P}^{\circ}(n,z)$, which enumerates analogous maps for the elements of the power set $\mathcal{P}(P)$. The problem at hand immediately reduces to the problem of enumeration of linear extensions for the subposets of $P$. We show that for every $Q\subset P$ a given linear extension $v$ of $Q$ can be associated with a unique linear extension $w$ of $P$. The number of such linear extensions $v$ (of length $k$) associated with a given linear extension $w$ of $P$ can be expressed compactly as $\binom{\text{del}_{P}(w)}{k}$, where $\text{del}_{P}(w)$ is the number of deletable elements of $w$ defined in the text. Consequently the extended strict order polynomial $\text{E}_{P}^{\circ}(n,z)$ can be represented as $ \text{E}_{P}^{\circ}(n,z)=\sum_{w\in\mathcal{L}(P)}\sum_{k=0}^{p}\binom{\text{del}_{P}(w)}{p-k}\binom{n+\text{des}(w)}{k}z^{k}$. The derived equation can be used for example for solving the following combinatorial problem: Consider a community of $p$ shepherds, some of whom are connected by a master-apprentice relation (expressed as a poset $P$). Every morning, $k$ of the shepherds go out and each of them herds a flock of sheep. Community tradition stipulates that each of these $k$ shepherds will herd at least one and at most $n$ sheep, and an apprentice will always herd fewer sheep than his master (or his master's master, etc). In how many ways can the flocks be formed? The strict order polynomial answers this question for the case in which all $p$ shepherds go to work, and the extended strict order polynomial considers also all the situations in which some of the shepherds decide to take a day off.


title: A Fast and Effective Method of Macula Automatic Detection for Retina Images

abstract: Retina image processing is one of the crucial and popular topics of medical image processing. The macula fovea is responsible for sharp central vision, which is necessary for human behaviors where visual detail is of primary importance, such as reading, writing, driving, etc. This paper proposes a novel method to locate the macula through a series of morphological processing. On the premise of maintaining high accuracy, our approach is simpler and faster than others. Furthermore, for the hospital's real images, our method is also able to detect the macula robustly.


title: Effective mapping class group dynamics I: Counting lattice points in Teichm\"uller space

abstract: We prove a quantitative estimate with a power saving error term for the number of points in a mapping class group orbit of Teichm\"uller space that lie within a Teichm\"uller metric ball of given center and large radius. Estimates of the same kind are also proved for sector and bisector counts. These estimates effectivize asymptotic counting results of Athreya, Bufetov, Eskin, and Mirzakhani.


title: VCDM: Leveraging Variational Bi-encoding and Deep Contextualized Word Representations for Improved Definition Modeling

abstract: In this paper, we tackle the task of definition modeling, where the goal is to learn to generate definitions of words and phrases. Existing approaches for this task are discriminative, combining distributional and lexical semantics in an implicit rather than direct way. To tackle this issue we propose a generative model for the task, introducing a continuous latent variable to explicitly model the underlying relationship between a phrase used within a context and its definition. We rely on variational inference for estimation and leverage contextualized word embeddings for improved performance. Our approach is evaluated on four existing challenging benchmarks with the addition of two new datasets, "Cambridge" and the first non-English corpus "Robert", which we release to complement our empirical study. Our Variational Contextual Definition Modeler (VCDM) achieves state-of-the-art performance in terms of automatic and human evaluation metrics, demonstrating the effectiveness of our approach.


title: Quantum parity conservation in planar quantum electrodynamics

abstract: Quantum parity conservation is verified at all orders in perturbation theory for a massless parity-even $U(1)\times U(1)$ planar quantum electrodynamics (QED$_3$) model. The presence of two massless fermions requires the Lowenstein-Zimmermann (LZ) subtraction scheme, in the framework of the Bogoliubov-Parasiuk-Hepp-Zimmermann-Lowenstein (BPHZL) renormalization method, in order to subtract the infrared divergences induced by the ultraviolet subtractions at 1- and 2-loops, however thanks to the superrenormalizability of the model the ultraviolet divergences are bounded up to 2-loops. Finally, it is proved that the BPHZL renormalization method preserves parity for the model taken into consideration, contrary to what happens to the ordinary massless parity-even $U(1)$ QED$_3$.

categories: hep-th cond-mat.str-el hep-ph math-ph math.MP quant-ph


title: Index theory for traveling waves in reaction diffusion systems with skew gradient structure

abstract: A unified geometric approach for the stability analysis of traveling pulse solutions for reaction-diffusion equations with skew-gradient structure has been established in a previous paper [9], but essentially no results have been found in the case of traveling front solutions. In this work, we will bridge this gap. For such cases, a Maslov index of the traveling wave is well-defined, and we will show how it can be used to provide the spectral information of the waves. As an application, we use the same index providing the exact number of unstable eigenvalues of the traveling front solutions of FitzHugh-Nagumo equation.


title: A Linguistic Analysis of Visually Grounded Dialogues Based on Spatial Expressions

abstract: Recent models achieve promising results in visually grounded dialogues. However, existing datasets often contain undesirable biases and lack sophisticated linguistic analyses, which make it difficult to understand how well current models recognize their precise linguistic structures. To address this problem, we make two design choices: first, we focus on OneCommon Corpus \citep{udagawa2019natural,udagawa2020annotated}, a simple yet challenging common grounding dataset which contains minimal bias by design. Second, we analyze their linguistic structures based on \textit{spatial expressions} and provide comprehensive and reliable annotation for 600 dialogues. We show that our annotation captures important linguistic structures including predicate-argument structure, modification and ellipsis. In our experiments, we assess the model's understanding of these structures through reference resolution. We demonstrate that our annotation can reveal both the strengths and weaknesses of baseline models in essential levels of detail. Overall, we propose a novel framework and resource for investigating fine-grained language understanding in visually grounded dialogues.


title: Stability assessment of a tailings storage facility using a non-local constitutive model accounting for anisotropic strain-softening

abstract: Recent failures of upstream-raised tailings storage facilities (TSF) raised con-cerns on the future use of these dams. While being cost-effective, they entail higher risks than conventional dams, as stability largely relies on the strength of tailings, which are loose and normally-consolidated materials that may exhibit strain-softening during un-drained loading. Current design practice involves limit equilibrium analyses adopting a fully-softened shear strength; while being conservative, this practice neglects the work input required to start the softening process that leads to progressive failure. This paper describes the calibration and application of the NGI-ADPSoft constitutive model to evaluate the potential of static liquefaction of an upstream-raised TSF and provides an indirect measure of resilience. The constitutive model incorporates undrained shear strength anisotropy and a mesh-independent anisotropic post-peak strain softening. The calibration is performed using laboratory testing, including anisotropically-consolidated triaxial compression tests and direct simple shear tests. The peak and residual undrained shear strengths are validated by statistical interpretation of the available CPTu data. It is shown that this numerical exercise is useful to verify the robustness of the TSF design.


title: A Family of Constitutive Models Implemented in PLAXIS to Simulate Cemented Mine Backfill

abstract: A family of constitutive models for mine cemented backfill is presented. Four formulas for the density- and pressure-dependency of elastic moduli, five formulas for the density- and pressure-dependency of friction angle and four formulas for the age-dependency of the elastic moduli and effective cohesion are incorporated into an isotropic hypoelasticity with Mohr-Coulomb perfect plasticity framework and implemented in PLAXIS as a user-defined material model. This family includes the standard Mohr-Coulomb, Bolton, Leps, Barton and Hoek- Brown models as trivial cases when both nonlinear elasticity and age-dependency are switched off. In this paper, the formulation of the models is introduced, the basis of the numerical implementation is outlined, and a case history of the application to the cemented backfill of a sublevel stoping mine is presented as an example.


title: Computational analysis of pathological image enables interpretable prediction for microsatellite instability

abstract: Microsatellite instability (MSI) is associated with several tumor types and its status has become increasingly vital in guiding patient treatment decisions. However, in clinical practice, distinguishing MSI from its counterpart is challenging since the diagnosis of MSI requires additional genetic or immunohistochemical tests. In this study, interpretable pathological image analysis strategies are established to help medical experts to automatically identify MSI. The strategies only require ubiquitous Haematoxylin and eosin-stained whole-slide images and can achieve decent performance in the three cohorts collected from The Cancer Genome Atlas. The strategies provide interpretability in two aspects. On the one hand, the image-level interpretability is achieved by generating localization heat maps of important regions based on the deep learning network; on the other hand, the feature-level interpretability is attained through feature importance and pathological feature interaction analysis. More interestingly, both from the image-level and feature-level interpretability, color features and texture characteristics are shown to contribute the most to the MSI predictions. Therefore, the classification models under the proposed strategies can not only serve as an efficient tool for predicting the MSI status of patients, but also provide more insights to pathologists with clinical understanding.


title: Cognitive Learning-Aided Multi-Antenna Communications

abstract: Cognitive communications have emerged as a promising solution to enhance, adapt, and invent new tools and capabilities that transcend conventional wireless networks. Deep learning (DL) is critical in enabling essential features of cognitive systems because of its fast prediction performance, adaptive behavior, and model-free structure. These features are especially significant for multi-antenna wireless communications systems, which generate and handle massive data. Multiple antennas may provide multiplexing, diversity, or antenna gains that, respectively, improve the capacity, bit error rate, or the signal-to-interference-plus-noise ratio. In practice, multi-antenna cognitive communications encounter challenges in terms of data complexity and diversity, hardware complexity, and wireless channel dynamics. DL solutions such as federated learning, transfer learning and online learning, tackle these problems at various stages of communications processing, including multi-channel estimation, hybrid beamforming, user localization, and sparse array design. This article provides a synopsis of various DL-based methods to impart cognitive behavior to multi-antenna wireless communications for improved robustness and adaptation to the environmental changes while providing satisfactory spectral efficiency and computation times. We discuss DL design challenges from the perspective of data, learning, and transceiver architectures. In particular, we suggest quantized learning models, data/model parallelization, and distributed learning methods to address the aforementioned challenges.


title: Conditional Generative Modeling via Learning the Latent Space

abstract: Although deep learning has achieved appealing results on several machine learning tasks, most of the models are deterministic at inference, limiting their application to single-modal settings. We propose a novel general-purpose framework for conditional generation in multimodal spaces, that uses latent variables to model generalizable learning patterns while minimizing a family of regression cost functions. At inference, the latent variables are optimized to find optimal solutions corresponding to multiple output modes. Compared to existing generative solutions, in multimodal spaces, our approach demonstrates faster and stable convergence, and can learn better representations for downstream tasks. Importantly, it provides a simple generic model that can beat highly engineered pipelines tailored using domain expertise on a variety of tasks, while generating diverse outputs. Our codes will be released.


title: Provable Hierarchical Imitation Learning via EM

abstract: Due to recent empirical successes, the options framework for hierarchical reinforcement learning is gaining increasing popularity. Rather than learning from rewards which suffers from the curse of dimensionality, we consider learning an options-type hierarchical policy from expert demonstrations. Such a problem is referred to as hierarchical imitation learning. Converting this problem to parameter inference in a latent variable model, we theoretically characterize the EM approach proposed by Daniel et al. (2016). The population level algorithm is analyzed as an intermediate step, which is nontrivial due to the samples being correlated. If the expert policy can be parameterized by a variant of the options framework, then under regularity conditions, we prove that the proposed algorithm converges with high probability to a norm ball around the true parameter. To our knowledge, this is the first performance guarantee for an hierarchical imitation learning algorithm that only observes primitive state-action pairs.


title: Direct observation of symmetry-breaking in a 'ferroelectric' polar metal

abstract: Ferroelectric materials contain a switchable spontaneous polarization that persists even in the absence of an external electric field. The coexistence of ferroelectricity and metallicity in a material appears to be illusive, since polarization is ill-defined in metals, where the itinerant electrons are expected to screen the long-range dipole interactions necessary for dipole ordering. The surprising discovery of the polar metal, LiOsO3 has generated interest in searching for new polar metals motivated by the prospects of exotic quantum phenomena such as unconventional pairing mechanisms giving rise to superconductivity, topological spin currents, anisotropic upper critical fields, and Mott multiferroics. Previous studies have suggested that the coordination preferences of the Li atom play a key role in stabilizing the polar metal phase of LiOsO3, but a thorough understanding of how polar order and metallicity can coexist remains elusive. Here, we use XUV-SHG as novel technique to directly probe the broken inversion-symmetry around the Li atom. Our results agree with previous theories that the primary structural distortion that gives rise to the polar metal phase in LiOsO3 is a consequence of a sub-Angstrom Li atom displacement along the polar axis. A remarkable agreement between our experimental results and ab initio calculations provide physical insights for connecting the nonlinear response to unit-cell spatial asymmetries. It is shown that XUV-SHG can selectively probe inversion-breaking symmetry in a bulk material with elemental specificity. Compared to optical SHG methods, XUV-SHG fills a key gap for studying structural asymmetries when the structural distortion is energetically separated from the Fermi surface. Further, these results pave the way for time-resolved probing of symmetry-breaking structural phase transitions on femtosecond timescales with element specificity.


title: Representation Learning for Sequence Data with Deep Autoencoding Predictive Components

abstract: We propose Deep Autoencoding Predictive Components (DAPC) -- a self-supervised representation learning method for sequence data, based on the intuition that useful representations of sequence data should exhibit a simple structure in the latent space. We encourage this latent structure by maximizing an estimate of predictive information of latent feature sequences, which is the mutual information between past and future windows at each time step. In contrast to the mutual information lower bound commonly used by contrastive learning, the estimate of predictive information we adopt is exact under a Gaussian assumption. Additionally, it can be computed without negative sampling. To reduce the degeneracy of the latent space extracted by powerful encoders and keep useful information from the inputs, we regularize predictive information learning with a challenging masked reconstruction loss. We demonstrate that our method recovers the latent space of noisy dynamical systems, extracts predictive features for forecasting tasks, and improves automatic speech recognition when used to pretrain the encoder on large amounts of unlabeled data.


title: Improving the efficiency of spectral features extraction by structuring the audio files

abstract: The extraction of spectral features from a music clip is a computationally expensive task. As in order to extract accurate features, we need to process the clip for its whole length. This preprocessing task creates a large overhead and also makes the extraction process slower. We show how formatting a dataset in a certain way, can help make the process more efficient by eliminating the need for processing the clip for its whole duration, and still extract the features accurately. In addition, we discuss the possibility of defining set generic durations for analyzing a certain type of music clip while training. And in doing so we cut down the need of processing the clip duration to just 10% of the global average.


title: The AKLT models on the singly decorated diamond lattice and two degree-4 planar lattices are gapped

abstract: Recently various 2D AKLT models have been shown to be gapped, including the one on the hexagonal lattice. Here we report on a non-trivial 3D AKLT model which consists of spin-2 entities on the diamond lattice sites and one single spin-1 entity between every neighboring spin-2 site. Although the nonzero gap problem for the uniformly spin-2 AKLT models on the diamond and square lattices is still open, we are able to establish the existence of the gap for two planar lattices, which we call the inscribed square lattice and the triangle-octagon lattice, respectively. So far, these latter two models are the only two uniformly spin-2 AKLT models that have a provable nonzero gap above the ground state. We also discuss some attempts in proving the gap existence on both the square and kagome lattices. In addition, we show that if one can solve a finite-size problem of a weighted AKLT Hamiltonian and if the gap is larger than certain threshold, then the model on the square lattice is gapped in the thermodynamic limit. The threshold of the gap scales inversely with the linear size of the finite-size problem.


title: Improving Context Modeling in Neural Topic Segmentation

abstract: Topic segmentation is critical in key NLP tasks and recent works favor highly effective neural supervised approaches. However, current neural solutions are arguably limited in how they model context. In this paper, we enhance a segmenter based on a hierarchical attention BiLSTM network to better model context, by adding a coherence-related auxiliary task and restricted self-attention. Our optimized segmenter outperforms SOTA approaches when trained and tested on three datasets. We also the robustness of our proposed model in domain transfer setting by training a model on a large-scale dataset and testing it on four challenging real-world benchmarks. Furthermore, we apply our proposed strategy to two other languages (German and Chinese), and show its effectiveness in multilingual scenarios.


title: Unravelling the enigmatic ISM conditions in Minkowski's Object

abstract: Local examples of jet-induced star formation lend valuable insight into its significance in galaxy evolution and can provide important observational constraints for theoretical models of positive feedback. Using optical integral field spectroscopy, we present an analysis of the ISM conditions in Minkowski's Object ($z = 0.0189$), a peculiar star-forming dwarf galaxy located in the path of a radio jet from the galaxy NGC 541. Full spectral fitting with PPXF indicates that Minkowski's Object primarily consists of a young stellar population $\sim 10$ Myr old, confirming that the bulk of the object's stellar mass formed during a recent jet interaction. Minkowski's Object exhibits line ratios largely consistent with star formation, although there is evidence for a low level ($\lesssim 15$ per cent) of contamination from a non-stellar ionising source. Strong-line diagnostics reveal a significant variation in the gas-phase metallicity within the object, with $\log\left( \rm O / H \right) + 12$ varying by $\sim 0.5$ dex, which cannot be explained by in-situ star formation, an enriched outflow from the jet, or enrichment of gas in the stellar bridge between NGC 541 and NGC 545/547. We hypothesise that Minkowski's Object either (a) was formed as a result of jet-induced star formation in pre-existing gas clumps in the stellar bridge, or (b) is a gas-rich dwarf galaxy that is experiencing an elevation in its star formation rate due to a jet interaction, and will eventually redden and fade, becoming an ultra-diffuse galaxy as it is processed by the cluster.


title: Finite Meta-Dynamic Neurons in Spiking Neural Networks for Spatio-temporal Learning

abstract: Spiking Neural Networks (SNNs) have incorporated more biologically-plausible structures and learning principles, hence are playing critical roles in bridging the gap between artificial and natural neural networks. The spikes are the sparse signals describing the above-threshold event-based firing and under-threshold dynamic computation of membrane potentials, which give us an alternative uniformed and efficient way on both information representation and computation. Inspired from the biological network, where a finite number of meta neurons integrated together for various of cognitive functions, we proposed and constructed Meta-Dynamic Neurons (MDN) to improve SNNs for a better network generalization during spatio-temporal learning. The MDNs are designed with basic neuronal dynamics containing 1st-order and 2nd-order dynamics of membrane potentials, including the spatial and temporal meta types supported by some hyper-parameters. The MDNs generated from a spatial (MNIST) and a temporal (TIDigits) datasets first, and then extended to various other different spatio-temporal tasks (including Fashion-MNIST, NETtalk, Cifar-10, TIMIT and N-MNIST). The comparable accuracy was reached compared to other SOTA SNN algorithms, and a better generalization was also achieved by SNNs using MDNs than that without using MDNs.


title: Bayesian Shrinkage Approaches to Unbalanced Problems of Estimation and Prediction on the Basis of Negative Multinomial Samples

abstract: In this paper, we treat estimation and prediction problems where negative multinomial variables are observed and in particular consider unbalanced settings. First, the problem of estimating multiple negative multinomial parameter vectors under the standardized squared error loss is treated and a new empirical Bayes estimator which dominates the UMVU estimator under suitable conditions is derived. Second, we consider estimation of the joint predictive density of several multinomial tables under the Kullback-Leibler divergence and obtain a sufficient condition under which the Bayesian predictive density with respect to a hierarchical shrinkage prior dominates the Bayesian predictive density with respect to the Jeffreys prior. Third, our proposed Bayesian estimator and predictive density give risk improvements in simulations. Finally, the problem of estimating the joint predictive density of negative multinomial variables is discussed.


title: Pre-training Multilingual Neural Machine Translation by Leveraging Alignment Information

abstract: We investigate the following question for machine translation (MT): can we develop a single universal MT model to serve as the common seed and obtain derivative and improved models on arbitrary language pairs? We propose mRASP, an approach to pre-train a universal multilingual neural machine translation model. Our key idea in mRASP is its novel technique of random aligned substitution, which brings words and phrases with similar meanings across multiple languages closer in the representation space. We pre-train a mRASP model on 32 language pairs jointly with only public datasets. The model is then fine-tuned on downstream language pairs to obtain specialized MT models. We carry out extensive experiments on 42 translation directions across a diverse settings, including low, medium, rich resource, and as well as transferring to exotic language pairs. Experimental results demonstrate that mRASP achieves significant performance improvement compared to directly training on those target pairs. It is the first time to verify that multiple low-resource language pairs can be utilized to improve rich resource MT. Surprisingly, mRASP is even able to improve the translation quality on exotic languages that never occur in the pre-training corpus. Code, data, and pre-trained models are available at https://github.com/linzehui/mRASP.


title: Cloud Cover and Aurora Contamination at Dome A in 2017 from KLCAM

abstract: Dome A in Antarctica has many characteristics that make it an excellent site for astronomical observations, from the optical to the terahertz. Quantitative site testing is still needed to confirm the site's properties. In this paper, we present a statistical analysis of cloud cover and aurora contamination from the Kunlun Cloud and Aurora Monitor (KLCAM). KLCAM is an automatic, unattended all-sky camera aiming for long-term monitoring of the usable observing time and optical sky background at Dome~A. It was installed at Dome~A in January 2017, worked through the austral winter, and collected over 47,000 images over 490 days. A semi-quantitative visual data analysis of cloud cover and auroral contamination was carried out by five individuals. The analysis shows that the night sky was free of cloud for 83 per cent of the time, which ranks Dome~A highly in a comparison with other observatory sites. Although aurorae were detected somewhere on an image for nearly 45 per cent of the time, the strongest auroral emission lines can be filtered out with customized filters.


title: SDC Resilient Error-bounded Lossy Compressor

abstract: Lossy compression is one of the most important strategies to resolve the big science data issue, however, little work was done to make it resilient against silent data corruptions (SDC). In fact, SDC is becoming non-negligible because of exa-scale computing demand on complex scientific simulations with vast volume of data being produced or in some particular instruments/devices (such as interplanetary space probe) that need to transfer large amount of data in an error-prone environment. In this paper, we propose an SDC resilient error-bounded lossy compressor upon the SZ compression framework. Specifically, we adopt a new independent-block-wise model that decomposes the entire dataset into many independent sub-blocks to compress. Then, we design and implement a series of error detection/correction strategies based on SZ. We are the first to extend algorithm-based fault tolerance (ABFT) to lossy compression. Our proposed solution incurs negligible execution overhead without soft errors. It keeps the correctness of decompressed data still bounded within user's requirement with a very limited degradation of compression ratios upon soft errors.


title: High dimensional asymptotics of likelihood ratio tests in the Gaussian sequence model under convex constraints

abstract: In the Gaussian sequence model $Y=\mu+\xi$, we study the likelihood ratio test (LRT) for testing $H_0: \mu=\mu_0$ versus $H_1: \mu \in K$, where $\mu_0 \in K$, and $K$ is a closed convex set in $\mathbb{R}^n$. In particular, we show that under the null hypothesis, normal approximation holds for the log-likelihood ratio statistic for a general pair $(\mu_0,K)$, in the high dimensional regime where the estimation error of the associated least squares estimator diverges in an appropriate sense. The normal approximation further leads to a precise characterization of the power behavior of the LRT in the high dimensional regime. These characterizations show that the power behavior of the LRT is in general non-uniform with respect to the Euclidean metric, and illustrate the conservative nature of existing minimax optimality and sub-optimality results for the LRT. A variety of examples, including testing in the orthant/circular cone, isotonic regression, Lasso, and testing parametric assumptions versus shape-constrained alternatives, are worked out to demonstrate the versatility of the developed theory.


title: Unsupervised Parsing via Constituency Tests

abstract: We propose a method for unsupervised parsing based on the linguistic notion of a constituency test. One type of constituency test involves modifying the sentence via some transformation (e.g. replacing the span with a pronoun) and then judging the result (e.g. checking if it is grammatical). Motivated by this idea, we design an unsupervised parser by specifying a set of transformations and using an unsupervised neural acceptability model to make grammaticality decisions. To produce a tree given a sentence, we score each span by aggregating its constituency test judgments, and we choose the binary tree with the highest total score. While this approach already achieves performance in the range of current methods, we further improve accuracy by fine-tuning the grammaticality model through a refinement procedure, where we alternate between improving the estimated trees and improving the grammaticality model. The refined model achieves 62.8 F1 on the Penn Treebank test set, an absolute improvement of 7.6 points over the previous best published result.


title: OpenIE6: Iterative Grid Labeling and Coordination Analysis for Open Information Extraction

abstract: A recent state-of-the-art neural open information extraction (OpenIE) system generates extractions iteratively, requiring repeated encoding of partial outputs. This comes at a significant computational cost. On the other hand, sequence labeling approaches for OpenIE are much faster, but worse in extraction quality. In this paper, we bridge this trade-off by presenting an iterative labeling-based system that establishes a new state of the art for OpenIE, while extracting 10x faster. This is achieved through a novel Iterative Grid Labeling (IGL) architecture, which treats OpenIE as a 2-D grid labeling task. We improve its performance further by applying coverage (soft) constraints on the grid at training time. Moreover, on observing that the best OpenIE systems falter at handling coordination structures, our OpenIE system also incorporates a new coordination analyzer built with the same IGL architecture. This IGL based coordination analyzer helps our OpenIE system handle complicated coordination structures, while also establishing a new state of the art on the task of coordination analysis, with a 12.3 pts improvement in F1 over previous analyzers. Our OpenIE system, OpenIE6, beats the previous systems by as much as 4 pts in F1, while being much faster.


title: Comparison of Cooperative Driving Strategies for CAVs at Signal-Free Intersections

abstract: The properties of cooperative driving strategies for planning and controlling Connected and Automated Vehicles (CAVs) at intersections range from some that achieve highly efficient coordination performance to others whose implementation is computationally fast. This paper comprehensively compares the performance of four representative strategies in terms of travel time, energy consumption, computation time, and fairness under different conditions, including the geometric configuration of intersections, asymmetry in traffic arrival rates, and the relative magnitude of these rates. Our simulation-based study has led to the following conclusions: 1) the Monte Carlo Tree Search (MCTS)-based strategy achieves the best traffic efficiency, whereas the Dynamic Resequencing (DR)-based strategy is energy-optimal; both strategies perform well in all metrics of interest. If the computation budget is adequate, the MCTS strategy is recommended; otherwise, the DR strategy is preferable; 2) An asymmetric intersection has a noticeable impact on the strategies, whereas the influence of the arrival rates can be neglected. When the geometric shape is asymmetrical, the modified First-In-First-Out (FIFO) strategy significantly outperforms the FIFO strategy and works well when the traffic demand is moderate, but their performances are similar in other situations; and 3) Improving traffic efficiency sometimes comes at the cost of fairness, but the DR and MCTS strategies can be adjusted to realize a better trade-off between various performance metrics by appropriately designing their objective functions.


title: M1 resonance in $^{208}$Pb within the self-consistent phonon-coupling model

abstract: The main goal of the paper is to investigate theoretically the experimentally observed fragmentation of the isovector $M1$ resonance in $^{208}$Pb within a self-consistent model based on an energy-density functional (EDF) of the Skyrme type. This fragmentation (spread of the $M1$ strength) is not reproduced in a conventional one-particle--one-hole ($1p1h$) random-phase approximation (RPA) and thus has to be investigated in the framework of more complicated models. However, previously applied models of this type were not self-consistent. In the present work, we use a recently developed renormalized version of the self-consistent time blocking approximation (RenTBA) in which the $1p1h\otimes$phonon configurations are included on top of the RPA $1p1h$ configurations. We have determined several sets of the parameters of the modified Skyrme EDF fitted within the RenTBA and RPA and have found the necessary condition of producing the fragmentation of the $M1$ resonance in $^{208}$Pb in our model. We present also the results of the RenTBA and RPA calculations for the first excited states of the natural parity modes in $^{208}$Pb obtained with these modified parametrizations.


title: PyMT5: multi-mode translation of natural language and Python code with transformers

abstract: Simultaneously modeling source code and natural language has many exciting applications in automated software development and understanding. Pursuant to achieving such technology, we introduce PyMT5, the Python method text-to-text transfer transformer, which is trained to translate between all pairs of Python method feature combinations: a single model that can both predict whole methods from natural language documentation strings (docstrings) and summarize code into docstrings of any common style. We present an analysis and modeling effort of a large-scale parallel corpus of 26 million Python methods and 7.7 million method-docstring pairs, demonstrating that for docstring and method generation, PyMT5 outperforms similarly-sized auto-regressive language models (GPT2) which were English pre-trained or randomly initialized. On the CodeSearchNet test set, our best model predicts 92.1% syntactically correct method bodies, achieved a BLEU score of 8.59 for method generation and 16.3 for docstring generation (summarization), and achieved a ROUGE-L F-score of 24.8 for method generation and 36.7 for docstring generation.


title: A recurring pattern in natural numbers of a certain property

abstract: Natural numbers satisfying an unusual property are mentioned by the author in [5], in which their infinitude is also proved. In this paper, we start with an arbitrary natural number which is not a multiple of 10 and non-palindromic, form numbers by concatenating its decimal digits, and investigate which of them have the unusual property. In particular, the pattern of which of them have the unusual property recurs.


abstract: We consider the problem of learning control policies that optimize a reward function while satisfying constraints due to considerations of safety, fairness, or other costs. We propose a new algorithm, Projection-Based Constrained Policy Optimization (PCPO). This is an iterative method for optimizing policies in a two-step process: the first step performs a local reward improvement update, while the second step reconciles any constraint violation by projecting the policy back onto the constraint set. We theoretically analyze PCPO and provide a lower bound on reward improvement, and an upper bound on constraint violation, for each policy update. We further characterize the convergence of PCPO based on two different metrics: $\normltwo$ norm and Kullback-Leibler divergence. Our empirical results over several control tasks demonstrate that PCPO achieves superior performance, averaging more than 3.5 times less constraint violation and around 15\% higher reward compared to state-of-the-art methods.


title: A macro-micro elasticity-diffusion system modeling absorption-induced swelling in rubber foams -- Proof of the strong solvability

abstract: In this article, we propose a macro-micro (two-scale) mathematical model for describing the macroscopic swelling of a rubber foam caused by the microscopic absorption of some liquid. In our modeling approach, we suppose that the material occupies a one-dimensional domain which swells as described by the standard beam equation including an additional term determined by the liquid pressure. As special feature of our model, the absorption takes place inside the rubber foam via a lower length scale, which is assumed to be inherently present in such a structured material. The liquid's absorption and transport inside the material is modeled by means of a nonlinear parabolic equation derived from Darcy's law posed in a non-cylindrical domain defined by the macroscopic deformation (which is a solution of the beam equation). Under suitable assumptions, we establish the existence and uniqueness of a suitable class of solutions to our evolution system coupling the nonlinear parabolic equation posed on the microscopic non-cylindrical domain with the beam equation posed on the macroscopic cylindrical domain. In order to guarantee the regularity of the non-cylindrical domain, we impose a singularity to the elastic response function appearing in the beam equation.


title: Fortifying Toxic Speech Detectors Against Veiled Toxicity

abstract: Modern toxic speech detectors are incompetent in recognizing disguised offensive language, such as adversarial attacks that deliberately avoid known toxic lexicons, or manifestations of implicit bias. Building a large annotated dataset for such veiled toxicity can be very expensive. In this work, we propose a framework aimed at fortifying existing toxic speech detectors without a large labeled corpus of veiled toxicity. Just a handful of probing examples are used to surface orders of magnitude more disguised offenses. We augment the toxic speech detector's training data with these discovered offensive examples, thereby making it more robust to veiled toxicity while preserving its utility in detecting overt toxicity.


title: A Self-Refinement Strategy for Noise Reduction in Grammatical Error Correction

abstract: Existing approaches for grammatical error correction (GEC) largely rely on supervised learning with manually created GEC datasets. However, there has been little focus on verifying and ensuring the quality of the datasets, and on how lower-quality data might affect GEC performance. We indeed found that there is a non-negligible amount of "noise" where errors were inappropriately edited or left uncorrected. To address this, we designed a self-refinement method where the key idea is to denoise these datasets by leveraging the prediction consistency of existing models, and outperformed strong denoising baseline methods. We further applied task-specific techniques and achieved state-of-the-art performance on the CoNLL-2014, JFLEG, and BEA-2019 benchmarks. We then analyzed the effect of the proposed denoising method, and found that our approach leads to improved coverage of corrections and facilitated fluency edits which are reflected in higher recall and overall performance.


title: Small data blow-up for the weakly coupled system of the generalized Tricomi equations with multiple propagation speeds

abstract: In the present paper, we study the Cauchy problem for the weakly coupled system of the generalized Tricomi equations with multiple propagation speeds. Our aim of this paper is to prove a small data blow-up result and an upper estimate of lifespan of the problem for a suitable compactly supported initial data in the subcritical and critical cases of the Strauss type. The proof is based on the framework of the argument in the paper [17]. One of our new contributions is to construct two families of special solutions to the free equation (see (2.16) or (2.18) as the test functions and prove their several properties. We emphasize that the system with two different propagation speeds is treated in this paper and the assumption on the initial data is improved from the point-wise positivity to the integral positivity.


title: Knowledge-enriched, Type-constrained and Grammar-guided Question Generation over Knowledge Bases

abstract: Question generation over knowledge bases (KBQG) aims at generating natural-language questions about a subgraph, i.e. a set of (connected) triples. Two main challenges still face the current crop of encoder-decoder-based methods, especially on small subgraphs: (1) low diversity and poor fluency due to the limited information contained in the subgraphs, and (2) semantic drift due to the decoder's oblivion of the semantics of the answer entity. We propose an innovative knowledge-enriched, type-constrained and grammar-guided KBQG model, named KTG, to addresses the above challenges. In our model, the encoder is equipped with auxiliary information from the KB, and the decoder is constrained with word types during QG. Specifically, entity domain and description, as well as relation hierarchy information are considered to construct question contexts, while a conditional copy mechanism is incorporated to modulate question semantics according to current word types. Besides, a novel reward function featuring grammatical similarity is designed to improve both generative richness and syntactic correctness via reinforcement learning. Extensive experiments show that our proposed model outperforms existing methods by a significant margin on two widely-used benchmark datasets SimpleQuestion and PathQuestion.


title: Multilingual Knowledge Graph Completion via Ensemble Knowledge Transfer

abstract: Predicting missing facts in a knowledge graph (KG) is a crucial task in knowledge base construction and reasoning, and it has been the subject of much research in recent works using KG embeddings. While existing KG embedding approaches mainly learn and predict facts within a single KG, a more plausible solution would benefit from the knowledge in multiple language-specific KGs, considering that different KGs have their own strengths and limitations on data quality and coverage. This is quite challenging, since the transfer of knowledge among multiple independently maintained KGs is often hindered by the insufficiency of alignment information and the inconsistency of described facts. In this paper, we propose KEnS, a novel framework for embedding learning and ensemble knowledge transfer across a number of language-specific KGs. KEnS embeds all KGs in a shared embedding space, where the association of entities is captured based on self-learning. Then, KEnS performs ensemble inference to combine prediction results from embeddings of multiple language-specific KGs, for which multiple ensemble techniques are investigated. Experiments on five real-world language-specific KGs show that KEnS consistently improves state-of-the-art methods on KG completion, via effectively identifying and leveraging complementary knowledge.


title: Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake News

abstract: Although many fact-checking systems have been developed in academia and industry, fake news is still proliferating on social media. These systems mostly focus on fact-checking but usually neglect online users who are the main drivers of the spread of misinformation. How can we use fact-checked information to improve users' consciousness of fake news to which they are exposed? How can we stop users from spreading fake news? To tackle these questions, we propose a novel framework to search for fact-checking articles, which address the content of an original tweet (that may contain misinformation) posted by online users. The search can directly warn fake news posters and online users (e.g. the posters' followers) about misinformation, discourage them from spreading fake news, and scale up verified content on social media. Our framework uses both text and images to search for fact-checking articles, and achieves promising results on real-world datasets. Our code and datasets are released at https://github.com/nguyenvo09/EMNLP2020.


title: Vision Skills Needed to Answer Visual Questions

abstract: The task of answering questions about images has garnered attention as a practical service for assisting populations with visual impairments as well as a visual Turing test for the artificial intelligence community. Our first aim is to identify the common vision skills needed for both scenarios. To do so, we analyze the need for four vision skills---object recognition, text recognition, color recognition, and counting---on over 27,000 visual questions from two datasets representing both scenarios. We next quantify the difficulty of these skills for both humans and computers on both datasets. Finally, we propose a novel task of predicting what vision skills are needed to answer a question about an image. Our results reveal (mis)matches between aims of real users of such services and the focus of the AI community. We conclude with a discussion about future directions for addressing the visual question answering task.


title: Model-Free Non-Stationary RL: Near-Optimal Regret and Applications in Multi-Agent RL and Inventory Control

abstract: We consider model-free reinforcement learning (RL) in non-stationary Markov decision processes. Both the reward functions and the state transition functions are allowed to vary arbitrarily over time as long as their cumulative variations do not exceed certain variation budgets. We propose Restarted Q-Learning with Upper Confidence Bounds (RestartQ-UCB), the first model-free algorithm for non-stationary RL, and show that it outperforms existing solutions in terms of dynamic regret. Specifically, RestartQ-UCB with Freedman-type bonus terms achieves a dynamic regret bound of $\widetilde{O}(S^{\frac{1}{3}} A^{\frac{1}{3}} \Delta^{\frac{1}{3}} H T^{\frac{2}{3}})$, where $S$ and $A$ are the numbers of states and actions, respectively, $\Delta>0$ is the variation budget, $H$ is the number of time steps per episode, and $T$ is the total number of time steps. We further present a parameter-free algorithm named Double-Restart Q-UCB that does not require prior knowledge of the variation budget. We show that our algorithms are \emph{nearly optimal} by establishing an information-theoretical lower bound of $\Omega(S^{\frac{1}{3}} A^{\frac{1}{3}} \Delta^{\frac{1}{3}} H^{\frac{2}{3}} T^{\frac{2}{3}})$, the first lower bound in non-stationary RL. Numerical experiments validate the advantages of RestartQ-UCB in terms of both cumulative rewards and computational efficiency. We demonstrate the power of our results in examples of multi-agent RL and inventory control across related products.


title: Representations of flat virtual braids which do not preserve the forbidden relations

abstract: In the paper, we construct a representation $\theta:FVB_n\to{\rm Aut}(F_{2n})$ of the flat virtual braid group $FVB_n$ on $n$ strands by automorphisms of the free group $F_{2n}$ with $2n$ generators which does not preserve the forbidden relations in the flat virtual braid group. This representation gives a positive answer to the problem formulated by V. Bardakov in the list of unsolved problems in virtual knot theory and combinatorial knot theory by R. Fenn, D. Ilyutko, L. Kauffman and V. Manturov. Using this representation we construct a new group invariant for flat welded links. Also we find the set of normal generators of the groups $VP_n\cap H_n$ in $VB_n$, $FVP_n\cap FH_n$ in $FVB_n$, $GVP_n\cap GH_n$ in $GVB_n$, which play an important role in the study of the kernel of the representation $\theta$.


title: Wall crossing for moduli of stable sheaves on an elliptic surface

abstract: We shall study the wall crossing behavior of moduli of stable sheaves on an elliptic surface.


title: Adversarial attacks on audio source separation

abstract: Despite the excellent performance of neural-network-based audio source separation methods and their wide range of applications, their robustness against intentional attacks has been largely neglected. In this work, we reformulate various adversarial attack methods for the audio source separation problem and intensively investigate them under different attack conditions and target models. We further propose a simple yet effective regularization method to obtain imperceptible adversarial noise while maximizing the impact on separation quality with low computational complexity. Experimental results show that it is possible to largely degrade the separation quality by adding imperceptibly small noise when the noise is crafted for the target model. We also show the robustness of source separation models against a black-box attack. This study provides potentially useful insights for developing content protection methods against the abuse of separated signals and improving the separation performance and robustness.


title: Questions for Data Scientists in Software Engineering: A Replication

abstract: In 2014, a Microsoft study investigated the sort of questions that data science applied to software engineering should answer. This resulted in 145 questions that developers considered relevant for data scientists to answer, thus providing a research agenda to the community. Fast forward to five years, no further studies investigated whether the questions from the software engineers at Microsoft hold for other software companies, including software-intensive companies with different primary focus (to which we refer as software-defined enterprises). Furthermore, it is not evident that the problems identified five years ago are still applicable, given the technological advances in software engineering.


title: Accurate, Efficient and Scalable Training of Graph Neural Networks

abstract: Graph Neural Networks (GNNs) are powerful deep learning models to generate node embeddings on graphs. When applying deep GNNs on large graphs, it is still challenging to perform training in an efficient and scalable way. We propose a novel parallel training framework. Through sampling small subgraphs as minibatches, we reduce training workload by orders of magnitude compared with state-of-the-art minibatch methods. We then parallelize the key computation steps on tightly-coupled shared memory systems. For graph sampling, we exploit parallelism within and across sampler instances, and propose an efficient data structure supporting concurrent accesses from samplers. The parallel sampler theoretically achieves near-linear speedup with respect to number of processing units. For feature propagation within subgraphs, we improve cache utilization and reduce DRAM traffic by data partitioning. Our partitioning is a 2-approximation strategy for minimizing the communication cost compared to the optimal. We further develop a runtime scheduler to reorder the training operations and adjust the minibatch subgraphs to improve parallel performance. Finally, we generalize the above parallelization strategies to support multiple types of GNN models and graph samplers. The proposed training outperforms the state-of-the-art in scalability, efficiency and accuracy simultaneously. On a 40-core Xeon platform, we achieve 60x speedup (with AVX) in the sampling step and 20x speedup in the feature propagation step, compared to the serial implementation. Our algorithm enables fast training of deeper GNNs, as demonstrated by orders of magnitude speedup compared to the Tensorflow implementation. We open-source our code at https://github.com/GraphSAINT/GraphSAINT.


title: Note on surface growth approach for bulk reconstruction

abstract: In a recent paper, a novel surface growth approach for reconstructing bulk geometry and matter fields was proposed, it was shown that this picture can be explicitly realized by the one-shot entanglement distillation tensor network and the surface state correspondence. In the present paper, we give direct analysis for the growth of the bulk minimal surfaces in asymptotically AdS 3 spacetime and show that bulk geometry can be efficiently reproduced in this way, which provides further support for the surface growth approach in entanglement wedge reconstruction.


title: Cyclical phenomena in technological change

abstract: The process of technological change can be regarded as a non-deterministic system governed by factors of a cumulative nature that generate cyclical phenomena. In this context, the process of growth and decline of technology can be systematically analyzed to design best practices for technology management of firms and innovation policy of nations. In this perspective, this study focuses on the evolution of technologies in the U.S. recorded music industry. Empirical findings reveal that technological change in the sector under study here has recurring fluctuations of technological innovations. In particular, cycle of technology has up wave phase longer than down wave phase in the process of evolution in markets before it is substituted by a new technology. Results suggest that radical innovation is one of the main sources of cyclical phenomena for industrial and corporate change, and as a consequence, economic and social change.