title: UniNet: Scalable Network Representation Learning with Metropolis-Hastings Sampling

abstract: Network representation learning (NRL) technique has been successfully adopted in various data mining and machine learning applications. Random walk based NRL is one popular paradigm, which uses a set of random walks to capture the network structural information, and then employs word2vec models to learn the low-dimensional representations. However, until now there is lack of a framework, which unifies existing random walk based NRL models and supports to efficiently learn from large networks. The main obstacle comes from the diverse random walk models and the inefficient sampling method for the random walk generation. In this paper, we first introduce a new and efficient edge sampler based on Metropolis-Hastings sampling technique, and theoretically show the convergence property of the edge sampler to arbitrary discrete probability distributions. Then we propose a random walk model abstraction, in which users can easily define different transition probability by specifying dynamic edge weights and random walk states. The abstraction is efficiently supported by our edge sampler, since our sampler can draw samples from unnormalized probability distribution in constant time complexity. Finally, with the new edge sampler and random walk model abstraction, we carefully implement a scalable NRL framework called UniNet. We conduct comprehensive experiments with five random walk based NRL models over eleven real-world datasets, and the results clearly demonstrate the efficiency of UniNet over billion-edge networks.


title: Inference in generalized bilinear models

abstract: Latent factor models are widely used to discover and adjust for hidden variation in modern applications. However, most methods do not fully account for uncertainty in the latent factors, which can lead to miscalibrated inferences such as overconfident p-values. In this article, we develop a fast and accurate method of uncertainty quantification in generalized bilinear models, which are a flexible extension of generalized linear models to include latent factors as well as row covariates, column covariates, and interactions. In particular, we introduce delta propagation, a general technique for propagating uncertainty among model components using the delta method. Further, we provide a rapidly converging algorithm for maximum a posteriori GBM estimation that extends earlier methods by estimating row and column dispersions. In simulation studies, we find that our method provides approximately correct frequentist coverage of most parameters of interest. We demonstrate on RNA-seq gene expression analysis and copy ratio estimation in cancer genomics.


title: Information Extraction from Swedish Medical Prescriptions with Sig-Transformer Encoder

abstract: Relying on large pretrained language models such as Bidirectional Encoder Representations from Transformers (BERT) for encoding and adding a simple prediction layer has led to impressive performance in many clinical natural language processing (NLP) tasks. In this work, we present a novel extension to the Transformer architecture, by incorporating signature transform with the self-attention model. This architecture is added between embedding and prediction layers. Experiments on a new Swedish prescription data show the proposed architecture to be superior in two of the three information extraction tasks, comparing to baseline models. Finally, we evaluate two different embedding approaches between applying Multilingual BERT and translating the Swedish text to English then encode with a BERT model pretrained on clinical notes.


title: Open-Domain Question Answering Goes Conversational via Question Rewriting

abstract: We introduce a new dataset for Question Rewriting in Conversational Context (QReCC), which contains 14K conversations with 80K question-answer pairs. The task in QReCC is to find answers to conversational questions within a collection of 10M web pages (split into 54M passages). Answers to questions in the same conversation may be distributed across several web pages. QReCC provides annotations that allow us to train and evaluate individual subtasks of question rewriting, passage retrieval and reading comprehension required for the end-to-end conversational question answering (QA) task. We report the effectiveness of a strong baseline approach that combines the state-of-the-art model for question rewriting, and competitive models for open-domain QA. Our results set the first baseline for the QReCC dataset with F1 of 19.10, compared to the human upper bound of 75.45, indicating the difficulty of the setup and a large room for improvement.


title: Human-Supervised Semi-Autonomous Mobile Manipulators for Safely and Efficiently Executing Machine Tending Tasks

abstract: Mobile manipulators can be used for machine tending and material handling tasks in small volume manufacturing applications. These applications usually have semi-structured work environment. The use of a fully autonomous mobile manipulator for such applications can be risky, as an inaccurate model of the workspace may result in damage to expensive equipment. On the other hand, the use of a fully teleoperated mobile manipulator may require a significant amount of operator time. In this paper, a semi-autonomous mobile manipulator is developed for safely and efficiently carrying out machine tending tasks under human supervision. The robot is capable of generating motion plans from the high-level task description and presenting simulation results to the human for approval. The human operator can authorize the robot to execute the automatically generated plan or provide additional input to the planner to refine the plan. If the level of uncertainty in some parts of the workspace model is high, then the human can decide to perform teleoperation to safely execute the task. Our preliminary user trials show that non-expert operators can quickly learn to use the system and perform machine tending tasks.


title: Toward Micro-Dialect Identification in Diaglossic and Code-Switched Environments

abstract: Although the prediction of dialects is an important language processing task, with a wide range of applications, existing work is largely limited to coarse-grained varieties. Inspired by geolocation research, we propose the novel task of Micro-Dialect Identification (MDI) and introduce MARBERT, a new language model with striking abilities to predict a fine-grained variety (as small as that of a city) given a single, short message. For modeling, we offer a range of novel spatially and linguistically-motivated multi-task learning models. To showcase the utility of our models, we introduce a new, large-scale dataset of Arabic micro-varieties (low-resource) suited to our tasks. MARBERT predicts micro-dialects with 9.9% F1, ~76X better than a majority class baseline. Our new language model also establishes new state-of-the-art on several external tasks.


title: From Anomalous to Normal: Temperature Dependence of the Band Gap in Two-Dimensional Black Phosphorus

abstract: The temperature dependence of the band gap is crucial to a semiconductor. Bulk black phosphorus (BP) is known to exhibit an anomalous behavior. Through optical spectroscopy, here we show that the temperature effect on BP band gap gradually evolves with decreasing layer number, eventually turns into a normal one in the monolayer limit, rendering a crossover from the anomalous to the normal. Meanwhile, the temperature-induced shift in optical resonance also differs with different transition indices for the same thickness sample. A comprehensive analysis reveals that the temperature-tunable interlayer coupling is responsible for the observed diverse scenario. Our study provides a key to the apprehension of the anomalous temperature behavior in certain layered semiconductors.


title: ByzShield: An Efficient and Robust System for Distributed Training

abstract: Training of large scale models on distributed clusters is a critical component of the machine learning pipeline. However, this training can easily be made to fail if some workers behave in an adversarial (Byzantine) fashion whereby they return arbitrary results to the parameter server (PS). A plethora of existing papers consider a variety of attack models and propose robust aggregation and/or computational redundancy to alleviate the effects of these attacks. In this work we consider an omniscient attack model where the adversary has full knowledge about the gradient computation assignments of the workers and can choose to attack (up to) any q out of K worker nodes to induce maximal damage. Our redundancy-based method ByzShield leverages the properties of bipartite expander graphs for the assignment of tasks to workers; this helps to effectively mitigate the effect of the Byzantine behavior. Specifically, we demonstrate an upper bound on the worst case fraction of corrupted gradients based on the eigenvalues of our constructions which are based on mutually orthogonal Latin squares and Ramanujan graphs. Our numerical experiments indicate over a 36% reduction on average in the fraction of corrupted gradients compared to the state of the art. Likewise, our experiments on training followed by image classification on the CIFAR-10 dataset show that ByzShield has on average a 20% advantage in accuracy under the most sophisticated attacks. ByzShield also tolerates a much larger fraction of adversarial nodes compared to prior work.


title: What Do Position Embeddings Learn? An Empirical Study of Pre-Trained Language Model Positional Encoding

abstract: In recent years, pre-trained Transformers have dominated the majority of NLP benchmark tasks. Many variants of pre-trained Transformers have kept breaking out, and most focus on designing different pre-training objectives or variants of self-attention. Embedding the position information in the self-attention mechanism is also an indispensable factor in Transformers however is often discussed at will. Therefore, this paper carries out an empirical study on position embeddings of mainstream pre-trained Transformers, which mainly focuses on two questions: 1) Do position embeddings really learn the meaning of positions? 2) How do these different learned position embeddings affect Transformers for NLP tasks? This paper focuses on providing a new insight of pre-trained position embeddings through feature-level analysis and empirical experiments on most of iconic NLP tasks. It is believed that our experimental results can guide the future work to choose the suitable positional encoding function for specific tasks given the application property.


title: Multi-path Neural Networks for On-device Multi-domain Visual Classification

abstract: Learning multiple domains/tasks with a single model is important for improving data efficiency and lowering inference cost for numerous vision tasks, especially on resource-constrained mobile devices. However, hand-crafting a multi-domain/task model can be both tedious and challenging. This paper proposes a novel approach to automatically learn a multi-path network for multi-domain visual classification on mobile devices. The proposed multi-path network is learned from neural architecture search by applying one reinforcement learning controller for each domain to select the best path in the super-network created from a MobileNetV3-like search space. An adaptive balanced domain prioritization algorithm is proposed to balance optimizing the joint model on multiple domains simultaneously. The determined multi-path model selectively shares parameters across domains in shared nodes while keeping domain-specific parameters within non-shared nodes in individual domain paths. This approach effectively reduces the total number of parameters and FLOPS, encouraging positive knowledge transfer while mitigating negative interference across domains. Extensive evaluations on the Visual Decathlon dataset demonstrate that the proposed multi-path model achieves state-of-the-art performance in terms of accuracy, model size, and FLOPS against other approaches using MobileNetV3-like architectures. Furthermore, the proposed method improves average accuracy over learning single-domain models individually, and reduces the total number of parameters and FLOPS by 78% and 32% respectively, compared to the approach that simply bundles single-domain models for multi-domain learning.


title: Accelerating Finite-temperature Kohn-Sham Density Functional Theory with Deep Neural Networks

abstract: We present a numerical modeling workflow based on machine learning (ML) which reproduces the the total energies produced by Kohn-Sham density functional theory (DFT) at finite electronic temperature to within chemical accuracy at negligible computational cost. Based on deep neural networks, our workflow yields the local density of states (LDOS) for a given atomic configuration. From the LDOS, spatially-resolved, energy-resolved, and integrated quantities can be calculated, including the DFT total free energy, which serves as the Born-Oppenheimer potential energy surface for the atoms. We demonstrate the efficacy of this approach for both solid and liquid metals and compare results between independent and unified machine-learning models for solid and liquid aluminum. Our machine-learning density functional theory framework opens up the path towards multiscale materials modeling for matter under ambient and extreme conditions at a computational scale and cost that is unattainable with current algorithms.


title: Narrowband Internet of Things for Non-terrestrial Networks

abstract: The Narrowband Internet of Things (NB-IoT) is a cellular access technology developed by the Third Generation Partnership Project (3GPP) to provide wide area connectivity for the Internet of Things. Since its introduction in 3GPP Release 13, NB-IoT has in a few years achieved a remarkable market presence and is currently providing coverage in close to 100 countries. To further extend the reach of NB-IoT and to connect the unconnected, 3GPP Release 17 will study the feasibility of adapting NB-IoT to support non-terrestrial networks (NTNs). In this article, we review the fundamentals of NB-IoT and NTN and explain how NB-IoT can be adapted to support satellite communication through a minimal set of modifications.


title: Total connected domination game

abstract: The (total) connected domination game on a graph $G$ is played by two players, Dominator and Staller, according to the standard (total) domination game with the additional requirement that at each stage of the game the selected vertices induce a connected subgraph of $G$. If Dominator starts the game and both players play optimally, then the number of vertices selected during the game is the (total) connected game domination number ($\gamma_{\rm tcg}(G)$) $\gamma_{\rm cg}(G)$ of $G$. We show that $\gamma_{\rm tcg}(G)\in \{\gamma_{\rm cg}(G), \gamma_{\rm cg}(G) + 1, \gamma_{\rm cg}(G) + 2\}$, and consequently define $G$ as Class $i$ if $\gamma_{\rm tcg}(G) = \gamma_{\rm cg} + i$ for $i \in \{0,1,2\}$. A large family of Class $0$ graphs is constructed which contains all connected Cartesian product graphs and connected direct product graphs with minumum degree at least $2$. We show that no tree is Class $2$ and characterize Class $1$ trees. We provide an infinite family of Class $2$ bipartite graphs.


title: Training without Gradients -- A Filtering Approach

abstract: A particle filtering approach is suggested for the training of multi-layer neural networks without utilizing gradients calculation. The network weights are considered to be the components of the estimated state-vector of a noise driven linear system, whereas the neural network serves as the measurement function in the estimation problem. A simple example is used to provide a preliminary demonstration of the concept, which remains to be further studied for training deep neural networks.


title: Boundary integral formulations for transient linear thermoelasticity with combined-type boundary conditions

abstract: We study boundary integral formulations for an interior/exterior initial boundary value problem arising from the thermo-elasto-dynamic equations in a homogeneous and isotropic domain. The time dependence is handled, based on Lubich's approach, through a passage to the Laplace domain. We focus on the cases where one of the unknown fields satisfies a Dirichlet boundary condition, while the other one is subject to conditions of Neumann type. In the Laplace domain, combined single- and double-layer potential boundary integral operators are introduced and proven to be coercive. Based on the Laplace domain estimates, it is possible to prove the existence and uniqueness of solutions in the time domain. This analysis complements previous results that may serve as the mathematical foundation for discretization schemes based on the combined use of the boundary element method and convolution quadrature.


title: The Complexity of Counting Edge Colorings for Simple Graphs

abstract: We prove #P-completeness results for counting edge colorings on simple graphs. These strengthen the corresponding results on multigraphs from [4]. We prove that for any $\kappa \ge r \ge 3$ counting $\kappa$-edge colorings on $r$-regular simple graphs is #P-complete. Furthermore, we show that for planar $r$-regular simple graphs where $r \in \{3, 4, 5\}$ counting edge colorings with \k{appa} colors for any $\kappa \ge r$ is also #P-complete. As there are no planar $r$-regular simple graphs for any $r > 5$, these statements cover all interesting cases in terms of the parameters $(\kappa, r)$.


title: On the criteria of large cavitation bubbles in a tube during a transient process

abstract: Extreme cavitation scenarios such as water column separations in hydraulic systems during transient processes caused by large cavitation bubbles can lead to catastrophic destruction. In the present paper, we study the onset criteria and dynamics of large cavitation bubbles in a tube. A new cavitation number $Ca_2 = {l^*}^{-1} Ca_0$ is proposed to describe the maximum length $L_{\max}$ of the cavitation bubble, where $l^*$ is a non-dimensional length of the water column indicating its slenderness, and $Ca_0$ is the classic cavitation number. Combined with the onset criteria for acceleration-induced cavitation ($Ca_1<1$, Pan et al. (2017)), we show that the occurrence of large cylindrical cavitation bubbles requires both $Ca_2<1$ and $Ca_1<1$ simultaneously. We also establish a Rayleigh-type model for the dynamics of large cavitation bubbles in a tube. The bubbles collapse at a finite end speed, and the time from the maximum bubble size to collapse is $T_c=\sqrt{2}\sqrt{lL_{\max}}\sqrt{\frac{\rho}{p_\infty}}$, where $l$ is the length of the water column, $L_{\max}$ is the maximum bubble length, $\rho$ is the liquid density, and $p_{\infty}$ is the reference pressure in the far field. The analytical results are validated against systematic experiments using a modified 'tube-arrest' apparatus, which can decouple acceleration and velocity. The results in the current work can guide design and operation of hydraulic systems encountering transient processes.


title: Improve the Robustness and Accuracy of Deep Neural Network with $L_{2,\infty}$ Normalization

abstract: In this paper, the robustness and accuracy of the deep neural network (DNN) was enhanced by introducing the $L_{2,\infty}$ normalization of the weight matrices of the DNN with Relu as the activation function. It is proved that the $L_{2,\infty}$ normalization leads to large dihedral angles between two adjacent faces of the polyhedron graph of the DNN function and hence smoother DNN functions, which reduces over-fitting. A measure is proposed for the robustness of a classification DNN, which is the average radius of the maximal robust spheres with the sample data as centers. A lower bound for the robustness measure is given in terms of the $L_{2,\infty}$ norm. Finally, an upper bound for the Rademacher complexity of DNN with $L_{2,\infty}$ normalization is given. An algorithm is given to train a DNN with the $L_{2,\infty}$ normalization and experimental results are used to show that the $L_{2,\infty}$ normalization is effective to improve the robustness and accuracy.


title: Interpretable Neural Computation for Real-World Compositional Visual Question Answering

abstract: There are two main lines of research on visual question answering (VQA): compositional model with explicit multi-hop reasoning, and monolithic network with implicit reasoning in the latent feature space. The former excels in interpretability and compositionality but fails on real-world images, while the latter usually achieves better performance due to model flexibility and parameter efficiency. We aim to combine the two to build an interpretable framework for real-world compositional VQA. In our framework, images and questions are disentangled into scene graphs and programs, and a symbolic program executor runs on them with full transparency to select the attention regions, which are then iteratively passed to a visual-linguistic pre-trained encoder to predict answers. Experiments conducted on the GQA benchmark demonstrate that our framework outperforms the compositional prior arts and achieves competitive accuracy among monolithic ones. With respect to the validity, plausibility and distribution metrics, our framework surpasses others by a considerable margin.


title: Helpfulness as a Key Metric of Human-Robot Collaboration

abstract: As robotic teammates become more common in society, people will assess the robots' roles in their interactions along many dimensions. One such dimension is effectiveness: people will ask whether their robotic partners are trustworthy and effective collaborators. This begs a crucial question: how can we quantitatively measure the helpfulness of a robotic partner for a given task at hand? This paper seeks to answer this question with regards to the interactive robot's decision making. We describe a clear, concise, and task-oriented metric applicable to many different planning and execution paradigms. The proposed helpfulness metric is fundamental to assessing the benefit that a partner has on a team for a given task. In this paper, we define helpfulness, illustrate it on concrete examples from a variety of domains, discuss its properties and ramifications for planning interactions with humans, and present preliminary results.


title: Coherent Helicity-Dependent Spin-Phonon Oscillations in the Ferromagnetic van der Waals Crystal CrI3

abstract: The discovery of two-dimensional (2D) systems hosting intrinsic long-range magnetic order represents a seminal addition to the rich physical landscape of van der Waals (vdW) materials. CrI3 has emerged as perhaps the most salient example, as the interdependence of crystalline structure and magnetic order, along with strong light-matter interactions provides a promising platform to explore the optical control of magnetic, vibrational, and charge degrees of freedom at the 2D limit. However, the fundamental question of how this relationship between structure and magnetism manifests on their intrinsic timescales has rarely been explored. Here, we use ultrafast optical spectroscopy to probe magnetic and vibrational dynamics in CrI3, revealing demagnetization dynamics governed by spin-flip scattering and remarkably, a strong transient exchange-mediated interaction between lattice vibrations and spin oscillations. The latter yields a coherent spin-coupled phonon mode that is highly sensitive to the helicity of the driving pulse in the magnetically ordered phase. Our results shed light on the nature of spin-lattice coupling in vdW magnets on ultrafast timescales and highlight their potential for applications requiring non-thermal, high-speed control of magnetism at the nanoscale.


title: Dimension-free Harnack inequalities for conjugate heat equations and their applications to geometric flows

abstract: Let $M$ be a differentiable manifold endowed with a family of complete Riemannian metrics $g(t)$ evolving under a geometric flow over the time interval $[0,T[$. In this article, we give a probabilistic representation for the derivative of the corresponding conjugate semigroup on $M$ which is generated by a Schr\"{o}dinger type operator. With the help of this derivative formula, we derive fundamental Harnack type inequalities in the setting of evolving Riemannian manifolds. In particular, we establish a dimension-free Harnack inequality and show how it can be used to achieve heat kernel upper bounds in the setting of moving metrics. Moreover, by means of the supercontractivity of the conjugate semigroup, we obtain a family of canonical log-Sobolev inequalities. We discuss and apply these results both in the case of the so-called modified Ricci flow and in the case of general geometric flows.


title: Generalized Independent Noise Condition for Estimating Latent Variable Causal Graphs

abstract: Causal discovery aims to recover causal structures or models underlying the observed data. Despite its success in certain domains, most existing methods focus on causal relations between observed variables, while in many scenarios the observed ones may not be the underlying causal variables (e.g., image pixels), but are generated by latent causal variables or confounders that are causally related. To this end, in this paper, we consider Linear, Non-Gaussian Latent variable Models (LiNGLaMs), in which latent confounders are also causally related, and propose a Generalized Independent Noise (GIN) condition to estimate such latent variable graphs. Specifically, for two observed random vectors $\mathbf{Y}$ and $\mathbf{Z}$, GIN holds if and only if $\omega^{\intercal}\mathbf{Y}$ and $\mathbf{Z}$ are statistically independent, where $\omega$ is a parameter vector characterized from the cross-covariance between $\mathbf{Y}$ and $\mathbf{Z}$. From the graphical view, roughly speaking, GIN implies that causally earlier latent common causes of variables in $\mathbf{Y}$ d-separate $\mathbf{Y}$ from $\mathbf{Z}$. Interestingly, we find that the independent noise condition, i.e., if there is no confounder, causes are independent from the error of regressing the effect on the causes, can be seen as a special case of GIN. Moreover, we show that GIN helps locate latent variables and identify their causal structure, including causal directions. We further develop a recursive learning algorithm to achieve these goals. Experimental results on synthetic and real-world data demonstrate the effectiveness of our method.


title: Automatically Deriving Control-Flow Graph Generators from Operational Semantics

abstract: We develop the first theory of control-flow graphs from first principles, and use it to create an algorithm for automatically synthesizing many variants of control-flow graph generators from a language's operational semantics. Our approach first introduces a new algorithm for converting a large class of small-step operational semantics to an abstract machine. It next uses a technique called "abstract rewriting" to automatically abstract the semantics of a language, which is used both to directly generate a CFG from a program ("interpreted mode") and to generate standalone code, similar to a human-written CFG generator, for any program in a language. We show how the choice of two abstraction and projection parameters allow our approach to synthesize several families of CFG-generators useful for different kinds of tools. We prove the correspondence between the generated graphs and the original semantics. We provide and prove an algorithm for automatically proving the termination of interpreted-mode generators. In addition to our theoretical results, we have implemented this algorithm in a tool called Mandate, and show that it produces human-readable code on two medium-size languages with 60-80 rules, featuring nearly all intraprocedural control constructs common in modern languages. We then showed these CFG-generators were sufficient to build two static analyzers atop them. Our work is a promising step towards the grand vision of being able to synthesize all desired tools from the semantics of a programming language.


title: Ch\^atelet surfaces and non-invariance of the Brauer-Manin obstruction for $3$-folds

abstract: In this paper, we construct three kinds of Ch\^atelet surfaces, which have some given arithmetic properties with respect to field extensions of number fields. We then use these constructions to study the properties of weak approximation with Brauer-Manin obstruction and the Hasse principle with Brauer-Manin obstruction for $3$-folds, which are pencils of Ch\^atelet surfaces parameterized by a curve, with respect to field extensions of number fields. We give general constructions (conditional on a conjecture of M. Stoll) to negatively answer some questions, and illustrate these constructions and some exceptions with some explicit unconditional examples.


title: Selective Information Passing for MR/CT Image Segmentation

abstract: Automated medical image segmentation plays an important role in many clinical applications, which however is a very challenging task, due to complex background texture, lack of clear boundary and significant shape and texture variation between images. Many researchers proposed an encoder-decoder architecture with skip connections to combine low-level feature maps from the encoder path with high-level feature maps from the decoder path for automatically segmenting medical images. The skip connections have been shown to be effective in recovering fine-grained details of the target objects and may facilitate the gradient back-propagation. However, not all the feature maps transmitted by those connections contribute positively to the network performance. In this paper, to adaptively select useful information to pass through those skip connections, we propose a novel 3D network with self-supervised function, named selective information passing network (SIP-Net). We evaluate our proposed model on the MICCAI Prostate MR Image Segmentation 2012 Grant Challenge dataset, TCIA Pancreas CT-82 and MICCAI 2017 Liver Tumor Segmentation (LiTS) Challenge dataset. The experimental results across these data sets show that our model achieved improved segmentation results and outperformed other state-of-the-art methods. The source code of this work is available at https://github.com/ahukui/SIPNet.


title: Field theoretic viewpoints on certain fluid mechanical phenomena

abstract: In this thesis we study field theoretic viewpoints on certain fluid mechanical phenomena. In the Higgs mechanism, the weak gauge bosons acquire masses by interacting with a scalar field, leading to a vector boson mass matrix. On the other hand, a rigid body accelerated through an inviscid, incompressible and irrotational fluid feels an opposing force linear in its acceleration, via an added-mass tensor. We uncover a physical analogy between these effects and propose a dictionary relating them. The correspondence turns the gauge Lie algebra into the space of directions in which the body can move, encodes the pattern of symmetry breaking in the shape of an associated body and relates symmetries of the body to those of the vacuum manifold. The new viewpoint raises interesting questions, notably on the fluid analogs of the broken symmetry and Higgs particle. Ideal gas dynamics can develop shock-like singularities which are typically regularized through viscosity. In 1d, discontinuities can also be dispersively smoothed. In the 2nd part, we develop a minimal conservative regularization of 3d adiabatic flow of a gas with exponent $\gamma$, by adding a capillarity energy $\beta_* (\nabla \rho)^2/\rho$ to the Hamiltonian. This leads to a nonlinear force with 3 derivatives of $\rho$, while preserving the conservation laws of mass and entropy. Our model admits dispersive sound, solitary & periodic traveling waves, but no steady continuous shock-like solutions. Nevertheless, in 1d, for $\gamma = 2$, numerical solutions in periodic domains show recurrence & avoidance of gradient catastrophes via solitons with phase-shift scattering. This is explained via an equivalence of our model (for homentropic potential flow in any dimension) with a defocussing nonlinear Schr\"odinger equation (NLS, cubic for $\gamma = 2$). Thus, our model generalizes KdV & NLS to adiabatic gas flow in any dimension.


title: Structured Self-Attention Weights Encode Semantics in Sentiment Analysis

abstract: Neural attention, especially the self-attention made popular by the Transformer, has become the workhorse of state-of-the-art natural language processing (NLP) models. Very recent work suggests that the self-attention in the Transformer encodes syntactic information; Here, we show that self-attention scores encode semantics by considering sentiment analysis tasks. In contrast to gradient-based feature attribution methods, we propose a simple and effective Layer-wise Attention Tracing (LAT) method to analyze structured attention weights. We apply our method to Transformer models trained on two tasks that have surface dissimilarities, but share common semantics---sentiment analysis of movie reviews and time-series valence prediction in life story narratives. Across both tasks, words with high aggregated attention weights were rich in emotional semantics, as quantitatively validated by an emotion lexicon labeled by human annotators. Our results show that structured attention weights encode rich semantics in sentiment analysis, and match human interpretations of semantics.


title: Highly anisotropic two-dimensional metal in monolayer MoOCl$_2$

abstract: Anisotropy is a general feature in materials. Strong anisotropy could lead to interesting physical properties and useful applications. Here, based on first-principles calculations and theoretical analysis, we predict a stable two-dimensional (2D) material---the monolayer MoOCl$_2$, and show that it possesses intriguing properties related to its high anisotropy. Monolayer MoOCl$_2$ can be readily exfoliated from the van der Waals layered bulk, which has already been synthesized. We show that a high in-plane anisotropy manifests in the structural, phononic, mechanical, electronic, and optical properties of monolayer MoOCl$_2$. The material is a metal with highly anisotropic Fermi surfaces, giving rise to open orbits at the Fermi level, which can be probed in magneto-transport. Remarkably, the combination of high anisotropy and metallic character makes monolayer MoOCl$_2$ an almost ideal hyperbolic material. It has two very wide hyperbolic frequency windows from 0.41 eV (99 THz) to 2.90 eV (701 THz), and from 3.63 eV (878 THz) to 5.54 eV (1340 THz). The former window has a large overlap with the visible spectrum, and the dissipation for most part of this window is very small. The window can be further tuned by the applied strain, such that at a chosen frequency, a transition between elliptic and hyperbolic character can be induced by strain. Our work discovers a highly anisotropic 2D metal with extraordinary properties, which holds great potential for electronic and optical applications.


title: On Long-Tailed Phenomena in Neural Machine Translation

abstract: State-of-the-art Neural Machine Translation (NMT) models struggle with generating low-frequency tokens, tackling which remains a major challenge. The analysis of long-tailed phenomena in the context of structured prediction tasks is further hindered by the added complexities of search during inference. In this work, we quantitatively characterize such long-tailed phenomena at two levels of abstraction, namely, token classification and sequence generation. We propose a new loss function, the Anti-Focal loss, to better adapt model training to the structural dependencies of conditional text generation by incorporating the inductive biases of beam search in the training process. We show the efficacy of the proposed technique on a number of Machine Translation (MT) datasets, demonstrating that it leads to significant gains over cross-entropy across different language pairs, especially on the generation of low-frequency words. We have released the code to reproduce our results.


title: Regularizing Neural Networks via Adversarial Model Perturbation

abstract: Effective regularization techniques are highly desired in deep learning for alleviating overfitting and improving generalization. This work proposes a new regularization scheme, based on the understanding that the flat local minima of the empirical risk cause the model to generalize better. This scheme is referred to as adversarial model perturbation (AMP), where instead of directly minimizing the empirical risk, an alternative "AMP loss" is minimized via SGD. Specifically, the AMP loss is obtained from the empirical risk by applying the "worst" norm-bounded perturbation on each point in the parameter space. Comparing with most existing regularization schemes, AMP has strong theoretical justifications, in that minimizing the AMP loss can be shown theoretically to favour flat local minima of the empirical risk. Extensive experiments on various modern deep architectures establish AMP as a new state of the art among regularization schemes. Our code is available at https://github.com/hiyouga/AMP-Regularizer.


title: Latent Tree Learning with Ordered Neurons: What Parses Does It Produce?

abstract: Recent latent tree learning models can learn constituency parsing without any exposure to human-annotated tree structures. One such model is ON-LSTM (Shen et al., 2019), which is trained on language modelling and has near-state-of-the-art performance on unsupervised parsing. In order to better understand the performance and consistency of the model as well as how the parses it generates are different from gold-standard PTB parses, we replicate the model with different restarts and examine their parses. We find that (1) the model has reasonably consistent parsing behaviors across different restarts, (2) the model struggles with the internal structures of complex noun phrases, (3) the model has a tendency to overestimate the height of the split points right before verbs. We speculate that both problems could potentially be solved by adopting a different training task other than unidirectional language modelling.


title: Cue-word Driven Neural Response Generation with a Shrinking Vocabulary

abstract: Open-domain response generation is the task of generating sensible and informative re-sponses to the source sentence. However, neural models tend to generate safe and mean-ingless responses. While cue-word introducing approaches encourage responses with concrete semantics and have shown tremendous potential, they still fail to explore di-verse responses during decoding. In this paper, we propose a novel but natural approach that can produce multiple cue-words during decoding, and then uses the produced cue-words to drive decoding and shrinks the decoding vocabulary. Thus the neural genera-tion model can explore the full space of responses and discover informative ones with efficiency. Experimental results show that our approach significantly outperforms several strong baseline models with much lower decoding complexity. Especially, our approach can converge to concrete semantics more efficiently during decoding.


title: Contrastive Rendering for Ultrasound Image Segmentation

abstract: Ultrasound (US) image segmentation embraced its significant improvement in deep learning era. However, the lack of sharp boundaries in US images still remains an inherent challenge for segmentation. Previous methods often resort to global context, multi-scale cues or auxiliary guidance to estimate the boundaries. It is hard for these methods to approach pixel-level learning for fine-grained boundary generating. In this paper, we propose a novel and effective framework to improve boundary estimation in US images. Our work has three highlights. First, we propose to formulate the boundary estimation as a rendering task, which can recognize ambiguous points (pixels/voxels) and calibrate the boundary prediction via enriched feature representation learning. Second, we introduce point-wise contrastive learning to enhance the similarity of points from the same class and contrastively decrease the similarity of points from different classes. Boundary ambiguities are therefore further addressed. Third, both rendering and contrastive learning tasks contribute to consistent improvement while reducing network parameters. As a proof-of-concept, we performed validation experiments on a challenging dataset of 86 ovarian US volumes. Results show that our proposed method outperforms state-of-the-art methods and has the potential to be used in clinical practice.


title: Defining Computer Art: Methods, Themes, and the Aesthetic Problematic

abstract: The application of computer technology in the field of art has given rise to novel modes of artistic practice, including media art, and it is a necessity to find a commensurable conceptual fundament. Therefore, computer art starting from the 1950s reenters the view. To clarify the definition, major methods for defining are reviewed, and it is argued that the thematic definition guided by situational logic provides a feasible approach. There is a triad of themes: the relationship between art and technology, the problem of machine creation, and the ontology of art. Consisted of primitive and mutually supportive questions, a logical space of questioning, i.e. a problematic, is formed as the basis for the identity of computer art. Among them, the problem of the ontology of art is located at the logical starting point of questioning, and this problematic is therefore an aesthetic one. The anticipation that computer art presents and responds to the above-mentioned aesthetic problematic suggests the plausibility of computer art being a legitimate category of art.


title: Asymptotic Properties of the Maximum Likelihood Estimator in Regime-Switching Models with Time-Varying Transition Probabilities

abstract: We prove the asymptotic properties of the maximum likelihood estimator (MLE) in time-varying transition probability (TVTP) regime-switching models. This class of models extends the constant regime transition probability in Markov-switching models to a time-varying probability by including information from observations. An important feature in this proof is the mixing rate of the regime process conditional on the observations, which is time varying owing to the time-varying transition probabilities. Consistency and asymptotic normality follow from the almost deterministic geometrically decaying bound of the mixing rate. The assumptions are verified in regime-switching autoregressive models with widely-applied TVTP specifications. A simulation study examines the finite-sample distributions of the MLE and compares the estimates of the asymptotic variance constructed from the Hessian matrix and the outer product of the score. The simulation results favour the latter. As an empirical example, we compare three leading economic indicators in terms of describing U.S. industrial production.


title: Origami-based Shape Morphing Fingertip to Enhance Grasping Stability and Dexterity

abstract: Adaptation to various scene configurations and object properties, stability and dexterity in robotic grasping manipulation is far from explored. This work presents an origami-based shape morphing fingertip design to actively tackle the grasping stability and dexterity problems. The proposed fingertip utilizes origami as its skeleton providing degrees of freedom at desired positions and motor-driven four-bar-linkages as its transmission components to achieve a compact size of the fingertip. 3 morphing types that are commonly observed and essential in robotic grasping are studied and validated with geometrical modeling. Experiments including grasping an object with convex point contact to pivot or do pinch grasping, grasped object reorientation, and enveloping grasping with concave fingertip surfaces are implemented to demonstrate the advantages of our fingertip compared to conventional parallel grippers. Multi-functionality on enhancing grasping stability and dexterity via active adaptation given different grasped objects and manipulation tasks are justified. Video is available at youtu.be/jJoJ3xnDdVk/.


title: Asymptotic behavior of positive solutions of some nonlinear elliptic equations on cylinders

abstract: We establish quantitative asymptotic behavior of positive solutions of a family of nonlinear elliptic equations on the half cylinder near the end. This unifies the study of isolated singularities of some semilinear elliptic equations, such as the Yamabe equation, Hardy-H\'enon equation etc.


title: Barter Exchange via Friends' Friends

abstract: Barter exchange studies the setting where each agent owns a good, and they can exchange with each other if that gives them more preferred goods. This exchange will give better outcomes if there are more participants. The challenge here is how to get more participants and our goal is to incentivize the existing participants to invite new participants. However, new participants might be competitors for the existing participants. Therefore, we design an exchange mechanism based on the classical Top Trading Cycle (TTC) algorithm to solve their conflicts. Our mechanism is truthful in terms of revealing their preferences and also guarantees that inviting all their neighbors is a dominant strategy for all participants. The mechanism can be applied in settings where more participants are preferred but no extra budget to reach new participants.


title: Boundary integral operators for the heat equation in time-dependent domains

abstract: This article provides a functional analytical framework for boundary integral equations of the heat equation in time-dependent domains. More specifically, we consider a non-cylindrical domain in space-time that is the $C^2$-diffeomorphic image of a cylinder, i.e., the tensor product of a time interval and a fixed domain in space. On the non-cylindrical domain, we introduce Sobolev spaces, trace lemmata and provide the mapping properties of the layer operators by mimicking the proofs of [M. Costabel, Boundary integral operators for the heat equation, Integral Equations and Operator Theory, 13(4):498-552, 1990]. Here it is critical that the Neumann trace requires a correction term for the normal velocity of the moving boundary. Therefore, one has to analyze the situation carefully.


title: HPCC-YNU at SemEval-2020 Task 9: A Bilingual Vector Gating Mechanism for Sentiment Analysis of Code-Mixed Text

abstract: It is fairly common to use code-mixing on a social media platform to express opinions and emotions in multilingual societies. The purpose of this task is to detect the sentiment of code-mixed social media text. Code-mixed text poses a great challenge for the traditional NLP system, which currently uses monolingual resources to deal with the problem of multilingual mixing. This task has been solved in the past using lexicon lookup in respective sentiment dictionaries and using a long short-term memory (LSTM) neural network for monolingual resources. In this paper, we (my codalab username is kongjun) present a system that uses a bilingual vector gating mechanism for bilingual resources to complete the task. The model consists of two main parts: the vector gating mechanism, which combines the character and word levels, and the attention mechanism, which extracts the important emotional parts of the text. The results show that the proposed system outperforms the baseline algorithm. We achieved fifth place in Spanglish and 19th place in Hinglish.The code of this paper is availabled at : https://github.com/JunKong5/Semveal2020-task9


title: An Empirical Study on Detecting COVID-19 in Chest X-ray Images Using Deep Learning Based Methods

abstract: Spreading of COVID-19 virus has increased the efforts to provide testing kits. Not only the preparation of these kits had been hard, rare, and expensive but also using them is another issue. Results have shown that these kits take some crucial time to recognize the virus, in addition to the fact that they encounter with 30% loss. In this paper, we have studied the usage of x-ray pictures which are ubiquitous, for the classification of COVID-19 chest Xray images, by the existing convolutional neural networks (CNNs). We intend to train chest x-rays of infected and not infected ones with different CNNs architectures including VGG19, Densnet-121, and Xception. Training these architectures resulted in different accuracies which were much faster and more precise than usual ways of testing.


title: On The Convergence of First Order Methods for Quasar-Convex Optimization

abstract: In recent years, the success of deep learning has inspired many researchers to study the optimization of general smooth non-convex functions. However, recent works have established pessimistic worst-case complexities for this class functions, which is in stark contrast with their superior performance in real-world applications (e.g. training deep neural networks). On the other hand, it is found that many popular non-convex optimization problems enjoy certain structured properties which bear some similarities to convexity. In this paper, we study the class of \textit{quasar-convex functions} to close the gap between theory and practice. We study the convergence of first order methods in a variety of different settings and under different optimality criterions. We prove complexity upper bounds that are similar to standard results established for convex functions and much better that state-of-the-art convergence rates of non-convex functions. Overall, this paper suggests that \textit{quasar-convexity} allows efficient optimization procedures, and we are looking forward to seeing more problems that demonstrate similar properties in practice.


title: AstroDS -- A Distributed Storage for Astrophysics of Cosmic Rays. Current Status

abstract: Currently, the processing of scientific data in astroparticle physics is based on various distributed technologies, the most common of which are Grid and cloud computing. The most frequently discussed approaches are focused on large and even very large scientific experiments, such as Cherenkov Telescope Array. We, by contrast, offer a solution designed for small to medium experiments such as TAIGA. In such experiments, as a rule, historically developed specific data processing methods and specialized software are used. We have specifically designed a distributed (cloud) data storage for astroparticle physics data collaboration in medium-sized experiments. In this article, we discuss the current state of our work using the example of the TAIGA and CASCADE experiments. A feature of our approach is that we provide our users with scientific data in the form to which they are accustomed to in everyday work on local resources.


title: Nilpotency in left semi-braces

abstract: We introduce left and right series of left semi-braces. This allows to define left and right nilpotent left semi-braces. We study the structure of such semi-braces and generalize some results, known for skew left braces, to left semi-braces. We study the structure of left semi-braces $B$ such that the set of additive idempotents $E$ is an ideal of $B$. Finally we introduce the concept of a nilpotent left semi-brace and we show that the multiplicative group of such semi-braces is nilpotent.


title: Testing radiation reaction by simple charge distributions

abstract: A point charge is frequently approximated by various charge distributions deriving the Lorentz-Abraham-Dirac (LAD) equation. Here a rigid spherical shell is treated from this point of view. This particular continuum model is excellent to investigate whether some hidden expectations are true or not. It is shown here that the field of a uniformly charged rigid spherical shell cannot be substituted by the field of a central point charge. The related calculations are short and transparent due to a reference frame free representation of spacetime and the mathematical theory of generalised functions. %Here it is shown that the field of a uniformly charged rigid spherical shell cannot be substituted by the field of a central effective point charge. The related calculations are short and transparent due to a reference frame free representation of spacetime and the mathematical theory of generalised functions.


title: When Hearst Is not Enough: Improving Hypernymy Detection from Corpus with Distributional Models

abstract: We address hypernymy detection, i.e., whether an is-a relationship exists between words (x, y), with the help of large textual corpora. Most conventional approaches to this task have been categorized to be either pattern-based or distributional. Recent studies suggest that pattern-based ones are superior, if large-scale Hearst pairs are extracted and fed, with the sparsity of unseen (x, y) pairs relieved. However, they become invalid in some specific sparsity cases, where x or y is not involved in any pattern. For the first time, this paper quantifies the non-negligible existence of those specific cases. We also demonstrate that distributional methods are ideal to make up for pattern-based ones in such cases. We devise a complementary framework, under which a pattern-based and a distributional model collaborate seamlessly in cases which they each prefer. On several benchmark datasets, our framework achieves competitive improvements and the case study shows its better interpretability.


title: Contact Tracing & Super-Spreaders in the Branching-Process Model

abstract: In recent years, it became clear that super-spreader events play an important role, particularly in the spread of airborne infections. We investigate a novel model for super-spreader events, not based on a heterogeneous contact graph but on a random contact rate: Many individuals become infected synchronously in single contact events. We use the branching-process approach for contact tracing to analyze the impact of super-spreader events on the effect of contact tracing. Here we neglect a tracing delay. Roughly speaking, we find that contact tracing is more efficient in the presence of super-spreaders if the fraction of symptomatics is small, the tracing probability is high, or the latency period is distinctively larger than the incubation period. In other cases, the effect of contact tracing can be decreased by super-spreaders. Numerical analysis with parameters suited for SARS-CoV-2 indicates that super-spreaders do not decrease the effect of contact tracing crucially in case of that infection.


title: Testing weakest force with coldest spot

abstract: Ultra-cold atom experiment in space with microgravity allows for realization of dilute atomic-gas Bose-Einstein condensate (BEC) with macroscopically large occupation number and significantly long condensate lifetime, which allows for a precise measurement on the shape oscillation frequency by calibrating itself over numerous oscillation periods. In this paper, we propose to measure the Newtonian gravitational constant via ultra-cold atom BEC with shape oscillation, although it is experimentally challenging. We also make a preliminary perspective on constraining the modified Newtonian potential such as the power-law potential, Yukawa interaction, and fat graviton. A resolution of frequency measurement of $(1-100)\,\mathrm{nHz}$ at most for the occupation number $10^9$, just one order above experimentally achievable number $N\sim10^6-10^8$, is feasible to constrain the modified Newtonian potential with Yukawa interaction greatly beyond the current exclusion limits.


title: The Current Design and Implementation of the AstroDS Data Aggregation Service

abstract: AstroDS is a distributed storage for Cosmic Ray Astrophysics. The primary goal of Astro DS is to gather data measured by the instruments of various physical experiments such as TAIGA, TUNKA, KASCADE into global storage and provide the users with a standardized user-friendly interface to search for the datasets that match certain conditions. AstroDS consists of a set of distributed microservices components that communicate with each other through the Internet via REST API. The core component of AstroDS is the Data Aggregation Service that orchestrates other components to provide access to data. The development process of AstroDS started in 2019. This paper describes the current design and implementation of the Data Aggregation Service and also the benefits it brings to the astrophysical community in the early state.


title: Simple approximate formulas for postbuckling deflection of heavy elastic columns

abstract: Columnar buckling is a ubiquitous phenomenon that occurs in both living things and man-made objects, regardless of the length scale ranging from macroscopic to nanometric structures. In general, analyzing the post-buckling behavior of a column requires the application of complex mathematical methods because it involves nonlinear problem solving. To complement these complex methods, this study presents simple analytical formulas for the large deflection of a heavy elastic column under combined loads. The analytical formulas relate the concentrated load acting on the tip of the column, the column's own weight, and the deflection angle of the column through a simple mathematical expression. This can assist in obtaining an overall picture of the post-buckling behavior of heavy columns from an application point of view.


title: Revisiting Deep Neural Network Test Coverage from the Test Effectiveness Perspective

abstract: Many test coverage metrics have been proposed to measure the Deep Neural Network (DNN) testing effectiveness, including structural coverage and non-structural coverage. These test coverage metrics are proposed based on the fundamental assumption: they are correlated with test effectiveness. However, the fundamental assumption is still not validated sufficiently and reasonably, which brings question on the usefulness of DNN test coverage. This paper conducted a revisiting study on the existing DNN test coverage from the test effectiveness perspective, to effectively validate the fundamental assumption. Here, we carefully considered the diversity of subjects, three test effectiveness criteria, and both typical and state-of-the-art test coverage metrics. Different from all the existing studies that deliver negative conclusions on the usefulness of existing DNN test coverage, we identified some positive conclusions on their usefulness from the test effectiveness perspective. In particular, we found the complementary relationship between structural and non-structural coverage and identified the practical usage scenarios and promising research directions for these existing test coverage metrics.


title: Double Forward Propagation for Memorized Batch Normalization

abstract: Batch Normalization (BN) has been a standard component in designing deep neural networks (DNNs). Although the standard BN can significantly accelerate the training of DNNs and improve the generalization performance, it has several underlying limitations which may hamper the performance in both training and inference. In the training stage, BN relies on estimating the mean and variance of data using a single minibatch. Consequently, BN can be unstable when the batch size is very small or the data is poorly sampled. In the inference stage, BN often uses the so called moving mean and moving variance instead of batch statistics, i.e., the training and inference rules in BN are not consistent. Regarding these issues, we propose a memorized batch normalization (MBN), which considers multiple recent batches to obtain more accurate and robust statistics. Note that after the SGD update for each batch, the model parameters will change, and the features will change accordingly, leading to the Distribution Shift before and after the update for the considered batch. To alleviate this issue, we present a simple Double-Forward scheme in MBN which can further improve the performance. Compared to related methods, the proposed MBN exhibits consistent behaviors in both training and inference. Empirical results show that the MBN based models trained with the Double-Forward scheme greatly reduce the sensitivity of data and significantly improve the generalization performance.


title: Making Online Sketching Hashing Even Faster

abstract: Data-dependent hashing methods have demonstrated good performance in various machine learning applications to learn a low-dimensional representation from the original data. However, they still suffer from several obstacles: First, most of existing hashing methods are trained in a batch mode, yielding inefficiency for training streaming data. Second, the computational cost and the memory consumption increase extraordinarily in the big data setting, which perplexes the training procedure. Third, the lack of labeled data hinders the improvement of the model performance. To address these difficulties, we utilize online sketching hashing (OSH) and present a FasteR Online Sketching Hashing (FROSH) algorithm to sketch the data in a more compact form via an independent transformation. We provide theoretical justification to guarantee that our proposed FROSH consumes less time and achieves a comparable sketching precision under the same memory cost of OSH. We also extend FROSH to its distributed implementation, namely DFROSH, to further reduce the training time cost of FROSH while deriving the theoretical bound of the sketching precision. Finally, we conduct extensive experiments on both synthetic and real datasets to demonstrate the attractive merits of FROSH and DFROSH.


title: Image Generation With Neural Cellular Automatas

abstract: In this paper, we propose a novel approach to generate images (or other artworks) by using neural cellular automatas (NCAs). Rather than training NCAs based on single images one by one, we combined the idea with variational autoencoders (VAEs), and hence explored some applications, such as image restoration and style fusion. The code for model implementation is available online.


title: A Model Compression Method with Matrix Product Operators for Speech Enhancement

abstract: The deep neural network (DNN) based speech enhancement approaches have achieved promising performance. However, the number of parameters involved in these methods is usually enormous for the real applications of speech enhancement on the device with the limited resources. This seriously restricts the applications. To deal with this issue, model compression techniques are being widely studied. In this paper, we propose a model compression method based on matrix product operators (MPO) to substantially reduce the number of parameters in DNN models for speech enhancement. In this method, the weight matrices in the linear transformations of neural network model are replaced by the MPO decomposition format before training. In experiment, this process is applied to the causal neural network models, such as the feedforward multilayer perceptron (MLP) and long short-term memory (LSTM) models. Both MLP and LSTM models with/without compression are then utilized to estimate the ideal ratio mask for monaural speech enhancement. The experimental results show that our proposed MPO-based method outperforms the widely-used pruning method for speech enhancement under various compression rates, and further improvement can be achieved with respect to low compression rates. Our proposal provides an effective model compression method for speech enhancement, especially in cloud-free application.


title: Asymptotics of partial density function vanishing along smooth subvariety

abstract: We study the asymptotic of the partial density function associated to holomorphic section of a postive line bundle vanishing to high orders along a fixed smooth subvariety. Assuming local torus-action-invariance, we describe the forbidden region, generalizing the result of Ross-Singer.


title: Stability of closedness of semi-algebraic sets under continuous semi-algebraic mappings

abstract: Given a closed semi-algebraic set $X \subset \mathbb{R}^n$ and a continuous semi-algebraic mapping $G \colon X \to \mathbb{R}^m,$ it will be shown that there exists an open dense semi-algebraic subset $\mathscr{U}$ of $L(\mathbb{R}^n, \mathbb{R}^m),$ the space of all linear mappings from $\mathbb{R}^n$ to $\mathbb{R}^m,$ such that for all $F \in \mathscr{U},$ the image $(F + G)(X)$ is a closed (semi-algebraic) set in $\mathbb{R}^m.$ To do this, we study the tangent cone at infinity $C_\infty X$ and the set $E_\infty X \subset C_\infty X$ of (unit) exceptional directions at infinity of $X.$ Specifically we show that the set $E_\infty X$ is nowhere dense in $C_\infty X \cap \mathbb{S}^{n - 1}.$


title: A Reduced Order Cut Finite Element method for geometrically parameterized steady and unsteady Navier-Stokes problems

abstract: This work focuses on steady and unsteady Navier-Stokes equations in a reduced order modeling framework. The methodology proposed is based on a Proper Orthogonal Decomposition within a levelset geometry description and the problems of interest are discretized with an unfitted mesh Finite Element Method. We construct and investigate a unified and geometry independent reduced basis which overcomes many barriers and complications of the past, that may occur whenever geometrical morphings are taking place. By employing a geometry independent reduced basis, we are able to avoid remeshing and transformation to reference configurations, and we are able to handle complex geometries. This combination of a fixed background mesh in a fixed extended background geometry with reduced order techniques appears beneficial and advantageous in many industrial and engineering applications, which could not be resolved efficiently in the past.


title: Powers in the wreath product of $G$ with $S_n$

abstract: In this paper we compute powers in the wreath product $G\wr S_n$, for any finite group $G$. For $r\geq 2$, a prime, consider $\omega_r: G\wr S_n\to G\wr S_n$ defined by $g \mapsto g^r$. Let $P_{r}(G\wr S_n)=\frac{|\omega_r(G\wr S_n)|}{|G|^n n!}$, be the probability that a randomly chosen element in $G\wr S_n$ is a $r^{th}$ power. We prove, $P_r(G\wr S_{n+1})=P_r(G\wr S_n)$ for all $n\not \equiv -1(\text{mod } r)$ if, order of $G$ is coprime to $r$. We also give a formula for the number of conjugacy classes that are $r^{th}$ powers in $G\wr S_n$.


title: A Distributed Hierarchy Framework for Enhancing Cyber Security of Control Center Applications

abstract: Recent cyber-attacks on power grids highlight the necessity to protect the critical functionalities of a control center vital for the safe operation of a grid. Even in a distributed framework one central control center acts as a coordinator in majority of the control center architectures. Such a control center can become a prime target for cyber as well as physical attacks, and, hence, a single point failure can lead to complete loss of visibility of the power grid. If the control center which runs the critical functions in a distributed computing environment can be randomly chosen between the available control centers in a secure framework, the ability of the attacker in causing a single point failure can be reduced to a great extent. To achieve this, a novel distributed hierarchy based framework to secure critical functions is proposed in this paper. The proposed framework ensures that the data aggregation and the critical functions are carried out at a random location, and incorporates security features such as attestation and trust management to detect compromised agents. A theoretical result is proved on the evolution and convergence of the trust values in the proposed trust management protocol. It is also shown that the system is nominally robust so long as the number of compromised nodes is strictly less than one-half of the nodes minus 1. For demonstration, a Kalman filter-based state estimation using phasor measurements is used as the critical function to be secured. The proposed framework's implementation feasibility is tested on a physical hardware cluster of Parallella boards. The framework is also validated using simulations on the IEEE 118 bus system.


title: Smoothing Game

abstract: We want to introduce another smoothing approach by treating each geometric element as a player in a game: a quest for the best element quality. In other words, each player has the goal of becoming as regular as possible. The set of strategies for each element is given by all translations of its vertices. Ideally, he would like to quantify this regularity using a quality measure which corresponds to the utility function in game theory. Each player is aware of the other players' utility functions as well as their set of strategies, which is analogous to his own utility function and strategies. In the simplest case, the utility functions only depend on the regularity. In more complicated cases this utility function depends on the element size, the curvature, or even the solution to a differential equation. This article is a sketch of a possible game-theoretical approach to mesh smoothing and still on-going research.


title: The stable hull of an exact $\infty$-category

abstract: We construct a left adjoint $\mathcal{H}^\text{st}\colon \mathbf{Ex}_{\infty} \rightarrow \mathbf{St}_{\infty}$ to the inclusion $\mathbf{St}_{\infty} \hookrightarrow \mathbf{Ex}_{\infty}$ of the $\infty$-category of stable $\infty$-categories into the $\infty$-category of exact $\infty$-categories, which we call the stable hull. For every exact $\infty$-category $\mathcal{E}$, the unit functor $\mathcal{E} \rightarrow \mathcal{H}^\text{st}(\mathcal{E})$ is fully faithful and preserves and reflects exact sequences. This provides an $\infty$-categorical variant of the Gabriel-Quillen embedding for ordinary exact categories. If $\mathcal{E}$ is an ordinary exact category, the stable hull $\mathcal{H}^\text{st}(\mathcal{E})$ is equivalent to the bounded derived $\infty$-category of $\mathcal{E}$.


title: Constraint Satisfaction Problems over Finite Structures

abstract: We initiate a systematic study of the computational complexity of the Constraint Satisfaction Problem (CSP) over finite structures that may contain both relations and operations. We show the close connection between this problem and a natural algebraic question: which finite algebras admit only polynomially many homomorphisms into them? We give some sufficient and some necessary conditions for a finite algebra to have this property. In particular, we show that every finite equationally nontrivial algebra has this property which gives us, as a simple consequence, a complete complexity classification of CSPs over two-element structures, thus extending the classification for two-element relational structures by Schaefer (STOC'78). We also present examples of two-element structures that have bounded width but do not have relational width (2,3), thus demonstrating that, from a descriptive complexity perspective, allowing operations leads to a richer theory.


title: Optimization in a non-linear Lanchester-type model involving supply units

abstract: In this paper, a non-linear Lanchester-type model involving supply units is introduced. The model describes a battle where the Blue party consisting of one armed force $B$ is fighting against the Red party. The Red party consists of $n$ armed forces each of which is supplied by a supply unit. A new variable called "fire allocation" is associated to the Blue force, reflecting its strategy during the battle. A problem of optimal fire allocation for Blue force is then studied. The optimal fire allocation of the Blue force allows that the number of Blue troops is always at its maximum. It is sought in the form of a piece-wise constant function of time with the help of "threatening rates" computed for each agent of the Red party. Numerical experiments are included to justify the theoretical results.


title: Noncommutative geometry, the Lorentzian Standard Model and its B-L extension

abstract: We explore the 1-loop renormalization group flow of two models coming from a generalization of the Connes-Lott version of Noncommutative Geometry in Lorentzian signature: the Noncommutative Standard Model and its B-L extension. Both make predictions on coupling constants at high energy, but only the latter is found to be compatible with the top quark and Higgs boson masses at the electroweak scale. We took into account corrections introduced by threshold effects and the relative positions of the Dirac and Majorana neutrino mass matrices and found them to be important. Some effects of 2-loop corrections are briefly discussed. The model is consistent with experiments only for a very small part of its parameter space and is thus predictive. The masses of the $Z'$ and B-L breaking scalar are found to be of the order $10^{14}$ GeV.


title: Representing Structured Semigroups on Etale Groupoid Bundles

abstract: We examine a semigroup analogue of the Kumjian-Renault representation of C*-algebras with Cartan subalgebras on twisted groupoids. Specifically, we show how to represent semigroups with distinguished normal subsemigroups as `slice-sections' of groupoid bundles.


title: HCNet: Hierarchical Context Network for Semantic Segmentation

abstract: Global context information is vital in visual understanding problems, especially in pixel-level semantic segmentation. The mainstream methods adopt the self-attention mechanism to model global context information. However, pixels belonging to different classes usually have weak feature correlation. Modeling the global pixel-level correlation matrix indiscriminately is extremely redundant in the self-attention mechanism. In order to solve the above problem, we propose a hierarchical context network to differentially model homogeneous pixels with strong correlations and heterogeneous pixels with weak correlations. Specifically, we first propose a multi-scale guided pre-segmentation module to divide the entire feature map into different classed-based homogeneous regions. Within each homogeneous region, we design the pixel context module to capture pixel-level correlations. Subsequently, different from the self-attention mechanism that still models weak heterogeneous correlations in a dense pixel-level manner, the region context module is proposed to model sparse region-level dependencies using a unified representation of each region. Through aggregating fine-grained pixel context features and coarse-grained region context features, our proposed network can not only hierarchically model global context information but also harvest multi-granularity representations to more robustly identify multi-scale objects. We evaluate our approach on Cityscapes and the ISPRS Vaihingen dataset. Without Bells or Whistles, our approach realizes a mean IoU of 82.8% and overall accuracy of 91.4% on Cityscapes and ISPRS Vaihingen test set, achieving state-of-the-art results.


title: Block-term Tensor Neural Networks

abstract: Deep neural networks (DNNs) have achieved outstanding performance in a wide range of applications, e.g., image classification, natural language processing, etc. Despite the good performance, the huge number of parameters in DNNs brings challenges to efficient training of DNNs and also their deployment in low-end devices with limited computing resources. In this paper, we explore the correlations in the weight matrices, and approximate the weight matrices with the low-rank block-term tensors. We name the new corresponding structure as block-term tensor layers (BT-layers), which can be easily adapted to neural network models, such as CNNs and RNNs. In particular, the inputs and the outputs in BT-layers are reshaped into low-dimensional high-order tensors with a similar or improved representation power. Sufficient experiments have demonstrated that BT-layers in CNNs and RNNs can achieve a very large compression ratio on the number of parameters while preserving or improving the representation power of the original DNNs.


title: Thermodynamic Properties of Ice: A Monte Carlo Study

abstract: In this text, we implement a monte carlo algorithm to study thermodynamic properties of ice. Our program, written in Python, is open-sourced and available at https://github.com/AKnightWing/ColdAsIce. We develop a novel scheme to compute the residual entropy of a two dimensional lattice model of ice at absolute zero. A model of energetic ice is also considered and its thermodynamic properties are studied with temperature. We report a remarkable result for the energetic ice model, the presence of a phase transition at non zero temperatures.


title: Scaling Guarantees for Nearest Counterfactual Explanations

abstract: Counterfactual explanations (CFE) are being widely used to explain algorithmic decisions, especially in consequential decision-making contexts (e.g., loan approval or pretrial bail). In this context, CFEs aim to provide individuals affected by an algorithmic decision with the most similar individual (i.e., nearest individual) with a different outcome. However, while an increasing number of works propose algorithms to compute CFEs, such approaches either lack in optimality of distance (i.e., they do not return the nearest individual) and perfect coverage (i.e., they do not provide a CFE for all individuals); or they cannot handle complex models, such as neural networks. In this work, we provide a framework based on Mixed-Integer Programming (MIP) to compute nearest counterfactual explanations with provable guarantees and with runtimes comparable to gradient-based approaches. Our experiments on the Adult, COMPAS, and Credit datasets show that, in contrast with previous methods, our approach allows for efficiently computing diverse CFEs with both distance guarantees and perfect coverage.


title: Effective Data-aware Covariance Estimator from Compressed Data

abstract: Estimating covariance matrix from massive high-dimensional and distributed data is significant for various real-world applications. In this paper, we propose a data-aware weighted sampling based covariance matrix estimator, namely DACE, which can provide an unbiased covariance matrix estimation and attain more accurate estimation under the same compression ratio. Moreover, we extend our proposed DACE to tackle multiclass classification problems with theoretical justification and conduct extensive experiments on both synthetic and real-world datasets to demonstrate the superior performance of our DACE.


title: A note on thickness of knots

abstract: We introduce a numerical invariant \beta(K) of a knot K which measures how non-alternating K is. We prove an inequality between \beta (K) and the (knot Floer) thickness of K. As an application we show that all Montesinos knots have thickness at most one.


title: Light Field Salient Object Detection: A Review and Benchmark

abstract: Salient object detection (SOD) is a long-standing research topic in computer vision and has drawn an increasing amount of research interest in the past decade. This paper provides the first comprehensive review and benchmark for light field SOD, which has long been lacking in the saliency community. Firstly, we introduce preliminary knowledge on light fields, including theory and data forms, and then review existing studies on light field SOD, covering ten traditional models, seven deep learning-based models, one comparative study, and one brief review. Existing datasets for light field SOD are also summarized with detailed information and statistical analyses. Secondly, we benchmark nine representative light field SOD models together with several cutting-edge RGB-D SOD models on four widely used light field datasets, from which insightful discussions and analyses, including a comparison between light field SOD and RGB-D SOD models, are achieved. Besides, due to the inconsistency of datasets in their current forms, we further generate complete data and supplement focal stacks, depth maps and multi-view images for the inconsistent datasets, making them consistent and unified. Our supplemental data makes a universal benchmark possible. Lastly, because light field SOD is quite a special problem attributed to its diverse data representations and high dependency on acquisition hardware, making it differ greatly from other saliency detection tasks, we provide nine hints into the challenges and future directions, and outline several open issues. We hope our review and benchmarking could help advance research in this field. All the materials including collected models, datasets, benchmarking results, and supplemented light field datasets will be publicly available on our project site https://github.com/kerenfu/LFSOD-Survey.


title: Dynamics of charged and magnetized particles around cylindrical black holes immersed in external magnetic field

abstract: This paper investigates the motion and acceleration of a particle that is electrically and magnetically charged, which rotates around a cylindrical black hole in the presence of an external asymptotically uniform magnetic field parallel to the z axis. Basically, the work considers the circular orbits of particles rotating around the central object and studies the dependence of the most internal stable circular orbits (ISCO) on the so-called magnetic coupling parameters, which are responsible for the interaction between the external magnetic field and magnetized and charged particles. It is also shown that the ISCO radius decreases with increasing magnetized parameter. Therefore, collisions of magnetized particles around a cylindrical black hole immersed in an external magnetic field were also studied, and it was shown that the magnetic field can act as a particle accelerator around non-rotating cylindrical black holes.


title: MS-Ranker: Accumulating Evidence from Potentially Correct Candidates for Answer Selection

abstract: As conventional answer selection (AS) methods generally match the question with each candidate answer independently, they suffer from the lack of matching information between the question and the candidate. To address this problem, we propose a novel reinforcement learning (RL) based multi-step ranking model, named MS-Ranker, which accumulates information from potentially correct candidate answers as extra evidence for matching the question with a candidate. In specific, we explicitly consider the potential correctness of candidates and update the evidence with a gating mechanism. Moreover, as we use a listwise ranking reward, our model learns to pay more attention to the overall performance. Experiments on two benchmarks, namely WikiQA and SemEval-2016 CQA, show that our model significantly outperforms existing methods that do not rely on external resources.


title: Tag Recommendation for Online Q&A Communities based on BERT Pre-Training Technique

abstract: Online Q&A and open source communities use tags and keywords to index, categorize, and search for specific content. The most obvious advantage of tag recommendation is the correct classification of information. In this study, we used the BERT pre-training technique in tag recommendation task for online Q&A and open-source communities for the first time. Our evaluation on freecode datasets show that the proposed method, called TagBERT, is more accurate compared to deep learning and other baseline methods. Moreover, our model achieved a high stability by solving the problem of previous researches, where increasing the number of tag recommendations significantly reduced model performance.


title: Astronomy from Dome A in Antarctica

abstract: Dome A in Antarctica has been demonstrated to be the best site on earth for optical, infrared, and terahertz astronomical observations by more and more evidence, such as excellent free-atmosphere seeing, extremely low perceptible water vapor, low sky background, and continuous dark time, etc. In this review paper, we present a complete picture of the development of astronomy at Dome A from the very beginning, review recent progress in time-domain astronomy, demonstrate exciting results of the site testing, and address the challenges in instrumentation. Currently proposed projects are briefly discussed.


title: Collective effects in photoionization of sodium clusters: plasmon resonance spill, induced attractive force and correlation minimum

abstract: Photoionization studies of Na20 and Na92 clusters are carried out in a framework of linear response density functional theory. Cross sections show substantial spillover of plasmon resonances to the near-threshold ionization energies which are in reasonable agreements with measurements. The analysis of the oscillator strength, consumed by the cross section, lends further insights. The many-body interaction induced self-consistent field from density fluctuations suggests the existence of an attractive force. This may cause time-delayed plasmonic photoemissions in ultrafast measurements. At the waning end of the plasmon structure, a strong minimum in the cross sections from a correlation-driven coherence effect is predicted which can possibly be observed by the photoelectron spectroscopy.


title: Distilling a Deep Neural Network into a Takagi-Sugeno-Kang Fuzzy Inference System

abstract: Deep neural networks (DNNs) demonstrate great success in classification tasks. However, they act as black boxes and we don't know how they make decisions in a particular classification task. To this end, we propose to distill the knowledge from a DNN into a fuzzy inference system (FIS), which is Takagi-Sugeno-Kang (TSK)-type in this paper. The model has the capability to express the knowledge acquired by a DNN based on fuzzy rules, thus explaining a particular decision much easier. Knowledge distillation (KD) is applied to create a TSK-type FIS that generalizes better than one directly from the training data, which is guaranteed through experiments in this paper. To further improve the performances, we modify the baseline method of KD and obtain good results.


title: Single-atom maser with engineered circuit for population inversion

abstract: We present a blueprint for a maser with a single three-level transmon superconducting artificial atom. The system can be pumped coherently via a two-photon process, and to achieve high population inversion, the relaxation rate of the metastable state is increased via an auxiliary low-Q cavity coupled to a transition between the transmon excited states. We show numerically that such a maser can operate both in the intermediate coupling regime with super-Poissonian photon statistics and in the strong coupling regime, where the statistics is sub-Poissonian. For the former, the maser exhibits thresholdless behavior and for the latter, there is a well-defined pumping threshold. A useful side-effect of the auxiliary resonator is that it allows to overcome the photon blockade effect for the pump, which would otherwise prevent high photon population. Finally, we observe the bistability of the steady-state Wigner function and the self-quenching effect for some parameters.


title: Can RNNs trained on harder subject-verb agreement instances still perform well on easier ones?

abstract: Previous work suggests that RNNs trained on natural language corpora can capture number agreement well for simple sentences but perform less well when sentences contain agreement attractors: intervening nouns between the verb and the main subject with grammatical number opposite to the latter. This suggests these models may not learn the actual syntax of agreement, but rather infer shallower heuristics such as `agree with the recent noun'. In this work, we investigate RNN models with varying inductive biases trained on selectively chosen `hard' agreement instances, i.e., sentences with at least one agreement attractor. For these the verb number cannot be predicted using a simple linear heuristic, and hence they might help provide the model additional cues for hierarchical syntax. If RNNs can learn the underlying agreement rules when trained on such hard instances, then they should generalize well to other sentences, including simpler ones. However, we observe that several RNN types, including the ONLSTM which has a soft structural inductive bias, surprisingly fail to perform well on sentences without attractors when trained solely on sentences with attractors. We analyze how these selectively trained RNNs compare to the baseline (training on a natural distribution of agreement attractors) along the dimensions of number agreement accuracy, representational similarity, and performance across different syntactic constructions. Our findings suggest that RNNs trained on our hard agreement instances still do not capture the underlying syntax of agreement, but rather tend to overfit the training distribution in a way which leads them to perform poorly on `easy' out-of-distribution instances. Thus, while RNNs are powerful models which can pick up non-trivial dependency patterns, inducing them to do so at the level of syntax rather than surface remains a challenge.


title: An Active Sense and Avoid System for Flying Robots in Dynamic Environments

abstract: This paper investigates a novel active-sensing-based obstacle avoidance paradigm for flying robots in dynamic environments. Instead of fusing multiple sensors to enlarge the field of view (FOV), we introduce an alternative approach that utilizes a stereo camera with an independent rotational DOF to sense the obstacles actively. In particular, the sensing direction is planned heuristically by multiple objectives, including tracking dynamic obstacles, observing the heading direction, and exploring the previously unseen area. With the sensing result, a flight path is then planned based on real-time sampling and uncertainty-aware collision checking in the state space, which constitutes an active sense and avoid (ASAA) system. Experiments in both simulation and the real world demonstrate that this system can well cope with dynamic obstacles and abrupt goal direction changes. Since only one stereo camera is utilized, this system provides a low-cost and effective approach to overcome the FOV limitation in visual navigation.


title: Event-Triggered Multi-agent Reinforcement Learning with Communication under Limited-bandwidth Constraint

abstract: Communicating with each other in a distributed manner and behaving as a group are essential in multi-agent reinforcement learning. However, real-world multi-agent systems suffer from restrictions on limited-bandwidth communication. If the bandwidth is fully occupied, some agents are not able to send messages promptly to others, causing decision delay and impairing cooperative effects. Recent related work has started to address the problem but still fails in maximally reducing the consumption of communication resources. In this paper, we propose Event-Triggered Communication Network (ETCNet) to enhance the communication efficiency in multi-agent systems by sending messages only when necessary. According to the information theory, the limited bandwidth is translated to the penalty threshold of an event-triggered strategy, which determines whether an agent at each step sends a message or not. Then the design of the event-triggered strategy is formulated as a constrained Markov decision problem, and reinforcement learning finds the best communication protocol that satisfies the limited bandwidth constraint. Experiments on typical multi-agent tasks demonstrate that ETCNet outperforms other methods in terms of the reduction of bandwidth occupancy and still preserves the cooperative performance of multi-agent systems at the most.


title: A Termination Criterion for Probabilistic PointClouds Registration

abstract: Probabilistic Point Clouds Registration (PPCR) is an algorithm that, in its multi-iteration version, outperformed state of the art algorithms for local point clouds registration. However, its performances have been tested using a fixed high number of iterations. To be of practical usefulness, we think that the algorithm should decide by itself when to stop, to avoid an excessive number of iterations and, therefore, wasting computational time. With this work, we compare different termination criterion on several datasets and prove that the chosen one produce very good results that are comparable to those obtained using a very high number of iterations while saving computational time.


title: An Empirical Investigation of Beam-Aware Training in Supertagging

abstract: Structured prediction is often approached by training a locally normalized model with maximum likelihood and decoding approximately with beam search. This approach leads to mismatches as, during training, the model is not exposed to its mistakes and does not use beam search. Beam-aware training aims to address these problems, but unfortunately, it is not yet widely used due to a lack of understanding about how it impacts performance, when it is most useful, and whether it is stable. Recently, Negrinho et al. (2018) proposed a meta-algorithm that captures beam-aware training algorithms and suggests new ones, but unfortunately did not provide empirical results. In this paper, we begin an empirical investigation: we train the supertagging model of Vaswani et al. (2016) and a simpler model with instantiations of the meta-algorithm. We explore the influence of various design choices and make recommendations for choosing them. We observe that beam-aware training improves performance for both models, with large improvements for the simpler model which must effectively manage uncertainty during decoding. Our results suggest that a model must be learned with search to maximize its effectiveness.


title: Collisionless Rayleigh-Taylor-like instability of the boundary between a hot pair plasma and an electron-proton plasma: the undular mode

abstract: We study with a two-dimensional particle-in-cell simulation the stability of a discontinuity or piston, which separates an electron-positron cloud from a cooler electron-proton plasma. Such a piston might be present in the relativistic jets of accreting black holes separating the jet material from the surrounding ambient plasma and when pair clouds form during an X-ray flare and expand into the plasma of the accretion disk corona. We inject a pair plasma at a simulation boundary with a mildly relativistic temperature and mean speed. It flows across a spatially uniform electron-proton plasma, which is permeated by a background magnetic field. The magnetic field is aligned with one simulation direction and oriented orthogonally to the mean velocity vector of the pair cloud. The expanding pair cloud expels the magnetic field and piles it up at its front. It is amplified to a value large enough to trap ambient electrons. The current of the trapped electrons, which are carried with the expanding cloud front, drives an electric field that accelerates protons. A solitary wave grows and changes into a piston after it saturated. Our simulations show that this piston undergoes a collision-less instability similar to a Rayleigh-Taylor instability. The undular mode grows and we observe fingers in the proton density distribution. The effect of the instability is to deform the piston but it cannot destroy it.


title: The stochasticity parameter of quadratic residues

abstract: Following V. I. Arnold, we define the stochasticity parameter $S(U)$ of a subset $U$ of $\mathbb{Z}/M\mathbb{Z}$ to be the sum of squares of the consecutive distances between elements of $U$. In this paper we study the stochasticity parameter of the set $R_M$ of quadratic residues modulo $M$. We present a method which allows to find the asymptotics of $S(R_M)$ for a set of $M$ of positive density. In particular, we obtain the following two corollaries. Denote by $s(k)=s(k,\mathbb{Z}/M\mathbb{Z})$ the average value of $S(U)$ over all subsets $U\subseteq \mathbb{Z}/M\mathbb{Z}$ of size $k$, which can be thought of as the stochasticity parameter of a random set of size $k$. Let $\mathfrak{S}(R_M)=S(R_M)/s(|R_M|)$. We show that a) $\varliminf_{M\to\infty}\mathfrak{S}(R_M)<1<\varlimsup_{M\to\infty}\mathfrak{S}(R_M)$; b) the set $\{ M\in \mathbb{N}: \mathfrak{S}(R_M)<1 \}$ has positive lower density.


title: Randomness in self-assembled colloidal crystals can widen photonic band gaps through particle shape and internal structure

abstract: Using computer simulations, we explore how thermal noise-induced randomness in a self-assembled photonic crystal affects its photonic band gaps (PBGs). We consider a two-dimensional photonic crystal comprised of a self-assembled array of parallel dielectric hard rods of infinite length with circular or square cross section. We find the PBGs can exist over a large range of intermediate packing densities. Counterintuitively, the largest band gap does not always appear at the packing density where the crystal is most ordered, despite the randomness inherent in any self-assembled structure. For rods with square cross section at intermediate packing densities, we find that the transverse magnetic (TM) band gap of the self-assembled (i.e. thermal) system can be larger than that of identical rods arranged in a perfect square lattice. By considering hollow rods, we find the band gap of transverse electric (TE) modes can be substantially increased while that of TM modes show no obvious improvement over solid rods. Our study suggests that particle shape and internal structure can be used to engineer the PBG of a self-assembled system despite the positional and orientational randomness arising from thermal noise.


title: Theoretical analysis of injection driven thermal light emitters based on graphene encapsulated by hexagonal boron nitride

abstract: We develop the device model for the proposed injection (electrically) driven thermal light emitters (IDLEs) based on the vertical Hexagonal Boron Nitride Layer/Graphene Layer/ Hexagonal Boron Nitride Layer (hBNL/GL/hBNL) heterostructures and analyze their dynamic response. The operation of the IDLEs is associated with the light emission of the hot two-dimensional electron-hole plasma (2DEHP) generated in the GL by both the lateral injection from the side contacts and the vertical injection through the hBNL (combined injection) heating the 2DEHP. The temporal variation of the injection current results in the variation of the carrier effective temperature and their density in the GL leading to the modulation of the output light. We determine the mechanisms limiting the IDLE efficiency and the maximum light modulation frequency. A large difference between the carrier and lattice temperatures the IDLEs with an effective heat removal enables a fairly large modulation depth at the modulation frequencies about dozen of GHz in contrast to the standard incandescent lamps. We compare the IDLEs with the combined injection under consideration and IDLEs using the carrier Joule heating by lateral current. The obtained results can be used for the IDLE optimization.