title: Optimal Energy Efficiency with Delay Constraints for Multi-layer Cooperative Fog Computing Networks

abstract: We develop a joint offloading and resource allocation framework for a multi-layer cooperative fog computing network, aiming to minimize the total energy consumption of multiple mobile devices subject to their service delay requirements. The resulting optimization involves both binary (offloading decisions) and real variables (resource allocations), making it an NP-hard and computationally intractable problem. To tackle it, we first propose an improved branch-and-bound algorithm (IBBA) that is implemented in a centralized manner. However, due to the large size of the cooperative fog computing network, the computational complexity of the proposed IBBA is relatively high. To speed up the optimal solution searching as well as to enable its distributed implementation, we then leverage the unique structure of the underlying problem and the parallel processing at fog nodes. To that end, we propose a distributed framework, namely feasibility finding Benders decomposition (FFBD), that decomposes the original problem into a master problem for the offloading decision and subproblems for resource allocation. The master problem (MP) is then equipped with powerful cutting-planes to exploit the fact of resource limitation at fog nodes. The subproblems (SP) for resource allocation can find their closed-form solutions using our fast solution detection method. These (simpler) subproblems can then be solved in parallel at fog nodes. The numerical results show that the FFBD always returns the optimal solution of the problem with significantly less computation time (e.g., compared with the centralized IBBA approach). The FFBD with the fast solution detection method, namely FFBD-F, can reduce up to $60\%$ and $90\%$ of computation time, respectively, compared with those of the conventional FFBD, namely FFBD-S, and IBBA.


title: Learning Deep Multi-Level Similarity for Thermal Infrared Object Tracking

abstract: Existing deep Thermal InfraRed (TIR) trackers only use semantic features to describe the TIR object, which lack the sufficient discriminative capacity for handling distractors. This becomes worse when the feature extraction network is only trained on RGB images.To address this issue, we propose a multi-level similarity model under a Siamese framework for robust TIR object tracking. Specifically, we compute different pattern similarities on two convolutional layers using the proposed multi-level similarity network. One of them focuses on the global semantic similarity and the other computes the local structural similarity of the TIR object. These two similarities complement each other and hence enhance the discriminative capacity of the network for handling distractors. In addition, we design a simple while effective relative entropy based ensemble subnetwork to integrate the semantic and structural similarities. This subnetwork can adaptive learn the weights of the semantic and structural similarities at the training stage. To further enhance the discriminative capacity of the tracker, we construct the first large scale TIR video sequence dataset for training the proposed model. The proposed TIR dataset not only benefits the training for TIR tracking but also can be applied to numerous TIR vision tasks. Extensive experimental results on the VOT-TIR2015 and VOT-TIR2017 benchmarks demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods.


title: Development of a new sixth order accurate compact scheme for two and three dimensional Helmholtz equation

abstract: In this work, a new compact sixth order accurate finite difference scheme for the two and three-dimensional Helmholtz equation is presented. The main significance of the proposed scheme is that its sixth order leading truncation error term does not explicitly depend on the associated wave number. This makes the scheme robust to work for the Helmholtz equation even with large wave numbers. The convergence analysis of the new scheme is given. Numerical results for various benchmark test problems are given to support the theoretical estimates. These numerical results confirm the accuracy and robustness of the proposed scheme.


title: Orders of units in integral group rings and blocks of defect $1$

abstract: We show that if the Sylow $p$-subgroup of a finite group $G$ is of order $p$, then the normalized unit group of the integral group ring of $G$ contains a normalized unit of order $pq$ if and only if $G$ contains an element of order $pq$, where $q$ is any prime. We use this result to answer the Prime Graph Question for most sporadic simple groups and some simple groups of Lie type, including a new infinite series of such groups. Our methods are based on the understanding of blocks of cyclic defect and Young tableaux combinatorics.


title: Tighter constraints of multiqubit entanglement

abstract: Monogamy and polygamy relations characterize the distributions of entanglement in multipartite systems. We provide classes of monogamy and polygamy inequalities of multiqubit entanglement in terms of concurrence, entanglement of formation, negativity, Tsallis-$q$ entanglement and R\'{e}nyi-$\alpha$ entanglement, respectively. We show that these inequalities are tighter than the existing ones for some classes of quantum states.


title: Fast Cadzow's Algorithm and a Gradient Variant

abstract: The Cadzow's algorithm is a signal denoising and recovery method which was designed for signals corresponding to low rank Hankel matrices. In this paper we first introduce a Fast Cadzow's algorithm which is developed by incorporating a novel subspace projection to reduce the high computational cost of the SVD in the Cadzow's algorithm. Then a Gradient method and a Fast Gradient method are proposed to address the non-decreasing MSE issue when applying the Cadzow's or Fast Cadzow's algorithm for signal denoising. Extensive empirical performance comparisons demonstrate that the proposed algorithms can complete the denoising and recovery tasks more efficiently and effectively.


title: Mass-imbalance induced structures of binary atomic mixtures in box potentials

abstract: We consider the ground states of binary atomic boson-boson and fermion-fermion mixtures confined in one-dimensional box potentials by simulating the systems using few-body models with delta-function interactions and many-body models with density-density interactions. For boson-boson mixtures, both models show signatures of phase separation in the strong repulsion regime and sandwiched structures emerge in the presence of mass imbalance. The structural difference between equal-mass and mass-imbalanced systems is due to the minimization of the interaction energy and the kinetic energies from the density distortion at the hard walls and at the phase-separation interface. The mass imbalance adjusts the kinetic energies and causes the lighter species to avoid the hard walls. For fermion-fermion mixtures, few-body simulations show a mass-imbalance induced structural changes in the strong repulsion regime, while many-body simulations show two-chunk phase separation due to the strong bulk kinetic energy. For equal-mass mixtures with strong inter-species repulsion, the few-body and many-body models predict different structures because the mean-field treatment in the many-body model approximates the contact interaction and smooths out the wavefunctions.


title: Transfer Learning by Modeling a Distribution over Policies

abstract: Exploration and adaptation to new tasks in a transfer learning setup is a central challenge in reinforcement learning. In this work, we build on the idea of modeling a distribution over policies in a Bayesian deep reinforcement learning setup to propose a transfer strategy. Recent works have shown to induce diversity in the learned policies by maximizing the entropy of a distribution of policies (Bachman et al., 2018; Garnelo et al., 2018) and thus, we postulate that our proposed approach leads to faster exploration resulting in improved transfer learning. We support our hypothesis by demonstrating favorable experimental results on a variety of settings on fully-observable GridWorld and partially observable MiniGrid (Chevalier-Boisvert et al., 2018) environments.


title: A Probabilistic Approach to Kepler Completeness and Reliability for Exoplanet Occurrence Rates

abstract: Exoplanet catalogs produced by surveys suffer from a lack of completeness (not every planet is detected) and less than perfect reliability (not every planet in the catalog is a true planet), particularly near the survey's detection limit. Exoplanet occurrence rate studies based on such a catalog must be corrected for completeness and reliability. The final Kepler data release, DR25, features a uniformly vetted planet candidate catalog and data products that facilitate corrections. We present a new probabilistic approach to the characterization of Kepler completeness and reliability, making full use of the Kepler DR25 products. We illustrate the impact of completeness and reliability corrections with a Poisson-likelihood occurrence rate method, using a recent stellar properties catalog that incorporates Gaia stellar radii and essentially uniform treatment of the stellar population. Correcting for reliability has a significant impact: the exoplanet occurrence rate for orbital period and radius within 20% of Earth's around GK dwarf stars, corrected for reliability, is 0.015+0.011-0.007, whereas not correcting results in 0.034+0.018-0.012 - correcting for reliability reduces this occurrence rate by more than a factor of two. We further show that using Gaia-based vs. DR25 stellar properties impacts the same occurrence rate by a factor of two. We critically examine the the DR25 catalog and the assumptions behind our occurrence rate method. We propose several ways in which confidence in both the Kepler catalog and occurrence rate calculations can be improved. This work provides an example of how the community can use the DR25 completeness and reliability products.


title: Virasoro algebra in $K$-space

abstract: We introduce a novel representation of Virasoro algebra in open string field theory. Elements of the algebra are vector fields on the $K$-space, where $K$ is the string field that generates a world sheet strip in sliver frame. The generators introduce a global symmetry of open string field theory. We also derive a representation of Virasoro algebra for nontrivial open string background described by the formal pure gauge solution. Generators for 0, 1 and 2 D-branes are explicitly studied and different behaviors around $K=0$ are observed.


title: Fermion Dark Matter with $N_2$ Leptogenesis in Minimal Scotogenic Model

abstract: We study the possibility of singlet fermion dark matter (DM) and successful leptogenesis in minimal scotogenic model which also provides a common origin of DM and light neutrino masses. In this scenario, where the standard model (SM) is extended by three gauge singlet fermions and one additional scalar doublet, all odd under an in-built $Z_2$ symmetry, the lightest singlet fermion which also happens to be the lightest $Z_2$ odd particle, can be either thermal or non-thermal DM candidate depending upon the strength of its couplings with SM leptons and the $Z_2$ odd scalar doublet. In both the scenarios, the $Z_2$ odd scalar doublet plays a non-trivial role either by assisting coannihilation with thermal DM or by providing a source for non-thermal DM via decay. The heavier $Z_2$ odd singlet fermion produces a net lepton asymmetry through its out-of-equilibrium decay into SM leptons and $Z_2$ odd scalar doublet. We show that the requirement of producing the observed baryon asymmetry pushes the scale of leptogenesis in case of normal ordering of light neutrino masses to several order of magnitudes above TeV scale. In case of inverted ordering however, it is possible to have successful $N_2$ leptogenesis at a scale of few tens of TeV. Inclusion of lepton flavour effects lowers this scale of leptogenesis by around an order of magnitude in both the cases. Correct DM abundance can be realised either by thermal freeze-out or by freeze-in mechanism in different parts of the parameter space that can have interesting prospects for ongoing experiments.


title: Ping-pong partitions and locally discrete groups of real-analytic circle diffeomorphisms, I: Construction

abstract: Following the recent advances in the study of groups of circle diffeomorphisms, we describe an efficient way of classifying the topological dynamics of locally discrete, finitely generated, virtually free subgroups of the group $\mathsf{Diff}^\omega_+(\mathbb S^1)$ of orientation preserving real-analytic circle diffeomorphisms, which include all subgroups of $\mathsf{Diff}^\omega_+(\mathbb S^1)$ acting with an invariant Cantor set. An important tool that we develop, of independent interest, is the extension of classical ping-pong lemma to actions of fundamental groups of graphs of groups. Our main motivation is an old conjecture by P. R. Dippolito [Ann. Math. 107 (1978), 403--453] from foliation theory, which we solve in this restricted but significant setting: this and other consequences of the classification will be treated in more detail in a companion work.


title: Robust conditional GANs under missing or uncertain labels

abstract: Matching the performance of conditional Generative Adversarial Networks with little supervision is an important task, especially in venturing into new domains. We design a new training algorithm, which is robust to missing or ambiguous labels. The main idea is to intentionally corrupt the labels of generated examples to match the statistics of the real data, and have a discriminator process the real and generated examples with corrupted labels. We showcase the robustness of this proposed approach both theoretically and empirically. We show that minimizing the proposed loss is equivalent to minimizing true divergence between real and generated data up to a multiplicative factor, and characterize this multiplicative factor as a function of the statistics of the uncertain labels. Experiments on MNIST dataset demonstrates that proposed architecture is able to achieve high accuracy in generating examples faithful to the class even with only a few examples per class.


title: Stochastic In-Face Frank-Wolfe Methods for Non-Convex Optimization and Sparse Neural Network Training

abstract: The Frank-Wolfe method and its extensions are well-suited for delivering solutions with desirable structural properties, such as sparsity or low-rank structure. We introduce a new variant of the Frank-Wolfe method that combines Frank-Wolfe steps and steepest descent steps, as well as a novel modification of the "Frank-Wolfe gap" to measure convergence in the non-convex case. We further extend this method to incorporate in-face directions for preserving structured solutions as well as block coordinate steps, and we demonstrate computational guarantees in terms of the modified Frank-Wolfe gap for all of these variants. We are particularly motivated by the application of this methodology to the training of neural networks with sparse properties, and we apply our block coordinate method to the problem of $\ell_1$ regularized neural network training. We present the results of several numerical experiments on both artificial and real datasets demonstrating significant improvements of our method in training sparse neural networks.


title: Phenomenology of complex structured light in turbulent air

abstract: The study of light propagation has been a cornerstone of progress in physics and technology. Recently, advances in control and shaping of light have created significant interest in the propagation of complex structures of light -- particularly under realistic terrestrial conditions. While theoretical understanding of this research question has significantly grown over the last two decades, outdoor-experiments with complex light structures are rare, and comparisons with theory have been nearly lacking. Such situations show a significant gap between theoretical models of atmospheric light behaviour and current experimental effort. Here, in an attempt to reduce this gap, we describe an interesting result of atmospheric models which are feasible for empirical observation. We analyze in detail light propagation in different spatial bases and present results of the theory that the influence of atmospheric turbulence is basis-dependent. Concretely, light propagating as eigenstate in one complete basis is stronger influenced by atmosphere than light propagating in a different, complete basis. We obtain these results by exploiting a family of the continuously adjustable, complete basis of spatial modes -- the Ince-Gauss modes. Our concrete numerical results will hopefully inspire experimental efforts and bring the theoretical and empirical study of complex light patterns in realistic scenarios closer together.


title: Simplified Kinematics of Continuum Robot Equilibrium Modulation via Moment Coupling Effects and Model Calibration

abstract: Recently, a new concept for continuum robots capable of producing macro-scale and micro-scale motion has been presented. These robots achieve their multi-scale motion capabilities by coupling direct-actuation of push-pull back-bones for macro motion with indirect actuation whereby the equilibrium pose is altered to achieve micro-scale motion. This paper presents a first attempt at explaining the micro-motion capabilities of these robots from a modeling perspective. This paper presents the macro and micro motion kinematics of a single segment continuum robot by using statics coupling effects among its sub-segments. Experimental observations of the micro-scale motion demonstrate a turning point behavior which could not be explained well using the current modeling methods. We present a simplistic modeling approach that introduces two calibration parameters to calibrate the moment coupling effects among the sub segments of the robot. It is shown that these two parameters can reproduce the turning point behavior at the micro-scale. The instantaneous macro and micro scale kinematics Jacobians and the calibration parameters identification Jacobian are derived. The modeling approach is verified against experimental data showing that our simplistic modeling approach can capture the experimental motion data with RMS position error of 5.82 micrometers if one wishes to fit the entire motion profile with the turning point. If one chooses to exclude motions past the turning point, our model can fit the experimental data with an accuracy of 4.76 micrometers.


title: $\mathbf{A}_{\text{inf}}$ is infinite dimensional

abstract: Given a perfect valuation ring $R$ of characteristic $p$ that is complete with respect to a rank-$1$ nondiscrete valuation, we show that the ring $\mathbf{A}_{\text{inf}}$ of Witt vectors of $R$ has infinite Krull dimension.


title: A Hierarchical Network for Diverse Trajectory Proposals

abstract: Autonomous explorative robots frequently encounter scenarios where multiple future trajectories can be pursued. Often these are cases with multiple paths around an obstacle or trajectory options towards various frontiers. Humans in such situations can inherently perceive and reason about the surrounding environment to identify several possibilities of either manoeuvring around the obstacles or moving towards various frontiers. In this work, we propose a 2 stage Convolutional Neural Network architecture which mimics such an ability to map the perceived surroundings to multiple trajectories that a robot can choose to traverse. The first stage is a Trajectory Proposal Network which suggests diverse regions in the environment which can be occupied in the future. The second stage is a Trajectory Sampling network which provides a finegrained trajectory over the regions proposed by Trajectory Proposal Network. We evaluate our framework in diverse and complicated real life settings. For the outdoor case, we use the KITTI dataset and our own outdoor driving dataset. In the indoor setting, we use an autonomous drone to navigate various scenarios and also a ground robot which can explore the environment using the trajectories proposed by our framework. Our experiments suggest that the framework is able to develop a semantic understanding of the obstacles, open regions and identify diverse trajectories that a robot can traverse. Our comparisons portray the performance gain of the proposed architecture over a diverse set of methods against which it is compared.


title: A State-of-the-Art Survey on Multidimensional Scaling Based Localization Techniques

abstract: Current and future wireless applications strongly rely on precise real-time localization. A number of applications such as smart cities, Internet of Things (IoT), medical services, automotive industry, underwater exploration, public safety, and military systems require reliable and accurate localization techniques. Generally, the most popular localization/ positioning system is the Global Positioning System (GPS). GPS works well for outdoor environments but fails in indoor and harsh environments. Therefore, a number of other wireless local localization techniques are developed based on terrestrial wireless networks, wireless sensor networks (WSNs) and wireless local area networks (WLANs). Also, there exist localization techniques which fuse two or more technologies to find out the location of the user, also called signal of opportunity based localization. Most of the localization techniques require ranging measurements such as time of arrival (ToA), time difference of arrival (TDoA), direction of arrival (DoA) and received signal strength (RSS). There are also range-free localization techniques which consider the proximity information and do not require the actual ranging measurements. Dimensionality reduction techniques are famous among the range free localization schemes. Multidimensional scaling (MDS) is one of the dimensionality reduction technique which has been used extensively in the recent past for wireless networks localization. In this paper, a comprehensive survey is presented for MDS and MDS based localization techniques in WSNs, Internet of Things (IoT), cognitive radio networks, and 5G networks.


title: Dynamic Network Embedding via Incremental Skip-gram with Negative Sampling

abstract: Network representation learning, as an approach to learn low dimensional representations of vertices, has attracted considerable research attention recently. It has been proven extremely useful in many machine learning tasks over large graph. Most existing methods focus on learning the structural representations of vertices in a static network, but cannot guarantee an accurate and efficient embedding in a dynamic network scenario. To address this issue, we present an efficient incremental skip-gram algorithm with negative sampling for dynamic network embedding, and provide a set of theoretical analyses to characterize the performance guarantee. Specifically, we first partition a dynamic network into the updated, including addition/deletion of links and vertices, and the retained networks over time. Then we factorize the objective function of network embedding into the added, vanished and retained parts of the network. Next we provide a new stochastic gradient-based method, guided by the partitions of the network, to update the nodes and the parameter vectors. The proposed algorithm is proven to yield an objective function value with a bounded difference to that of the original objective function. Experimental results show that our proposal can significantly reduce the training time while preserving the comparable performance. We also demonstrate the correctness of the theoretical analysis and the practical usefulness of the dynamic network embedding. We perform extensive experiments on multiple real-world large network datasets over multi-label classification and link prediction tasks to evaluate the effectiveness and efficiency of the proposed framework, and up to 22 times speedup has been achieved.


title: Partial Server Pooling in Redundancy Systems

abstract: Partial sharing allows providers to possibly pool a fraction of their resources when full pooling is not beneficial to them. Recent work in systems without sharing has shown that redundancy can improve performance considerably. In this paper, we combine partial sharing and redundancy by developing partial sharing models for providers operating multi-server systems with redundancy. Two M/M/N queues with redundant service models are considered. Copies of an arriving job are placed in the queues of servers that can serve the job. Partial sharing models for cancel-on-complete and cancel-on-start redundancy models are developed. For cancel-on-complete, it is shown that the Pareto efficient region is the full pooling configuration. For a cancel-on-start policy, we conjecture that the Pareto frontier is always non-empty and is such that at least one of the two providers is sharing all of its resources. For this system, using bargaining theory the sharing configuration that the providers may use is determined. Mean response time and probability of waiting are the performance metrics considered.


title: rVAD: An Unsupervised Segment-Based Robust Voice Activity Detection Method

abstract: This paper presents an unsupervised segment-based method for robust voice activity detection (rVAD). The method consists of two passes of denoising followed by a voice activity detection (VAD) stage. In the first pass, high-energy segments in a speech signal are detected by using a posteriori signal-to-noise ratio (SNR) weighted energy difference and if no pitch is detected within a segment, the segment is considered as a high-energy noise segment and set to zero. In the second pass, the speech signal is denoised by a speech enhancement method, for which several methods are explored. Next, neighbouring frames with pitch are grouped together to form pitch segments, and based on speech statistics, the pitch segments are further extended from both ends in order to include both voiced and unvoiced sounds and likely non-speech parts as well. In the end, a posteriori SNR weighted energy difference is applied to the extended pitch segments of the denoised speech signal for detecting voice activity. We evaluate the VAD performance of the proposed method using two databases, RATS and Aurora-2, which contain a large variety of noise conditions. The rVAD method is further evaluated, in terms of speaker verification performance, on the RedDots 2016 challenge database and its noise-corrupted versions. Experiment results show that rVAD is compared favourably with a number of existing methods. In addition, we present a modified version of rVAD where computationally intensive pitch extraction is replaced by computationally efficient spectral flatness calculation. The modified version significantly reduces the computational complexity at the cost of moderately inferior VAD performance, which is an advantage when processing a large amount of data and running on low resource devices. The source code of rVAD is made publicly available.


title: Testing Inflationary Cosmology

abstract: In this thesis we will primarily demonstrate how additional scalar degrees of freedom - which are motivated from many high-energy embeddings - open up new observational windows onto the physics of inflation. We construct a Bayesian framework to statistically compare models with additional fields given the current astronomical data. Putting inflation to the test, we perform our analysis on the quadratic curvaton accompanying a range of inflationary potentials, where we find that only one potential remains as a viable candidate. Furthermore, if the curvaton mechanism were to be confirmed by future non-Gaussianity measurements (from large scale structure surveys), the model could prove to be tremendously informative of the early inflationary history. The initial conditions given to these scalar fields become apparent when considering their fundamentally quantum behaviour. Taking this physics into account leads us to develop detailed models for post-inflationary phenomenology (namely, the curvaton and freeze-in dark matter models) and to discover powerful new probes of inflation itself. We further demonstrate how this theoretical study complements our statistical approach by motivating the prior information in our Bayesian analyses. The thesis finishes with a discussion of the future prospects for inflationary model selection. By hypothesising different toy survey configurations, we forecast different outcomes using information theory and our newly developed Bayesian experimental design formalism. In particular, we find that the most likely observable to optimise model selection between single-field inflationary models, through an order of magnitude precision improvement in the future, is the scalar spectral index. We conclude with a summary of the results obtained throughout.


title: Region of Attraction for Power Systems using Gaussian Process and Converse Lyapunov Function -- Part I: Theoretical Framework and Off-line Study

abstract: This paper introduces a novel framework to construct the region of attraction (ROA) of a power system centered around a stable equilibrium by using stable state trajectories of system dynamics. Most existing works on estimating ROA rely on analytical Lyapunov functions, which are subject to two limitations: the analytic Lyapunov functions may not be always readily available, and the resulting ROA may be overly conservative. This work overcomes these two limitations by leveraging the converse Lyapunov theorem in control theory to eliminate the need of an analytic Lyapunov function and learning the unknown Lyapunov function with the Gaussian Process (GP) approach. In addition, a Gaussian Process Upper Confidence Bound (GP-UCB) based sampling algorithm is designed to reconcile the trade-off between the exploitation for enlarging the ROA and the exploration for reducing the uncertainty of sampling region. Within the constructed ROA, it is guaranteed in probability that the system state will converge to the stable equilibrium with a confidence level. Numerical simulations are also conducted to validate the assessment approach for the ROA of the single machine infinite bus system and the New England $39$-bus system. Numerical results demonstrate that our approach can significantly enlarge the estimated ROA compared to that of the analytic Lyapunov counterpart.


title: A Survey on Neural Network Language Models

abstract: As the core component of Natural Language Processing (NLP) system, Language Model (LM) can provide word representation and probability indication of word sequences. Neural Network Language Models (NNLMs) overcome the curse of dimensionality and improve the performance of traditional LMs. A survey on NNLMs is performed in this paper. The structure of classic NNLMs is described firstly, and then some major improvements are introduced and analyzed. We summarize and compare corpora and toolkits of NNLMs. Further, some research directions of NNLMs are discussed.


title: Verifying fundamental solution groups for lossless wave equations via stationary action and optimal control

abstract: A representation of a fundamental solution group for a class of wave equations is constructed by exploiting connections between stationary action and optimal control. By using a Yosida approximation of the associated generator, an approximation of the group of interest is represented for sufficiently short time horizons via an idempotent convolution kernel that describes all possible solutions of a corresponding short time horizon optimal control problem. It is shown that this representation of the approximate group can be extended to arbitrary longer horizons via a concatenation of such short horizon optimal control problems, provided that the associated initial and terminal conditions employed in concatenating trajectories are determined via a stationarity rather than an optimality based condition. The long horizon approximate group obtained is shown to converge strongly to the exact group of interest, under reasonable conditions. The construction is illustrated by its application to the solution of a two point boundary value problem.


title: Quadratic Suffices for Over-parametrization via Matrix Chernoff Bound

abstract: We improve the over-parametrization size over two beautiful results [Li and Liang' 2018] and [Du, Zhai, Poczos and Singh' 2019] in deep learning theory.


title: Vector bundles on Fano threefolds and K3 surfaces

abstract: Let X be a Fano threefold, and let S be a K3 surface in X . Any moduli space M of simple vector bundles on S carries a holomorphic symplectic structure. Following an idea of Tyurin, we show that in some cases, those vector bundles which come from X form a Lagrangian subvariety of M . We illustrate this with a number of concrete examples.


title: Federated AI lets a team imagine together: Federated Learning of GANs

abstract: Envisioning a new imaginative idea together is a popular human need. Imagining together as a team can often lead to breakthrough ideas, but the collaboration effort can also be challenging, especially when the team members are separated by time and space. What if there is a AI that can assist the team to collaboratively envision new ideas?. Is it possible to develop a working model of such an AI? This paper aims to design such an intelligence. This paper proposes a approach to design a creative and collaborative intelligence by employing a form of distributed machine learning approach called Federated Learning along with fusion on Generative Adversarial Networks, GAN. This collaborative creative AI presents a new paradigm in AI, one that lets a team of two or more to come together to imagine and envision ideas that synergies well with interests of all members of the team. In short, this paper explores the design of a novel type of AI paradigm, called Federated AI Imagination, one that lets geographically distributed teams to collaboratively imagine.


title: Landau-Khalatnikov problem in relativistic hydrodynamics

abstract: An alternative approach to solving the Landau-Khalatnikov problem on one-dimensional stage of expansion of hot hadronic matter created in collisions of high-energy particles or nuclei is suggested. Solving the relativistic hydrodynamics equations by the Riemann method yields a representation for Khalatnikov's potential which satisfies explicitly the condition of symmetry of the matter flow with respect to reflection in the central plane of the initial distribution of matter. New exact relationships are obtained for evolution of the density of energy in the center of the distribution and for laws of motion of boundaries between the general solution and the rarefaction waves. The rapidity distributions are derived in the Landau approximation with account of the pre-exponential factor.


title: A hyperbolic Embedding Model for Directed Networks

abstract: Network embedding is a fervid topic in current networks science and observes that most real complex systems can be embedded in hidden metrics space and emerge as the geometrical property, where the geometric distance between nodes determines the likelihood of links connected. Among those, hyperbolic space associated with the structural organization of many real complex systems, it has thus received extensive attention. However, the majority of methods and measurements, recently developed, less take these features into consideration for the asymmetry of links. Here, we discuss how to multiplex node information as an embedding foundation through identifying the bipartite structure of directed networks; and we proposed the generally mapping framework which hybrids the topological structure of complex networks, directed links and the hidden metrics space. By splitting the different properties of a node, possibilities between different types of nodes can be modeled. In addition to that, we apply this model to some real systems, including international trade networks and C.elegans neural networks. Results confirm that directed networks enable mapping into metrics space as well, and network embedding information can improve the scope of application of existing models.


title: What and Where to Translate: Local Mask-based Image-to-Image Translation

abstract: Recently, image-to-image translation has obtained significant attention. Among many, those approaches based on an exemplar image that contains the target style information has been actively studied, due to its capability to handle multimodality as well as its applicability in practical use. However, two intrinsic problems exist in the existing methods: what and where to transfer. First, those methods extract style from an entire exemplar which includes noisy information, which impedes a translation model from properly extracting the intended style of the exemplar. That is, we need to carefully determine what to transfer from the exemplar. Second, the extracted style is applied to the entire input image, which causes unnecessary distortion in irrelevant image regions. In response, we need to decide where to transfer the extracted style. In this paper, we propose a novel approach that extracts out a local mask from the exemplar that determines what style to transfer, and another local mask from the input image that determines where to transfer the extracted style. The main novelty of this paper lies in (1) the highway adaptive instance normalization technique and (2) an end-to-end translation framework which achieves an outstanding performance in reflecting a style of an exemplar. We demonstrate the quantitative and qualitative evaluation results to confirm the advantages of our proposed approach.


title: High-dimensional limit theorems for random vectors in $\ell_p^n$-balls. II

abstract: In this article we prove three fundamental types of limit theorems for the $q$-norm of random vectors chosen at random in an $\ell_p^n$-ball in high dimensions. We obtain a central limit theorem, a moderate deviations as well as a large deviations principle when the underlying distribution of the random vectors belongs to a general class introduced by Barthe, Gu\'edon, Mendelson, and Naor. It includes the normalized volume and the cone probability measure as well as projections of these measures as special cases. Two new applications to random and non-random projections of $\ell_p^n$-balls to lower-dimensional subspaces are discussed as well. The text is a continuation of [Kabluchko, Prochno, Th\"ale: High-dimensional limit theorems for random vectors in $\ell_p^n$-balls, Commun. Contemp. Math. (2019)].


title: Elastic anomalies associated with domain switching in BaTiO$_3$ single crystals under in-situ electrical cycling

abstract: The elastic response of BaTiO$_3$ single crystals during electric field cycling at room temperature has been studied using in-situ Resonant Ultrasound Spectroscopy (RUS), which allows monitoring of both the elastic and anelastic changes caused by ferroelectric polarization switching. We find that the first ferroelectric switching of a virgin single crystal is dominated by ferroelastic 90{\deg} switching. In subsequent ferroelectric switching, ferroelastic switching is reduced by domain pinning and by the predominance of 180{\deg} ferroelectric domains, as confirmed by polarized light microscopy. RUS under in-situ electric field therefore demonstrates to be an effective technique for the investigation of electromechanical coupling in ferroelectrics.


title: Magnetic Raman continuum in single crystalline H$_3$LiIr$_2$O$_6$

abstract: Recently H$_3$LiIr$_2$O$_6$ has been reported as a spin-orbital entangled quantum spin liquid (QSL) [K. Kitagawa et al., Nature {\bf 554}, 341 (2018)], albeit its connection to Kitaev QSL has not been yet identified. To unveil the related Kitaev physics, we perform the first Raman spectroscopy studies on single crystalline H$_3$LiIr$_2$O$_6$ samples. We implement a soft chemical replacement of Li$^+$ with H$^+$ from $\alpha$-Li$_2$IrO$_3$ single crystals to synthesize the single crystal samples of the iridate second generation H$_3$LiIr$_2$O$_6$. The Raman spectroscopy can be used to diagnose the QSL state since the magnetic Raman continuum arises from a process involving pairs of fractionalized Majorana fermionic excitation in a pure Kitaev model. We observe a broad dome-shaped magnetic continuum in H$_3$LiIr$_2$O$_6$, in line with theoretical expectations for the two-spin process in the Kitaev QSL. Our results establish the close connection to the Kitaev QSL physics in H$_3$LiIr$_2$O$_6$.


title: Mapping classes are almost determined by their finite quotient actions

abstract: Given any connected compact orientable surface, a pair of mapping classes are said to be procongruently conjugate if they induce a conjugate pair of outer automophisms on the profinite completion of the fundamental group of the surface. For example, this occurs if they induce conjugate outer automorphisms on every characteristic finite quotient of the fundamental group. In this paper, it is shown that every procongruent conjugacy class of mapping classes, as a subset of the surface mapping class group, is the disjoint union of at most finitely many conjugacy classes of mapping classes. For any pseudo-Anosov mapping class of a connected closed orientable surface, several topological features are confirmed to depend only on the procongurent conjugacy class of the mapping class, including: the stretching factor, the topological type of the prong singularities, the transverse orientability of the invariant foliations, and the isomorphism type of the symplectic Floer homology.


title: Optimal Control for Controllable Stochastic Linear Systems

abstract: This paper is concerned with a constrained stochastic linear-quadratic optimal control problem, in which the terminal state is fixed and the initial state is constrained to lie in a stochastic linear manifold. The controllability of stochastic linear systems is studied. Then the optimal control is explicitly obtained by considering a parameterized unconstrained backward LQ problem and an optimal parameter selection problem. A notable feature of our results is that, instead of solving an equation involving derivatives with respect to the parameter, the optimal parameter is characterized by an algebraic equation.


title: On Copula-based Collective Risk Models

abstract: Several collective risk models have recently been proposed by relaxing the widely used but controversial assumption of independence between claim frequency and severity. Approaches include the bivariate copula model, random effect model, and two-part frequency-severity model. This study focuses on the copula approach to develop collective risk models that allow a flexible dependence structure for frequency and severity. We first revisit the bivariate copula method for frequency and average severity. After examining the inherent difficulties of the bivariate copula model, we alternatively propose modeling the dependence of frequency and individual severities using multivariate Gaussian and t-copula functions. The proposed copula models have computational advantages and provide intuitive interpretations for the dependence structure. Our analytical findings are illustrated by analyzing automobile insurance data.


title: Semi-supervised Complex-valued GAN for Polarimetric SAR Image Classification

abstract: Polarimetric synthetic aperture radar (PolSAR) images are widely used in disaster detection and military reconnaissance and so on. However, their interpretation faces some challenges, e.g., deficiency of labeled data, inadequate utilization of data information and so on. In this paper, a complex-valued generative adversarial network (GAN) is proposed for the first time to address these issues. The complex number form of model complies with the physical mechanism of PolSAR data and in favor of utilizing and retaining amplitude and phase information of PolSAR data. GAN architecture and semi-supervised learning are combined to handle deficiency of labeled data. GAN expands training data and semi-supervised learning is used to train network with generated, labeled and unlabeled data. Experimental results on two benchmark data sets show that our model outperforms existing state-of-the-art models, especially for conditions with fewer labeled data.


title: Statistical physics of long dynamical trajectories for a system in contact with several thermal reservoirs

abstract: For a system in contact with several reservoirs $r$ at different inverse-temperatures $\beta_r$, we describe how the Markov jump dynamics with the generalized detailed balance condition can be analyzed via a statistical physics approach of dynamical trajectories $[{\cal C}(t)]_{0 \leq t \leq T} $ over a long time interval $T \to + \infty$. The relevant intensive variables are the time-empirical density $\rho(\cal C)$, that measures the fractions of time spent in the various configurations ${\cal C}$, and the time-empirical jump densities $k_r ({\cal C', \cal C}) $, that measure the frequencies of jumps from configuration ${\cal C} $ to configuration ${\cal C '} $ when it is the reservoir $r$ that furnishes or absorbs the corresponding energy difference ($E({\cal C '})- E({\cal C })$).


title: Pixel DAG-Recurrent Neural Network for Spectral-Spatial Hyperspectral Image Classification

abstract: Exploiting rich spatial and spectral features contributes to improve the classification accuracy of hyperspectral images (HSIs). In this paper, based on the mechanism of the population receptive field (pRF) in human visual cortex, we further utilize the spatial correlation of pixels in images and propose pixel directed acyclic graph recurrent neural network (Pixel DAG-RNN) to extract and apply spectral-spatial features for HSIs classification. In our model, an undirected cyclic graph (UCG) is used to represent the relevance connectivity of pixels in an image patch, and four DAGs are used to approximate the spatial relationship of UCGs. In order to avoid overfitting, weight sharing and dropout are adopted. The higher classification performance of our model on HSIs classification has been verified by experiments on three benchmark data sets.


title: Probing for Semantic Classes: Diagnosing the Meaning Content of Word Embeddings

abstract: Word embeddings typically represent different meanings of a word in a single conflated vector. Empirical analysis of embeddings of ambiguous words is currently limited by the small size of manually annotated resources and by the fact that word senses are treated as unrelated individual concepts. We present a large dataset based on manual Wikipedia annotations and word senses, where word senses from different words are related by semantic classes. This is the basis for novel diagnostic tests for an embedding's content: we probe word embeddings for semantic classes and analyze the embedding space by classifying embeddings into semantic classes. Our main findings are: (i) Information about a sense is generally represented well in a single-vector embedding - if the sense is frequent. (ii) A classifier can accurately predict whether a word is single-sense or multi-sense, based only on its embedding. (iii) Although rare senses are not well represented in single-vector embeddings, this does not have negative impact on an NLP application whose performance depends on frequent senses.


title: Distilling Object Detectors with Fine-grained Feature Imitation

abstract: State-of-the-art CNN based recognition models are often computationally prohibitive to deploy on low-end devices. A promising high level approach tackling this limitation is knowledge distillation, which let small student model mimic cumbersome teacher model's output to get improved generalization. However, related methods mainly focus on simple task of classification while do not consider complex tasks like object detection. We show applying the vanilla knowledge distillation to detection model gets minor gain. To address the challenge of distilling knowledge in detection model, we propose a fine-grained feature imitation method exploiting the cross-location discrepancy of feature response. Our intuition is that detectors care more about local near object regions. Thus the discrepancy of feature response on the near object anchor locations reveals important information of how teacher model tends to generalize. We design a novel mechanism to estimate those locations and let student model imitate the teacher on them to get enhanced performance. We first validate the idea on a developed lightweight toy detector which carries simplest notion of current state-of-the-art anchor based detection models on challenging KITTI dataset, our method generates up to 15% boost of mAP for the student model compared to the non-imitated counterpart. We then extensively evaluate the method with Faster R-CNN model under various scenarios with common object detection benchmark of Pascal VOC and COCO, imitation alleviates up to 74% performance drop of student model compared to teacher. Codes released at https://github.com/twangnh/Distilling-Object-Detectors


title: A uniqueness result on detecting a prey in a spider orb-web

abstract: We consider the inverse problem of localizing a prey hitting a spider orb-web from dynamic measurements taken near the center of the web, where the spider is supposed to stay. The actual discrete orb-web, formed by a finite number of radial and circumferential threads, is modelled as a continuous membrane. The membrane has a specific fibrous structure, which is inherited from the original discrete web, and it is subject to tensile pre-stress in the referential configuration. The transverse load describing the prey's impact is assumed of the form $g(t)f(x)$, where $g(t)$ is a known function of time and $f(x)$ is the unknown term depending on the position variable $x$. For axially-symmetric orb-webs supported at the boundary and undergoing infinitesimal transverse deformations, we prove a uniqueness result for $f(x)$ in terms of measurements of the transverse dynamic displacement taken on an arbitrarily small and thin ring centered at the origin of the web, for a sufficiently large interval of time.


title: From QBFs to MALL and back via focussing: fragments of multiplicative additive linear logic for each level of the polynomial hierarchy

abstract: In this work we investigate how to extract alternating time bounds from 'focussed' proof systems. Our main result is the obtention of fragments of MALLw (MALL with weakening) complete for each level of the polynomial hierarchy. In one direction we encode QBF satisfiability and in the other we encode focussed proof search, and we show that the composition of the two encodings preserves quantifier alternation, yielding the required result. By carefully composing with well-known embeddings of MALLw into MALL, we obtain a similar delineation of MALL formulas, again carving out fragments complete for each level of the polynomial hierarchy. This refines the well-known results that both MALLw and MALL are PSPACE-complete. A key insight is that we have to refine the usual presentation of focussing to account for deterministic computations in proof search, which correspond to invertible rules that do not branch. This is so that we may more faithfully associate phases of focussed proof search to their alternating time complexity. This presentation seems to uncover further dualities at the level of proof search than usual presentations, so could be of further proof theoretic interest in its own right.


title: On the Vulnerability of Capsule Networks to Adversarial Attacks

abstract: This paper extensively evaluates the vulnerability of capsule networks to different adversarial attacks. Recent work suggests that these architectures are more robust towards adversarial attacks than other neural networks. However, our experiments show that capsule networks can be fooled as easily as convolutional neural networks.


title: The spectrum of composition operators induced by a rotation in the space of all analytic functions on the disc

abstract: A characterization of those points in the unit disc which belong to the spectrum of a composition operator $C_{\varphi}$, defined by a rotation $\varphi(z)=rz$ with $|r|=1$, on the space $H_0(\mathbb{D})$ of all analytic functions on the unit disc which vanish at $0$, is given. Examples show that the point $1$ may or may not belong to the spectrum of $C_{\varphi}$, and this is related to Diophantine approximation. Our results complement recent work by Arendt, Celari\`es and Chalendar.


title: m_c and m_b from M_B_c and improved estimate of f_B_c and f_B_c (2S)

abstract: We extract (for the first time) the correlated values of the running masses m_c and m_b from M_Bc using QCD Laplace sum rules (LSR) within stability criteria where pertubative (PT) expressions at N2LO and non-perturbative (NP) gluon condensates at LO are included. Allowing the values of m_{c,b}(m_{c,b}) to move inside the enlarged range of recent estimates from charmonium and bottomium sum rules (Table 1) obtained using similar stability criteria, wee deduce : m_c(m_c) = 1286(16) MeV and m_b(m_b) = 4208(8) MeV. Combined with previous estimates (Table 2), we deduce a tentative QCD Spectral Sum Rules (QSSR) average m_c(m_c) = 1266(6) MeV and m_b(m_b) = 4197(8) MeV, where the errors come from the precise determinations from J/psi and Upsilon sum rules. As a result, we present an improved prediction of f_B_c =371(17)MeV and the tentative upper bound f_B_c(2S)<139(6) MeV, which are useful for a further analysis of B_c-decays.


title: Shintani lifts for Weil representations of unitary groups over finite fields

abstract: We construct extended Weil representations of unitary groups over finite fields geometrically, and show that they are Shintani lifts for Weil representations.


title: Elliptic flow of identified particles in Pb-Pb collisions at $\sqrt{s_{NN}}=5.02$ TeV

abstract: In this paper, by using a Tsallis-Pareto-type function and the multisource thermal model, the elliptic flow coefficients of particles $\pi ^{\pm }$, $K^{\pm }$, $p+\overline{p}$, $\Lambda +\overline{% \Lambda }$, and $K_{S}^{0}$ produced in Pb-Pb collisions at the center-of-mass energy of $\sqrt{s_{NN}}=5.02$ TeV are investigated. In the process of collisional evolution, because of geometric structure, pressure gradient, and thermal diffusion effects, deformation and translation occurred in the isotropic emission source, leading to anisotropy in the azimuth distribution of the final-state particles. Based on these dynamic factors, the dependence of elliptic flow on transverse momentum is described as well.


title: The biasing phenomenon

abstract: {We study biasing as a physical phenomenon by analysing geometrical and clustering properties of density fields of matter and galaxies.} {Our goal is to determine the bias function using a combination of geometrical and power spectrum analysis of simulated and real data.} {We apply an algorithm based on local densities of particles, $\delta$, to form simulated biased models using particles with $\delta \ge \delta_0$. We calculate the bias function of model samples as functions of the particle density limit $\delta_0$. We compare the biased models with Sloan Digital Sky Survey (SDSS) luminosity limited samples of galaxies using the extended percolation method. We find density limits $\delta_0$ of biased models, which correspond to luminosity limited SDSS samples.} {Power spectra of biased model samples allow to estimate the bias function $b(>L)$ of galaxies of luminosity $L$. We find the estimated bias parameter of $L_\ast$ galaxies, $b_\ast =1.85 \pm 0.15$. } {The absence of galaxy formation in low-density regions of the Universe is the dominant factor of the biasing phenomenon. Second largest effect is the dependence of the bias function on the luminosity of galaxies. Variations in gravitational and physical processes during the formation and evolution of galaxies have the smallest influence to the bias function. }


title: Analysis of a Poisson-picking symmetric winners-take-all game with randomized payoffs

abstract: Winners-take-all situations introduce an incentive for agents to diversify their behavior, since doing so will result in splitting an eventual price with fewer people. At the same time, when the payoff of a process depends on a parameter choice that is symmetric with respect to agents, all agents have the incentive to choose the values of the parameter that lead to higher payoffs. We explore the trade-off between these two considerations, with a focus on a particular example. This example can be seen as a simple model for the situation where a group of friends bet against each other about the top-scoring team in a sports league. We obtain analytic characterizations of the symmetric equilibria in the case of only 2 agents and in the case where there are only two possible top-scorers. We also conduct some simulations beyond these cases, and observe how does the pressure to diversify behavior evolve as the parameters of the model change.


title: Linearization of holomorphic semicocycles in Banach spaces

abstract: We consider holomorphic semicocycles on the open unit ball in a Banach space taking values in a Banach algebra. We establish criteria for a semicocycle to be linearizable, that is, cohomologically equivalent to one independent of the spatial variable.


title: Accelerated methods for composite non-bilinear saddle point problem

abstract: Based on G. Lan's accelerated gradient sliding and general relation between the smoothness and strong convexity parameters of function under Legendre transformation we show that under rather general conditions the best known bounds for bilinear convex-concave smooth composite saddle point problem keep true for or non-bilinear convex-concave smooth composite saddle point problem. Moreover, we describe situations when the bounds differ and explain the nature of the difference.


title: Efficient invariant energy quadratization and scalar auxiliary variable approaches without bounded below restriction for phase field models

abstract: Recently introduced invariant energy quadratization (IEQ) and scalar auxiliary variable (SAV) approaches have proven to be very powerful ways to construct energy stable schemes for phase field models. Both methods require an assumption which the energy potential or energy is bounded from below. Under this assumption, a positive constant $C$ need to be added to keep the square root reasonable. However, it seems that it maybe more reasonable in both physics and mathematics if the energy potential or energy is arbitrary. Furthermore, if the bounded value from below is not obvious exactly, we are not easy to give a proper constant $C$ before calculation. In this paper, by adding a positive preserving function ($M(\phi)$ in IEQ and $E_0(\phi)$ in SAV ) instead of the positive constant in square root, we can improve this situation. The main contribution of this article is we proved that the positive preserving function can always be found for polynomial type $F(\phi)$. We also proved the unconditional energy stability for all semi-discrete schemes carefully and rigorously. A comparative study of classical IEQ, SAV, MIEQ and MSAV approaches is considered to show the accuracy and efficiency. Finally, we present various 2D numerical simulations to demonstrate the stability and


title: On a Combination of Alternating Minimization and Nesterov's Momentum

abstract: Alternating minimization (AM) procedures are practically efficient in many applications for solving convex and non-convex optimization problems. On the other hand, Nesterov's accelerated gradient is theoretically optimal first-order method for convex optimization. In this paper we combine AM and Nesterov's acceleration to propose an accelerated alternating minimization algorithm. We prove $1/k^2$ convergence rate in terms of the objective for convex problems and $1/k$ in terms of the squared gradient norm for non-convex problems, where $k$ is the iteration counter. Our method does not require any knowledge of neither convexity of the problem nor function parameters such as Lipschitz constant of the gradient, i.e. it is adaptive to convexity and smoothness and is uniformly optimal for smooth convex and non-convex problems. Further, we develop its primal-dual modification for strongly convex problems with linear constraints and prove the same $1/k^2$ for the primal objective residual and constraints feasibility.


title: A Distributed Event-Triggered Control Strategy for DC Microgrids Based on Publish-Subscribe Model Over Industrial Wireless Sensor Networks

abstract: This paper presents a complete design, analysis, and performance evaluation of a novel distributed event-triggered control and estimation strategy for DC microgrids. The primary objective of this work is to efficiently stabilize the grid voltage, and to further balance the energy level of the energy storage (ES) systems. The locally-installed distributed controllers are utilised to reduce the number of transmitted packets and battery usage of the installed sensors, based on a proposed event-triggered communication scheme. Also, to reduce the network traffic, an optimal observer is employed which utilizes a modified Kalman consensus filter (KCF) to estimate the state of the DC microgrid via the distributed sensors. Furthermore, in order to effectively provide an intelligent data exchange mechanism for the proposed event-triggered controller, the publish-subscribe communication model is employed to setup a distributed control infrastructure in industrial wireless sensor networks (WSNs). The performance of the proposed control and estimation strategy is validated via the simulations of a DC microgrid composed of renewable energy sources (RESs). The results confirm the appropriateness of the implemented strategy for the optimal utilization of the advanced industrial network architectures in the smart grids.


title: Nonlocality amplifies echoes

abstract: In this paper we will provide smoking-gun signatures of nonlocal interactions while studying reflection and transmission of waves bouncing through two Dirac delta potentials. In particular, we will show that the transmission of waves is less damped compared to the local case, due to the fact that nonlocality weakens the interaction. As a consequence the echoes are amplified. These signatures can be potentially detectable in the context of gravitational waves, where two Dirac delta potentials can mimic the two potential barriers at the surface and at the photon sphere of an ultra compact object, or, at the two photon spheres of a wormhole, experiencing nonlocal interactions.


title: Soft-ranking Label Encoding for Robust Facial Age Estimation

abstract: Automatic facial age estimation can be used in a wide range of real-world applications. However, this process is challenging due to the randomness and slowness of the aging process. Accordingly, in this paper, we propose a comprehensive framework aimed at overcoming the challenges associated with facial age estimation. First, we propose a novel age encoding method, referred to as 'Soft-ranking', which encodes two important properties of facial age, i.e., the ordinal property and the correlation between adjacent ages. Therefore, Soft-ranking provides a richer supervision signal for training deep models. Moreover, we also carefully analyze existing evaluation protocols for age estimation, finding that the overlap in identity between the training and testing sets affects the relative performance of different age encoding methods. Finally, since existing face databases for age estimation are generally small, deep models tend to suffer from an overfitting problem. To address this issue, we propose a novel regularization strategy to encourage deep models to learn more robust features from facial parts for age estimation purposes. Extensive experiments indicate that the proposed techniques improve the age estimation performance; moreover, we achieve state-of-the-art performance on the three most popular age databases, $i.e.$, Morph II, CLAP2015, and CLAP2016.


title: Deep Music Analogy Via Latent Representation Disentanglement

abstract: Analogy-making is a key method for computer algorithms to generate both natural and creative music pieces. In general, an analogy is made by partially transferring the music abstractions, i.e., high-level representations and their relationships, from one piece to another; however, this procedure requires disentangling music representations, which usually takes little effort for musicians but is non-trivial for computers. Three sub-problems arise: extracting latent representations from the observation, disentangling the representations so that each part has a unique semantic interpretation, and mapping the latent representations back to actual music. In this paper, we contribute an explicitly-constrained variational autoencoder (EC$^2$-VAE) as a unified solution to all three sub-problems. We focus on disentangling the pitch and rhythm representations of 8-beat music clips conditioned on chords. In producing music analogies, this model helps us to realize the imaginary situation of "what if" a piece is composed using a different pitch contour, rhythm pattern, or chord progression by borrowing the representations from other pieces. Finally, we validate the proposed disentanglement method using objective measurements and evaluate the analogy examples by a subjective study.


title: Accuracy Requirements for Early Estimation of Crop Production in Senegal

abstract: Early warning systems for food security rely on timely and accurate estimations of crop production. Several approaches have been developed to get early estimations of area and yield, the two components of crop production. The most common methods, based on Earth observation data, are image classification for crop area and correlation with vegetation index for crop yield. Regardless of the approach used, early estimators of cropland area, crop area or crop yield should have an accuracy providing lower production error than existing historical crop statistics. The objective of this study is to develop a methodological framework to define the accuracy requirements for early estimators of cropland area, crop area and crop yield in Senegal. These requirements are made according to (i) the inter-annual variability and the trend of historical data, (ii) the calendar of official statistics data collection, and (iii) the time at which early estimations of cropland area, crop area and crop yield can theoretically be available. This framework is applied to the seven main crops in Senegal using 20 years of crop production data. Results show that the inter-annual variability of crop yield is the main factor limiting the accuracy of pre-harvest production forecast. Estimators of cropland area can be used to improve production prediction of groundnuts, millet and rice, the three main crops in Senegal stressing the value of cropland mapping for food security. While applied to Senegal, this study could easily be reproduced in any country where reliable agricultural statistics are available.


title: Distributed sub-optimal resource allocation via a projected form of singular perturbation

abstract: Distributed optimization for resource allocation problems is investigated and a sub-optimal continuous-time algorithm is proposed. Our algorithm has lower order dynamics than others to reduce burdens of computation and communication, and is applicable to weight-balanced graphs. Moreover, it can deal with both local set constraints and coupled inequality constraints, and remove the requirement of twice differentiability of the cost function in comparison with the existing sub-optimal algorithm. However, this algorithm is not easy to be analyzed since it involves singular perturbation type dynamics with projected non-differentiable right-hand side. We overcome the encountered difficulties and obtain results including the existence of an equilibrium, the sub-optimality, and the convergence of the algorithm.


title: Movable-Object-Aware Visual SLAM via Weakly Supervised Semantic Segmentation

abstract: Moving objects can greatly jeopardize the performance of a visual simultaneous localization and mapping (vSLAM) system which relies on the static-world assumption. Motion removal have seen successful on solving this problem. Two main streams of solutions are based on either geometry constraints or deep semantic segmentation neural network. The former rely on static majority assumption, and the latter require labor-intensive pixel-wise annotations. In this paper we propose to adopt a novel weakly-supervised semantic segmentation method. The segmentation mask is obtained from a CNN pre-trained with image-level class labels only. Thus, we leverage the power of deep semantic segmentation CNNs, while avoid requiring expensive annotations for training. We integrate our motion removal approach with the ORB-SLAM2 system. Experimental results on the TUM RGB-D and the KITTI stereo datasets demonstrate our superiority over the state-of-the-art.


title: A Local Resolution of the Problem of Time. V. Combining Temporal and Configurational Relationalism for Finite Theories

abstract: As we have known comprehensively since the early 1990's works of Isham and Kucha\v{r}, The Problem of Time mostly concerns interferences between its many facets. Having introduced the local facets in Articles I to IV, we now show how Article I's approach to Temporal Relationalism can be combined with Article II's to Configurational Relationalism. This requires reformulating some of the Principles of Dynamics to be Temporal Relationalism implementing, a strategy which we follow through in each subsequent Article. All in all, around half of the Principles of Dynamics needs to be rewritten to solve this noted, 50-year-old and hitherto unresolved foundational problem. This stands as sufficient reason to render new resultant Principles of Dynamics - `TRiPoD' - a significant and worthwhile development of the Principles of Dynamics. This amounts to taking Jacobi's action principle more seriously than Jacobi himself did, or any authors in between: to constitute a new starting point for the entirety of the Principles of Dynamics is to be reworked. This can moreover be viewed as a mild recategorization necessitated by the Problem of Time. While mathematically simple to carry out, it requires quite a lot of conceptual developments, by which it is both prudent and useful exposition to present this first for finite rather than Field Theoretic examples in the current Article. Article VI then extends this approach to Field Theory and GR.


title: Overcoming Limitations of Mixture Density Networks: A Sampling and Fitting Framework for Multimodal Future Prediction

abstract: Future prediction is a fundamental principle of intelligence that helps plan actions and avoid possible dangers. As the future is uncertain to a large extent, modeling the uncertainty and multimodality of the future states is of great relevance. Existing approaches are rather limited in this regard and mostly yield a single hypothesis of the future or, at the best, strongly constrained mixture components that suffer from instabilities in training and mode collapse. In this work, we present an approach that involves the prediction of several samples of the future with a winner-takes-all loss and iterative grouping of samples to multiple modes. Moreover, we discuss how to evaluate predicted multimodal distributions, including the common real scenario, where only a single sample from the ground-truth distribution is available for evaluation. We show on synthetic and real data that the proposed approach triggers good estimates of multimodal distributions and avoids mode collapse. Source code is available at $\href{https://github.com/lmb-freiburg/Multimodal-Future-Prediction}{\text{this https URL.}}$


title: A Lorentz-Covariant Interacting Electron-Photon System in One Space Dimension

abstract: A Lorenz-covariant system of wave equations is formulated for a quantum-mechanical two-body system in one space dimension, comprised of one electron and one photon. Manifest Lorentz covariance is achieved using Dirac's formalism of multi-time wave functions, i.e., wave functions $\Psi(\mathbf{x}_{{ph}},\mathbf{x}_{{el}})$ where $\mathbf{x}_{{el}},\mathbf{x}_{{ph}}$ are the generic spacetime events of the electron and photon, respectively. Their interaction is implemented via a Lorentz-invariant no-crossing-of-paths boundary condition at the coincidence submanifold $\{\mathbf{x}_{{el}}=\mathbf{x}_{{ph}}\}$, compatible with particle current conservation. The corresponding initial-boundary-value problem is proved to be well-posed. Electron and photon trajectories are shown to exist globally in a Hypersurface Bohm--Dirac theory, for typical particle initial conditions. Also presented are the results of some numerical experiments which illustrate Compton scattering as well as a new phenomenon: photon capture and release by the electron.


title: Insight-HXMT observations of the Crab pulsar

abstract: We report on X-ray emission properties of the Crab pulsar(PSR B0531+21) using observations by Insight-HXMT during its first year after launch. We obtained high signal-to-noise profiles in the X-ray energy band 11-250 keV. We have confirmed an increase in the flux ratio of the second peak over the main peak with increasing energy, consistent with other missions. The separation of the two peaks shows no significant trend with increasing energy. The phase-averaged spectrum, fitted by a logpar model, and the phase-resolved spectra of the Crab pulsar, fitted by a powerlaw in the different energy bands of HXMT, are consistent with RXTE and NuSTAR in that photon indices evolve as a function of phase as well as a function of energy contributing to a broadband modeling.


title: Learning to Predict Novel Noun-Noun Compounds

abstract: We introduce temporally and contextually-aware models for the novel task of predicting unseen but plausible concepts, as conveyed by noun-noun compounds in a time-stamped corpus. We train compositional models on observed compounds, more specifically the composed distributed representations of their constituents across a time-stamped corpus, while giving it corrupted instances (where head or modifier are replaced by a random constituent) as negative evidence. The model captures generalisations over this data and learns what combinations give rise to plausible compounds and which ones do not. After training, we query the model for the plausibility of automatically generated novel combinations and verify whether the classifications are accurate. For our best model, we find that in around 85% of the cases, the novel compounds generated are attested in previously unseen data. An additional estimated 5% are plausible despite not being attested in the recent corpus, based on judgments from independent human raters.


title: A Local Resolution of the Problem of Time. VI. Combining Temporal and Configurational Relationalism for Field Theories and GR

abstract: We next combine Temporal and Configurational Relationalism's resolution for Field Theory, including in particular for GR. The current Article also provides the finite-and-field theory portmanteau notation, by which the rest of this series' reworking of the Principles of Dynamics can be presented concurrently for Finite Theories and Field Theories. GR's Riem, superspace, and thin sandwich are also further outlined in support of the rest of this Series.


title: When is the frame of nuclei spatial: A new approach

abstract: For a frame $L$, let $X_L$ be the Esakia space of $L$. We identify a special subset $Y_L$ of $X_L$ consisting of nuclear points of $X_L$, and prove the following results: $L$ is spatial iff $Y_L$ is dense in $X_L$. If $L$ is spatial, then $N(L)$ is spatial iff $Y_L$ is weakly scattered. If $L$ is spatial, then $N(L)$ is boolean iff $Y_L$ is scattered. As a consequence, we derive the well-known results of Beazer and Macnab [1979], Simmons [1980], Niefield and Rosenthal [1987], and Isbell [1972].


title: Gravitational Perturbations in a cavity: Nonlinearities

abstract: Motivated by recent studies of nonlinear perturbations of asymptotically anti-de Sitter spacetimes, we study gravitational perturbations of $(n+2)$ dimensional Minkowski spacetime with a spherical Dirichlet wall. By considering the tensor, vector and scalar perturbations on the $n$ sphere, we present simplified nonhomogeneous equations at arbitrary order in weakly nonlinear perturbation theory for each sector. A suitable choice of perturbative variables is required at higher orders to simplify the expression for the boundary conditions and to expand the variables in terms of linear order eigenfunctions. Finally we comment on the nonlinear stability of the system. Some of the tools used can easily be generalized to study nonlinear perturbations of anti-de Sitter spacetime.


title: Coupled Bloch-Wave Analysis of Active PhC Waveguides and Cavities

abstract: A coupled Bloch-wave approach is employed to analyze active photonic-crystal (PhC) waveguides and cavities. Gain couples the otherwise independent counter-propagating Bloch modes. This coupling is shown to limit the maximum attainable slow-light enhancement of gain itself and to strongly affect the mode selection in PhC lasers.


title: Consensus Neural Network for Medical Imaging Denoising with Only Noisy Training Samples

abstract: Deep neural networks have been proved efficient for medical image denoising. Current training methods require both noisy and clean images. However, clean images cannot be acquired for many practical medical applications due to naturally noisy signal, such as dynamic imaging, spectral computed tomography, arterial spin labeling magnetic resonance imaging, etc. In this paper we proposed a training method which learned denoising neural networks from noisy training samples only. Training data in the acquisition domain was split to two subsets and the network was trained to map one noisy set to the other. A consensus loss function was further proposed to efficiently combine the outputs from both subsets. A mathematical proof was provided that the proposed training scheme was equivalent to training with noisy and clean samples when the noise in the two subsets was uncorrelated and zero-mean. The method was validated on Low-dose CT Challenge dataset and NYU MRI dataset and achieved improved performance compared to existing unsupervised methods.


title: The Frame of Nuclei of an Alexandroff Space

abstract: Let $\mathcal{O}S$ be the frame of open sets of a topological space $S$, and let $N(\mathcal{O}S)$ be the frame of nuclei of $\mathcal{O}S$. For an Alexandroff space $S$, we prove that $N(\mathcal{O}S)$ is spatial iff the infinite binary tree $\mathscr T_2$ does not embed isomorphically into $(S, \le)$, where $\le$ is the specialization preorder of $S$.


title: A Local Resolution of the Problem of Time. VII. Constraint Closure

abstract: We now set up Constraint Closure in a manner consistent with Temporal and Configurational Relationalism. This requires modifying the Dirac Algorithm - which addresses the Constraint Closure Problem facet of the Problem of Time piecemeal - to the TRi-Dirac Algorithm. This is a member of the wider class of Dirac-type algorithms that enjoys the property of being Temporal Relationalism implementing (TRi). Constraint algebraic structures ensue. We include examples of types of constraint, outcomes of the Dirac Algorithm and different kinds of Constraint Closure Problems. Enough new Principles of Dynamics is required to support this venture that an Appendix on it is provided: differential Hamiltonians, anti-Routhians, and the brackets, state spaces and morphisms corresponding to these.


title: A Local Resolution of the Problem of Time. IX. Spacetime Constructability

abstract: Assuming Temporal and Configurational Relationalism, GR as Geometrodynamic's DeWitt supermetric alongside local Lorentzian Relativity with its universal finite maximum propagation speed arises as one of very few options from Feeding Families through a Dirac-type Algorithm for Consistency. This amounts to Spacetime Construction from prior assumptions about space and dynamics alone. The other alternatives, arising as cofactors' likewise strongly vanishing roots are, firstly, Galileo-Riemann Geometrostatics with Galilean Relativity's infinte propagation speed. Secondly, Strong Gravity with Carrollian Relativity 's zero propagation speed. If none of these vanish, constant mean curvature of the spatial slice is enforced, paralleling previous work on decouping GR's constraints and addressing its initial-value problem. Assuming just Temporal Relationalism, spatial 3-diffeomorphism Configurational Relationalism is enforced as an integrability as one of very few options. The alternatives here are, once again, Galileo-Riemann Geometrostatics and Strong Gravity, for which spatial 3-diffeomorphisms are thereby optional, and local volume preserving diffeomorphisms. Options are few in each case above due to Rigidity kicking in. We furthermore demonstrate that such Rigidities are more generally Lie rather than specific to Dirac-type Algorithms. We do this by deriving the conformal versus projective ambiguity in top-geometry by feeding the general quadratic generator into the Lie Algorithm for Consistency. Both Feeding Families through a Brackets Consistency Algorithm and Rigidity are thus additionally of relevance to the Foundations of Geometry.


title: An introduction to astrophysical observables in gravitational wave detections

abstract: Our knowledge and understanding of the Universe is mainly based on observations of the electromagnetic radiation in a wide range of wavelengths. Only during the past two decades, new kinds of detectors have been developed, exploiting other forms of cosmic probes: individual photons with energy above the GeV, charged particles and antiparticles, neutrinos and, finally, gravitational waves. These new ``telescopes'' leaded to unexpected breakthroughs. Years 2016 and 2017 have seen the dawn of the astrophysics and cosmology with gravitational waves, awarded with the 2017 Nobel Prize. The events GW150914 (the first black hole-black hole merger) and GW170817 (the coalescence of two neutron stars, producing a short gamma-ray burst and follow-up observed by more than 70 observatories on all continents and in space) represent really milestones in science that every physicist (senior or in formation) should appreciate. In this document, after an accessible discussion on the generation and propagation of GWs, the key features of observable quantities (the strain, the GW frequency $\nu_{gw}$, and $\dot \nu_{gw}$) of GW150914 and GW170817 are discussed using Newtonian physics, dimensional analysis and analogies with electromagnetic waves. The objective is to show how astrophysical quantities (the initial and final masses of merging objects, the energy loss, the distance, their spin) are derived from observables. The results from the fully general-relativistic analysis published in the two discovery papers are compared with the output of our simple treatment. Then, some of the outcomes of GW observations are discussed in terms of multimessenger astrophysics.


title: The Implicit Metropolis-Hastings Algorithm

abstract: Recent works propose using the discriminator of a GAN to filter out unrealistic samples of the generator. We generalize these ideas by introducing the implicit Metropolis-Hastings algorithm. For any implicit probabilistic model and a target distribution represented by a set of samples, implicit Metropolis-Hastings operates by learning a discriminator to estimate the density-ratio and then generating a chain of samples. Since the approximation of density ratio introduces an error on every step of the chain, it is crucial to analyze the stationary distribution of such chain. For that purpose, we present a theoretical result stating that the discriminator loss upper bounds the total variation distance between the target distribution and the stationary distribution. Finally, we validate the proposed algorithm both for independent and Markov proposals on CIFAR-10 and CelebA datasets.


title: Super-resolution PET imaging using convolutional neural networks

abstract: Positron emission tomography (PET) suffers from severe resolution limitations which limit its quantitative accuracy. In this paper, we present a super-resolution (SR) imaging technique for PET based on convolutional neural networks (CNNs). To facilitate the resolution recovery process, we incorporate high-resolution (HR) anatomical information based on magnetic resonance (MR) imaging. We introduce the spatial location information of the input image patches as additional CNN inputs to accommodate the spatially-variant nature of the blur kernels in PET. We compared the performance of shallow (3-layer) and very deep (20-layer) CNNs with various combinations of the following inputs: low-resolution (LR) PET, radial locations, axial locations, and HR MR. To validate the CNN architectures, we performed both realistic simulation studies using the BrainWeb digital phantom and clinical neuroimaging data analysis. For both simulation and clinical studies, the LR PET images were based on the Siemens HR+ scanner. Two different scenarios were examined in simulation: one where the target HR image is the ground-truth phantom image and another where the target HR image is based on the Siemens HRRT scanner --- a high-resolution dedicated brain PET scanner. The latter scenario was also examined using clinical neuroimaging datasets. A number of factors affected relative performance of the different CNN designs examined, including network depth, target image quality, and the resemblance between the target and anatomical images. In general, however, all CNNs outperformed classical penalized deconvolution techniques by large margins both qualitatively (e.g., edge and contrast recovery) and quantitatively (as indicated by two metrics: peak signal-to-noise-ratio and structural similarity index).


title: The A.B.C.Ds of Schubert calculus

abstract: We collect Atiyah-Bott Combinatorial Dreams (A.B.C.Ds) in Schubert calculus. One result relates equivariant structure coefficients for two isotropic flag manifolds, with consequences to the thesis of C. Monical. We contextualize using work of N. Bergeron-F. Sottile, S. Billey-M. Haiman, P. Pragacz, and T. Ikeda-L. Mihalcea-I. Naruse. The relation complements a theorem of A. Kresch-H. Tamvakis in quantum cohomology. Results of A. Buch-V. Ravikumar rule out a similar correspondence in K-theory.


title: A Variant of Gaussian Process Dynamical Systems

abstract: In order to better model high-dimensional sequential data, we propose a collaborative multi-output Gaussian process dynamical system (CGPDS), which is a novel variant of GPDSs. The proposed model assumes that the output on each dimension is controlled by a shared global latent process and a private local latent process. Thus, the dependence among different dimensions of the sequences can be captured, and the unique characteristics of each dimension of the sequences can be maintained. For training models and making prediction, we introduce inducing points and adopt stochastic variational inference methods.


title: LSTM Networks Can Perform Dynamic Counting

abstract: In this paper, we systematically assess the ability of standard recurrent networks to perform dynamic counting and to encode hierarchical representations. All the neural models in our experiments are designed to be small-sized networks both to prevent them from memorizing the training sets and to visualize and interpret their behaviour at test time. Our results demonstrate that the Long Short-Term Memory (LSTM) networks can learn to recognize the well-balanced parenthesis language (Dyck-$1$) and the shuffles of multiple Dyck-$1$ languages, each defined over different parenthesis-pairs, by emulating simple real-time $k$-counter machines. To the best of our knowledge, this work is the first study to introduce the shuffle languages to analyze the computational power of neural networks. We also show that a single-layer LSTM with only one hidden unit is practically sufficient for recognizing the Dyck-$1$ language. However, none of our recurrent networks was able to yield a good performance on the Dyck-$2$ language learning task, which requires a model to have a stack-like mechanism for recognition.


title: Interval maps of given topological entropy and Sharkovskii's type

abstract: It is known that the topological entropy of a continuous interval map $f$ is positive if and only if the type of $f$ for Sharkovskii's order is $2^d p$ for some odd integer $p\ge 3$ and some $d\ge 0$; and in this case the topological entropy of $f$ is greater than or equal to $\frac{\log\lambda_p}{2^d}$, where $\lambda_p$ is the unique positive root of $X^p-2X^{p-2}-1$. For every odd $p\ge 3$, every $d\ge 0$ and every $\lambda\ge\lambda_p$, we build a piecewise monotone continuous interval map that is of type $2^dp$ for Sharkovskii's order and whose topological entropy is $\frac{\log\lambda}{2^d}$. This shows that, for a given type, every possible finite entropy above the minimum can be reached provided the type allows the map to have positive entropy. Moreover, if $d=0$ the map we build is topologically mixing.


title: Unsupervised Primitive Discovery for Improved 3D Generative Modeling

abstract: 3D shape generation is a challenging problem due to the high-dimensional output space and complex part configurations of real-world objects. As a result, existing algorithms experience difficulties in accurate generative modeling of 3D shapes. Here, we propose a novel factorized generative model for 3D shape generation that sequentially transitions from coarse to fine scale shape generation. To this end, we introduce an unsupervised primitive discovery algorithm based on a higher-order conditional random field model. Using the primitive parts for shapes as attributes, a parameterized 3D representation is modeled in the first stage. This representation is further refined in the next stage by adding fine scale details to shape. Our results demonstrate improved representation ability of the generative model and better quality samples of newly generated 3D shapes. Further, our primitive generation approach can accurately parse common objects into a simplified representation.


title: Low-complexity Noncoherent Maximum Likelihood Sequence Detection Scheme for CPM in Aeronautical Telemetry

abstract: Due to high spectral efficiency and power efficiency, the continuous phase modulation (CPM) technique with constant envelope is widely used in aeronautical telemetry in strategic weapons and rockets, which are essential for national defence and aeronautic application. How to improve the bit error rate (BER) performance of CPM and keep a reasonable complexity is key for the entire telemetry system and has been the focus of research and engineering design. In this paper, a low-complexity noncoherent maximum likelihood sequence detection (MLSD) scheme for CPM is proposed. In the proposed method, the criterion of noncoherent MLSD for CPM is derived when the carrier phase is unknown, and then a novel Viterbi algorithm (VA) with modified state vector is designed to simplify the implementation of noncoherent MLSD. Both analysis and experimental results show that the proposed approach has lower computational complexity and does not need accurate carrier phase recovery, which overcomes the shortage of traditional MLSD method. What's more, compared to the traditional MLSD method, the proposed method also achieves almost the same detection performance.


title: $N\pi$-state contamination in lattice calculations of the nucleon pseudoscalar form factor

abstract: The nucleon-pion-state contribution in the QCD 3-point function of the pseudoscalar density is calculated to leading order in chiral perturbation theory. It predicts a nucleon-pion-state contamination in lattice estimates for the pseudoscalar form factor $G_{\rm P}(Q^2)$ determined with the plateau method. Depending on the momentum transfer $Q^2$ the contamination varies between -20% and +50% for a source-sink separation of 2 fm. The nucleon-pion-state contamination also causes violations in the generalized Goldberger-Treiman relation among the pseudoscalar and the axial nucleon form factors, the dominant source being the nucleon-pion-state contamination in the induced pseudoscalar form factor $\tilde{G}_{\rm P}(Q^2)$. Comparing the chiral perturbation theory predictions with lattice results of the PACS collaboration we find reasonable agreement even for source-sink separations as small as 1.3 fm.


title: Weak Hardy-Type Spaces Associated with Ball Quasi-Banach Function Spaces II: Littlewood--Paley Characterizations and Real Interpolation

abstract: Let $X$ be a ball quasi-Banach function space on ${\mathbb R}^n$. In this article, assuming that the powered Hardy--Littlewood maximal operator satisfies some Fefferman--Stein vector-valued maximal inequality on $X$ as well as it is bounded on both the weak ball quasi-Banach function space $WX$ and the associated space, the authors establish various Littlewood--Paley function characterizations of $WH_X({\mathbb R}^n)$ under some weak assumptions on the Littlewood--Paley functions. The authors also prove that the real interpolation intermediate space $(H_{X}({\mathbb R}^n),L^\infty({\mathbb R}^n))_{\theta,\infty}$, between the Hardy space associated with $X$, $H_{X}({\mathbb R}^n)$, and the Lebesgue space $L^\infty({\mathbb R}^n)$, is $WH_{X^{{1}/{(1-\theta)}}}({\mathbb R}^n)$, where $\theta\in (0, 1)$. All these results are of wide applications. Particularly, when $X:=M_q^p({\mathbb R}^n)$ (the Morrey space), $X:=L^{\vec{p}}({\mathbb R}^n)$ (the mixed-norm Lebesgue space) and $X:=(E_\Phi^q)_t({\mathbb R}^n)$ (the Orlicz-slice space), all these results are even new; when $X:=L_\omega^\Phi({\mathbb R}^n)$ (the weighted Orlicz space), the result on the real interpolation is new and, when $X:=L^{p(\cdot)}({\mathbb R}^n)$ (the variable Lebesgue space) and $X:=L_\omega^\Phi({\mathbb R}^n)$, the Littlewood--Paley function characterizations of $WH_X({\mathbb R}^n)$ obtained in this article improves the existing results via weakening the assumptions on the Littlewood--Paley functions.


title: Electrostatic responses of anisotropic dielectric films

abstract: We study the electrostatic responses (i.e. retardation effects due to the propagation of electromagnetic waves are ignored) of a linear homogeneous and anisotropic (LHA) dielectric film to an arbitrary external electrostatic potential, which may be generated by charges located either inside or outside it. A formalism is developed to calculate the polarization charges induced in the film. In our derivation, the idea is exploited that a physical boundary can be looked upon as a region of rapid variation in polarization rather than a simple geometric separation. With this no boundary conditions are needed in solving the relevant electrostatics problem. Our approach makes it clear that the responses consist of two contributions, one arising from the very presence of surfaces while the other existing even in an infinite medium. The approach can be applied not just to electrostatic but also many problems and is of great pedagogical value. In light of the results, we discuss graphene plasma waves under the influence of a LHA dielectric film such as a few-layer hexagonal boron nitride. It is found that the dispersion of these waves is strongly affected by the anisotropy at wavelengths comparable to the film thickness.


title: Rational homotopy equivalences and singular chains

abstract: Bousfield and Kan's $\mathbb{Q}$-completion and fiberwise $\mathbb{Q}$-completion of spaces lead to two different approaches to the rational homotopy theory of non-simply connected spaces. In the first approach, a map is a weak equivalence if it induces an isomorphism on rational homology. In the second, a map of connected and pointed spaces is a weak equivalence if it induces an isomorphism between fundamental groups and higher rationalized homotopy groups; we call these maps $\pi_1$-rational homotopy equivalences. In this paper, we compare these two notions and show that $\pi_1$-rational homotopy equivalences correspond to maps that induce $\Omega$-quasi-isomorphisms on the rational singular chains, i.e. maps that induce a quasi-isomorphism after applying the cobar functor to the dg coassociative coalgebra of rational singular chains. This implies that both notions of rational homotopy equivalence can be deduced from the rational singular chains by using different algebraic notions of weak equivalences: quasi-isomorphism and $\Omega$-quasi-isomorphisms. We further show that, in the second approach, there are no dg coalgebra models of the chains that are both strictly cocommutative and coassociative.


title: Encouraging Paragraph Embeddings to Remember Sentence Identity Improves Classification

abstract: While paragraph embedding models are remarkably effective for downstream classification tasks, what they learn and encode into a single vector remains opaque. In this paper, we investigate a state-of-the-art paragraph embedding method proposed by Zhang et al. (2017) and discover that it cannot reliably tell whether a given sentence occurs in the input paragraph or not. We formulate a sentence content task to probe for this basic linguistic property and find that even a much simpler bag-of-words method has no trouble solving it. This result motivates us to replace the reconstruction-based objective of Zhang et al. (2017) with our sentence content probe objective in a semi-supervised setting. Despite its simplicity, our objective improves over paragraph reconstruction in terms of (1) downstream classification accuracies on benchmark datasets, (2) faster training, and (3) better generalization ability.