title: The Poisson Transmuted-G Family of Distributions: Its Properties and Applications

abstract: In this paper introduces a new family of continuous distributions namely the Poison transmuted-G family of distribution is proposed by inducing two addition parameter on the base line G distribution. Some of its mathematical properties including explicit expressions for the moments generating function, order statistics, Probability weighted moments, stress-strength reliability, residual life, reversed residual life, R\'enyi entropy and mean deviation are derived. Some special models of the new family are listed. Estimation of the model parameters by the maximum likelihood method is discussed. The advantage of the proposed family in data fitting is illustrated by means of two applications to failure time data set.


title: Escaping Saddle Points Efficiently with Occupation-Time-Adapted Perturbations

abstract: Motivated by the super-diffusivity of self-repelling random walk, which has roots in statistical physics, this paper develops a new perturbation mechanism for optimization algorithms. In this mechanism, perturbations are adapted to the history of states via the notion of occupation time. After integrating this mechanism into the framework of perturbed gradient descent (PGD) and perturbed accelerated gradient descent (PAGD), two new algorithms are proposed: perturbed gradient descent adapted to occupation time (PGDOT) and its accelerated version (PAGDOT). PGDOT and PAGDOT are shown to converge to second-order stationary points at least as fast as PGD and PAGD, respectively, and thus they are guaranteed to avoid getting stuck at non-degenerate saddle points. The theoretical analysis is corroborated by empirical studies in which the new algorithms consistently escape saddle points and outperform not only their counterparts, PGD and PAGD, but also other popular alternatives including stochastic gradient descent, Adam, AMSGrad, and RMSProp.


title: Supersymmetry and exceptional points

abstract: A conceptual bridge is provided between SUSY and the three-Hilbert-space upgrade of quantum theory a.k.a. ${\cal PT}-$symmetric or quasi-Hermitian. In particular, a natural theoretical link is found between SUSY and the presence of Kato's exceptional points (EPs), both being related to the phenomenon of degeneracy of energy levels. Regularized spiked harmonic oscillator is recalled for illustration.


title: Access Structures Determined by Uniform Polymatroids

abstract: An access structure is said to be multipartite, if the set of participants is divided into several parts and all participants in the same part play an equivalent role. The search for ideal secret sharing schemes for some special interesting families of multipartite access structures, has been carried out by many authors. In this paper a new concept of study of ideal access structures is proposed. We do not consider special classes of access structures defined by imposing certain prescribed assumptions, but we investigate all access structures obtained from uniform polymatroids using the method developed by Farr\`as, Mart\'i-Farr\'e and Padr\'o. They satisfy necessary condition to be ideal, i.e., they are matroid ports. Moreover some objects in this family can be useful for the applications of secret sharing. The choice of uniform polymatroids is motivated by the fact that each such polymatroid defines ideal access structures. The method presented in this article is universal and can be continued with other classes of polymatroids in further similar studies. Here we are especially interested in hierarchy of participants determined by the access structure and we distinguish two main classes: they are compartmented and hierarchical access structures. The vast majority of papers discussing hierarchical access structures consider access structures which are compartment or totally hierarchical. The main results are summarized in Section 4, which presents situations where partial hierarchy properties may arise. In particular, hierarchical orders of obtained structures are described. It is surprising, that the hierarchical orders of access structures obtained from uniform polymatroids are flat, i.e., every chain has at most 2 elements. The ideality of some families of hierarchical access structures is proved in Section 5.


title: Tempering the mechanical response of FCC micro-pillars: an Eulerian plasticity approach

abstract: The mechanical response of almost pure single-crystal micro-pillars under compression exhibits a highly localized behavior that can endanger the structural stability of a sample. Recent experiments revealed that the mechanical response of a crystal is very sensitive to both the presence of a quenched disorder in the sample and the orientation of the crystal. In this work, we study the influence of disorder and crystal orientation on the large strain response of a 2D FCC crystal with three active glide planes using a very simple Eulerian plasticity model in the FE framework. Our numerical and theoretical results on clean crystal pillars suggest that a single plane or many gliding planes can be activated depending on the crystal orientation. While in the former case, the deformation is localized, leading to ductile rupture, in the latter, a complex interplay between active planes takes place, resulting in a more uniform deformation. The strain-localization can be avoided when inhomogeneities are engineered inside the crystal, or the crystal orientation is altered because of the activation of multiple slip systems, resulting in a "patchwork" of the distribution of the slip systems.


title: Finding Universal Grammatical Relations in Multilingual BERT

abstract: Recent work has found evidence that Multilingual BERT (mBERT), a transformer-based multilingual masked language model, is capable of zero-shot cross-lingual transfer, suggesting that some aspects of its representations are shared cross-lingually. To better understand this overlap, we extend recent work on finding syntactic trees in neural networks' internal representations to the multilingual setting. We show that subspaces of mBERT representations recover syntactic tree distances in languages other than English, and that these subspaces are approximately shared across languages. Motivated by these results, we present an unsupervised analysis method that provides evidence mBERT learns representations of syntactic dependency labels, in the form of clusters which largely agree with the Universal Dependencies taxonomy. This evidence suggests that even without explicit supervision, multilingual masked language models learn certain linguistic universals.


title: Classification of abrupt changes along viewing profiles of scientific articles

abstract: With the expansion of electronic publishing, a new dynamics of scientific articles dissemination was initiated. Nowadays, many works are widely disseminated even before publication, in the form of preprints. Another important new element concerns the views of published articles. Thanks to the availability of respective data by some journals, such as PLoS ONE, it became possible to develop investigations on how scientific works are viewed along time, often before the first citations appear. This provides the main theme of the present work. More specifically, our research was motivated by preliminary observations that the view profiles along time tend to present a piecewise linear nature. A methodology was then delineated in order to identify the main segments in the view profiles, which allowed several related measurements to be derived. In particular, we focused on the inclination and length of each subsequent segment. Basic statistics indicated that the inclination can vary substantially along subsequent segments, while the segment lengths resulted more stable. Complementary joint statistics analysis, considering pairwise correlations, provided further information about the properties of the views. In order to better understand the view profiles, we performed respective multivariate statistical analysis, including principal component analysis and hierarchical clustering. The results suggest that a portion of the polygonal views are organized into clusters or groups. These groups were characterized in terms of prototypes indicating the relative increase or decrease along subsequent segments. Four respective distinct models were then developed for representing the observed segments. It was found that models incorporating joint dependencies between the properties of the segments provided the most accurate results among the considered alternatives.


title: Intelligent GPS Spoofing Attack Detection in Power Grids

abstract: The GPS is vulnerable to GPS spoofing attack (GSA), which leads to disorder in time and position results of the GPS receiver. In power grids, phasor measurement units (PMUs) use GPS to build time-tagged measurements, so they are susceptible to this attack. As a result of this attack, sampling time and phase angle of the PMU measurements change. In this paper, a neural network GPS spoofing detection (NNGSD) with employing PMU data from the dynamic power system is presented to detect GSAs. Numerical results in different conditions show the real-time performance of the proposed detection method.


title: Rates of Convergence for the Planar Discrete Green's Function in Pacman Domains

abstract: We obtain upper bounds for the rates of convergence for the simple random walk Green's function in the domains $D_\alpha = D_{\alpha}(n)=\{re^{i\theta}\in \mathbb{C}:0 <\theta<2\pi-\alpha, 0<r<2n\}-z_0,$ where $z_0\in\mathbb{Z}^2$ is a point closest to $ne^{i(\pi-\alpha/2)}$. The rate depends on the angle of the wedge and is what was suggested by the sharpest available results in the extreme cases $\alpha =0$ and $\alpha=\pi$. Our proof uses the KMT coupling between random walk and Brownian motion.


title: Schwarzschild-like black holes: Light-like trajectories and massless scalar absorption

abstract: Black holes are among the most intriguing objects in nature. They are believed to be fully described by General Relativity (GR), and the astrophysical black holes are expected to belong to the Kerr family, obeying the no-hair theorems. Alternative theories of gravity or parameterized deviations of GR allow black hole solutions, which have additional parameters other than mass and angular momentum. We analyze a Schwarzschild-like metric, proposed by Johannsen and Psaltis, characterized by its mass and a deformation parameter. We compute the absorption cross section of massless scalar waves for different values of this deformation parameter and compare it with the corresponding scalar absorption cross section of the Schwarzschild black hole. We also present analytical approximations for the absorption cross section in the high-frequency regime. We check the consistence of our results comparing the numerical and analytical approaches, finding excellent agreement.


title: Bulk and surface topological indices for a skyrmion string

abstract: The magnetic skyrmion is a topological magnetic vortex, and its topological nature is characterized by an index called skyrmion number which is a mapping of the magnetic moments defined on a two-dimensional space to a unit sphere. In three-dimensions, a skyrmion, i.e., a vortex penetrating though the magnet naturally forms a string, which terminates at the surfaces of the magnet or in the bulk. For such a string, the topological indices, which control its topological stability are less trivial. Here, we show theoretically, in terms of numerical simulation for the current-driven motion of a skyrmion string in a film sample with the step edges on the surface, that the topological indices relevant to the stability are the followings; (i) skyrmion number along the developed surface, and (ii) the monopole charge in the bulk defined as the integral over the surface enclosing a singular magnetic configuration. As long as the magnetic configuration is slowly varying, the former is conserved while its changes is associated with nonzero monopole charge. The skyrmion number and the monoplole charge offer a coherent understanding of the stability of the topological magnetic texture and the nontrivial dynamics of skyrmion strings.


title: An exact solution method for the enumeration of connected Feynman diagrams

abstract: We completely generalize previous results related to the counting of connected Feynman diagrams. We use a generating function approach, which encodes the Wick contraction combinatorics of the respective connected diagrams. Exact solutions are found for an arbitrary number of external legs, and a general algorithm is implemented for this calculus. From these solutions, we calculate many asymptotics expansion terms for a simple analytical tool (Taylor expansion theorem). Our approach offers new perspectives in the realm of Feynman diagrams enumeration (or zero-dimensional quantum field theory).


title: What Was Written vs. Who Read It: News Media Profiling Using Text Analysis and Social Media Context

abstract: Predicting the political bias and the factuality of reporting of entire news outlets are critical elements of media profiling, which is an understudied but an increasingly important research direction. The present level of proliferation of fake, biased, and propagandistic content online, has made it impossible to fact-check every single suspicious claim, either manually or automatically. Alternatively, we can profile entire news outlets and look for those that are likely to publish fake or biased content. This approach makes it possible to detect likely "fake news" the moment they are published, by simply checking the reliability of their source. From a practical perspective, political bias and factuality of reporting have a linguistic aspect but also a social context. Here, we study the impact of both, namely (i) what was written (i.e., what was published by the target medium, and how it describes itself on Twitter) vs. (ii) who read it (i.e., analyzing the readers of the target medium on Facebook, Twitter, and YouTube). We further study (iii) what was written about the target medium on Wikipedia. The evaluation results show that what was written matters most, and that putting all information sources together yields huge improvements over the current state-of-the-art.


title: PriLok: Citizen-protecting distributed epidemic tracing

abstract: Contact tracing is an important instrument for national health services to fight epidemics. As part of the COVID-19 situation, many proposals have been made for scaling up contract tracing capacities with the help of smartphone applications, an important but highly critical endeavor due to the privacy risks involved in such solutions. Extending our previously expressed concern, we clearly articulate in this article, the functional and non-functional requirements that any solution has to meet, when striving to serve, not mere collections of individuals, but the whole of a nation, as required in face of such potentially dangerous epidemics. We present a critical information infrastructure, PriLock, a fully-open preliminary architecture proposal and design draft for privacy preserving contact tracing, which we believe can be constructed in a way to fulfill the former requirements. Our architecture leverages the existing regulated mobile communication infrastructure and builds upon the concept of "checks and balances", requiring a majority of independent players to agree to effect any operation on it, thus preventing abuse of the highly sensitive information that must be collected and processed for efficient contact tracing. This is enforced with a largely decentralised layout and highly resilient state-of-the-art technology, which we explain in the paper, finishing by giving a security, dependability and resilience analysis, showing how it meets the defined requirements, even while the infrastructure is under attack.


title: Fast Failures in the LHC and the future High Luminosity LHC*

abstract: An energy of $362\:\text{MJ}$ is stored in each of the two LHC proton beams for nominal beam parameters. This will be further increased to about $700\:\text{MJ}$ in the future High Luminosity LHC (HL-LHC) and uncontrolled beam losses represent a significant hazard for the integrity and safe operation of the machine. In this paper, a number of failure mechanisms that can lead to a fast increase of beam losses are analyzed. Most critical are failures in the magnet protection system, namely the quench heaters and a novel protection system called Coupling-Loss Induced Quench (CLIQ). An important outcome is that magnet protection has to be evaluated for its impact on the beam and designed accordingly. In particular, CLIQ, which is to protect the new HL-LHC triplet magnets, constitutes the fastest known failure in the LHC if triggered spuriously. A schematic change of CLIQ to mitigate the hazard is presented. A loss of the Beam-Beam Kick due to the extraction of one beam is another source of beam losses with a fast onset. A significantly stronger impact is expected in the upcoming LHC Run III and HL-LHC as compared to the current LHC, mainly due to the increased bunch intensity. Its criticality and mitigation methods are discussed. It is shown that symmetric quenches in the superconducting magnets for the final focusing triplet can have a significant impact on the beam on short timescales. The impact on the beam due to failures of the Beam-Beam Compensating Wires as well as coherent excitations by the transverse beam damper are also discussed.


title: Global Field Totients

abstract: Using a remainder theorem for valuations of a field, we give a new perspective on the norm function of a global field. We define the Euler totient function of a global field and recover the essential analytical properties of the classical arithmetical function, namely the product formula. In addition, we prove the holomorphicity of the associated zeta function. As an application, we recover the analog of the mean value theorem of Erd\H{o}s, Dressler, and Bateman via the Weiner-Ikehara theorem.


title: Probabilistic Multi-Step-Ahead Short-Term Water Demand Forecasting with Lasso

abstract: Water demand is a highly important variable for operational control and decision making. Hence, the development of accurate forecasts is a valuable field of research to further improve the efficiency of water utilities. Focusing on probabilistic multi-step-ahead forecasting, a time series model is introduced, to capture typical autoregressive, calendar and seasonal effects, to account for time-varying variance, and to quantify the uncertainty and path-dependency of the water demand process. To deal with the high complexity of the water demand process a high-dimensional feature space is applied, which is efficiently tuned by an automatic shrinkage and selection operator (lasso). It allows to obtain an accurate, simple interpretable and fast computable forecasting model, which is well suited for real-time applications. The complete probabilistic forecasting framework allows not only for simulating the mean and the marginal properties, but also the correlation structure between hours within the forecasting horizon. For practitioners, complete probabilistic multi-step-ahead forecasts are of considerable relevance as they provide additional information about the expected aggregated or cumulative water demand, so that a statement can be made about the probability with which a water storage capacity can guarantee the supply over a certain period of time. This information allows to better control storage capacities and to better ensure the smooth operation of pumps. To appropriately evaluate the forecasting performance of the considered models, the energy score (ES) as a strictly proper multidimensional evaluation criterion, is introduced. The methodology is applied to the hourly water demand data of a German water supplier.


title: Kink-Antikink Interaction Forces and Bound States in a Biharmonic $\phi^4$ Model

abstract: We consider the interaction of solitons in a biharmonic, beam model analogue of the well-studied $\phi^4$ Klein-Gordon theory. Specifically, we calculate the force between a well separated kink and antikink. Knowing their accelerations as a function of separation, we can determine their motion using a simple ODE. There is good agreement between this asymptotic analysis and numerical computation. Importantly, we find the force has an exponentially-decaying oscillatory behaviour (unlike the monotonically attractive interaction in the Klein-Gordon case). Corresponding to the zeros of the force, we predict the existence of an infinite set of field theory equilibria, i.e., kink-antikink bound states. We confirm the first few of these at the PDE level, and verify their anticipated stability or instability. We also explore the implications of this interaction force in the collision between a kink and an oppositely moving antikink.


title: The Bramson correction for Fisher--KPP equations with nonlocal diffusion

abstract: We establish the logarithmic Bramson correction to the position of solutions to the Fisher--KPP equation with nonlocal diffusion. Solutions with step-like initial data typically resemble a front at position $c_{*} t - \frac{3}{2 \lambda_{*}} \log t + \mathcal{O}(1)$ for explicit constants $c_{*}$ and $\lambda_{*}$. However, certain singular diffusions exhibit more exotic behavior.


title: Molassembler: Molecular graph construction, modification and conformer generation for inorganic and organic molecules

abstract: We present the graph-based molecule software Molassembler for building organic and inorganic molecules. Molassembler provides algorithms for the construction of molecules built from any set of elements from the periodic table. In particular, poly-nuclear transition metal complexes and clusters can be considered. Structural information is encoded as a graph. Stereocenter configurations are interpretable from Cartesian coordinates into an abstract index of permutation for an extensible set of polyhedral shapes. Substituents are distinguished through a ranking algorithm. Graph and stereocenter representations are freely modifiable and chiral state is propagated where possible through incurred ranking changes. Conformers are generated with full stereoisomer control by four spatial dimension Distance Geometry with a refinement error function including dihedral terms. Molecules are comparable by an extended graph isomorphism and their representation is canonicalizeable. Molassembler is written in C++ and provides Python bindings.


title: Defining bicircular matroids in monadic logic

abstract: We conjecture that the class of frame matroids can be characterised by a sentence in the monadic second-order logic of matroids, and we prove that there is such a characterisation for the class of bicircular matroids. The proof does not depend on an excluded-minor characterisation.


title: Reaction-diffusion spatial modeling of COVID-19: Greece and Andalusia as case examples

abstract: We examine the spatial modeling of the outbreak of COVID-19 in two regions: the autonomous community of Andalusia in Spain and the mainland of Greece. We start with a 0D compartmental epidemiological model consisting of Susceptible, Exposed, Asymptomatic, (symptomatically) Infected, Hospitalized, Recovered, and deceased populations. We emphasize the importance of the viral latent period and the key role of an asymptomatic population. We optimize model parameters for both regions by comparing predictions to the cumulative number of infected and total number of deaths via minimizing the $\ell^2$ norm of the difference between predictions and observed data. We consider the sensitivity of model predictions on reasonable variations of model parameters and initial conditions, addressing issues of parameter identifiability. We model both pre-quarantine and post-quarantine evolution of the epidemic by a time-dependent change of the viral transmission rates that arises in response to containment measures. Subsequently, a spatially distributed version of the 0D model in the form of reaction-diffusion equations is developed. We consider that, after an initial localized seeding of the infection, its spread is governed by the diffusion (and 0D model "reactions") of the asymptomatic and symptomatically infected populations, which decrease with the imposed restrictive measures. We inserted the maps of the two regions, and we imported population-density data into COMSOL, which was subsequently used to solve numerically the model PDEs. Upon discussing how to adapt the 0D model to this spatial setting, we show that these models bear significant potential towards capturing both the well-mixed, 0D description and the spatial expansion of the pandemic in the two regions. Veins of potential refinement of the model assumptions towards future work are also explored.


title: How to overcome the limitations of p-q Theory: Geometric Algebra Power Theory to the rescue

abstract: This paper investigates the recent advances in Geometric Algebra-based power theory (GAPoT) and how this tool provides new insights to solve the flaws of one of the most widespread theory in the time domain, the Instantaneous Reactive Power theory (IRP) and its further enhancements. GAPoT can be applied to single-phase and multi-phase systems to obtain an optimal current decomposition under any distorted voltage source supply and load condition. This could be the case in microgrids or smart grids. Moreover, it is possible to define different strategies based on instantaneous or averaged quantities depending on whether the voltage supply conditions are sinusoidal and symmetrical or not. Several examples illustrate how GAPoT is able to overcome the limitations of IRP theory.


title: Site Percolation on Planar Graphs

abstract: We prove that for a non-amenable, locally finite, connected, transitive, planar graph with one end, any automorphism invariant site percolation on the graph does not have exactly 1 infinite 1-cluster and exactly 1 infinite 0-cluster a.s. If we further assume that the site percolation is insertion-tolerant and a.s.~there exists a unique infinite 0-cluster, then a.s.~there are no infinite 1-clusters. The proof is based on the analysis of a class of delicately constructed interfaces between clusters and contours. Applied to the case of i.i.d.~Bernoulli site percolation on infinite, connected, locally finite, transitive, planar graphs, these results solve two conjectures of Benjamini and Schramm (Conjectures 7 and 8 in \cite{bs96}) in 1996.


title: Time complexity of in-memory solution of linear systems

abstract: In-memory computing with crosspoint resistive memory arrays has been shown to accelerate data-centric computations such as the training and inference of deep neural networks, thanks to the high parallelism endowed by physical rules in the electrical circuits. By connecting crosspoint arrays with negative feedback amplifiers, it is possible to solve linear algebraic problems such as linear systems and matrix eigenvectors in just one step. Based on the theory of feedback circuits, we study the dynamics of the solution of linear systems within a memory array, showing that the time complexity of the solution is free of any direct dependence on the problem size N, rather it is governed by the minimal eigenvalue of an associated matrix of the coefficient matrix. We show that, when the linear system is modeled by a covariance matrix, the time complexity is O(logN) or O(1). In the case of sparse positive-definite linear systems, the time complexity is solely determined by the minimal eigenvalue of the coefficient matrix. These results demonstrate the high speed of the circuit for solving linear systems in a wide range of applications, thus supporting in-memory computing as a strong candidate for future big data and machine learning accelerators.


title: In-memory eigenvector computation in time O(1)

abstract: In-memory computing with crosspoint resistive memory arrays has gained enormous attention to accelerate the matrix-vector multiplication in the computation of data-centric applications. By combining a crosspoint array and feedback amplifiers, it is possible to compute matrix eigenvectors in one step without algorithmic iterations. In this work, time complexity of the eigenvector computation is investigated, based on the feedback analysis of the crosspoint circuit. The results show that the computing time of the circuit is determined by the mismatch degree of the eigenvalues implemented in the circuit, which controls the rising speed of output voltages. For a dataset of random matrices, the time for computing the dominant eigenvector in the circuit is constant for various matrix sizes, namely the time complexity is O(1). The O(1) time complexity is also supported by simulations of PageRank of real-world datasets. This work paves the way for fast, energy-efficient accelerators for eigenvector computation in a wide range of practical applications.


title: Formation of spectral triplets induced by parity deformation in a quantum dot-cavity system

abstract: In this work, we conduct an investigation on the optical emission properties of a pumped-dissipative QD-cavity system within the Lindblad master equation approach, where the cavity mode is modeled through the R-deformed realization of the Heisenberg algebra (RDHA). We found that the parity deformation parameter associated with the RDHA gives rise to a collective phenomenon by reordering the one-photon optical transitions of the system, and it is demonstrated that there are two critical values for this parameter where a new type of spectral triplet arises in the emission spectrum. Moreover, our results reveal that depending on the critical value of the deformation parameter, the spectral triplets observed in the emission spectrum exhibit signatures of the weak- and strong-coupling regimes simultaneously.


title: Improved Throughput for All-or-Nothing Multicommodity Flows with Arbitrary Demands

abstract: Throughput is a main performance objective in communication networks. This paper considers a fundamental maximum throughput routing problem -- the all-or-nothing multicommodity flow (ANF) problem -- in arbitrary directed graphs and in the practically relevant but challenging setting where demands can be (much) larger than the edge capacities. Hence, in addition to assigning requests to valid flows for each routed commodity, an admission control mechanism is required which prevents overloading the network when routing commodities. We make several contributions. On the theoretical side we obtain substantially improved bi-criteria approximation algorithms for this NP-hard problem. We present two non-trivial linear programming relaxations and show how to convert their fractional solutions into integer solutions via randomized rounding. One is an exponential-size formulation (solvable in polynomial time using a separation oracle) that considers a "packing" view and allows a more flexible approach, while the other is a compact (polynomial-size) edge-flow formulation that allows for easy solving via standard LP solvers. We obtain a polynomial-time randomized algorithm that yields an arbitrarily good approximation on the weighted throughput, while violating the edge capacity constraints by only a small multiplicative factor. We also describe a deterministic rounding algorithm by derandomization, using the method of pessimistic estimators. We complement our theoretical results with a proof of concept empirical evaluation.


title: Article citation study: Context enhanced citation sentiment detection

abstract: Citation sentimet analysis is one of the little studied tasks for scientometric analysis. For citation analysis, we developed eight datasets comprising citation sentences, which are manually annotated by us into three sentiment polarities viz. positive, negative, and neutral. Among eight datasets, three were developed by considering the whole context of citations. Furthermore, we proposed an ensembled feature engineering method comprising word embeddings obtained for texts, parts-of-speech tags, and dependency relationships together. Ensembled features were considered as input to deep learning based approaches for citation sentiment classification, which is in turn compared with Bag-of-Words approach. Experimental results demonstrate that deep learning is useful for higher number of samples, whereas support vector machine is the winner for smaller number of samples. Moreover, context-based samples are proved to be more effective than context-less samples for citation sentiment analysis.


title: Multiple states in turbulent large-aspect ratio thermal convection: What determines the number of convection rolls?

abstract: Recent findings suggest that wall-bounded turbulent flow can take different statistically stationary turbulent states, with different transport properties, even for the very same values of the control parameters. What state the system takes depends on the initial conditions. Here we analyze the multiple states in large-aspect ratio ($\Gamma$) two-dimensional turbulent Rayleigh--B\'enard flow with no-slip plates and horizontally periodic boundary conditions as model system. We determine the number $n$ of convection rolls, their mean aspect ratios $\Gamma_r = \Gamma /n$, and the corresponding transport properties of the flow (i.e., the Nusselt number $Nu$), as function of the control parameters Rayleigh ($Ra$) and Prandtl number. The effective scaling exponent $\beta$ in $Nu \sim Ra^\beta$ is found to depend on the realized state and thus $\Gamma_r$, with a larger value for the smaller $\Gamma_r$. By making use of a generalized Friedrichs inequality, we show that the elliptical instability and viscous damping determine the $\Gamma_r$-window for the realizable turbulent states. The theoretical results are in excellent agreement with our numerical finding $2/3 \le \Gamma_r \le 4/3$, where the lower threshold is approached for the larger $Ra$. Finally, we show that the theoretical approach to frame $\Gamma_r$ also works for free-slip boundary conditions.


title: Accelerating Deep Neuroevolution on Distributed FPGAs for Reinforcement Learning Problems

abstract: Reinforcement learning augmented by the representational power of deep neural networks, has shown promising results on high-dimensional problems, such as game playing and robotic control. However, the sequential nature of these problems poses a fundamental challenge for computational efficiency. Recently, alternative approaches such as evolutionary strategies and deep neuroevolution demonstrated competitive results with faster training time on distributed CPU cores. Here, we report record training times (running at about 1 million frames per second) for Atari 2600 games using deep neuroevolution implemented on distributed FPGAs. Combined hardware implementation of the game console, image pre-processing and the neural network in an optimized pipeline, multiplied with the system level parallelism enabled the acceleration. These results are the first application demonstration on the IBM Neural Computer, which is a custom designed system that consists of 432 Xilinx FPGAs interconnected in a 3D mesh network topology. In addition to high performance, experiments also showed improvement in accuracy for all games compared to the CPU-implementation of the same algorithm.


title: Reinforcement Learning based Design of Linear Fixed Structure Controllers

abstract: Reinforcement learning has been successfully applied to the problem of tuning PID controllers in several applications. The existing methods often utilize function approximation, such as neural networks, to update the controller parameters at each time-step of the underlying process. In this work, we present a simple finite-difference approach, based on random search, to tuning linear fixed-structure controllers. For clarity and simplicity, we focus on PID controllers. Our algorithm operates on the entire closed-loop step response of the system and iteratively improves the PID gains towards a desired closed-loop response. This allows for embedding stability requirements into the reward function without any modeling procedures.


title: Velocity measurements of a dilute particulate suspension over and through a porous medium model

abstract: We experimentally examine pressure-driven flows of 1%, 3%, and 5% dilute suspensions over and through a porous media model. The flow of non-colloidal, non-Brownian suspensions of rigid and spherical particles suspended in a Newtonian fluid is considered at very low Reynolds numbers. The model of porous media consists of square arrays of rods oriented across the flow in a rectangular channel. Systematic experiments using high-spatial-resolution planar particle image velocimetry (PIV) and index-matching techniques are conducted to accurately measure the velocity measurements of both very dilute and solvent flows inside and on top of the porous media model. We found that for 1%, 3%, and 5% dilute suspensions the fully-developed velocity profile inside the free-flow region are well predicted by the exact solution derived from coupling the Navier-Stokes equation within the free flow-region and the volume-averaged Navier Stokes (VANS) equation for the porous media. We further analyze the velocity and shear rate at the suspension-porous interface and compare these data with those of pure suspending fluid and the related analytical solutions. The exact solution is used to define parameters necessary to calculate key values to analyze the porous media/fluid interaction such as Darcy velocity, penetration depth, and fractional ratios of the mass flow rate. These parameters are comparable between the solvent, dilute suspensions, and exact solution. However, we found clear effects between the solvent and the suspensions which shows different physical phenomenon occurring when particles are introduced into a flow moving over and through a porous media.


title: Optimal PID and Antiwindup Control Design as a Reinforcement Learning Problem

abstract: Deep reinforcement learning (DRL) has seen several successful applications to process control. Common methods rely on a deep neural network structure to model the controller or process. With increasingly complicated control structures, the closed-loop stability of such methods becomes less clear. In this work, we focus on the interpretability of DRL control methods. In particular, we view linear fixed-structure controllers as shallow neural networks embedded in the actor-critic framework. PID controllers guide our development due to their simplicity and acceptance in industrial practice. We then consider input saturation, leading to a simple nonlinear control structure. In order to effectively operate within the actuator limits we then incorporate a tuning parameter for anti-windup compensation. Finally, the simplicity of the controller allows for straightforward initialization. This makes our method inherently stabilizing, both during and after training, and amenable to known operational PID gains.


title: AutoHOOT: Automatic High-Order Optimization for Tensors

abstract: High-order optimization methods, including Newton's method and its variants as well as alternating minimization methods, dominate the optimization algorithms for tensor decompositions and tensor networks. These tensor methods are used for data analysis and simulation of quantum systems. In this work, we introduce AutoHOOT, the first automatic differentiation (AD) framework targeting at high-order optimization for tensor computations. AutoHOOT takes input tensor computation expressions and generates optimized derivative expressions. In particular, AutoHOOT contains a new explicit Jacobian / Hessian expression generation kernel whose outputs maintain the input tensors' granularity and are easy to optimize. The expressions are then optimized by both the traditional compiler optimization techniques and specific tensor algebra transformations. Experimental results show that AutoHOOT achieves competitive CPU and GPU performance for both tensor decomposition and tensor network applications compared to existing AD software and other tensor computation libraries with manually written kernels. The tensor methods generated by AutoHOOT are also well-parallelizable, and we demonstrate good scalability on a distributed memory supercomputer.


title: A Robust Matching Pursuit Algorithm Using Information Theoretic Learning

abstract: Current orthogonal matching pursuit (OMP) algorithms calculate the correlation between two vectors using the inner product operation and minimize the mean square error, which are both suboptimal when there are non-Gaussian noises or outliers in the observation data. To overcome these problems, a new OMP algorithm is developed based on the information theoretic learning (ITL), which is built on the following new techniques: (1) an ITL-based correlation (ITL-Correlation) is developed as a new similarity measure which can better exploit higher-order statistics of the data, and is robust against many different types of noise and outliers in a sparse representation framework; (2) a non-second order statistic measurement and minimization method is developed to improve the robustness of OMP by overcoming the limitation of Gaussianity inherent in cost function based on second-order moments. The experimental results on both simulated and real-world data consistently demonstrate the superiority of the proposed OMP algorithm in data recovery, image reconstruction, and classification.


title: On $k$-diametral point configurations in Minkowski spaces

abstract: The structure of $k$-diametral point configurations in Minkowski $d$-space is shown to be closely related to the properties of $k$-antipodal point configurations in $\mathbb{R}^d$. In particular, the maximum size of $k$-diametral point configurations of Minkowski $d$-spaces is obtained for given $k\geq 2$ and $d\geq 2$ generalizing Petty's results (Proc. Am. Math. Soc. 29: 369-374, 1971) on equilateral sets in Minkowski spaces. Furthermore, bounds are derived for the maximum size of $k$-diametral point configurations in Euclidean $d$-space. In the proofs convexity methods are combined with volumetric estimates and combinatorial properties of diameter graphs.


title: Replication Markets: Results, Lessons, Challenges and Opportunities in AI Replication

abstract: The last decade saw the emergence of systematic large-scale replication projects in the social and behavioral sciences, (Camerer et al., 2016, 2018; Ebersole et al., 2016; Klein et al., 2014, 2018; Collaboration, 2015). These projects were driven by theoretical and conceptual concerns about a high fraction of "false positives" in the scientific publications (Ioannidis, 2005) (and a high prevalence of "questionable research practices" (Simmons, Nelson, and Simonsohn, 2011). Concerns about the credibility of research findings are not unique to the behavioral and social sciences; within Computer Science, Artificial Intelligence (AI) and Machine Learning (ML) are areas of particular concern (Lucic et al., 2018; Freire, Bonnet, and Shasha, 2012; Gundersen and Kjensmo, 2018; Henderson et al., 2018). Given the pioneering role of the behavioral and social sciences in the promotion of novel methodologies to improve the credibility of research, it is a promising approach to analyze the lessons learned from this field and adjust strategies for Computer Science, AI and ML In this paper, we review approaches used in the behavioral and social sciences and in the DARPA SCORE project. We particularly focus on the role of human forecasting of replication outcomes, and how forecasting can leverage the information gained from relatively labor and resource-intensive replications. We will discuss opportunities and challenges of using these approaches to monitor and improve the credibility of research areas in Computer Science, AI, and ML.


title: Unified Models of Human Behavioral Agents in Bandits, Contextual Bandits and RL

abstract: Artificial behavioral agents are often evaluated based on their consistent behaviors and performance to take sequential actions in an environment to maximize some notion of cumulative reward. However, human decision making in real life usually involves different strategies and behavioral trajectories that lead to the same empirical outcome. Motivated by clinical literature of a wide range of neurological and psychiatric disorders, we propose here a more general and flexible parametric framework for sequential decision making that involves a two-stream reward processing mechanism. We demonstrated that this framework is flexible and unified enough to incorporate a family of problems spanning multi-armed bandits (MAB), contextual bandits (CB) and reinforcement learning (RL), which decompose the sequential decision making process in different levels. Inspired by the known reward processing abnormalities of many mental disorders, our clinically-inspired agents demonstrated interesting behavioral trajectories and comparable performance on simulated tasks with particular reward distributions, a real-world dataset capturing human decision-making in gambling tasks, and the PacMan game across different reward stationarities in a lifelong learning setting.


title: Improved strong coupling determinations from hadronic decays of electroweak bosons at N$^3$LO accuracy

abstract: We present two new extractions of the QCD coupling constant at the Z pole, $\alpha_S(m_Z)$, from detailed comparisons of inclusive W and Z hadronic decays data to state-of-the-art perturbative Quantum Chromodynamics calculations at next-to-next-to-next-to-leading order (N$^{3}$LO) accuracy, incorporating the latest experimental and theoretical developments. In the W boson case, the total width computed at N$^{3}$LO is used for the first time in the extraction. For the Z boson pseudo-observables, the N$^{3}$LO results are complemented with the full two- and partial three-loop electroweak corrections recently made available, and the experimental values are updated to account for newly estimated LEP luminosity biases. A combined reanalysis of the Z boson data yields $\alpha_S(m_Z) = 0.1203 \pm 0.0028$, with a 2.3\% uncertainty reduced by about 7\% compared to the previous state-of-the-art. From the combined W boson data, a value of $\alpha_S(m_Z) = 0.101 \pm 0.027$ is extracted, with still large experimental uncertainties but also reduced compared to previous works. The levels of theoretical and parametric precision required in the context of QCD coupling determinations with permil uncertainties from high-statistics W and Z boson samples expected at future $e^+e^-$ colliders such as the FCC-ee, are discussed in detail.


title: Van der Corput lemmas for Mittag-Leffler functions. II. $\alpha$-directions

abstract: The paper is devoted to study analogues of the van der Corput lemmas involving Mittag-Leffler functions. The generalisation is that we replace the exponential function with the Mittag-Leffler-type function, to study oscillatory integrals appearing in the analysis of time-fractional partial differential equations. More specifically, we study integral of the form $I_{\alpha,\beta}(\lambda)=\int_\mathbb{R}E_{\alpha,\beta}\left(i^\alpha\lambda \phi(x)\right)\psi(x)dx,$ for the range $0<\alpha\leq 2,\,\beta>0$. This extends the variety of estimates obtained in the first part, where integrals with functions $E_{\alpha,\beta}\left(i \lambda \phi(x)\right)$ have been studied. Several generalisations of the van der Corput lemmas are proved. As an application of the above results, the generalised Riemann-Lebesgue lemma, the Cauchy problem for the time-fractional Klein-Gordon and time-fractional Schr\"{o}dinger equations are considered.


title: A class of conserved currents for linearized gravity in the Kerr spacetime

abstract: We construct a class of conserved currents for linearized gravity on a Kerr background. Our procedure, motivated by the current for scalar fields discovered by Carter (1977), is given by taking the symplectic product of solutions to the linearized Einstein equations that are defined by symmetry operators. We consider symmetry operators that are associated with separation of variables in the Teukolsky equation, as well as those arising due the self-adjoint nature of the Einstein equations. In the geometric optics limit, the charges associated with these currents reduce to sums over gravitons of positive powers of their Carter constants, much like the conserved current for scalar fields. We furthermore compute the fluxes of these conserved currents through null infinity and the horizon and identify which are finite.


title: Stability of the Spectral Gap for Lattice Fermions

abstract: It is widely believed that the spectral gap above the Fermi sea ground state of lattice free fermions is stable against generic weak interactions. Quite recently, Hastings presented a new interesting idea to prove the stability for Majorana free fermions. He ingeniously used Majorana fermions so that the unperturbed Hamiltonian of the free fermion part is mapped into a frustration-free form. In this paper, we refine Hastings's argument, and give a complete proof of the stability of the spectral gap above the Fermi sea ground state against generic weak interactions for generic lattice free fermions.


title: A Compound Decision Approach to Covariance Matrix Estimation

abstract: Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings are common in modern genomics, where covariance matrix estimation is frequently employed as a method for inferring gene networks. To achieve estimation accuracy in these settings, existing methods typically either assume that the population covariance matrix has some particular structure, for example sparsity, or apply shrinkage to better estimate the population eigenvalues. In this paper, we study a new approach to estimating high-dimensional covariance matrices. We first frame covariance matrix estimation as a compound decision problem. This motivates defining a class of decision rules and using a nonparametric empirical Bayes g-modeling approach to estimate the optimal rule in the class. Simulation results and gene network inference in an RNA-seq experiment in mouse show that our approach is comparable to or can outperform a number of state-of-the-art proposals.


title: Non-zero torsion and late cosmology

abstract: In this work, we study some thermodynamical aspects associated with torsion in a flat FLRW spacetime cosmic evolution. By implementing two Ansatze for the torsion term, we find that the model admits a phantom regime or a quintessence behavior. This scheme differs from the $\Lambda$CDM model at the thermodynamical level. The resulting cosmic expansion is not adiabatic, the fulfillment of the second law of thermodynamics requires a positive torsion term, and the temperature of the cosmic fluid is always positive. The entropy of the torsion phantom scenario is negative, but introducing chemical potential solves this issue. For a Dirac-Milne type Universe, the torsion leads to a growing behavior for the temperature of the fluid but has no incidence on the rate of expansion.


title: Epipolar Transformers

abstract: A common approach to localize 3D human joints in a synchronized and calibrated multi-view setup consists of two-steps: (1) apply a 2D detector separately on each view to localize joints in 2D, and (2) perform robust triangulation on 2D detections from each view to acquire the 3D joint locations. However, in step 1, the 2D detector is limited to solving challenging cases which could potentially be better resolved in 3D, such as occlusions and oblique viewing angles, purely in 2D without leveraging any 3D information. Therefore, we propose the differentiable "epipolar transformer", which enables the 2D detector to leverage 3D-aware features to improve 2D pose estimation. The intuition is: given a 2D location p in the current view, we would like to first find its corresponding point p' in a neighboring view, and then combine the features at p' with the features at p, thus leading to a 3D-aware feature at p. Inspired by stereo matching, the epipolar transformer leverages epipolar constraints and feature matching to approximate the features at p'. Experiments on InterHand and Human3.6M show that our approach has consistent improvements over the baselines. Specifically, in the condition where no external data is used, our Human3.6M model trained with ResNet-50 backbone and image size 256 x 256 outperforms state-of-the-art by 4.23 mm and achieves MPJPE 26.9 mm.


title: Hyperspectral imaging for dynamic thin film interferometry

abstract: Dynamic thin film interferometry is a technique used to non-invasively characterize the thickness of thin liquid films. Recovering the underlying thickness from the captured interferograms, unconditionally and automatically is still an open problem. Here we report a compact setup employing a snapshot hyperspectral camera and the related algorithms for the automated determination of thickness profiles of dynamic thin liquid films. The proposed technique is shown to recover film thickness profiles to within 100 nm of accuracy as compared to those profiles reconstructed through the manual color matching process. Subsequently, we discuss the characteristics and advantages of hyperspectral interferometry including the increased robustness against imagining noise as well as the ability to perform thickness reconstruction without considering the absolute light intensity information.


title: Application of quantum Pinsker inequality to quantum communications

abstract: Back in the 1960s, based on Wiener's thought, Shikao Ikehara (first student of N.Wiener) encouraged the progress of Hisaharu Umegaki's research from a pure mathematical aspect in order to further develop the research on mathematical methods of quantum information at Tokyo Institute of Technology. Then, in the 1970s, based on the results accomplished by Umegaki Group, Ikehara instructed the author to develop and spread quantum information science as the global information science. While Umegaki Group's results have been evaluated as major achievements in pure mathematics, their contributions to current quantum information science have not been fully discussed. This paper gvies a survey of my talk in the memorial seminar on Ikehara, in which Ikehara and Umegaki Group's contributions to design theory of quantum communication have been introduced with specific examples such as quantum relative entropy and quantum Pinsker inequality.


title: A comparison study of deep Galerkin method and deep Ritz method for elliptic problems with different boundary conditions

abstract: Recent years have witnessed growing interests in solving partial differential equations by deep neural networks, especially in the high-dimensional case. Unlike classical numerical methods, such as finite difference method and finite element method, the enforcement of boundary conditions in deep neural networks is highly nontrivial. One general strategy is to use the penalty method. In the work, we conduct a comparison study for elliptic problems with four different boundary conditions, i.e., Dirichlet, Neumann, Robin, and periodic boundary conditions, using two representative methods: deep Galerkin method and deep Ritz method. In the former, the PDE residual is minimized in the least-squares sense while the corresponding variational problem is minimized in the latter. Therefore, it is reasonably expected that deep Galerkin method works better for smooth solutions while deep Ritz method works better for low-regularity solutions. However, by a number of examples, we observe that deep Ritz method can outperform deep Galerkin method with a clear dependence of dimensionality even for smooth solutions and deep Galerkin method can also outperform deep Ritz method for low-regularity solutions. Besides, in some cases, when the boundary condition can be implemented in an exact manner, we find that such a strategy not only provides a better approximate solution but also facilitates the training process.


title: A Finite Horizon Optimal Stochastic Impulse Control Problem with A Decision Lag

abstract: This paper studies an optimal stochastic impulse control problem in a finite horizon with a decision lag, by which we mean that after an impulse is made, a fixed number units of time has to be elapsed before the next impulse is allowed to be made. The continuity of the value function is proved. A suitable version of dynamic programming principle is established, which takes into account the dependence of state process on the elapsed time. The corresponding Hamilton-Jacobi-Bellman (HJB) equation is derived, which exhibit some special feature of the problem. The value function of this optimal impulse control problem is characterized as the unique viscosity solution to the corresponding HJB equation. An optimal impulse control is constructed provided the value function is given. Moreover, a limiting case with the waiting time approaching $0$ is discussed.


title: The treewidth of 2-section of hypergraphs

abstract: Let $H=(V,F)$ be a simple hypergraph without loops. $H$ is called linear if $|f\cap g|\le 1$ for any $f,g\in F$ with $f\not=g$. The $2$-section of $H$, denoted by $[H]_2$, is a graph with $V([H]_2)=V$ and for any $ u,v\in V([H]_2)$, $uv\in E([H]_2)$ if and only if there is $ f\in F$ such that $u,v\in f$. The treewidth of a graph is an important invariant in structural and algorithmic graph theory. In this paper, we consider the treewidth of the $2$-section of a linear hypergraph. We will use the minimum degree, maximum degree, anti-rank and average rank of a linear hypergraph to determine the upper and lower bounds of the treewidth of its $2$-section. Since for any graph $G$, there is a linear hypergraph $H$ such that $[H]_2\cong G$, we provide a method to estimate the bound of treewidth of graph by the parameters of the hypergraph.


title: A Multi-Variate Triple-Regression Forecasting Algorithm for Long-Term Customized Allergy Season Prediction

abstract: In this paper, we propose a novel multi-variate algorithm using a triple-regression methodology to predict the airborne-pollen allergy season that can be customized for each patient in the long term. To improve the prediction accuracy, we first perform a pre-processing to integrate the historical data of pollen concentration and various inferential signals from other covariates such as the meteorological data. We then propose a novel algorithm which encompasses three-stage regressions: in Stage 1, a regression model to predict the start/end date of a airborne-pollen allergy season is trained from a feature matrix extracted from 12 time series of the covariates with a rolling window; in Stage 2, a regression model to predict the corresponding uncertainty is trained based on the feature matrix and the prediction result from Stage 1; in Stage 3, a weighted linear regression model is built upon prediction results from Stage 1 and 2. It is observed and proved that Stage 3 contributes to the improved forecasting accuracy and the reduced uncertainty of the multi-variate triple-regression algorithm. Based on different allergy sensitivity level, the triggering concentration of the pollen - the definition of the allergy season can be customized individually. In our backtesting, a mean absolute error (MAE) of 4.7 days was achieved using the algorithm. We conclude that this algorithm could be applicable in both generic and long-term forecasting problems.


title: A Design of SDR-based Pseudo-Analog Wireless Video Transmission System

abstract: The pseudo-analog wireless video transmission technology can improve the effectiveness, reliability, and robustness of the conventional digital system in video broadcast scenarios. Although some prototypes of IEEE 802.11 series have been developed for researchers to do simulations and experiments, they are usually expensive and provide very limited access to the physical layer. More importantly, these prototypes cannot be used to verify the correctness of the new proposed pseudo-analog wireless video transmission algorithms directly due to limited modulation modes they can support. In this paper, we present a novel design of software radio platform (SDR)-based pseudo-analog wireless video transceiver which is completely transparent and allows users to learn all the implementation details. Firstly, we prove that the analog method can also achieve the optimal performance as the digital method from the perspective of the rate-distortion theory. Then, we describe the two hardware implementation difficulties existed in the designing process including the data format modification and the non-linear distortion. Next, we introduce the implementation details of the designed transceiver. Finally, we analyze the performance of the designed transceiver. Specifically, the results show that the designed system can work effectively in both simulations and experiments.


title: Compact Neural Representation Using Attentive Network Pruning

abstract: Deep neural networks have evolved to become power demanding and consequently difficult to apply to small-size mobile platforms. Network parameter reduction methods have been introduced to systematically deal with the computational and memory complexity of deep networks. We propose to examine the ability of attentive connection pruning to deal with redundancy reduction in neural networks as a contribution to the reduction of computational demand. In this work, we describe a Top-Down attention mechanism that is added to a Bottom-Up feedforward network to select important connections and subsequently prune redundant ones at all parametric layers. Our method not only introduces a novel hierarchical selection mechanism as the basis of pruning but also remains competitive with previous baseline methods in the experimental evaluation. We conduct experiments using different network architectures on popular benchmark datasets to show high compression ratio is achievable with negligible loss of accuracy.


title: Posterior Control of Blackbox Generation

abstract: Text generation often requires high-precision output that obeys task-specific rules. This fine-grained control is difficult to enforce with off-the-shelf deep learning models. In this work, we consider augmenting neural generation models with discrete control states learned through a structured latent-variable approach. Under this formulation, task-specific knowledge can be encoded through a range of rich, posterior constraints that are effectively trained into the model. This approach allows users to ground internal model decisions based on prior knowledge, without sacrificing the representational power of neural generative models. Experiments consider applications of this approach for text generation. We find that this method improves over standard benchmarks, while also providing fine-grained control.


title: The reflectionless properties of Toeplitz waves and Hankel waves: an analysis via Bessel functions

abstract: We study reflectionless properties at the boundary for the wave equation in one space dimension and time, in terms of a well-known matrix that arises from a simple discretisation of space. It is known that all matrix functions of the familiar second difference matrix representing the Laplacian in this setting are the sum of a Toeplitz matrix and a Hankel matrix. The solution to the wave equation is one such matrix function. Here, we study the behaviour of the corresponding waves that we call Toeplitz waves and Hankel waves. We show that these waves can be written as certain linear combinations of even Bessel functions of the first kind. We find exact and explicit formulae for these waves. We also show that the Toeplitz and Hankel waves are reflectionless on even, respectively odd, traversals of the domain. Our analysis naturally suggests a new method of computer simulation that allows control, so that it is possible to choose -- in advance -- the number of reflections. An attractive result that comes out of our analysis is the appearance of the well-known shift matrix, and also other matrices that might be thought of as Hankel versions of the shift matrix. By revealing the algebraic structure of the solution in terms of shift matrices, we make it clear how the Toeplitz and Hankel waves are indeed reflectionless at the boundary on even or odd traversals. Although the subject of the reflectionless boundary condition has a long history, we believe the point of view that we adopt here in terms of matrix functions is new.


title: Fast and accurate detection of Covid-19-related pneumonia from chest X-ray images with novel deep learning model

abstract: Background: Novel coronavirus disease has spread rapidly worldwide. As recent radiological literatures on Covid-19 related pneumonia is primarily focused on CT findings, the American College of Radiology (ACR) recommends using portable chest X-radiograph (CXR). A tool to assist for detection and monitoring of Covid-19 cases from CXR is highly required. Purpose: To develop a fully automatic framework to detect Covid-19 related pneumonia using CXR images and evaluate its performance. Materials and Methods: In this study, a novel deep learning model, named CovIDNet (Covid-19 Indonesia Neural-Network), was developed to extract visual features from chest x-ray images for the detection of Covid-19 related pneumonia. The model was trained and validated by chest x-rays datasets collected from several open source provided by GitHub and Kaggle. Results and Discussion: In the validation stage using open-source data, the accuracy to recognize Covid-19 and others classes reaches 98.44%, that is, 100% Covid-19 precision and 97% others precision. Discussion: The use of the model to classify Covid-19 and other pathologies might slightly decrease the accuracy. Although SoftMax was used to handle classification bias, this indicates the benefit of additional training upon the introduction of new set of data. Conclusion: The model has been tested and get 98.4% accuracy for open source datasets, the sensitivity and specificity are 100% and 96.97%, respectively.


title: Efficient Privacy Preserving Edge Computing Framework for Image Classification

abstract: In order to extract knowledge from the large data collected by edge devices, traditional cloud based approach that requires data upload may not be feasible due to communication bandwidth limitation as well as privacy and security concerns of end users. To address these challenges, a novel privacy preserving edge computing framework is proposed in this paper for image classification. Specifically, autoencoder will be trained unsupervised at each edge device individually, then the obtained latent vectors will be transmitted to the edge server for the training of a classifier. This framework would reduce the communications overhead and protect the data of the end users. Comparing to federated learning, the training of the classifier in the proposed framework does not subject to the constraints of the edge devices, and the autoencoder can be trained independently at each edge device without any server involvement. Furthermore, the privacy of the end users' data is protected by transmitting latent vectors without additional cost of encryption. Experimental results provide insights on the image classification performance vs. various design parameters such as the data compression ratio of the autoencoder and the model complexity.


title: Class-Aware Domain Adaptation for Improving Adversarial Robustness

abstract: Recent works have demonstrated convolutional neural networks are vulnerable to adversarial examples, i.e., inputs to machine learning models that an attacker has intentionally designed to cause the models to make a mistake. To improve the adversarial robustness of neural networks, adversarial training has been proposed to train networks by injecting adversarial examples into the training data. However, adversarial training could overfit to a specific type of adversarial attack and also lead to standard accuracy drop on clean images. To this end, we propose a novel Class-Aware Domain Adaptation (CADA) method for adversarial defense without directly applying adversarial training. Specifically, we propose to learn domain-invariant features for adversarial examples and clean images via a domain discriminator. Furthermore, we introduce a class-aware component into the discriminator to increase the discriminative power of the network for adversarial examples. We evaluate our newly proposed approach using multiple benchmark datasets. The results demonstrate that our method can significantly improve the state-of-the-art of adversarial robustness for various attacks and maintain high performances on clean images.


title: Ergodicity and Perturbation Bounds for $M_t/M_t/1$ Queue with Balking, Catastrophes, Server Failures and Repairs

abstract: In this paper, we display methods for the computation of convergence and perturbation bounds for $M_t/M_t/1$ system with balking, catastrophes, server failures and repairs. Based on the logarithmic norm of linear operators, the bounds on the rate of convergence, perturbation bounds, and the main limiting characteristics of the queue-length process are obtained. Finally, we consider the application of all obtained estimates to a specific model.


title: On asymptotic base loci of relative anti-canonical divisors of algebraic fiber spaces

abstract: In this paper, we study the relative anti-canonical divisor $-K_{X/Y}$ of an algebraic fiber space $\phi: X \to Y$, and we reveal relations among positivity conditions of $-K_{X/Y}$, certain flatness of direct image sheaves, and variants of the base loci including the stable (augmented, restricted) base loci and upper level sets of Lelong numbers. This paper contains three main results: The first result says that all the above base loci are located in the horizontal direction unless they are empty. The second result is an algebraic proof for Campana--Cao--Matsumura's equality on Hacon--$\rm{M^c}$Kernan's question, whose original proof depends on analytics methods. The third result partially solves the question which asks whether algebraic fiber spaces with semi-ample relative anti-canonical divisor actually have a product structure via the base change by an appropriate finite \'etale cover of $Y$. Our proof is based on algebraic as well as analytic methods for positivity of direct image sheaves.


title: Non-recurrent Traffic Congestion Detection with a Coupled Scalable Bayesian Robust Tensor Factorization Model

abstract: Non-recurrent traffic congestion (NRTC) usually brings unexpected delays to commuters. Hence, it is critical to accurately detect and recognize the NRTC in a real-time manner. The advancement of road traffic detectors and loop detectors provides researchers with a large-scale multivariable temporal-spatial traffic data, which allows the deep research on NRTC to be conducted. However, it remains a challenging task to construct an analytical framework through which the natural spatial-temporal structural properties of multivariable traffic information can be effectively represented and exploited to better understand and detect NRTC. In this paper, we present a novel analytical training-free framework based on coupled scalable Bayesian robust tensor factorization (Coupled SBRTF). The framework can couple multivariable traffic data including traffic flow, road speed, and occupancy through sharing a similar or the same sparse structure. And, it naturally captures the high-dimensional spatial-temporal structural properties of traffic data by tensor factorization. With its entries revealing the distribution and magnitude of NRTC, the shared sparse structure of the framework compasses sufficiently abundant information about NRTC. While the low-rank part of the framework, expresses the distribution of general expected traffic condition as an auxiliary product. Experimental results on real-world traffic data show that the proposed method outperforms coupled Bayesian robust principal component analysis (coupled BRPCA), the rank sparsity tensor decomposition (RSTD), and standard normal deviates (SND) in detecting NRTC. The proposed method performs even better when only traffic data in weekdays are utilized, and hence can provide more precise estimation of NRTC for daily commuters.


title: The Distribution of the Nontrivial Zeros of Riemann Zeta Function

abstract: We improve the estimation of the distribution of the nontrivial zeros of Riemann zeta function $\zeta(\sigma+it)$ for sufficiently large $t$, which is based on an exact calculation of some special logarithmic integrals of nonvanishing $\zeta(\sigma+it)$ along well-chosen contours. A special and single-valued coordinate transformation $s=\tau(z)$ is chosen as the inverse of $z=\chi(s)$, and the functional equation $\zeta(s) = \chi(s)\zeta(1-s)$ is simplified as $G(z) = z\, G_-(\frac{1}{z})$ in the $z$ coordinate, where $G(z)=\zeta(s)=\zeta\circ\tau(z)$ and $G_-$ is the conjugated branch of $G$. Two types of special and symmetric contours $\partial D_{\epsilon}^1$ and $\partial D_{\epsilon}^2$ in the $s$ coordinate are specified, and improper logarithmic integrals of nonvanishing $\zeta(s)$ along $\partial D_{\epsilon}^1$ and $\partial D_{\epsilon}^2$ can be calculated as $2\pi i$ and $0$ respectively, depending on the total increase in the argument of $z=\chi(s)$. Any domains in the critical strip for sufficiently large $t$ can be covered by the domains $D_{\epsilon}^1$ or $D_{\epsilon}^2$, and the distribution of nontrivial zeros of $\zeta(s)$ is revealed in the end, which is more subtle than Riemann's initial hypothesis and in rhythm with the argument of $\chi(\frac{1}{2}+it)$.


title: Determination of the magnetocaloric effect from thermophysical parameters and their relationships near magnetic phase transition in doped manganites

abstract: We present the results of a comparative analysis of the magnetocaloric effect (MCE) in Pr0.7Sr0.2Ca0.1MnO3, through direct and indirect measurements, using experimentally measured magnetization, specific heat, magnetostriction, resistivity, thermal diffusivity and thermal conductivity parameters. We have demonstrated that the change in each parameter in response to a magnetic field near the ferromagnetic-paramagnetic phase transition temperature of the material correlates with the change in magnetic entropy. These findings allow us to interrelate these parameters and provide an alternative, effective approach for accessing the usefulness of magnetocaloric materials.


title: Belief Rule Based Expert System to Identify the Crime Zones

abstract: This paper focuses on Crime zone Identification. Then, it clarifies how we conducted the Belief Rule Base algorithm to produce interesting frequent patterns for crime hotspots. The paper also shows how we used an expert system to forecast potential types of crime. In order to further analyze the crime datasets, the paper introduces an analysis study by combining our findings of the Chittagong crime dataset with demographic information to capture factors that could affect neighborhood safety. The results of this solution could be used to raise awareness of the dangerous locations and to help agencies predict future crimes at a specific location in a given time.


title: BlockRoam: Blockchain-based Roaming Management System for Future Mobile Networks

abstract: Mobile service providers (MSPs) are particularly vulnerable to roaming frauds, especially ones that exploit the long delay in the data exchange process of the contemporary roaming management systems, causing multi-billion dollars loss each year. In this paper, we introduce BlockRoam, a novel blockchain-based roaming management system that provides an efficient data exchange platform among MSPs and mobile subscribers. Utilizing the Proof-of-Stake (PoS) consensus mechanism and smart contracts, BlockRoam can significantly shorten the information exchanging delay, thereby addressing the roaming fraud problems. Through intensive analysis, we show that the security and performance of such PoS-based blockchain network can be further enhanced by incentivizing more users (e.g., subscribers) to participate in the network. Moreover, users in such networks often join stake pools (e.g., formed by MSPs) to increase their profits. Therefore, we develop an economic model based on Stackelberg game to jointly maximize the profits of the network users and the stake pool, thereby encouraging user participation. We also propose an effective method to guarantee the uniqueness of this game's equilibrium. The performance evaluations show that the proposed economic model helps the MSPs to earn additional profits, attracts more investment to the blockchain network, and enhances the network's security and performance.


title: Anisotropic Magnetocaloric Properties of The Ludwigite Single Crystal Cu2MnBO5

abstract: We present the results of a thorough study of the specific heat and magnetocaloric properties of a ludwigite crystal Cu2MnBO5 over a temperature range of 60 - 350 K and in magnetic fields up to 18 kOe. It is found that at temperatures below the Curie temperature (92 K), capacity possesses a linear temperature-dependent behavior, which is associated with the predominance of two-dimensional antiferromagnetic interactions of magnons. The temperature independence of capacity is observed in the temperature range of 95 - 160 K, which can be attributed to the excitation of the Wigner glass phase. The magnetocaloric effect (i.e. the adiabatic temperature change) was assessed through a direct measurement or an indirect method using the capacity data. Owing to its strong magnetocrystalline anisotropy, an anisotropic MCE or the rotating MCE is observed in Cu2MnBO5. A deep minimum in the rotating MCE near the TC is observed and may be associated with the anisotropy of the paramagnetic susceptibility.


title: A Survey on Deep Learning for Neuroimaging-based Brain Disorder Analysis

abstract: Deep learning has been recently used for the analysis of neuroimages, such as structural magnetic resonance imaging (MRI), functional MRI, and positron emission tomography (PET), and has achieved significant performance improvements over traditional machine learning in computer-aided diagnosis of brain disorders. This paper reviews the applications of deep learning methods for neuroimaging-based brain disorder analysis. We first provide a comprehensive overview of deep learning techniques and popular network architectures, by introducing various types of deep neural networks and recent developments. We then review deep learning methods for computer-aided analysis of four typical brain disorders, including Alzheimer's disease, Parkinson's disease, Autism spectrum disorder, and Schizophrenia, where the first two diseases are neurodegenerative disorders and the last two are neurodevelopmental and psychiatric disorders, respectively. More importantly, we discuss the limitations of existing studies and present possible future directions.


title: A Generic Message Authentication Code: A combination of the Inter MAC and Carter-Wegman MAC

abstract: Message Authentication Code (MAC) is a method for providing integrity and authenticity assurances on the message by allowing the receiver to detect any changes to the message content. In this paper, we present a generic MAC named InterCW-MAC which can prevent replay attack and can deal with a untrusted receiver who may search the secret keys of the sender.


abstract: The Bernstein inequality is a tight upper bound on tail probabilities for independent random variables. Freedman extended the Bernstein inequality to martingales with differences bounded from above, and then Dzhaparidze and van Zanten generalized Freedman's result to non-bounded locally square integrable martingales. In this paper, we derive some Dzhaparidze-van Zanten type inequalities for self-normalized martingales with square integrable and non-square integrable differences.


title: Pressure induced Lifshitz transition in ThFeAsN

abstract: In this paper, we present pressure dependent structural parameters and electronic structure of ThFeAsN superconductor. There are no anomalies in the structural parameters as well as elastic constants with hydrostatic pressure which is consistent with the experiments. We study the electronic structure of this compound at different external pressures in terms of density of states, band structure and Fermi surface. Density of states at the Fermi level, coming from Fe-d orbitals follows the same trend as that of the superconducting transition temperature (T$_c$) as a function of hydrostatic pressure. We also observe a pressure induced orbital selective Lifshitz transition in ThFeAsN compound which is quite different from the Lifshitz transitions observed in the other families of Fe-based superconductors. Fermi surfaces of ThFeAsN specially hole like Fermi surfaces at $\Gamma$ point are altered significantly with pressure. This modification of Fermi surface topology with pressure seems to play the major role in the reduction of T$_c$ with pressure in ThFeAsN superconductor. Spin-orbit coupling does not affect the Lifshitz transition but it modifies the energy ordering of bands near $\Gamma$ point at higher pressure.


title: New conformal map for the trapezoidal formula for infinite integrals of unilateral rapidly decreasing functions

abstract: While the trapezoidal formula can attain exponential convergence when applied to infinite integrals of bilateral rapidly decreasing functions, it is not capable of this in the case of unilateral rapidly decreasing functions. To address this issue, Stenger proposed the application of a conformal map to the integrand such that it transforms into bilateral rapidly decreasing functions. Okayama and Hanada modified the conformal map and provided a rigorous error bound for the modified formula. This paper proposes a further improved conformal map, with two rigorous error bounds provided for the improved formula. Numerical examples comparing the proposed and existing formulas are also given.


title: Convergence analysis of Adaptive Locally Iterative Filtering and SIFT method

abstract: Adaptive Local Iterative Filtering (ALIF) is a currently proposed novel time-frequency analysis tool. It has been empirically shown that ALIF is able to separate components and overcome the mode-mixing problem. However, so far its convergence is still an open problem, particularly for highly nonstationary signals, due to the fact that the kernel associated with ALIF is non-translational invariant, non-convolutional and non-symmetric. Our first contribution in this work is providing a convergence analysis of ALIF. From the practical perspective, ALIF depends on a robust frequencies estimator, based on which the decomposition can be achieved. Our second contribution is proposing a robust and adaptive decomposition method for noisy and nonstationary signals, which we coined the Synchrosqueezing Iterative Filtering Technique (SIFT). In SIFT, we apply the synchrosqueezing transform to estimate the instantaneous frequency, and then apply the ALIF to decompose a signal. We show numerically the ability of this new approach in handling highly nonstationary signals.


title: Electronic structure, lattice dynamics and magnetism of new ThXAsN (X=Fe,Co,Ni) superconductors: A First Principles Study

abstract: In this work, we present a comparative first principles study of mechanical properties, electronic structure, phonon dispersion relation, electron-phonon coupling and magnetism in three isostructural superconductors, namely, ThFeAsN, ThCoAsN and ThNiAsN. Experimentally, ThFeAsN and ThNiAsN show superconducting properties, while ThCoAsN has not been synthesized. Our calculated elastic constants show that all these systems are mechanically stable. Significant differences in the electronic structures of these three compounds in terms of density of states, band structures and Fermi surfaces, are found. Our phonon calculations reveal that all the systems including ThCoAsN, are dynamically stable. Phonon dispersion relations indicate that the optical modes of all the three systems are almost the same while there are significant variations in the low frequency manifold consisting of mixed modes. The electron-phonon coupling constants and superconducting transition temperatures calculated based on the Eliashberg formalism, predict a rather high $T_c$ of 6.4 K for ThCoAsN and also a $T_c$ of 3.4 K for ThNiAsN which agrees well with the experimental value of 4.3 K. Nevertheless, we find a $T_c$ of 0.05 K for ThFeAsN, which is much smaller than the experimental $T_c$ of $\sim$30 K. However, a simple analysis considering the amplifying effects of spin density wave order and out-of-plane soft phonon modes suggests that the $T_c$ could be increased considerably to $\sim$10 K. Finally, we also discuss the effect of anion As height on the electronic structures and study possible magnetic states in these three compounds.


title: An Integrated Enhancement Solution for 24-hour Colorful Imaging

abstract: The current industry practice for 24-hour outdoor imaging is to use a silicon camera supplemented with near-infrared (NIR) illumination. This will result in color images with poor contrast at daytime and absence of chrominance at nighttime. For this dilemma, all existing solutions try to capture RGB and NIR images separately. However, they need additional hardware support and suffer from various drawbacks, including short service life, high price, specific usage scenario, etc. In this paper, we propose a novel and integrated enhancement solution that produces clear color images, whether at abundant sunlight daytime or extremely low-light nighttime. Our key idea is to separate the VIS and NIR information from mixed signals, and enhance the VIS signal adaptively with the NIR signal as assistance. To this end, we build an optical system to collect a new VIS-NIR-MIX dataset and present a physically meaningful image processing algorithm based on CNN. Extensive experiments show outstanding results, which demonstrate the effectiveness of our solution.


title: Stationary entanglement between light and microwave via ferromagnetic magnons

abstract: We show how to generate stationary entanglement between light and microwave in a hybrid opto-electro-magnonical system which mainly consists of a microwave cavity, a yttrium iron garnet (YIG) sphere and a nanofiber. The optical modes in nanofiber can evanescently coupled to whispering gallery modes, that are able to interact with magnon mode via spin-orbit interaction, in YIG sphere, while the microwave cavity photons and magnons are coupled through magnetic dipole interaction simultaneously. Under reasonable parameter regimes, pretty amount of entanglement can be generated, and it also shows persistence against temperature. Our work is expected to provide a new perspective for building more advanced and comprehensive quantum networks along with magnons for fast-developing quantum technology and for studying the macroscopic quantum phenomena.


title: Manifestation of the divergence between antisymmetrized-molecular-dynamics and container pictures of $^{9}$Be via ${}^{9}$Be($p,pn$)${}^{8}$Be knockout reaction

abstract: We propose a new approach to probe the spatial extension of the valence neutron orbital in the $^{9}$Be nucleus via the ${}^{9}$Be($p,pn$)${}^{8}$Be knockout reaction. This property of the nuclear molecular orbital has not been established in previous experimental studies and divergence exists between the theoretical descriptions of ${}^{9}$Be from different perspectives, \textit{i.e.}, the antisymmetrized molecular dynamics and the container pictures of cluster dynamics. These pictures are represented by two different well-proven microscopic models, the antisymmetrized molecular dynamics (AMD) and Tohsaki-Horiuchi-Schuck-R\"{o}pke (THSR) wave functions. The corresponding reduced width amplitudes (RWAs) in the $^{8}$Be$+n$ channel are extracted from both the AMD and THSR wave functions, and they are found to describe drastically different valence-nucleon motion, which shows the theoretical ambiguity in describing the $\pi$-orbitals in $^{9}$Be. Using the RWAs as input, the physical observables of the ${}^{9}$Be($p,pn$)${}^{8}$Be knockout reaction are predicted by the distorted-wave impulse approximation (DWIA) framework. The magnitudes of the triple-differential cross sections (TDX) are found to be highly sensitive to the RWA input. It is concluded that the ${}^{9}$Be($p,pn$)${}^{8}$Be knockout reaction could provide a feasible probing for the subtle differences between several structure models manifesting through the spatial extension of the $\pi$-orbital in the $^{9}$Be nucleus.


title: Modeling the spread of infectious disease in urban areas with travel contagion

abstract: In this study, we develop the mathematical model to understand the coupling between the spreading dynamics of infectious diseases and the mobility dynamics through urban transportation systems. We first describe the mobility dynamics of the urban population as the process of leaving from home, traveling to and from the activity locations, and engaging in activities. We then embed the susceptible-exposed-infectious-recovered (SEIR) process over the mobility dynamics and develops the spatial SEIR model with travel contagion (Trans-SEIR), which explicitly accounts for contagions both during travel and during daily activities. We investigate the theoretical properties of the proposed model and show how activity contagion and travel contagion contribute to the average number of secondary infections. In the numerical experiments, we explore how the urban transportation system may alter the fundamental dynamics of the infectious disease, change the number of secondary infections, promote the synchronization of the disease across the city, and affect the peak of the disease outbreaks. The Trans-SEIR model is further applied to the understand the disease dynamics during the COVID-19 outbreak in New York City, where we show how the activity and travel contagion may be distributed and how effective travel control can be implemented with only limited resources. The Trans-SEIR model along with the findings in our study may have significant contributions to improving our understanding of the coupling between urban transportation and disease dynamics, the development of quarantine and control measures of disease system, and promoting the idea of disease-resilient urban transportation networks.


title: Testing Mediation Effects Using Logic of Boolean Matrices

abstract: Mediation analysis is becoming an increasingly important tool in scientific studies. A central question in high-dimensional mediation analysis is to infer the significance of individual mediators. The main challenge is the sheer number of possible paths that go through all combinations of mediators. Most existing mediation inference solutions either explicitly impose that the mediators are conditionally independent given the exposure, or ignore any potential directed paths among the mediators. In this article, we propose a novel hypothesis testing procedure to evaluate individual mediation effects, while taking into account potential interactions among the mediators. Our proposal thus fills a crucial gap, and greatly extends the scope of existing mediation tests. Our key idea is to construct the test statistic using the logic of Boolean matrices, which enables us to establish the proper limiting distribution under the null hypothesis. We further employ screening, data splitting, and decorrelated estimation to reduce the bias and increase the power of the test. We show our test can control both the size and false discovery rate asymptotically, and the power of the test approaches one, meanwhile allowing the number of mediators to diverge to infinity with the sample size. We demonstrate the efficacy of our method through both simulations and a neuroimaging study of Alzheimer's disease.


title: Lifetime Maximization for UAV-assisted Data Gathering Networks in the Presence of Jamming

abstract: Deployment of unmanned aerial vehicles (UAVs) is recently getting significant attention due to a variety of practical use cases, such as surveillance, data gathering, and commodity delivery. Since UAVs are powered by batteries, energy efficient communication is of paramount importance. In this paper, we investigate the problem of lifetime maximization of a UAV-assisted network in the presence of multiple sources of interference, where the UAVs are deployed to collect data from a set of wireless sensors. We demonstrate that the placement of the UAVs play a key role in prolonging the lifetime of the network since the required transmission powers of the UAVs are closely related to their locations in space. In the proposed scenario, the UAVs transmit the gathered data to a primary UAV called \textit{leader}, which is in charge of forwarding the data to the base station (BS) via a backhaul UAV network. We deploy tools from spectral graph theory to tackle the problem due to its high non-convexity. Simulation results demonstrate that our proposed method can significantly improve the lifetime of the UAV network.


title: Ensemble Wrapper Subsampling for Deep Modulation Classification

abstract: Subsampling of received wireless signals is important for relaxing hardware requirements as well as the computational cost of signal processing algorithms that rely on the output samples. We propose a subsampling technique to facilitate the use of deep learning for automatic modulation classification in wireless communication systems. Unlike traditional approaches that rely on pre-designed strategies that are solely based on expert knowledge, the proposed data-driven subsampling strategy employs deep neural network architectures to simulate the effect of removing candidate combinations of samples from each training input vector, in a manner inspired by how wrapper feature selection models work. The subsampled data is then processed by another deep learning classifier that recognizes each of the considered 10 modulation types. We show that the proposed subsampling strategy not only introduces drastic reduction in the classifier training time, but can also improve the classification accuracy to higher levels than those reached before for the considered dataset. An important feature herein is exploiting the transferability property of deep neural networks to avoid retraining the wrapper models and obtain superior performance through an ensemble of wrappers over that possible through solely relying on any of them.


title: From Speaker Verification to Multispeaker Speech Synthesis, Deep Transfer with Feedback Constraint

abstract: High-fidelity speech can be synthesized by end-to-end text-to-speech models in recent years. However, accessing and controlling speech attributes such as speaker identity, prosody, and emotion in a text-to-speech system remains a challenge. This paper presents a system involving feedback constraint for multispeaker speech synthesis. We manage to enhance the knowledge transfer from the speaker verification to the speech synthesis by engaging the speaker verification network. The constraint is taken by an added loss related to the speaker identity, which is centralized to improve the speaker similarity between the synthesized speech and its natural reference audio. The model is trained and evaluated on publicly available datasets. Experimental results, including visualization on speaker embedding space, show significant improvement in terms of speaker identity cloning in the spectrogram level. Synthesized samples are available online for listening. (https://caizexin.github.io/mlspk-syn-samples/index.html)


title: Transformer Based Language Models for Similar Text Retrieval and Ranking

abstract: Most approaches for similar text retrieval and ranking with long natural language queries rely at some level on queries and responses having words in common with each other. Recent applications of transformer-based neural language models to text retrieval and ranking problems have been very promising, but still involve a two-step process in which result candidates are first obtained through bag-of-words-based approaches, and then reranked by a neural transformer. In this paper, we introduce novel approaches for effectively applying neural transformer models to similar text retrieval and ranking without an initial bag-of-words-based step. By eliminating the bag-of-words-based step, our approach is able to accurately retrieve and rank results even when they have no non-stopwords in common with the query. We accomplish this by using bidirectional encoder representations from transformers (BERT) to create vectorized representations of sentence-length texts, along with a vector nearest neighbor search index. We demonstrate both supervised and unsupervised means of using BERT to accomplish this task.


title: Maximal Algorithmic Caliber and Algorithmic Causal Network Inference: General Principles of Real-World General Intelligence?

abstract: Ideas and formalisms from far-from-equilibrium thermodynamics are ported to the context of stochastic computational processes, via following and extending Tadaki's algorithmic thermodynamics. A Principle of Maximum Algorithmic Caliber is proposed, providing guidance as to what computational processes one should hypothesize if one is provided constraints to work within. It is conjectured that, under suitable assumptions, computational processes obeying algorithmic Markov conditions will maximize algorithmic caliber. It is proposed that in accordance with this, real-world cognitive systems may operate in substantial part by modeling their environments and choosing their actions to be (approximate and compactly represented) algorithmic Markov networks. These ideas are suggested as potential early steps toward a general theory of the operation of pragmatic generally intelligent systems.