title: Symmetric block-low-rank layers for fully reversible multilevel neural networks

abstract: Factors that limit the size of the input and output of a neural network include memory requirements for the network states/activations to compute gradients, as well as memory for the convolutional kernels or other weights. The memory restriction is especially limiting for applications where we want to learn how to map volumetric data to the desired output, such as video-to-video. Recently developed fully reversible neural networks enable gradient computations using storage of the network states for a couple of layers only. While this saves a tremendous amount of memory, it is the convolutional kernels that take up most memory if fully reversible networks contain multiple invertible pooling/coarsening layers. Invertible coarsening operators such as the orthogonal wavelet transform cause the number of channels to grow explosively. We address this issue by combining fully reversible networks with layers that contain the convolutional kernels in a compressed form directly. Specifically, we introduce a layer that has a symmetric block-low-rank structure. In spirit, this layer is similar to bottleneck and squeeze-and-expand structures. We contribute symmetry by construction, and a combination of notation and flattening of tensors allows us to interpret these network structures in linear algebraic fashion as a block-low-rank matrix in factorized form and observe various properties. A video segmentation example shows that we can train a network to segment the entire video in one go, which would not be possible, in terms of memory requirements, using non-reversible networks and previously proposed reversible networks.


title: Convolutional Dictionary Pair Learning Network for Image Representation Learning

abstract: Both the Dictionary Learning (DL) and Convolutional Neural Networks (CNN) are powerful image representation learning systems based on different mechanisms and principles, however whether we can seamlessly integrate them to improve the per-formance is noteworthy exploring. To address this issue, we propose a novel generalized end-to-end representation learning architecture, dubbed Convolutional Dictionary Pair Learning Network (CDPL-Net) in this paper, which integrates the learning schemes of the CNN and dictionary pair learning into a unified framework. Generally, the architecture of CDPL-Net includes two convolutional/pooling layers and two dictionary pair learn-ing (DPL) layers in the representation learning module. Besides, it uses two fully-connected layers as the multi-layer perception layer in the nonlinear classification module. In particular, the DPL layer can jointly formulate the discriminative synthesis and analysis representations driven by minimizing the batch based reconstruction error over the flatted feature maps from the convolution/pooling layer. Moreover, DPL layer uses l1-norm on the analysis dictionary so that sparse representation can be delivered, and the embedding process will also be robust to noise. To speed up the training process of DPL layer, the efficient stochastic gradient descent is used. Extensive simulations on real databases show that our CDPL-Net can deliver enhanced performance over other state-of-the-art methods.


title: Crack Detection Using Enhanced Hierarchical Convolutional Neural Networks

abstract: Unmanned aerial vehicles (UAV) are expected to replace human in hazardous tasks of surface inspection due to their flexibility in operating space and capability of collecting high quality visual data. In this study, we propose enhanced hierarchical convolutional neural networks (HCNN) to detect cracks from image data collected by UAVs. Unlike traditional HCNN, here a set of branch networks is utilised to reduce the obscuration in the down-sampling process. Moreover, the feature preserving blocks combine the current and previous terms from the convolutional blocks to provide input to the loss functions. As a result, the weights of resized images can be reduced to minimise the information loss. Experiments on images of different crack datasets have been carried out to demonstrate the effectiveness of proposed HCNN.


title: Improving the initial guess for the Newton-Raphson protocol in time-dependent simulations

abstract: A general linearisation procedure for the consistent tangent of a small-strain visco-plastic material model is presented in this note. The procedure is based on multi-variable linearisation around a so-called 'reference state'. In particular, the linerarisation of the time integration scheme is found to yield an extra term compared to classical expressions, which only appears because the material response is time-dependent. It has the effect of yielding a very accurate initial guess for the Newton-Raphson protocol based on the ongoing viscous flow. It is shown, using a modern variational FFT-based solver, that the extra term reduces both the CPU time and the number of Newton-Raphson iterations by around a factor two.


title: encointer -- Local Community Cryptocurrencies with Universal Basic Income

abstract: Encointer proposes a blockchain platform for local community cryptocurrencies. Individuals can claim a universal basic income through issuance of fresh money. Money supply is kept in proportion to population size through the use of demurrage. Sybil attacks are prevented by regular, concurrent and randomized pseudonym key signing parties to obtain a proof-of-personhood. Encointer features privacy by design and purchasing-power adjusted transaction fees.


title: Lung and Colon Cancer Histopathological Image Dataset (LC25000)

abstract: The field of Machine Learning, a subset of Artificial Intelligence, has led to remarkable advancements in many areas, including medicine. Machine Learning algorithms require large datasets to train computer models successfully. Although there are medical image datasets available, more image datasets are needed from a variety of medical entities, especially cancer pathology. Even more scarce are ML-ready image datasets. To address this need, we created an image dataset (LC25000) with 25,000 color images in 5 classes. Each class contains 5,000 images of the following histologic entities: colon adenocarcinoma, benign colonic tissue, lung adenocarcinoma, lung squamous cell carcinoma, and benign lung tissue. All images are de-identified, HIPAA compliant, validated, and freely available for download to AI researchers.


title: A Secure Authentication Technique in Internet of Medical Things through Machine Learning

abstract: The rapid growth of the Internet of Things technology in healthcare domain led to the appearance of many security threats and risks. It became very challenging to provide full protection with the expansion in using sensor objects in medical field, this led to the Internet of Medical Things definition, the security part in IoMT poses a perilous problem that keeps growing, because of the data sensitivity and critical information. The lack of providing a secure environment in IoMT may lead to patients privacy issues, not only leaving the data privacy of the patients at risk but also their lives can be in danger. In this paper, we provide a discussion on both definition and architecture of the Internet of Medical Things and Propose a new authentication approach through machine learning, to enhance the security level.


title: Evaluating Usage of Images for App Classification

abstract: App classification is useful in a number of applications such as adding apps to an app store or building a user model based on the installed apps. Presently there are a number of existing methods to classify apps based on a given taxonomy on the basis of their text metadata. However, text based methods for app classification may not work in all cases, such as when the text descriptions are in a different language, or missing, or inadequate to classify the app. One solution in such cases is to utilize the app images to supplement the text description. In this paper, we evaluate a number of approaches in which app images can be used to classify the apps. In one approach, we use Optical character recognition (OCR) to extract text from images, which is then used to supplement the text description of the app. In another, we use pic2vec to convert the app images into vectors, then train an SVM to classify the vectors to the correct app label. In another, we use the captionbot.ai tool to generate natural language descriptions from the app images. Finally, we use a method to detect and label objects in the app images and use a voting technique to determine the category of the app based on all the images. We compare the performance of our image-based techniques to classify a number of apps in our dataset. We use a text based SVM app classifier as our base and obtained an improved classification accuracy of 96% for some classes when app images are added.


title: Coronal properties of black hole X-ray binaries in the hard state as seen by NuSTAR and Swift

abstract: In this work, we measure two important phenomenological parameters of corona (and hot accretion flow) in black hole X-ray binaries: the photon index $\Gamma$ and the electron temperature $\te$. Thanks to the capability of {\it NuSTAR} in hard X-rays, we measure these two parameters over six orders of magnitude in the 0.1-100 keV X-ray luminosity $\lx$, from $\sim 5\times10^{38} \ergs$ down to as low as $\sim 5\times10^{32} \ergs$. We confirm the existence of a "V"-shaped correlation between $\Gamma$ and $\lx$. Surprisingly, we observe a "$\Lambda$"-shaped correlation between $\te$ and $\lx$. The "cooler when brighter" branch in the high luminosity regime ($\lx \ga 3\times 10^{36} \ergs$) agrees with previous results and can be understood under the existing model of Compton scattering in the corona. On the other hand, the apparent "cooler when fainter" (positive $\te$-$\lx$ correlation) branch in the low-luminosity regime ($\lx \la 3\times 10^{36} \ergs$) is unexpected, thus it puts a new challenge to existing models of hot accretion flow/corona.


title: Semicooperation under curved strategy spacetime

abstract: Mutually beneficial cooperation is a common part of economic systems as firms in partial cooperation with others can often make a higher sustainable profit. Though cooperative games were popular in 1950s, recent interest in non-cooperative games is prevalent despite the fact that cooperative bargaining seems to be more useful in economic and political applications. In this paper we assume that the strategy space and time are inseparable with respect to a contract. Under this assumption we show that the strategy spacetime is a dynamic curved Liouville-like 2-brane quantum gravity surface under asymmetric information and that traditional Euclidean geometry fails to give a proper feedback Nash equilibrium. Cooperation occurs when two firms' strategies fall into each other's influence curvature in this strategy spacetime. Small firms in an economy dominated by large firms are subject to the influence of large firms. We determine an optimal feedback semi-cooperation of the small firm in this case using a Liouville-Feynman path integral method.


title: Cooperative Perception for 3D Object Detection in Driving Scenarios using Infrastructure Sensors

abstract: 3D object detection is a common function within the perception system of an autonomous vehicle and outputs a list of 3D bounding boxes around objects of interest. Various 3D object detection methods have relied on fusion of different sensor modalities to overcome limitations of individual sensors. However, occlusion, limited field-of-view and low-point density of the sensor data cannot be reliably and cost-effectively addressed by multi-modal sensing from a single point of view. Alternatively, cooperative perception incorporates information from spatially diverse sensors distributed around the environment as a way to mitigate these limitations. This article proposes two schemes for cooperative 3D object detection using single modality sensors. The early fusion scheme combines point clouds from multiple spatially diverse sensing points of view before detection. In contrast, the late fusion scheme fuses the independently detected bounding boxes from multiple spatially diverse sensors. We evaluate the performance of both schemes, and their hybrid combination, using a synthetic cooperative dataset created in two complex driving scenarios, a T-junction and a roundabout. The evaluation shows that the early fusion approach outperforms late fusion by a significant margin at the cost of higher communication bandwidth. The results demonstrate that cooperative perception can recall more than 95% of the objects as opposed to 30% for single-point sensing in the most challenging scenario. To provide practical insights into the deployment of such system, we report how the number of sensors and their configuration impact the detection performance of the system.


title: DADA: Driver Attention Prediction in Driving Accident Scenarios

abstract: Driver attention prediction is becoming an essential research problem in human-like driving systems. This work makes an attempt to predict the driver attention in driving accident scenarios (DADA). However, challenges tread on the heels of that because of the dynamic traffic scene, intricate and imbalanced accident categories. In this work, we design a semantic context induced attentive fusion network (SCAFNet). We first segment the RGB video frames into the images with different semantic regions (i.e., semantic images), where each region denotes one kind of semantic categories of the scene (e.g., road, trees, etc.), and learn the spatio-temporal features of RGB frames and semantic images in two parallel paths simultaneously. Then, the learned features are fused by an attentive fusion network to find the semantic-induced scene variation in driver attention prediction. The contributions are three folds. 1) With the semantic images, we introduce their semantic context features and verified the manifest promotion effect for helping the driver attention prediction, where the semantic context features are modeled by a graph convolution network (GCN) on semantic images; 2) We fuse the semantic context features of semantic images and the features of RGB frames in an attentive strategy, and the fused details are transferred over frames by a convolutional LSTM module to obtain the attention map of each video frame with the consideration of historical scene variation in driving situations; 3) The superiority of the proposed method is evaluated on our previously collected dataset (named as DADA-2000) and two other challenging datasets with state-of-the-art methods. DADA-2000 is available at https://github.com/JWFangit/LOTVS-DADA.


title: Gas production from methane hydrates upon thermal stimulation; an analytical study employing radial coordinates

abstract: In this study, a radial analytical model for methane hydrate dissociation upon thermal stimulation in porous media considering the effect of wellbore structure has been developed. The analytical approach is based on a similarity solution employing a moving boundary separating the dissociated and undissociated zones. Two different heat sources are considered: i) line heat source; and ii) wellbore heat source with specific thickness consisting of casing, gravel, and cement. The temperature and pressure distributions, dissociation rate, and energy efficiency considering various initial and boundary conditions, and reservoir properties are investigated. Direct heat transfer from the heat source to the reservoir without considering the heat conduction in the wellbore thickness causes higher the dissociation rate and gas production in the line heat source model compared to the wellbore heating model. Increasing the heat source temperature or decreasing its pressure increases gas production. However, employing them simultaneously results in greater gas production but reduces energy efficiency. The dissociation rate has direct relation with porosity, thermal diffusivities, and thermal conductivities of the reservoir, but is not dependent on the reservoirs permeability.


title: The Chi-Square Test of Distance Correlation

abstract: Distance correlation has gained much recent attention in the data science community: the sample statistic is straightforward to compute and asymptotically equals zero if and only if independence, making it an ideal choice to discover any type of dependency structure given sufficient sample size. One major bottleneck is the testing process: because the null distribution of distance correlation depends on the underlying random variables and metric choice, it typically requires a permutation test to estimate the null and compute the p-value, which is very costly for large amount of data. To overcome the difficulty, in this paper we propose a chi-square test for distance correlation. Method-wise, the chi-square test is non-parametric, extremely fast, and applicable to bias-corrected distance correlation using any strong negative type metric or characteristic kernel. The test exhibits a similar testing power as the standard permutation test, and can be utilized for K-sample and partial testing. Theory-wise, we show that the underlying chi-square distribution well approximates and dominates the limiting null distribution in upper tail, prove the chi-square test can be valid and universally consistent for testing independence, and establish a testing power inequality with respect to the permutation test.


title: A Water-Filling Primal-Dual Algorithm for Approximating Non-Linear Covering Problems

abstract: Obtaining strong linear relaxations of capacitated covering problems constitute a major technical challenge even for simple settings. For one of the most basic cases, the Knapsack-Cover (Min-Knapsack) problem, the relaxation based on knapsack-cover inequalities achieves an integrality gap of 2. These inequalities have been exploited in more general environments, many of which admit primal-dual approximation algorithms. Inspired by problems from power and transport systems, we introduce a new general setting in which items can be taken fractionally to cover a given demand. The cost incurred by an item is given by an arbitrary non-decreasing function of the chosen fraction. We generalize the knapsack-cover inequalities to this setting an use them to obtain a $(2+\varepsilon)$-approximate primal-dual algorithm. Our procedure has a natural interpretation as a bucket-filling algorithm, which effectively balances the difficulties given by having different slopes in the cost functions: when some superior portion of an item presents a low slope, it helps to increase the priority with which the inferior portions may be taken. We also present a rounding algorithm with an approximation guarantee of 2. We generalize our algorithm to the Unsplittable Flow-Cover problem on a line, also for the setting where items can be taken fractionally. For this problem we obtain a $(4+\varepsilon)$-approximation algorithm in polynomial time, almost matching the $4$-approximation known for the classical setting.


title: Cosmological Constraint on Dark Photon from $N_{\rm eff}$

abstract: A new U(1) gauge symmetry is the simplest extension of the Standard Model and has various theoretical and phenomenological motivations. In this paper, we study the cosmological constraint on the MeV scale dark photon. After the neutrino decoupling era at $T = \mathcal{O}(1)\,$MeV, the decay and annihilation of the dark photon heats up the electron and photon plasma and accordingly decreases the effective number of neutrino $N_{\mathrm{eff}}$ in the recombination era. We derive a conservative lower-limit of the dark photon mass around 8.5 MeV from the current Planck data if the mixing between the dark photon and ordinary photon is larger than $\mathcal{O}(10^{-9})$. We also find that the future CMB stage-$\rm I\! V$ experiments can probe up to 17 MeV dark photon.


title: Accelerated iterative regularization via dual diagonal descent

abstract: We propose and analyze an accelerated iterative dual diagonal descent algorithm for the solution of linear inverse problems with general regularization and data-fit functions. In particular, we develop an inertial approach of which we analyze both convergence and stability. Using tools from inexact proximal calculus, we prove early stopping results with optimal convergence rates for additive data-fit terms as well as more general cases, such as the Kullback-Leibler divergence, for which different type of proximal point approximations hold.


title: Passive radiative cooling impact on commercial crystalline silicon-based photovoltaics

abstract: The radiative cooling of objects during daytime under direct sunlight has recently been shown to be significantly enhanced by utilizing nanophotonic coatings. Multilayer thin film stacks, 2D photonic crystals, etc. as coating structures improved the thermal emission rate of a device in the infrared atmospheric transparency window reducing considerably devices' temperature. Due to the increased heating in photovoltaic (PV) devices, that has significant adverse consequences on both their efficiency and life-time, and inspired by the recent advances in daytime radiative cooling, we developed a coupled thermal-electrical modeling to examine the physical mechanisms on how a radiative cooler affects the overall efficiency of commercial photovoltaic modules. Employing this modeling, which takes into account all the major processes affected by the temperature variation in a PV device, we evaluated the relative impact of the main radiative cooling approaches proposed so far on the PV efficiency, and we established required conditions for optimized radiative cooling. Moreover, we identified the validity regimes of the currently existing PV-cooling models which treat the PV coolers as simple thermal emitters. Finally, we assessed some realistic photonic coolers from the literature, compatible with photovoltaics, to implement the radiative cooling requirements, and demonstrated their associated impact on the temperature reduction and PV efficiency. Providing the physical mechanisms and requirements for cooling radiatively solar cells, our study provides guidelines for utilizing suitable photonic structures as radiative coolers, enhancing the efficiency and the lifetime of PV devices.


title: Learning Multivariate New Physics

abstract: We discuss a method that employs a multilayer perceptron to detect deviations from a reference model in large multivariate datasets. Our data analysis strategy does not rely on any prior assumption on the nature of the deviation. It is designed to be sensitive to small discrepancies that arise in datasets dominated by the reference model. The main conceptual building blocks were introduced in Ref. [1]. Here we make decisive progress in the algorithm implementation and we demonstrate its applicability to problems in high energy physics. We show that the method is sensitive to putative new physics signals in di-muon final states at the LHC. We also compare our performances on toy problems with the ones of alternative methods proposed in the literature.


title: Quantum Theory of Multisubband Plasmon-Phonon Coupling

abstract: We present a theoretical description of the coupling between longitudinal optical phonons and collective excitations of a two-dimensional electron gas. By diagonalizing the Hamiltonian of the system, including Coulomb electron-electron and Fr\"ohlich interactions, we observe the formation of multisubband polarons, mixed states partially phonon and partially multisubband plasmon, characterized by a coupling energy which is a significant fraction, up to ~40%, of the phonon energy. We demonstrate that multisubband plasmons and longitudinal optical phonons are in the ultra-strong coupling regime in several III-V and II-VI material systems.


title: Calculating the divided differences of the exponential function by addition and removal of inputs

abstract: We introduce a method for calculating the divided differences of the exponential function by means of addition and removal of items from the input list to the function. Our technique exploits a new identity related to divided differences recently derived by F. Zivcovich [Dolomites Research Notes on Approximation 12, 28-42 (2019)]. We show that upon adding an item to or removing an item from the input list of an already evaluated exponential, the re-evaluation of the divided differences can be done with only $O(s n)$ floating point operations and $O(s n)$ bytes of memory, where $[z_0,\dots,z_n]$ are the inputs and $s \propto \max_{i,j} |z_i - z_j|$. We demonstrate our algorithm's ability to deal with input lists that are orders-of-magnitude longer than the maximal capacities of the current state-of-the-art. We discuss in detail one practical application of our method: the efficient calculation of weights in the off-diagonal series expansion quantum Monte Carlo algorithm.


title: Felix Klein's "Zu Hilberts erster Note \"uber die Grundlagen der Physik": an English translation

abstract: We present an English translation of a 1918 paper by Felix Klein.


title: Self-injective von Neumann regular rings and K\"othe's Conjecture

abstract: One of the many equivalent formulation of the K\"othe's conjecture is the assertion that there exists no ring which contains two nil right ideals whose sum is not nil. We discuss several consequences of an observation that if the Koethe conjecture fails then there exists a counterexample in the form of a countable local subring of a suitable self-injective prime (von Neumann) regular ring.


title: Torus-like solutions for the Landau-de Gennes model. Part I: the Lyuksyutov regime

abstract: We study global minimizers of a continuum Landau-De Gennes energy functional for nematic liquid crystals, in three-dimensional domains. Assuming smooth and uniaxial (e.g. homeotropic) boundary conditions and a corresponding physically relevant norm constraint (Lyuksyutov constraint) in the interior, we prove full regularity up to the boundary for the minimizers. As a consequence, in a relevant range (which we call the Lyuksyutov regime) of parameters of the model we show that even without the norm constraint isotropic melting is anyway avoided in the energy minimizing configurations. Finally, we describe a class of boundary data including radial anchoring which yield in both the previous situations as minimizers smooth configurations whose level sets of the biaxiality carry nontrivial topology. Results in this paper will be largely employed and refined in the next papers of our series. In particular, in [DMP2], we will prove that for smooth minimizers in a restricted class of axially symmetric configurations, the level sets of the biaxiality are generically finite union of tori of revolution.


title: Felix Klein's "\"Uber die Differentialgesetze f\"ur die Erhaltung von Impuls und Energie in der Einsteinschen Gravitationstheorie": an English translation

abstract: We present an English translation of a second 1918 paper by Felix Klein which follows up on his earlier work.


title: Metamorphic Testing for Object Detection Systems

abstract: Recent advances in deep neural networks (DNNs) have led to object detectors that can rapidly process pictures or videos, and recognize the objects that they contain. Despite the promising progress by industrial manufacturers such as Amazon and Google in commercializing deep learning-based object detection as a standard computer vision service, object detection systems - similar to traditional software - may still produce incorrect results. These errors, in turn, can lead to severe negative outcomes for the users of these object detection systems. For instance, an autonomous driving system that fails to detect pedestrians can cause accidents or even fatalities. However, principled, systematic methods for testing object detection systems do not yet exist, despite their importance. To fill this critical gap, we introduce the design and realization of MetaOD, the first metamorphic testing system for object detectors to effectively reveal erroneous detection results by commercial object detectors. To this end, we (1) synthesize natural-looking images by inserting extra object instances into background images, and (2) design metamorphic conditions asserting the equivalence of object detection results between the original and synthetic images after excluding the prediction results on the inserted objects. MetaOD is designed as a streamlined workflow that performs object extraction, selection, and insertion. Evaluated on four commercial object detection services and four pretrained models provided by the TensorFlow API, MetaOD found tens of thousands of detection defects in these object detectors. To further demonstrate the practical usage of MetaOD, we use the synthetic images that cause erroneous detection results to retrain the model. Our results show that the model performance is increased significantly, from an mAP score of 9.3 to an mAP score of 10.5.


title: Model reduction for a power grid model

abstract: We apply model reduction techniques to the DeMarco power grid model. The DeMarco model, when augmented by an appropriate line failure mechanism, can be used to study cascade failures. Here we examine the DeMarco model without the line failure mechanism and we investigate how to construct reduced order models for subsets of the state variables. We show that due to the oscillating nature of the solutions and the absence of timescale separation between resolved and unresolved variables, the construction of accurate reduced models becomes highly non-trivial since one has to account for long memory effects. In addition, we show that a reduced model which includes even a short memory is drastically better than a memoryless model.


title: Unsupervised Adversarial Image Inpainting

abstract: We consider inpainting in an unsupervised setting where there is neither access to paired nor unpaired training data. The only available information is provided by the uncomplete observations and the inpainting process statistics. In this context, an observation should give rise to several plausible reconstructions which amounts at learning a distribution over the space of reconstructed images. We model the reconstruction process by using a conditional GAN with constraints on the stochastic component that introduce an explicit dependency between this component and the generated output. This allows us sampling from the latent component in order to generate a distribution of images associated to an observation. We demonstrate the capacity of our model on several image datasets: faces (CelebA), food images (Recipe-1M) and bedrooms (LSUN Bedrooms) with different types of imputation masks. The approach yields comparable performance to model variants trained with additional supervision.


title: ResNetX: a more disordered and deeper network architecture

abstract: Designing efficient network structures has always been the core content of neural network research. ResNet and its variants have proved to be efficient in architecture. However, how to theoretically character the influence of network structure on performance is still vague. With the help of techniques in complex networks, We here provide a natural yet efficient extension to ResNet by folding its backbone chain. Our architecture has two structural features when being mapped to directed acyclic graphs: First is a higher degree of the disorder compared with ResNet, which let ResNetX explore a larger number of feature maps with different sizes of receptive fields. Second is a larger proportion of shorter paths compared to ResNet, which improves the direct flow of information through the entire network. Our architecture exposes a new dimension, namely "fold depth", in addition to existing dimensions of depth, width, and cardinality. Our architecture is a natural extension to ResNet, and can be integrated with existing state-of-the-art methods with little effort. Image classification results on CIFAR-10 and CIFAR-100 benchmarks suggested that our new network architecture performs better than ResNet.


title: Parameter estimation of temperature dependent material parameters in the cooling process of TMCP steel plates

abstract: Accelerated cooling is a key technology in producing thermomechanically controlled processed (TMCP) steel plates. In a TMCP process hot plates are subjected to a strong cooling what results in a complex microstructure leading to increased strength and fracture toughness. The microstructure is strongly affected by the temperature evolution during the cooling process as well as residual stresses and flatness deformations. Therefore, the full control (quantification) of the temperature evolution is very important regarding plate design and processing. It can only be achieved by a thermophysical characterization of the material and the cooling system. In this paper, we focus on the thermophysical characterization of the material parameters. Mathematically, we consider a specific inverse heat conduction problem. The temperature evolution of a heated steel plate passing through the cooling device is modeled by a 1D nonlinear partial differential equation (PDE) with unknown temperature dependent material parameters, which describe the characteristics of the underlying material. We present a numerical approach to identify these material parameters up to some canonical ambiguity without any a priori information.


title: Design Considerations for Efficient Deep Neural Networks on Processing-in-Memory Accelerators

abstract: This paper describes various design considerations for deep neural networks that enable them to operate efficiently and accurately on processing-in-memory accelerators. We highlight important properties of these accelerators and the resulting design considerations using experiments conducted on various state-of-the-art deep neural networks with the large-scale ImageNet dataset.


title: Intra-Variable Handwriting Inspection Reinforced with Idiosyncrasy Analysis

abstract: In this paper, we work on intra-variable handwriting, where the writing samples of an individual can vary significantly. Such within-writer variation throws a challenge for automatic writer inspection, where the state-of-the-art methods do not perform well. To deal with intra-variability, we analyze the idiosyncrasy in individual handwriting. We identify/verify the writer from highly idiosyncratic text-patches. Such patches are detected using a deep recurrent reinforcement learning-based architecture. An idiosyncratic score is assigned to every patch, which is predicted by employing deep regression analysis. For writer identification, we propose a deep neural architecture, which makes the final decision by the idiosyncratic score-induced weighted average of patch-based decisions. For writer verification, we propose two algorithms for patch-fed deep feature aggregation, which assist in authentication using a triplet network. The experiments were performed on two databases, where we obtained encouraging results.


title: Image Analytics for Legal Document Review: A Transfer Learning Approach

abstract: Though technology assisted review in electronic discovery has been focusing on text data, the need of advanced analytics to facilitate reviewing multimedia content is on the rise. In this paper, we present several applications of deep learning in computer vision to Technology Assisted Review of image data in legal industry. These applications include image classification, image clustering, and object detection. We use transfer learning techniques to leverage established pretrained models for feature extraction and fine tuning. These applications are first of their kind in the legal industry for image document review. We demonstrate effectiveness of these applications with solving real world business challenges.


title: Mitigating large adversarial perturbations on X-MAS (X minus Moving Averaged Samples)

abstract: We propose the scheme that mitigates the adversarial perturbation $\epsilon$ on the adversarial example $X_{adv}$ ($=$ $X$ $\pm$ $\epsilon$, $X$ is a benign sample) by subtracting the estimated perturbation $\hat{\epsilon}$ from $X$ $+$ $\epsilon$ and adding $\hat{\epsilon}$ to $X$ $-$ $\epsilon$. The estimated perturbation $\hat{\epsilon}$ comes from the difference between $X_{adv}$ and its moving-averaged outcome $W_{avg}*X_{adv}$ where $W_{avg}$ is $N \times N$ moving average kernel that all the coefficients are one. Usually, the adjacent samples of an image are close to each other such that we can let $X$ $\approx$ $W_{avg}*X$ (naming this relation after X-MAS[X minus Moving Averaged Samples]). By doing that, we can make the estimated perturbation $\hat{\epsilon}$ falls within the range of $\epsilon$. The scheme is also extended to do the multi-level mitigation by configuring the mitigated adversarial example $X_{adv}$ $\pm$ $\hat{\epsilon}$ as a new adversarial example to be mitigated. The multi-level mitigation gets $X_{adv}$ closer to $X$ with a smaller (i.e. mitigated) perturbation than original unmitigated perturbation by setting the moving averaged adversarial sample $W_{avg} * X_{adv}$ (which has the smaller perturbation than $X_{adv}$ if $X$ $\approx$ $W_{avg}*X$) as the boundary condition that the multi-level mitigation cannot cross over (i.e. decreasing $\epsilon$ cannot go below and increasing $\epsilon$ cannot go beyond). With the multi-level mitigation, we can get high prediction accuracies even in the adversarial example having a large perturbation (i.e. $\epsilon$ $>$ $16$). The proposed scheme is evaluated with adversarial examples crafted by the FGSM (Fast Gradient Sign Method) based attacks on ResNet-50 trained with ImageNet dataset.


title: So2Sat LCZ42: A Benchmark Dataset for Global Local Climate Zones Classification

abstract: Access to labeled reference data is one of the grand challenges in supervised machine learning endeavors. This is especially true for an automated analysis of remote sensing images on a global scale, which enables us to address global challenges such as urbanization and climate change using state-of-the-art machine learning techniques. To meet these pressing needs, especially in urban research, we provide open access to a valuable benchmark dataset named "So2Sat LCZ42," which consists of local climate zone (LCZ) labels of about half a million Sentinel-1 and Sentinel-2 image patches in 42 urban agglomerations (plus 10 additional smaller areas) across the globe. This dataset was labeled by 15 domain experts following a carefully designed labeling work flow and evaluation process over a period of six months. As rarely done in other labeled remote sensing dataset, we conducted rigorous quality assessment by domain experts. The dataset achieved an overall confidence of 85%. We believe this LCZ dataset is a first step towards an unbiased globallydistributed dataset for urban growth monitoring using machine learning methods, because LCZ provide a rather objective measure other than many other semantic land use and land cover classifications. It provides measures of the morphology, compactness, and height of urban areas, which are less dependent on human and culture. This dataset can be accessed from http://doi.org/10.14459/2018mp1483140.


title: Defense against Lion Attack in Cognitive Radio Systems using the Markov Decision Process Approach

abstract: Cognitive Radio (CR) technology is a solution to solve the lack of spectrum by allowing the secondary user to use licensed bands. There are several potential security challenges for cognitive radio like Jamming, PUE and Lion attack. Lion attack is multi layer attacks that has effected on two layers. The Lion attack uses PUE or jamming attack in physical layer to disrupt TCP protocol in transport layer. Since transport layer is unaware of physical layer situation, when it occurs to an unacknowledged packet, there is no way to distinguish between congestion and disconnection in the physical layer. So the windows size of TCP would be decrease because of a wrong decision caused by unawareness. To Mitigate the Lion attack the cross layer design is usually used to freeze its windows size during frequency handoff. The main issue in this solution is finding the best strategy for freezing. In this paper, we propose a dynamic method for freezing and performing frequency handoff to counter Lion attack. Also a learning model based on Markov decision process (MDP) is applied. By using the proposed method, the secondary user can choose an optimal strategy in both physical and transport layers to reduce the effect of Lion attack.


title: Game-theory-based analysis on interactions among secondary and malicious users in coordinated jamming attack in cognitive radio systems

abstract: IEEE 802.22 standard utilizes cognitive radio (CR) techniques to allow sharing unused spectrum band. The cognitive radio is vulnerable to various attacks such as jamming attacks. This paper has focused on coordinated jamming attacks. A simple strategy for secondary users is to change their bands and switch to other appropriate bands when the jamming attack is occurred. Also, the malicious users should switch to other bands in order to jam the secondary users. To address this problem, a game theoretical method is proposed to analyze coordinated jamming attacks in CR. Then, using Nash equilibrium on the proposed game, the most appropriate bands have been found to switch as well as the optimal switching probabilities for both secondary and malicious users. Meanwhile, effects of different parameters like the number of malicious users are investigated in changing the optimal switching probabilities by analysis on the model.


title: An Analysis on Interactions among Secondary User and Unknown Jammer in Cognitive Radio Systems by Fictitious Play

abstract: With the advancement of communication, the spectrum shortage problem becomes a serious problem for future generations. The cognitive radio technology is proposed to address this concern. In cognitive radio networks, the secondary users can access spectrum that allocated to the primary users without interference to the operation of primary users. Using cognitive radio network raises security issues such as jamming attack. A straightforward strategy to counter the jamming attack is to switch other bands. Finding the best strategy for switching is complicated when the malicious user is unknown to the primary users. This paper uses fictitious game for analysis the defense against such an unknown jammer.


title: Interpretable Embeddings From Molecular Simulations Using Gaussian Mixture Variational Autoencoders

abstract: Extracting insight from the enormous quantity of data generated from molecular simulations requires the identification of a small number of collective variables whose corresponding low-dimensional free-energy landscape retains the essential features of the underlying system. Data-driven techniques provide a systematic route to constructing this landscape, without the need for extensive a priori intuition into the relevant driving forces. In particular, autoencoders are powerful tools for dimensionality reduction, as they naturally force an information bottleneck and, thereby, a low-dimensional embedding of the essential features. While variational autoencoders ensure continuity of the embedding by assuming a unimodal Gaussian prior, this is at odds with the multi-basin free-energy landscapes that typically arise from the identification of meaningful collective variables. In this work, we incorporate this physical intuition into the prior by employing a Gaussian mixture variational autoencoder (GMVAE), which encourages the separation of metastable states within the embedding. The GMVAE performs dimensionality reduction and clustering within a single unified framework, and is capable of identifying the inherent dimensionality of the input data, in terms of the number of Gaussians required to categorize the data. We illustrate our approach on two toy models, alanine dipeptide, and a challenging disordered peptide ensemble, demonstrating the enhanced clustering effect of the GMVAE prior compared to standard VAEs. The resulting embeddings appear to be promising representations for constructing Markov state models, highlighting the transferability of the dimensionality reduction from static equilibrium properties to dynamics.


title: Deformed Infinite series metric in Cartan Spaces

abstract: Igarashi introduce the concept of $(\alpha, \beta)$-metric in Cartan space $\ell^{n}$ analogously to one in Finsler space and obtained the basic important geometric properties and also investigate the special class of the space with $(\alpha, \beta)$-metric in $\ell^{n}$ in terms of $ 'invariants' $. In the present paper we determine the $ 'invariants' $ in two different cases of deformed infinite series metric which characterize the special classes of Cartan spaces $\ell^{n}$.


title: An Unsupervised Deep Learning Method for Multi-coil Cine MRI

abstract: Deep learning has achieved good success in cardiac magnetic resonance imaging (MRI) reconstruction, in which convolutional neural networks (CNNs) learn a mapping from the undersampled k-space to the fully sampled images. Although these deep learning methods can improve the reconstruction quality compared with iterative methods without requiring complex parameter selection or lengthy reconstruction time, the following issues still need to be addressed: 1) all these methods are based on big data and require a large amount of fully sampled MRI data, which is always difficult to obtain for cardiac MRI; 2) the effect of coil correlation on reconstruction in deep learning methods for dynamic MR imaging has never been studied. In this paper, we propose an unsupervised deep learning method for multi-coil cine MRI via a time-interleaved sampling strategy. Specifically, a time-interleaved acquisition scheme is utilized to build a set of fully encoded reference data by directly merging the k-space data of adjacent time frames. Then these fully encoded data can be used to train a parallel network for reconstructing images of each coil separately. Finally, the images from each coil are combined via a CNN to implicitly explore the correlations between coils. The comparisons with classic k-t FOCUSS, k-t SLR, L+S and KLR methods on in vivo datasets show that our method can achieve improved reconstruction results in an extremely short amount of time.


title: Unsupervised Few-shot Learning via Self-supervised Training

abstract: Learning from limited exemplars (few-shot learning) is a fundamental, unsolved problem that has been laboriously explored in the machine learning community. However, current few-shot learners are mostly supervised and rely heavily on a large amount of labeled examples. Unsupervised learning is a more natural procedure for cognitive mammals and has produced promising results in many machine learning tasks. In the current study, we develop a method to learn an unsupervised few-shot learner via self-supervised training (UFLST), which can effectively generalize to novel but related classes. The proposed model consists of two alternate processes, progressive clustering and episodic training. The former generates pseudo-labeled training examples for constructing episodic tasks; and the later trains the few-shot learner using the generated episodic tasks which further optimizes the feature representations of data. The two processes facilitate with each other, and eventually produce a high quality few-shot learner. Using the benchmark dataset Omniglot and Mini-ImageNet, we show that our model outperforms other unsupervised few-shot learning methods. Using the benchmark dataset Market1501, we further demonstrate the feasibility of our model to a real-world application on person re-identification.


title: Locality and compositionality in zero-shot learning

abstract: In this work we study locality and compositionality in the context of learning representations for Zero Shot Learning (ZSL). In order to well-isolate the importance of these properties in learned representations, we impose the additional constraint that, differently from most recent work in ZSL, no pre-training on different datasets (e.g. ImageNet) is performed. The results of our experiments show how locality, in terms of small parts of the input, and compositionality, i.e. how well can the learned representations be expressed as a function of a smaller vocabulary, are both deeply related to generalization and motivate the focus on more local-aware models in future research directions for representation learning.


title: Axial Attention in Multidimensional Transformers

abstract: We propose Axial Transformers, a self-attention-based autoregressive model for images and other data organized as high dimensional tensors. Existing autoregressive models either suffer from excessively large computational resource requirements for high dimensional data, or make compromises in terms of distribution expressiveness or ease of implementation in order to decrease resource requirements. Our architecture, by contrast, maintains both full expressiveness over joint distributions over data and ease of implementation with standard deep learning frameworks, while requiring reasonable memory and computation and achieving state-of-the-art results on standard generative modeling benchmarks. Our models are based on axial attention, a simple generalization of self-attention that naturally aligns with the multiple dimensions of the tensors in both the encoding and the decoding settings. Notably the proposed structure of the layers allows for the vast majority of the context to be computed in parallel during decoding without introducing any independence assumptions. This semi-parallel structure goes a long way to making decoding from even a very large Axial Transformer broadly applicable. We demonstrate state-of-the-art results for the Axial Transformer on the ImageNet-32 and ImageNet-64 image benchmarks as well as on the BAIR Robotic Pushing video benchmark. We open source the implementation of Axial Transformers.


title: Differentiable Set Operations for Algebraic Expressions

abstract: Basic principles of set theory have been applied in the context of probability and binary computation. Applying the same principles on inequalities is less common but can be extremely beneficial in a variety of fields. This paper formulates a novel approach to directly apply set operations on inequalities to produce resultant inequalities with differentiable boundaries. The suggested approach uses inequalities of the form Ei: fi(x1,x2,..,xn) and an expression of set operations in terms of Ei like, (E1 and E2) or E3, or can be in any standard form like the Conjunctive Normal Form (CNF) to produce an inequality F(x1,x2,..,xn)<=1 which represents the resulting bounded region from the expressions and has a differentiable boundary. To ensure differentiability of the solution, a trade-off between representation accuracy and curvature at borders (especially corners) is made. A set of parameters is introduced which can be fine-tuned to improve the accuracy of this approach. The various applications of the suggested approach have also been discussed which range from computer graphics to modern machine learning systems to fascinating demonstrations for educational purposes (current use). A python script to parse such expressions is also provided.


title: Non elementary classes of relation and cylindric algebras

abstract: For any pair of ordinals $\alpha<\beta$, $\sf CA_\alpha$ denotes the class of cylindric algebras of dimension $\alpha$, $\sf RCA_{\alpha}$ denote the class of representable $\sf CA_\alpha$s and $\sf Nr_\alpha CA_\beta$ ($\sf Ra CA_\beta)$ denotes the class of $\alpha$-neat reducts (relation algebra reducts) of $\sf CA_\beta$. We show that any class $\sf K$ such that $\sf RaCA_\omega \subseteq \sf K\subseteq RaCA_5$, $\sf K$ is not elementary, i.e not definable in first order logic. Let $2<n<\omega$. It is also shown that any class $\sf K$ such that $\sf Nr_nCA_\omega \cap {\sf CRCA}_n\subseteq {\sf K}\subseteq \mathbf{S}_c\sf Nr_nCA_{n+3}$, where $\sf CRCA_n$ is the class of completely representable $\sf CA_n$s, and $\mathbf{S}_c$ denotes the operation of forming complete subalgebras, is proved not to be elementary. Finally, we show that any class $\sf K$ such that $\mathbf{S}_d\sf Ra CA_\omega \subseteq {\sf K}\subseteq \mathbf{S}_c\sf RaCA_5$ is not elementary. It remains to be seen whether there exist elementary classes between $\sf RaCA_\omega$ and $\mathbf{S}_d\sf RCA_{\omega}$. In particular, for $m\geq n+3$, the classes $\sf Nr_nCA_m$, $\sf CRCA_n$, $\mathbf{S}_d\sf Nr_nCA_m$, where $\mathbf{S}_d$ is the operation of forming dense subalgebras are not first order definable.


title: Physical Layer Security in Vehicular Networks with Reconfigurable Intelligent Surfaces

abstract: This paper studies the physical layer security (PLS) of a vehicular network employing a reconfigurable intelligent surface (RIS). RIS technologies are emerging as an important paradigm for the realisation of smart radio environments, where large numbers of small, low-cost and passive elements, reflect the incident signal with an adjustable phase shift without requiring a dedicated energy source. Inspired by the promising potential of RIS-based transmission, we investigate two vehicular network system models: One with vehicle-to-vehicle communication with the source employing a RIS-based access point, and the other model in the form of a vehicular adhoc network (VANET), with a RIS-based relay deployed on a building. Both models assume the presence of an eavesdropper, to investigate the average secrecy capacity of the considered systems. Monte-Carlo simulations are provided throughout to validate the results. The results show that performance of the system in terms of the secrecy capacity is affected by the location of the RIS-relay and the number of RIS cells. The effect of other system parameters such as source power and eavesdropper distances are also studied.


title: Detecting Deepfake-Forged Contents with Separable Convolutional Neural Network and Image Segmentation

abstract: Recent advances in AI technology have made the forgery of digital images and videos easier, and it has become significantly more difficult to identify such forgeries. These forgeries, if disseminated with malicious intent, can negatively impact social and political stability, and pose significant ethical and legal challenges as well. Deepfake is a variant of auto-encoders that use deep learning techniques to identify and exchange images of a person's face in a picture or film. Deepfake can result in an erosion of public trust in digital images and videos, which has far-reaching effects on political and social stability. This study therefore proposes a solution for facial forgery detection to determine if a picture or film has ever been processed by Deepfake. The proposed solution reaches detection efficiency by using the recently proposed separable convolutional neural network (CNN) and image segmentation. In addition, this study also examined how different image segmentation methods affect detection results. Finally, the ensemble model is used to improve detection capabilities. Experiment results demonstrated the excellent performance of the proposed solution.


title: Stationary State Degeneracy of Open Quantum Systems with Non-Abelian Symmetries

abstract: We study the null space degeneracy of open quantum systems with multiple non-Abelian, strong symmetries. By decomposing the Hilbert space representation of these symmetries into an irreducible representation involving the direct sum of multiple, commuting, invariant subspaces we derive a tight lower bound for the stationary state degeneracy. We apply these results within the context of open quantum many-body systems, presenting three illustrative examples: a fully-connected quantum network, the XXX Heisenberg model and the Hubbard model. We find that the derived bound, which scales at least cubically in the system size the $SU(2)$ symmetric cases, is often saturated. Moreover, our work provides a theory for the systematic block-decomposition of a Liouvillian with non-Abelian symmetries, reducing the computational difficulty involved in diagonalising these objects and exposing a natural, physical structure to the steady states - which we observe in our examples.

categories: quant-ph cond-mat.quant-gas cond-mat.stat-mech math-ph math.MP physics.atom-ph


title: Unsupervised Representation Learning by Predicting Random Distances

abstract: Deep neural networks have gained tremendous success in a broad range of machine learning tasks due to its remarkable capability to learn semantic-rich features from high-dimensional data. However, they often require large-scale labelled data to successfully learn such features, which significantly hinders their adaption into unsupervised learning tasks, such as anomaly detection and clustering, and limits their applications into critical domains where obtaining massive labelled data is prohibitively expensive. To enable unsupervised learning on those domains, in this work we propose to learn features without using any labelled data by training neural networks to predict data distances in a randomly projected space. Random mapping is a theoretically proven approach to obtain approximately preserved distances. To well predict these random distances, the representation learner is optimised to learn genuine class structures that are implicitly embedded in the randomly projected space. Empirical results on 19 real-world datasets show that our learned representations substantially outperform a few state-of-the-art competing methods in both anomaly detection and clustering tasks. Code is available at https://git.io/RDP


title: Learning Neural Activations

abstract: An artificial neuron is modelled as a weighted summation followed by an activation function which determines its output. A wide variety of activation functions such as rectified linear units (ReLU), leaky-ReLU, Swish, MISH, etc. have been explored in the literature. In this short paper, we explore what happens when the activation function of each neuron in an artificial neural network is learned natively from data alone. This is achieved by modelling the activation function of each neuron as a small neural network whose weights are shared by all neurons in the original network. We list our primary findings in the conclusions section. The code for our analysis is available at: https://github.com/amina01/Learning-Neural-Activations.


title: ALICE Inner Tracking System Upgrade: construction and commissioning

abstract: ALICE (A Large Ion Collider Experiment) is the CERN LHC experiment optimized for the study of the strongly interacting matter produced in heavy-ion collisions and devoted to the characterization of the Quark-Gluon Plasma. To achieve the physics program for LHC Run 3 and 4, ALICE is undergoing a major upgrade of the experimental apparatus during the ongoing second long LHC shutdown. A key element of the ALICE upgrade is the substitution of the Inner Tracking System (ITS) with a completely new silicon-based detector whose features will allow the reconstruction of rare physics channels which could not be accessed before with the ITS layout used during LHC Run 1 and 2. The enabling technology for such performance boost is the adoption of custom-designed MAPS (Monolithic Active Pixel Sensors) as detecting element. In this proceedings, the status of the construction and commissioning of the ITS upgrade will be detailed. The completion of the modules construction will be achieved soon and, in the meantime, the commissioning in laboratory is proceeding using the components already integrated in the detector.


title: LLOV: A Fast Static Data-Race Checker for OpenMP Programs

abstract: In the era of Exascale computing, writing efficient parallel programs is indispensable and at the same time, writing sound parallel programs is very difficult. Specifying parallelism with frameworks such as OpenMP is relatively easy, but data races in these programs are an important source of bugs. In this paper, we propose LLOV, a fast, lightweight, language agnostic, and static data race checker for OpenMP programs based on the LLVM compiler framework. We compare LLOV with other state-of-the-art data race checkers on a variety of well-established benchmarks. We show that the precision, accuracy, and the F1 score of LLOV is comparable to other checkers while being orders of magnitude faster. To the best of our knowledge, LLOV is the only tool among the state-of-the-art data race checkers that can verify a C/C++ or FORTRAN program to be data race free.


title: Tempered relaxation equation and related generalized stable processes

abstract: Fractional relaxation equations, as well as relaxation functions time-changed by independent stochastic processes have been widely studied (see, for example, \cite{MAI}, \cite{STAW} and \cite{GAR}). We start here by proving that the upper-incomplete Gamma function satisfies the tempered-relaxation equation (of index $\rho \in (0,1)$); thanks to this explicit form of the solution, we can then derive its spectral distribution, which extends the stable law. Accordingly, we define a new class of selfsimilar processes (by means of the $n$-times Laplace transform of its density) which is indexed by the parameter $\rho $: in the special case where $\rho =1$, it reduces to the stable subordinator. Therefore the parameter $\rho $ can be seen as a measure of the local deviation from the temporal dependence structure displayed in the standard stable case.


title: Explain Your Move: Understanding Agent Actions Using Specific and Relevant Feature Attribution

abstract: As deep reinforcement learning (RL) is applied to more tasks, there is a need to visualize and understand the behavior of learned agents. Saliency maps explain agent behavior by highlighting the features of the input state that are most relevant for the agent in taking an action. Existing perturbation-based approaches to compute saliency often highlight regions of the input that are not relevant to the action taken by the agent. Our proposed approach, SARFA (Specific and Relevant Feature Attribution), generates more focused saliency maps by balancing two aspects (specificity and relevance) that capture different desiderata of saliency. The first captures the impact of perturbation on the relative expected reward of the action to be explained. The second downweighs irrelevant features that alter the relative expected rewards of actions other than the action to be explained. We compare SARFA with existing approaches on agents trained to play board games (Chess and Go) and Atari games (Breakout, Pong and Space Invaders). We show through illustrative examples (Chess, Atari, Go), human studies (Chess), and automated evaluation methods (Chess) that SARFA generates saliency maps that are more interpretable for humans than existing approaches. For the code release and demo videos, see https://nikaashpuri.github.io/sarfa-saliency/.


title: Brain-to-Brain Communication Based on Wireless Technologies: Actual and Future Perspectives

abstract: During the last few years, intensive research efforts are being done in the field of brain interfaces to extract neuro-information from the signals representing neuronal activities in the human brain. Recent development of brain-to-computer interfaces support direct communication between animals' brains, enabling direct brain-to-brain communication. Although these results are based on binary communication with relaxed requirements of latency and throughput, the fast development in neuro-science technologies indicates potential new scenarios for wireless communications between brains. In this paper we highlight technologies that are being used today to enable brain-to-brain communication and propose potential wireless communication architectures and requirements for future scenarios.


title: EdgeDRNN: Enabling Low-latency Recurrent Neural Network Edge Inference

abstract: This paper presents a Gated Recurrent Unit (GRU) based recurrent neural network (RNN) accelerator called EdgeDRNN designed for portable edge computing. EdgeDRNN adopts the spiking neural network inspired delta network algorithm to exploit temporal sparsity in RNNs. It reduces off-chip memory access by a factor of up to 10x with tolerable accuracy loss. Experimental results on a 10 million parameter 2-layer GRU-RNN, with weights stored in DRAM, show that EdgeDRNN computes them in under 0.5 ms. With 2.42 W wall plug power on an entry level USB powered FPGA board, it achieves latency comparable with a 92 W Nvidia 1080 GPU. It outperforms NVIDIA Jetson Nano, Jetson TX2 and Intel Neural Compute Stick 2 in latency by 6X. For a batch size of 1, EdgeDRNN achieves a mean effective throughput of 20.2 GOp/s and a wall plug power efficiency that is over 4X higher than all other platforms.


title: The Tensor Pomeron and Small-x Deep Inelastic Scattering

abstract: We apply the tensor-pomeron model to small-$x$ deep-inelastic lepton-proton scattering and photoproduction. Our model includes a soft and a hard tensor pomeron as well as a reggeon contribution. Data with c.m. energies $6 < \sqrt{s} < 318$ GeV and virtualities $Q^2 < 50 \,\mbox{GeV}^2$ are considered. Our fit gives a very good description of the available data in this kinematic region, including the latest HERA data for $x < 0.01$. In particular, the transition region from low to high $Q^2$ is well described. Within the errors, the hard pomeron is absent in photoproduction. The intercepts of the soft and hard pomeron in the two-tensor-pomeron model are found to be $1.0935\, ({}^{+76}_{-64})$ and $1.3008 \,({}^{+73}_{-84})$, respectively. We argue that a vector pomeron would not give any contribution to photoproduction.


title: Effective results on uniformization and intrinsic GCM spheres in perturbations of Kerr

abstract: This is a follow-up of our paper \cite{KS-Kerr1} on the construction of general covariant modulated (GCM) spheres in perturbations of Kerr, which we expect to play a central role in establishing their nonlinear stability. We reformulate the main results of that paper using a canonical definition of $\ell=1$ modes on a $2$-sphere embedded in a $1+3$ vacuum manifold. This is based on a new, effective, version of the classical uniformization theorem which allows us to define such modes and prove their stability for spheres with comparable metrics. The reformulation allows us to prove a second, intrinsic, existence theorem for GCM spheres, expressed purely in terms of geometric quantities defined on it. A natural definition of angular momentum for such GCM spheres is also introduced, which we expect to play a key role in determining the final angular momentum for general perturbations of Kerr.

categories: math.AP gr-qc math-ph math.DG math.MP physics.class-ph


title: Improving pixel differentiation in holographic images

abstract: Computer generated holography (CGH) has seen a resurgence in recent years due, in part, to the rise of virtual and mixed reality systems. The majority of approaches for CGH are based on a sampled Discrete Fourier Transform (DFT) and ignore the interstitial behaviour between sampling points in the replay field. In this paper we demonstrate that neighbouring replay field pixels can interfere significantly giving the visual impression of pixel movement and increased noise. We also demonstrate that increasing the separation between target pixels reduces the interference and improves pixel quality. This phenomena is demonstrated experimentally with close agreement between model and measured result. This work begins by introducing the concept of pixel differentiation before showing simulated models of pixel differentiation issues. Two mitigation approaches are introduced and an experimental system is then used to validate the simulation. Finally results are discussed and conclusions drawn.


title: Experimental Demonstration of Learned Time-Domain Digital Back-Propagation

abstract: We present the first experimental demonstration of learned time-domain digital back-propagation (DBP), in 64-GBd dual-polarization 64-QAM signal transmission over 1014 km. Performance gains were comparable to those obtained with conventional, higher complexity, frequency-domain DBP.


title: Search for an exotic S=-2, Q=-2 baryon resonance in proton-proton interactions at $\sqrt{s_{NN}}$ = 17.3 GeV

abstract: Pentaquark states have been extensively investigated theoretically in the context of the constituent quark model. In this paper results of an experimental search for pentaquarks in the \Xim\pim, \Xim\pip, \Xip\pim and \Xip\pip invariant mass spectra in proton-proton interactions at $\sqrt{s}$=17.3~\GeV are presented. Previous possible evidence from the NA49 collaboration of the existence of a narrow \Xim\pim baryon resonance in p+p interactions is not confirmed with almost 10 times greater event statistics. The search was performed using the \NASixtyOne detector which reuses the main components of the NA49 apparatus. No signal was observed with either the selection cuts of NA49 or newly optimised cuts.


title: Relativistic compact stars in the Kuchowicz spacetime

abstract: We present an anisotropic charged analogue of Kuchowicz (1971) solution of the general relativistic field equations in curvature coordinates by using simple form of electric intensity $E$ and pressure anisotropy factor $\Delta$ that involve charge parameter $K$ and anisotropy parameter $\alpha$ respectively. Our solution is well behaved in all respects for all values of $X$ ( $X$ is related to the radius of the star ) lying in the range $0< X \le 0.6$, $\alpha$ lying in the range $0 \le \alpha \le 1.3$, $K$ lying in the range $0< K \le 1.75$ and Schwarzschild compactness parameter "$u$" lying in the range $0< u \le 0.338$. Since our solution is well behaved for a wide range of the parameters, we can model many different types of ultra-cold compact stars like quark stars and neutron stars. We present some models of super dense quark stars and neutron stars corresponding to $X=0.2,~\alpha=0.2$ and $K=0.5$ for which $u_{max}=0.15$. By assuming surface density $\rho_b=4.6888\times 10^{14}~ g/cc$ the mass and radius are $0.955 M_\odot$ and $9.439 km$ respectively. For $\rho_b=2.7\times 10^{14}~ g/cc$ the mass and radius are $1.259 M_\odot$ and $12.439 km$ respectively and for $\rho_b=2\times 10^{14}~ g/cc$ the mass and radius are $1.463 M_\odot$ and $14.453 km$ respectively. It is also shown that inclusion of more electric charge and anisotropy enhances the static stable configuration under radial perturbations. The $M-R$ graph suggests that the maximum mass of the configuration depends on the surface density {\bf i.e. with the increase of surface density} the maximum mass and corresponding radius decrease. This may be because of existence of exotic matters at higher densities that soften the EoSs.


title: A Generalization of Desargues' Involution Theorem

abstract: This paper states and proves a generalization of the well-known Desargues involution theorem from plane projective geometry.


title: The distribution of zeros of entire functions of exponential type with restrictions on growth along the imaginary axis

abstract: Let $g$ be a entire function of exponential type on the complex plane $\mathbb C$, $Z=\{ z_k\}_{k=1,2,\dots}$ be a sequence of points in $\mathbb C$. We give a criterion for the existence of an entire function $f\neq 0$ of exponential type that vanishes on $ Z$ and satisfies the constraint $\ln |f(iy)|\leq \ln |g(iy)|+o(|y|)$, $y\to \pm\infty$. Our results generalize and develop a joint results of P. Malliavin and L. A. Rubel. Applications to multipliers for entire functions of exponential type, to analytic functionals and their convolutions on the complex plane, as well as to the completeness of exponential systems in the spaces of locally analytic functions on compacts in terms of the width of these compacts are given.


title: Self-organization in many-body systems with short-range interactions: clustering, correlations and topology

abstract: We investigate the self-organization of point-particles with short-range interactions modeled via simple 1D and 2D Hubbard-like models. We show how various properties emerge such as, boson-like ordering leading to topological structures in real space, via the clustering of the particles at discrete energy levels, which can be analyzed using a network/graph mathematical language. We calculate analytically the number of clusters, the correlations between them and topological numbers like the Euler characteristic, deriving different organizational schemes and entanglement entropy scaling laws. All calculations are performed for an arbitrary number of particles N and energy of the system E. Our results demonstrate how orders with diverse topological/geometric and entanglement features, emerge in strongly interacting many-body systems, that follow minimal microscopic interaction rules.


title: Light flavor baryon production from small to large collision systems at ALICE

abstract: Studies of light hadron and nuclei production are fundamental to characterize the hot and dense fireball created in ultra-relativistic heavy ion collisions and to investigate hadronisation mechanisms at the LHC. Observables investigated as a function of the charged particle multiplicity in proton-proton and proton-lead collisions have shown features not expected and qualitatively similar to what has been observed in larger size colliding systems. The ALICE experiment, exploiting its excellent tracking and PID capabilities, has performed an extensive and systematic study of strange and non-strange hadrons, short-lived hadron resonances and light (anti-)(hyper-)nuclei. A critical overview of these results will be presented through comparison with the statistical hadronisation model.


title: Federated Imitation Learning: A Novel Framework for Cloud Robotic Systems with Heterogeneous Sensor Data

abstract: Humans are capable of learning a new behavior by observing others to perform the skill. Similarly, robots can also implement this by imitation learning. Furthermore, if with external guidance, humans can master the new behavior more efficiently. So, how can robots achieve this? To address the issue, we present a novel framework named FIL. It provides a heterogeneous knowledge fusion mechanism for cloud robotic systems. Then, a knowledge fusion algorithm in FIL is proposed. It enables the cloud to fuse heterogeneous knowledge from local robots and generate guide models for robots with service requests. After that, we introduce a knowledge transfer scheme to facilitate local robots acquiring knowledge from the cloud. With FIL, a robot is capable of utilizing knowledge from other robots to increase its imitation learning in accuracy and efficiency. Compared with transfer learning and meta-learning, FIL is more suitable to be deployed in cloud robotic systems. Finally, we conduct experiments of a self-driving task for robots (cars). The experimental results demonstrate that the shared model generated by FIL increases imitation learning efficiency of local robots in cloud robotic systems.


title: Pairs of positive radial solutions for a Minkowski-curvature Neumann problem with indefinite weight

abstract: We prove the existence of a pair of positive radial solutions for the Neumann boundary value problem \begin{equation*} \begin{cases} \, \mathrm{div}\,\Biggl{(} \dfrac{\nabla u}{\sqrt{1- | \nabla u |^{2}}}\Biggr{)} + \lambda a(|x|)u^p = 0, & \text{in $B$,} \\ \, \partial_{\nu}u=0, & \text{on $\partial B$,} \end{cases} \end{equation*} where $B$ is a ball centered at the origin, $a(|x|)$ is a radial sign-changing function with $\int_B a(|x|)\,\mathrm{d}x < 0$, $p>1$ and $\lambda > 0$ is a large parameter. The proof is based on the Leray-Schauder degree theory and extends to a larger class of nonlinearities.


title: Extended galactic rotational velocity profiles in $f(R)$ gravity background

abstract: An attempt has been made to explore the galactic dynamics via the rotational velocity beyond the Einstein's geometric theory of gravity. It is inspired from the geometric relation obtained in the power law $f(R)$ gravity model in vacuum. We analyse the action with a small positive deviation from the Einstein-Hilbert action (taking $R$ as $f(R)\propto R^{1+\delta}$) at the galactic scales for the explanation of cosmological dark matter problem and obtain the contribution of dynamical $f(R)$ background geometry in accelerating the test mass. In the weak field limits, we obtain the effective acceleration of the test mass due to a massive spherically symmetric source in $f(R)$ background and develop an equation for the rotational velocity. We test the viability of the model by tracing the motion of test mass outside the typical galactic visible boundaries without considering any dark matter halo profile. We obtain a nice agreement in the outer regions (up to few tens of kpc beyond the visible boundary) of the typical galaxy by using the known galaxy data.\\ We further explore the galactic dynamics for a galaxy NGC 1052 of which the dark matter deficient galaxies, i.e., DF2 and DF4 are a part (satellite galaxies) and discuss plots of the dynamical feature of rotation curves in $f(R)$ background for the model parameter $\delta<<1$ and interpret the results for its satellite galaxies.


title: Final Spitzer IRAC Observations of the Rise and Fall of SN 1987A

abstract: Spitzer's final Infrared Array Camera (IRAC) observations of SN 1987A show the 3.6 and 4.5 $\mu$m emission from the equatorial ring (ER) continues a period of steady decline. Deconvolution of the images reveals that the emission is dominated by the ring, not the ejecta, and is brightest on the west side. Decomposition of the marginally resolved emission also confirms this, and shows that the west side of the ER has been brightening relative to the other portions of the ER. The infrared (IR) morphological changes resemble those seen in both the soft X-ray emission and the optical emission. The integrated ER light curves at 3.6 and 4.5 $\mu$m are more similar to the optical light curves than the soft X-ray light curve, though differences would be expected if dust is responsible for this emission and its destruction is rapid. Future observations with the James Webb Space Telescope will continue to monitor the ER evolution, and will reveal the true spectrum and nature of the material responsible for the broadband emission at 3.6 and 4.5 $\mu$m. The present observations also serendipitously reveal a nearby variable source, subsequently identified as a Be star, that has gone through a multi-year outburst during the course of these observations.


title: Thin-shell wormholes in de Rham-Gabadadze-Tolley massive gravity

abstract: In this work, we study the thin-shell wormholes in dRGT massive gravity. In order to joint two bulks of the spacetime geometry, we first derive junction conditions of the dRGT spacetime. This results the dynamics of the spherical thin-shell wormholes in the dRGT theory. We show that the massive graviton correction term of the dRGT theory in the Einstein equation is represented in terms of the effective anisotropic pressure fluid. However, if there is only this correction term, without invoking exotic fluids, we find that the thin-shell wormholes can not be stabilized. We then examine the stability conditions of the wormholes by introducing four existing models of the exotic fluids at the throat. In addition, we analyze the energy conditions for the thin-shell wormholes in the dRGT massive gravity by checking the null, weak, and strong conditions at the wormhole throat. We show that in general the classical energy conditions are violated by introducing all existing models of the exotic fluids. Moreover, we quantify the wormhole geometry by using the embedding diagrams to represent a thin-shell wormhole in the dRGT massive gravity.


abstract: In Domain Adaptation (DA), the category-relevant losses usually occupy a dominant position, while they are usually built with hard or soft labels in existing models. We observed that hard labels are overconfident due to hard samples existed, and soft labels are ambiguous as too many small noisy probabilities involved, and both of them are easily to cause negative transfer. Besides, the category-irrelevant losses in Closed-Set DA (CSDA) paradigm fail to work in Open-Set DA (OSDA), and they also have to be in a category-relevant form, since target data samples are split into shared and private classes. To this end, we propose a newly-unified DA framework (i.e., Importance Filtered Cross-Domain Adaptation, IFCDA). Firstly, an importance filtered mechanism is devised to generate filtered soft labels to mitigate negative transfer desirably. Specifically, the soft labels are divided into confident and ambiguous ones. Then, only the maximum probability in each confident label is retained, and a threshold value is set to truncate each ambiguous label so that only prominent probabilities are reserved. Moreover, a general graph-based label propagation is contrived to attain soft labels in both CSDA and OSDA, where an extra component is embedded into label vector, so that it could detect target novel classes. Finally, the category-relevant losses in both scenarios are reformulated using filtered soft labels, while the category-irrelevant MMD loss in CSDA is reformulated as a form like class-wise MMD using newly-designed importance filtered soft labels. Notably, CSDA paradigm is a special case when all extra components are set to 0, thus the proposed approach is geared to both CSDA and OSDA. Comprehensive experiments on benchmark cross-domain object recognition datasets verify that the proposed approach outperforms several state-of-the-art methods in both scenarios.


title: Simplicial sets with a notion of smallness

abstract: We consider simplicial sets equipped with a notion of smallness, and observe that this slight "topological" extension of the "algebraic" simplicial language allows a concise reformulation of a number of classical notions in topology, e.g. continuity, limit of a map or a sequence along a filter, various notions of equicontinuity and uniform convergence of a sequence of functions; completeness and compactness; in algebraic topology, locally trivial bundles as a direct product after base-change and geometric realisation as a space of discontinuous paths. In model theory, we observe that indiscernible sequences in a model form a simplicial set with a notion of smallness which can be seen as an analogue of the Stone space of types. These reformulations are presented as a series of exercises, to emphasise their elementary nature and that they indeed can be used as exercises to make a student familiar with computations in basic simplicial and topological language. (Formally, we consider the category of simplicial objects in the category of filters in the sense of Bourbaki.) This work is unfinished and is likely to remain such for a while, hence we release it as is, in the small hope that our reformulations may provide interesting examples of computations in basic simplicial and topological language on material familiar to a student in a first course of topology or category theory.


title: Nonlinear Markov Clustering by Minimum Curvilinear Sparse Similarity

abstract: The development of algorithms for unsupervised pattern recognition by nonlinear clustering is a notable problem in data science. Markov clustering (MCL) is a renowned algorithm that simulates stochastic flows on a network of sample similarities to detect the structural organization of clusters in the data, but it has never been generalized to deal with data nonlinearity. Minimum Curvilinearity (MC) is a principle that approximates nonlinear sample distances in the high-dimensional feature space by curvilinear distances, which are computed as transversal paths over their minimum spanning tree, and then stored in a kernel. Here we propose MC-MCL, which is the first nonlinear kernel extension of MCL and exploits Minimum Curvilinearity to enhance the performance of MCL in real and synthetic data with underlying nonlinear patterns. MC-MCL is compared with baseline clustering methods, including DBSCAN, K-means and affinity propagation. We find that Minimum Curvilinearity provides a valuable framework to estimate nonlinear distances also when its kernel is applied in combination with MCL. Indeed, MC-MCL overcomes classical MCL and even baseline clustering algorithms in different nonlinear datasets.


title: Block-encoding based quantum algorithm for linear systems with displacement structures

abstract: Matrices with the displacement structures of circulant, Toeplitz, and Hankel types as well as matrices with structures generalizing these types are omnipresent in computations of sciences and engineering. In this paper, we present efficient and memory-reduced quantum algorithms for solving linear systems with such structures by devising a new approach to implement the block-encodings of these structured matrices. More specifically, by decomposing $n\times n$ dense matrices into linear combinations of displacement matrices, we first deduce the parameterized representations of the matrices with displacement structures so that they can be treated similarly. With such representations, we then construct $\epsilon$-approximate block-encodings of these structured matrices in two different data access models, i.e., the black-box model and the QRAM data structure model. It is shown the quantum linear system solvers based on the proposed block-encodings provide a quadratic speedup with respect to the dimension over classical algorithms in the black-box model and an exponential speedup in the QRAM data structure model. In particular, these linear system solvers subsume known results with significant improvements and also motivate new instances where there was no specialized quantum algorithm before. As an application, one of the quantum linear system solvers is applied to the linear prediction of time series, which justifies the claimed quantum speedup is achievable for problems of practical interest.


title: Minimax Semiparametric Learning With Approximate Sparsity

abstract: This paper is about the feasibility and means of root-n consistently estimating linear, mean-square continuous functionals of a high dimensional, approximately sparse regression. Such objects include a wide variety of interesting parameters such as regression coefficients, average derivatives, and the average treatment effect. We give lower bounds on the convergence rate of estimators of a regression slope and an average derivative and find that these bounds are substantially larger than in a low dimensional, semiparametric setting. We also give debiased machine learners that are root-n consistent under either a minimal approximate sparsity condition or rate double robustness. These estimators improve on existing estimators in being root-n consistent under more general conditions that previously known.


title: Job Prediction: From Deep Neural Network Models to Applications

abstract: Determining the job is suitable for a student or a person looking for work based on their job's descriptions such as knowledge and skills that are difficult, as well as how employers must find ways to choose the candidates that match the job they require. In this paper, we focus on studying the job prediction using different deep neural network models including TextCNN, Bi-GRU-LSTM-CNN, and Bi-GRU-CNN with various pre-trained word embeddings on the IT Job dataset. In addition, we also proposed a simple and effective ensemble model combining different deep neural network models. The experimental results illustrated that our proposed ensemble model achieved the highest result with an F1 score of 72.71%. Moreover, we analyze these experimental results to have insights about this problem to find better solutions in the future.


title: Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generation

abstract: In this paper, we address the task of semantic-guided scene generation. One open challenge in scene generation is the difficulty of the generation of small objects and detailed local texture, which has been widely observed in global image-level generation methods. To tackle this issue, in this work we consider learning the scene generation in a local context, and correspondingly design a local class-specific generative network with semantic maps as a guidance, which separately constructs and learns sub-generators concentrating on the generation of different classes, and is able to provide more scene details. To learn more discriminative class-specific feature representations for the local generation, a novel classification module is also proposed. To combine the advantage of both the global image-level and the local class-specific generation, a joint generation network is designed with an attention fusion module and a dual-discriminator structure embedded. Extensive experiments on two scene image generation tasks show superior generation performance of the proposed model. The state-of-the-art results are established by large margins on both tasks and on challenging public benchmarks. The source code and trained models are available at https://github.com/Ha0Tang/LGGAN.


title: Entanglement entropy of physical states in hypercuboidally truncated spin foam quantum gravity

abstract: In this article we consider physical states in the hypercuboidal truncation of the EPRL-FK spin foam quantum gravity model. In particular, these states are defined on graphs which allow considering the entanglement entropy (EE) associated to the bipartition of space. We compute the EE numerically for some examples, and find that it depends on the coupling constants within the theory. We also find that there appears a maximum of the EE within the region of the coupling constant containing the non-Gaussian fixed point of the RG flow of the truncated model. We discuss the relation of this behaviour with the restoration of diffeomorphism symmetry at the fixed point.


title: Repeating fast radio bursts with WSRT/Apertif

abstract: Repeating fast radio bursts (FRBs) present excellent opportunities to identify FRB progenitors and host environments, as well as decipher the underlying emission mechanism. Detailed studies of repeating FRBs might also hold clues to the origin of FRBs as a population. We aim to detect the first two repeating FRBs: FRB 121102 (R1) and FRB 180814.J0422+73 (R2), and characterise their repeat statistics. We also want to significantly improve the sky localisation of R2. We use the Westerbork Synthesis Radio Telescope to conduct extensive follow-up of these two repeating FRBs. The new phased-array feed system, Apertif, allows covering the entire sky position uncertainty of R2 with fine spatial resolution in one pointing. We characterise the energy distribution and the clustering of detected R1 bursts. We detected 30 bursts from R1. Our measurements indicate a dispersion measure of 563.5(2) pc cm$^{-3}$, suggesting a significant increase in DM over the past few years. We place an upper limit of 8% on the linear polarisation fraction of the brightest burst. We did not detect any bursts from R2. A single power-law might not fit the R1 burst energy distribution across the full energy range or widely separated detections. Our observations provide improved constraints on the clustering of R1 bursts. Our stringent upper limits on the linear polarisation fraction imply a significant depolarisation, either intrinsic to the emission mechanism or caused by the intervening medium, at 1400 MHz that is not observed at higher frequencies. The non-detection of any bursts from R2 implies either a highly clustered nature of the bursts, a steep spectral index, or a combination of both. Alternatively, R2 has turned off completely, either permanently or for an extended period of time.


title: Thunder and Lightning: Using Neutron-Star Mergers as Simultaneous Standard Candles and Sirens to Measure Cosmological Parameters

abstract: With the detection of gravitational wave (GW) GW170817 and its associated electromagnetic (EM) counterparts from a binary neutron star (NS) merger, the "standard siren" method for Hubble-constant measurements is expected to play a role in the Hubble-constant tension in the next few years. One intriguing proposal put forward in multiple studies is to use an NS merger's optical counterpart, known as a kilonova, as a standard candle, because its absolute magnitude can in principle be calculated from simulations. In this work, I detail the statistical framework for performing joint standard-candle and standard-siren measurements using GWs, EM follow-up data, and simulations of EM counterparts. I then perform an example analysis using GW170817 and its optical counterpart AT2017gfo to illustrate the method and the method's limitations. Crucially, the inferences using this method are only as robust as the EM counterpart models, so significant theoretical advances are needed before this method can be employed for precision cosmology.


title: Quantum Pairing Time Orders

abstract: We propose the concept of the time-independent correlators for the even- and odd-frequency pairing states that can be defined for both bosonic and fermionic quasiparticles. These correlators explicitly capture the existence of two distinct classes of pairing states and provide a direct probe of the hidden Berezinskii order. This concept is illustrated in the cases of pairings for Majorana fermions and quasiparticles in Dirac semimetals. It is shown that the time-independent correlator is able to effectively capture the energy scale relevant for pairing.


title: On Network Traffic Forecasting using Autoregressive Models

abstract: Various statistical analysis methods are studied for years to extract accurate trends of network traffic and predict the future load mainly to allocate required resources. Besides, many stochastic modeling techniques are offered to represent fundamental characteristics of different types of network traffic. In this study, we analyze autoregressive traffic forecasting techniques considering their popularity and wide-use in the domain. In comparison to similar works, we present important traffic characteristics and discussions from the literature to create a self-consistent guidance along with the survey. Then, we approach to techniques in the literature revealing which network characteristics they can capture offering a characteristic-based framework. Most importantly, we aim to fill the gap between the statistical analysis of those methods and their relevance with networking by discussing significant aspects and requirements for accurate forecasting from a network-telemetric perspective.


title: Detecting DDoS Attack on SDN Due to Vulnerabilities in OpenFlow

abstract: Software Defined Networking (SDN) is a network paradigm shift that facilitates comprehensive network programmability to cope with emerging new technologies such as cloud computing and big data. SDN facilitates simplified and centralized network management enabling it to operate in dynamic scenarios. Further, SDN uses the OpenFlow protocol for communication between the controller and its switches. The OpenFlow creates vulnerabilities for network attacks especially Distributed Denial of Service (DDoS). DDoS attacks are launched from the compromised hosts connected to the SDN switches. In this paper, we introduce a time- and space-efficient solution for the identification of these compromised hosts. Our solution consumes less computational resources and space and does not require any special equipment.


title: Efficient Quantum Tomography of Two-Mode Wigner Functions

abstract: We introduce an efficient method to reconstruct the Wigner function of many-mode continuous variable systems. It is based on convex optimization with semidefinite programs, and also includes a version of the maximum entropy principle, in order to yield unbiased states. A key ingredient of the proposed approach is the representation of the state in a truncated Fock basis. As a bonus, the discrete finite representation allows to easily quantify the entanglement.


title: Bitopological Duality for Algebras of Fittings logic and Natural Duality extension

abstract: In this paper, we investigate a bitopological duality for algebras of Fitting's multi-valued logic. We also extend the natural duality theory for $\mathbb{ISP_I}(\mathcal{L})$ by developing a duality for $\mathbb{ISP}(\mathcal{L})$, where $\mathcal{L}$ is a finite algebra in which underlying lattice is bounded distributive.


title: Controllability of Linear Dynamical Systems Under Input Sparsity Constraints

abstract: In this work, we consider the controllability of a discrete-time linear dynamical system with sparse control inputs. Sparsity constraints on the input arises naturally in networked systems, where activating each input variable adds to the cost of control. We derive algebraic necessary and sufficient conditions for ensuring controllability of a system with an arbitrary transfer matrix. The derived conditions can be verified in polynomial time complexity, unlike the more traditional Kalman-type rank tests. Further, we characterize the minimum number of input vectors required to satisfy the derived conditions for controllability. Finally, we present a generalized Kalman decomposition-like procedure that separates the state-space into subspaces corresponding to sparse-controllable and sparse-uncontrollable parts. These results form a theoretical basis for designing networked linear control systems with sparse inputs.