title: Lossy Compression with Distortion Constrained Optimization

abstract: When training end-to-end learned models for lossy compression, one has to balance the rate and distortion losses. This is typically done by manually setting a tradeoff parameter $\beta$, an approach called $\beta$-VAE. Using this approach it is difficult to target a specific rate or distortion value, because the result can be very sensitive to $\beta$, and the appropriate value for $\beta$ depends on the model and problem setup. As a result, model comparison requires extensive per-model $\beta$-tuning, and producing a whole rate-distortion curve (by varying $\beta$) for each model to be compared. We argue that the constrained optimization method of Rezende and Viola, 2018 is a lot more appropriate for training lossy compression models because it allows us to obtain the best possible rate subject to a distortion constraint. This enables pointwise model comparisons, by training two models with the same distortion target and comparing their rate. We show that the method does manage to satisfy the constraint on a realistic image compression task, outperforms a constrained optimization method based on a hinge-loss, and is more practical to use for model selection than a $\beta$-VAE.


title: Fast Automatic Visibility Optimization for Thermal Synthetic Aperture Visualization

abstract: In this article, we describe and validate the first fully automatic parameter optimization for thermal synthetic aperture visualization. It replaces previous manual exploration of the parameter space, which is time consuming and error prone. We prove that the visibility of targets in thermal integral images is proportional to the variance of the targets' image. Since this is invariant to occlusion it represents a suitable objective function for optimization. Our findings have the potential to enable fully autonomous search and recuse operations with camera drones.


title: Some observations on the Rueppel sequence and associated Hankel determinants

abstract: Starting with a definition based on the Catalan numbers, we carry out an empirical study of the Rueppel sequence. We use the Hankel transform as the main technique. By means of this transform we find links to such sequences as the Jacobi sequence and the paper-folding sequence. We also study several number arrays defined by this sequence, which are analogs of the important Catalan triangles of combinatorics. We identify a sequence related to the Golay-Rudin-Shapiro sequence that plays a fundamental role in linking the Hankel transforms of the paper with classical sequences. Examples are given where certain privileged permutations appearing in the Leibnitz formula for determinants have a special role.


title: Active Preference Learning using Maximum Regret

abstract: We study active preference learning as a framework for intuitively specifying the behaviour of autonomous robots. In active preference learning, a user chooses the preferred behaviour from a set of alternatives, from which the robot learns the user's preferences, modeled as a parameterized cost function. Previous approaches present users with alternatives that minimize the uncertainty over the parameters of the cost function. However, different parameters might lead to the same optimal behaviour; as a consequence the solution space is more structured than the parameter space. We exploit this by proposing a query selection that greedily reduces the maximum error ratio over the solution space. In simulations we demonstrate that the proposed approach outperforms other state of the art techniques in both learning efficiency and ease of queries for the user. Finally, we show that evaluating the learning based on the similarities of solutions instead of the similarities of weights allows for better predictions for different scenarios.


title: Communication memento: Memoryless communication complexity

abstract: We study the communication complexity of computing functions $F:\{0,1\}^n\times \{0,1\}^n \rightarrow \{0,1\}$ in the memoryless communication model. Here, Alice is given $x\in \{0,1\}^n$, Bob is given $y\in \{0,1\}^n$ and their goal is to compute F(x,y) subject to the following constraint: at every round, Alice receives a message from Bob and her reply to Bob solely depends on the message received and her input x; the same applies to Bob. The cost of computing F in this model is the maximum number of bits exchanged in any round between Alice and Bob (on the worst case input x,y). In this paper, we also consider variants of our memoryless model wherein one party is allowed to have memory, the parties are allowed to communicate quantum bits, only one player is allowed to send messages. We show that our memoryless communication model capture the garden-hose model of computation by Buhrman et al. (ITCS'13), space bounded communication complexity by Brody et al. (ITCS'13) and the overlay communication complexity by Papakonstantinou et al. (CCC'14). Thus the memoryless communication complexity model provides a unified framework to study space-bounded communication models. We establish the following: (1) We show that the memoryless communication complexity of F equals the logarithm of the size of the smallest bipartite branching program computing F (up to a factor 2); (2) We show that memoryless communication complexity equals garden-hose complexity; (3) We exhibit various exponential separations between these memoryless communication models. We end with an intriguing open question: can we find an explicit function F and universal constant c>1 for which the memoryless communication complexity is at least $c \log n$? Note that $c\geq 2+\varepsilon$ would imply a $\Omega(n^{2+\varepsilon})$ lower bound for general formula size, improving upon the best lower bound by Ne\v{c}iporuk in 1966.


title: Multi-Phase Cross-modal Learning for Noninvasive Gene Mutation Prediction in Hepatocellular Carcinoma

abstract: Hepatocellular carcinoma (HCC) is the most common type of primary liver cancer and the fourth most common cause of cancer-related death worldwide. Understanding the underlying gene mutations in HCC provides great prognostic value for treatment planning and targeted therapy. Radiogenomics has revealed an association between non-invasive imaging features and molecular genomics. However, imaging feature identification is laborious and error-prone. In this paper, we propose an end-to-end deep learning framework for mutation prediction in APOB, COL11A1 and ATRX genes using multiphasic CT scans. Considering intra-tumour heterogeneity (ITH) in HCC, multi-region sampling technology is implemented to generate the dataset for experiments. Experimental results demonstrate the effectiveness of the proposed model.


title: Fluid-Structure Interaction Simulation of a Coriolis Mass Flowmeter using a Lattice Boltzmann Method

abstract: In this paper we use a fluid-structure interaction (FSI) approach to simulate a Coriolis mass flowmeter (CMF). The fluid dynamics are calculated by the open source framework OpenLB, based on the lattice Boltzmann method (LBM). For the structural dynamics we employ the open source software Elmer, an implementation of the finite element method (FEM). A staggered coupling approach between the two software packages is presented. The finite element mesh is created by the mesh generator Gmsh to ensure a complete open source workflow. The Eigenmodes of the CMF, which are calculated by modal analysis are compared with measurement data. Using the estimated excitation frequency, a fully coupled, partitioned, FSI simulation is applied to simulate the phase shift of the investigated CMF design. The calculated phaseshift values are in good agreement to the measurement data and verify the suitability of the model to numerically describe the working principle of a CMF.


title: Thresholdless excitation of edge plasmons by transverse current

abstract: We theoretically demonstrate that dc electron flow across the junction of two-dimensional electron systems leads to excitation of edge magnetoplasmons. The threshold current for such plasmon excitation does not depend on contact effects and approaches zero for ballistic electron systems, which makes a strong distinction from the well-known Dyakonov-Shur and Cerenkov-type instabilities. We estimate the competing plasmon energy gain from dc current and loss due to electron scattering. We show that plasmon self excitation is feasible in GaAs-based heterostructures at $T\lesssim 200$ K and magnetic fields $B \lesssim 10$ T.


title: Precision measurement of the $E2$ transition strength to the 2$^+_1$ state of $^{12}$C

abstract: The form factor of the electromagnetic excitation of $^{12}$C to its 2$^+_1$ state was measured at extremely low momentum transfers in an electron scattering experiment at the S-DALINAC. A combined analysis with the world form factor data results in a reduced transition strength $B(E2; 2^+_1\rightarrow 0^+_1) =7.63(19)$ e$^2$fm$^4$ with an accuracy improved to 2.5\%. In-Medium-No Core Shell Model results with interactions derived from chiral effective field theory are capable to reproduce the result. A quadrupole moment $Q(2^+_1) = 5.97(30)$ efm$^2$ can be extracted from the strict correlation with the $B((E2)$ strength emerging in the calculations.


title: Multi-Instance Multi-Label Learning for Gene Mutation Prediction in Hepatocellular Carcinoma

abstract: Gene mutation prediction in hepatocellular carcinoma (HCC) is of great diagnostic and prognostic value for personalized treatments and precision medicine. In this paper, we tackle this problem with multi-instance multi-label learning to address the difficulties on label correlations, label representations, etc. Furthermore, an effective oversampling strategy is applied for data imbalance. Experimental results have shown the superiority of the proposed approach.


title: Adversarial Graph Embeddings for Fair Influence Maximization over Social Networks

abstract: Influence maximization is a widely studied topic in network science, where the aim is to reach the maximum possible number of nodes, while only targeting a small initial set of individuals. It has critical applications in many fields, including viral marketing, information propagation, news dissemination, and vaccinations. However, the objective does not usually take into account whether the final set of influenced nodes is fair with respect to sensitive attributes, such as race or gender. Here we address fair influence maximization, aiming to reach minorities more equitably. We introduce Adversarial Graph Embeddings: we co-train an auto-encoder for graph embedding and a discriminator to discern sensitive attributes. This leads to embeddings which are similarly distributed across sensitive attributes. We then find a good initial set by clustering the embeddings. We believe we are the first to use embeddings for the task of fair influence maximization. While there are typically trade-offs between fairness and influence maximization objectives, our experiments on synthetic and real-world datasets show that our approach dramatically reduces disparity while remaining competitive with state-of-the-art influence maximization methods.


title: The formation of the young massive cluster B1 in the Antennae galaxies (NGC 4038/NGC 4039) triggered by cloud-cloud collision

abstract: The Antennae Galaxies is one of the starbursts in major mergers. Tsuge et al. (2020) showed that the five giant molecular complexes in the Antennae Galaxies have signatures of cloud-cloud collisions based on the ALMA archival data at 60 pc resolution. In the present work we analyzed the new CO data toward the super star cluster (SSC) B1 at 14 pc resolution obtained with ALMA, and confirmed that two clouds show complementary distribution with a displacement of $\sim$70 pc as well as the connecting bridge features between them. The complementary distribution shows a good correspondence with the theoretical collision model (Takahira et al. 2014), and indicates that SSC B1 having $\sim$10$^{6}$ $M$$_{\odot}$ was formed by the trigger of a cloud-cloud collision with a time scale of $\sim$1Myr, which is consistent with the cluster age. It is likely that SSC B1 was formed from molecular gas of $\sim$10$^{7}$ $M$$_{\odot}$ with a star formation efficiency of $\sim$10 % in 1 Myr. We identified a few places where additional clusters are forming. Detailed gas motion indicates stellar feedback in accelerating gas is not effective, while ionization plays a role in evacuating the gas around the clusters at a $\sim$30-pc radius. The results have revealed the details of the parent gas where a cluster having mass similar to a globular is being formed.


title: On the use of Data-Driven Cost Function Identification in Parametrized NMPC

abstract: In this paper, a framework with complete numerical investigation is proposed regarding the feasibility of constrained Nonlinear Model Predictive Control (NMPC) design using Data-Driven model of the cost function. Although the idea is very much in the air, this paper proposes a complete implementation using python modules that are made freely available on a GitHub repository. Moreover, a discussion regarding the different ways of deriving control via data-driven modeling is proposed that can be of interest to practitioners.


title: Distributed Model Predictive Control with Asymmetric Adaptive Terminal Sets for the Regulation of Large-scale Systems

abstract: In this paper, a novel distributed model predictive control (MPC) scheme with asymmetric adaptive terminal sets is developed for the regulation of large-scale systems with a distributed structure. Similar to typical MPC schemes, a structured Lyapunov matrix and a distributed terminal controller, respecting the distributed structure of the system, are computed offline. However, in this scheme, a distributed positively invariant terminal set is computed online and updated at each time instant taking into consideration the current state of the system. In particular, we consider ellipsoidal terminal sets as they are easy to compute for large-scale systems. The size and the center of these terminal sets, together with the predicted state and input trajectories, are considered as decision variables in the online phase. Determining the terminal set center online is found to be useful specifically in the presence of asymmetric constraints. Finally, a relaxation of the resulting online optimal control problem is provided. The efficacy of the proposed scheme is illustrated in simulation by comparing it to a recent distributed MPC scheme with adaptive terminal sets.


title: A Sim2Real Deep Learning Approach for the Transformation of Images from Multiple Vehicle-Mounted Cameras to a Semantically Segmented Image in Bird's Eye View

abstract: Accurate environment perception is essential for automated driving. When using monocular cameras, the distance estimation of elements in the environment poses a major challenge. Distances can be more easily estimated when the camera perspective is transformed to a bird's eye view (BEV). For flat surfaces, Inverse Perspective Mapping (IPM) can accurately transform images to a BEV. Three-dimensional objects such as vehicles and vulnerable road users are distorted by this transformation making it difficult to estimate their position relative to the sensor. This paper describes a methodology to obtain a corrected 360{\deg} BEV image given images from multiple vehicle-mounted cameras. The corrected BEV image is segmented into semantic classes and includes a prediction of occluded areas. The neural network approach does not rely on manually labeled data, but is trained on a synthetic dataset in such a way that it generalizes well to real-world data. By using semantically segmented images as input, we reduce the reality gap between simulated and real-world data and are able to show that our method can be successfully applied in the real world. Extensive experiments conducted on the synthetic data demonstrate the superiority of our approach compared to IPM. Source code and datasets are available at https://github.com/ika-rwth-aachen/Cam2BEV


title: Upper bounds of nodal sets for eigenfunctions of eigenvalue problems

abstract: The aim of this article is to provide a simple and unified way to obtain the sharp upper bounds of nodal sets of eigenfunctions for different types of eigenvalue problems on real analytic domains. The examples include biharmonic Steklov eigenvalue problems, buckling eigenvalue problems and champed-plate eigenvalue problems. The geometric measure of nodal sets are derived from doubling inequalities and growth estimates for eigenfunctions. It is done through analytic estimates of Morrey-Nirenberg and Carleman estimates.


title: An optomechanical discrete variable quantum teleportation scheme

abstract: We propose an experimental protocol to realize discrete variable quantum teleportation using optomechanical devices. The photonic polarization superposition state of a single photon is teleported to a phononic superposition of two micromechanical oscillators by means of photon/phonon entanglement generation and optical Bell state measurement using two-photon interference. Verification of the protocol is performed by coherent state transfer between the mechanical devices and light. Simulations show the feasibility of the proposed scheme at millikelvin temperatures using state-of-the-art gigahertz optomechanical devices.


title: Geometric graphs from data to aid classification tasks with graph convolutional networks

abstract: Traditional classification tasks learn to assign samples to given classes based solely on sample features. This paradigm is evolving to include other sources of information, such as known relations between samples. Here we show that, even if additional relational information is not available in the data set, one can improve classification by constructing geometric graphs from the features themselves, and using them within a Graph Convolutional Network. The improvement in classification accuracy is maximized by graphs that capture sample similarity with relatively low edge density. We show that such feature-derived graphs increase the alignment of the data to the ground truth while improving class separation. We also demonstrate that the graphs can be made more efficient using spectral sparsification, which reduces the number of edges while still improving classification performance. We illustrate our findings using synthetic and real-world data sets from various scientific domains.


title: Self-localized Solitons of a q-Deformed Quantum System

abstract: Beyond a pure mathematical interest, q-deformation is promising for the modeling and interpretation of various physical phenomena. In this paper, we numerically investigate the existence and properties of the self-localized soliton solutions of the nonlinear Schr\"{o}dinger equation (NLSE) with a q-deformed Rosen-Morse potential. By implementing a Petviashvili method (PM), we obtain the self-localized one and two soliton solutions of the NLSE with a q-deformed Rosen-Morse potential. In order to investigate the temporal behavior and stabilities of these solitons, we implement a Fourier spectral method with a $4^{th}$ order Runge-Kutta time integrator. We observe that the self-localized one and two solitons are stable and remain bounded with a pulsating behavior and minor changes in the sidelobes of the soliton waveform. Additionally, we investigate the stability and robustness of these solitons under noisy perturbations. A sinusoidal monochromatic wave field modeled within the frame of the NLSE with a q-deformed Rosen-Morse potential turns into a chaotic wavefield and exhibits rogue oscillations due to modulation instability triggered by noise, however, the self-localized solitons of the NLSE with a q-deformed Rosen-Morse potential are stable and robust under the effect of noise. We also show that soliton profiles can be reconstructed after a denoising process performed using a Savitzky-Golay filter.


title: Fluctuational Electrodynamics in Atomic and Macroscopic Systems: van der Waals Interactions and Radiative Heat Transfer

abstract: We present an approach to describing fluctuational electrodynamic (FED) interactions, particularly van der Waals (vdW) interactions as well as radiative heat transfer (RHT), between material bodies of vastly different length scales, allowing for going between atomistic and continuum treatments of the response of each of these bodies as desired. Any local continuum description of electromagnetic (EM) response is compatible with our approach, while atomistic descriptions in our approach are based on effective electronic and nuclear oscillator degrees of freedom, encapsulating dissipation, short-range electronic correlations, and collective nuclear vibrations (phonons). While our previous works using this approach have focused on presenting novel results, this work focuses on the derivations underlying these methods. First, we show how the distinction between "atomic" and "macroscopic" bodies is ultimately somewhat arbitrary, as formulas for vdW free energies and RHT look very similar regardless of how the distinction is drawn. Next, we demonstrate that the atomistic description of material response in our approach yields EM interaction matrix elements which are expressed in terms of analytical formulas for compact bodies or semianalytical formulas based on Ewald summation for periodic media; we use this to compute vdW interaction free energies as well as RHT powers among small biological molecules in the presence of a metallic plate as well as between parallel graphene sheets in vacuum, showing strong deviations from conventional macroscopic theories due to the confluence of geometry, phonons, and EM retardation effects. Finally, we propose formulas for efficient computation of FED interactions among material bodies in which those that are treated atomistically as well as those treated through continuum methods may have arbitrary shapes, extending previous surface-integral techniques.


title: Quasinormal modes and black hole hairs in AdS

abstract: Holography relates the quasinormal modes frequencies of AdS black holes to the pole structure of the dual field theory propagator. These modes thus provide the timescale for the approach to thermal equilibrium in the CFT. Here, we study how such pole structure and, in particular, the time to equilibrium can get modified in the presence of a black hole hair. More precisely, we consider in AdS a set of relaxed boundary conditions that allow for a low decaying graviton mode near the boundary, which triggers an additional degree of freedom. We solve the scalar field response on such background analytically and non-perturbatively in the hair parameter, and we obtain how the pole structure gets affected by the presence of a black hole hair, relative to that of the usual AdS black hole geometry. The setup we consider is a massive 3D gravity theory, which admits a one-parameter family deformation of BTZ solution and enables us to solve the problem analytically. The theory also admits an AdS$_3$ soliton which gives a family of vacua that can be constructed from the hairy black hole by means of a double Wick rotation. The spectrum of normal modes on the latter geometry can also be solved analytically; we study its properties in relation to those of the AdS$_3$ vacuum.


title: Constraining superheavy decaying dark matter with directional ultra-high energy gamma-ray limits

abstract: Dwarf spheroidal galaxies are compact stellar objects with small or negligible astrophysical backgrounds, widely considered as promising targets to search for a signal from the dark matter decay and annihilation. We present constraints on the lifetime of the superheavy decaying dark matter branching to the $q\bar{q}$ channel in the mass range $10^{19} - 10^{25}$ eV based on the directional limits on the ultra-high-energy (UHE) gamma rays obtained by the Pierre Auger Observatory and the Telescope Array experiment. Attenuation effects during the propagation of UHE photons towards Earth are taken into account, with the strongest constraints derived for the Ursa Major II, Coma Berenices and Segue I galaxies.


title: On J-holomorphic variational vector fields and extremal discs

abstract: We prove that every $J$-holomorphic variational vector field can be realized as derivation $\frac{d}{dt}_{|t=0}f_t$ where $(f_t)$ is a one parametric family of $J$-holomorphic discs. Furthermore, we discuss properness of an extremal $J$-holomorphic disc in a bounded pseudoconvex domain.


title: The Mathieu unit cell as a template for low emittance lattices

abstract: The multi-bend achromat (MBA), which often serves as a building block for modern low-emittance storage rings, is composed of a repetition of unit cells with optimized optical functions for low emittance in the achromat center, as well as end cells for dispersion and optics matching to insertion devices. In this work, we describe the simplest stable class of unit cells that are based on a longitudinal Fourier expansion, transforming Hill equations to Mathieu equations. The resulting cell class exhibits continuously changing dipolar and quadrupolar moments along the beam path. Although this elementary model is defined by only three parameters, it captures a significant amount of notions that are applied in the design of MBAs. This is especially interesting as Mathieu cells can be viewed as an elementary extension of Christofilos' original model of alternating-gradient focusing, while their sinusoidal bending and focusing functions lend themselves to future applications in undulator-like structures. Mathieu cells can be used to estimate the range of reasonable cell tunes and put an emphasis on the combination of longitudinal gradient bending and reverse bending, as well as on strong horizontal focusing to reach emittances lower than the classic theoretical minimum emittance cell. Furthermore, the lowest emittances in this model are accompanied by small absolute momentum compaction factors.


title: Automatic Cross-Domain Transfer Learning for Linear Regression

abstract: Transfer learning research attempts to make model induction transferable across different domains. This method assumes that specific information regarding to which domain each instance belongs is known. This paper helps to extend the capability of transfer learning for linear regression problems to situations where the domain information is uncertain or unknown; in fact, the framework can be extended to classification problems. For normal datasets, we assume that some latent domain information is available for transfer learning. The instances in each domain can be inferred by different parameters. We obtain this domain information from the distribution of the regression coefficients corresponding to the explanatory variable $x$ as well as the response variable $y$ based on a Dirichlet process, which is more reasonable. As a result, we transfer not only variable $x$ as usual but also variable $y$, which is challenging since the testing data have no response value. Previous work mainly overcomes the problem via pseudo-labelling based on transductive learning, which introduces serious bias. We provide a novel framework for analysing the problem and considering this general situation: the joint distribution of variable $x$ and variable $y$. Furthermore, our method controls the bias well compared with previous work. We perform linear regression on the new feature space that consists of different latent domains and the target domain, which is from the testing data. The experimental results show that the proposed model performs well on real datasets.


title: How Reliable are Bootstrap-based Heteroskedasticity Robust Tests?

abstract: We develop theoretical finite-sample results concerning the size of wild bootstrap-based heteroskedasticity robust tests in linear regression models. In particular, these results provide an efficient diagnostic check, which can be used to weed out tests that are unreliable for a given testing problem in the sense that they overreject substantially. This allows us to assess the reliability of a large variety of wild bootstrap-based tests in an extensive numerical study.


title: Trapped surface formation for spherically symmetric Einstein-Maxwell-charged scalar field system with double null foliation

abstract: In this paper, under spherical symmetry we prove a trapped surface formation criterion for the Einstein-Maxwell-charged scalar field system. We generalize an approach introduced by Christodoulou for studying the Einstein-scalar field. In appendix, with double null foliation we also reprove Christodoulou's result and for Minkowskian incoming characteristic initial data, we improve Christodoulou's bound.


title: TIRAMISU: A Polyhedral Compiler for Dense and Sparse Deep Learning

abstract: In this paper, we demonstrate a compiler that can optimize sparse and recurrent neural networks, both of which are currently outside of the scope of existing neural network compilers (sparse neural networks here stand for networks that can be accelerated with sparse tensor algebra techniques). Our demonstration includes a mapping of sparse and recurrent neural networks to the polyhedral model along with an implementation of our approach in TIRAMISU, our state-of-the-art polyhedral compiler. We evaluate our approach on a set of deep learning benchmarks and compare our results with hand-optimized industrial libraries. Our results show that our approach at least matches Intel MKL-DNN and in some cases outperforms it by 5x (on multicore-CPUs).


title: A Collaborative Filtering Approach for the Automatic Tuning of Compiler Optimisations

abstract: Selecting the right compiler optimisations has a severe impact on programs' performance. Still, the available optimisations keep increasing, and their effect depends on the specific program, making the task human intractable. Researchers proposed several techniques to search in the space of compiler optimisations. Some approaches focus on finding better search algorithms, while others try to speed up the search by leveraging previously collected knowledge. The possibility to effectively reuse previous compilation results inspired us toward the investigation of techniques derived from the Recommender Systems field. The proposed approach exploits previously collected knowledge and improves its characterisation over time. Differently from current state-of-the-art solutions, our approach is not based on performance counters but relies on Reaction Matching, an algorithm able to characterise programs looking at how they react to different optimisation sets. The proposed approach has been validated using two widely used benchmark suites, cBench and PolyBench, including 54 different programs. Our solution, on average, extracted 90% of the available performance improvement 10 iterations before current state-of-the-art solutions, which corresponds to 40% fewer compilations and performance tests to perform.


title: Importing Relationships into a Running Graph Database Using Parallel Processing

abstract: Importing relationships into a running graph database using multiple threads running concurrently is a difficult task, as multiple threads cannot write information to the same node at the same time. Here we present an algorithm in which relationships are sorted into bins, then imported such that no two threads ever access the same node concurrently. When this algorithm was implemented as a procedure to run on the Neo4j graph database, it reduced the time to import relationships by up to 69% when 32 threads were used.


title: Parallel Programming Models for Heterogeneous Many-Cores : A Survey

abstract: Heterogeneous many-cores are now an integral part of modern computing systems ranging from embedding systems to supercomputers. While heterogeneous many-core design offers the potential for energy-efficient high-performance, such potential can only be unlocked if the application programs are suitably parallel and can be made to match the underlying heterogeneous platform. In this article, we provide a comprehensive survey for parallel programming models for heterogeneous many-core architectures and review the compiling techniques of improving programmability and portability. We examine various software optimization techniques for minimizing the communicating overhead between heterogeneous computing devices. We provide a road map for a wide variety of different research areas. We conclude with a discussion on open issues in the area and potential research directions. This article provides both an accessible introduction to the fast-moving area of heterogeneous programming and a detailed bibliography of its main achievements.


title: A Heuristic Based on Randomized Greedy Algorithms for the Clustered Shortest-Path Tree Problem

abstract: Randomized Greedy Algorithms (RGAs) are interesting approaches to solve problems whose structures are not well understood as well as problems in combinatorial optimization which incorporate the random processes and the greedy algorithms. This paper introduces a new algorithm that combines the major features of RGAs and Shortest Path Tree Algorithm (SPTA) to deal with the Clustered Shortest-Path Tree Problem (CluSPT). In our algorithm, SPTA is used to determine the shortest path tree in each cluster while the combination between characteristics of the RGAs and search strategy of SPTA is used to constructed the edges connecting clusters. To evaluate the performance of the proposed algorithm, Euclidean benchmarks are selected. The experimental investigations show the strengths of the proposed algorithm in comparison with some existing algorithms. We also analyze the influence of the parameters on the performance of the algorithm.


title: Behind the Last Line of Defense -- Surviving SoC Faults and Intrusions

abstract: Today, leveraging the enormous modular power, diversity and flexibility of manycore systems-on-a-chip (SoCs) requires careful orchestration of complex resources, a task left to low-level software, e.g. hypervisors. In current architectures, this software forms a single point of failure and worthwhile target for attacks: once compromised, adversaries gain access to all information and full control over the platform and the environment it controls. This paper proposes Midir, an enhanced manycore architecture, effecting a paradigm shift from SoCs to distributed SoCs. Midir changes the way platform resources are controlled, by retrofitting tile-based fault containment through well known mechanisms, while securing low-overhead quorum-based consensus on all critical operations, in particular privilege management and, thus, management of containment domains. Allowing versatile redundancy management, Midir promotes resilience for all software levels, including at low level. We explain this architecture, its associated algorithms and hardware mechanisms and show, for the example of a Byzantine fault tolerant microhypervisor, that it outperforms the highly efficient MinBFT by one order of magnitude.


title: Delay-aware Resource Allocation in Fog-assisted IoT Networks Through Reinforcement Learning

abstract: Fog nodes in the vicinity of IoT devices are promising to provision low latency services by offloading tasks from IoT devices to them. Mobile IoT is composed by mobile IoT devices such as vehicles, wearable devices and smartphones. Owing to the time-varying channel conditions, traffic loads and computing loads, it is challenging to improve the quality of service (QoS) of mobile IoT devices. As task delay consists of both the transmission delay and computing delay, we investigate the resource allocation (i.e., including both radio resource and computation resource) in both the wireless channel and fog node to minimize the delay of all tasks while their QoS constraints are satisfied. We formulate the resource allocation problem into an integer non-linear problem, where both the radio resource and computation resource are taken into account. As IoT tasks are dynamic, the resource allocation for different tasks are coupled with each other and the future information is impractical to be obtained. Therefore, we design an on-line reinforcement learning algorithm to make the sub-optimal decision in real time based on the system's experience replay data. The performance of the designed algorithm has been demonstrated by extensive simulation results.


title: Near Memory Acceleration on High Resolution Radio Astronomy Imaging

abstract: Modern radio telescopes like the Square Kilometer Array (SKA) will need to process in real-time exabytes of radio-astronomical signals to construct a high-resolution map of the sky. Near-Memory Computing (NMC) could alleviate the performance bottlenecks due to frequent memory accesses in a state-of-the-art radio-astronomy imaging algorithm. In this paper, we show that a sub-module performing a two-dimensional fast Fourier transform (2D FFT) is memory bound using CPI breakdown analysis on IBM Power9. Then, we present an NMC approach on FPGA for 2D FFT that outperforms a CPU by up to a factor of 120x and performs comparably to a high-end GPU, while using less bandwidth and memory.


title: Inference Time Optimization Using BranchyNet Partitioning

abstract: Deep Neural Network (DNN) applications with edge computing presents a trade-off between responsiveness and computational resources. On one hand, edge computing can provide high responsiveness deploying computational resources close to end devices, which may be prohibitive for the majority of cloud computing services. On the other hand, DNN inference requires computational power to be executed, which may not be available on edge devices, but a cloud server can provide it. To solve this problem (trade-off), we partition a DNN between edge device and cloud server, which means the first DNN layers are processed at the edge and the other layers at the cloud. This paper proposes an optimal partition of DNN, according to network bandwidth, computational resources of edge and cloud, and parameter inherent to data. Our proposal aims to minimize the inference time, to allow high responsiveness applications. To this end, we show the equivalency between DNN partitioning problem and shortest path problem to find an optimal solution, using Dijkstra's algorithm.


title: World ships: Feasibility and Rationale

abstract: World ships are hypothetical, large, self-contained spacecraft for crewed interstellar travel, taking centuries to reach other stars. Due to their crewed nature, size, and long trip times, the feasibility of world ships faces an additional set of challenges compared to interstellar probes. Despite their emergence in the 1980s, most of these topics remain unexplored. This article revisits some of the key feasibility issues of world ships. First, definitions of world ships from the literature are revisited and the notion of world ship positioned with respect to similar concepts such as generation ships. Second, the key question of population size is revisited in light of recent results from the literature. Third, socio-technical and economic feasibility issues are evaluated. Finally, world ships are compared to potential alternative modes of crewed interstellar travel. Key roadblocks for world ships are the considerable resources required, shifting its economic feasibility beyond the year 2300, and the development of a maintenance system capable of detecting, replacing, and repairing several components per second. The emergence of alternative, less costly modes of crewed interstellar travel at an earlier point in time might render world ships obsolete.


title: Relativistic Implications for Physical Copies of Conscious States

abstract: The possibility of algorithmic consciousness depends on the assumption that conscious states can be copied or repeated by sufficiently duplicating their underlying physical states, leading to a variety of paradoxes, including the problems of duplication, teleportation, simulation, self-location, the Boltzmann brain, and Wigner's Friend. In an effort to further elucidate the physical nature of consciousness, I challenge these assumptions by analyzing the implications of special relativity on evolutions of identical copies of a mental state, particularly the divergence of these evolutions due to quantum fluctuations. By assuming the supervenience of a conscious state on some sufficient underlying physical state, I show that the existence of two or more instances, whether spacelike or timelike, of the same conscious state leads to a logical contradiction, ultimately refuting the assumption that a conscious state can be physically reset to an earlier state or duplicated by any physical means. Several explanatory hypotheses and implications are addressed, particularly the relationships between consciousness, locality, physical irreversibility, and quantum no-cloning.


title: A Local Law for Singular Values from Diophantine Equations

abstract: We introduce the $N\times N$ random matrices $$ X_{j,k}=\exp\left(2\pi i \sum_{q=1}^d\ \omega_{j,q} k^q\right) \quad \text{with } \{\omega_{j,q}\}_{\substack{1\leq j\leq N\\ 1\leq q\leq d}} \text{ i.i.d. random variables}, $$ and $d$ a fixed integer. We prove that the distribution of their singular values converges to the local Marchenko-Pastur law at scales $N^{-\theta_d}$ for an explicit, small $\theta_d>0$, as long as $d\geq 18$. To our knowledge, this is the first instance of a random matrix ensemble that is explicitly defined in terms of only $O(N)$ random variables exhibiting a universal local spectral law. Our main technical contribution is to derive concentration bounds for the Stieltjes transform that simultaneously take into account stochastic and oscillatory cancellations. Important ingredients in our proof are strong estimates on the number of solutions to Diophantine equations (in the form of Vinogradov's main conjecture recently proved by Bourgain-Demeter-Guth) and a pigeonhole argument that combines the Ward identity with an algebraic uniqueness condition for Diophantine equations derived from the Newton-Girard identities.


title: Partial Deconfinement at Strong Coupling on the Lattice

abstract: We provide evidence for partial deconfinement -- the deconfinement of a SU($M$) subgroup of the SU($N$) gauge group -- by using lattice Monte Carlo simulations. We take matrix models as concrete examples. By appropriately fixing the gauge, we observe that the $M\times M$ submatrices deconfine. This gives direct evidence for partial deconfinement at strong coupling. We discuss the applications to QCD and holography.


title: Physicochemical Features and Peculiarities of Interaction of Antimicrobial Peptides with the Membrane

abstract: Antimicrobial peptides (AMPs) are anti-infectives that have potential as a novel and untapped class of biotherapeutics. Modes of action of antimicrobial peptides imply interaction with cell envelope. Comprehensive understanding of peculiarities of interactions of antimicrobial peptides with cell envelope is necessary to perform the task-oriented design of new biotherapeutics, against which for microbes it is hard to work out resistance. In order to enable a de novo design with low costs and in high throughput, in silico predictive models have to be required. To develop the performant predictive model, comprehensive knowledge on mechanisms of action of AMPs has to be possessed. The last knowledge will allow us to encode amino acid sequences expressively and to get success to the choosing of the accurate classifier of AMPs. A shared protective layer of microbial cells is inner, plasmatic membrane. The interaction of AMP with a biological membrane (native and/or artificial) is the most comprehensively studied. We provide a review of mechanisms and results of interaction of AMP with the cell membrane, relying on the survey of physicochemical, aggregative and structural features of AMPs. Potency and mechanism of action of AMP have presented in the terms of amino acid compositions and distributions of the polar and apolar residues along the chain, that is in such physicochemical features of peptides as the hydrophobicity, hydrophilicity, and amphiphilicity. Many different approaches were used to classify AMPs. The survey of the knowledge on sequences, structures, and modes of actions of AMP, allows concluding that, only the physicochemical features of AMPs give the capability to perform the unambiguous classification. Comprehensive knowledge of physicochemical features of AMP is necessary to develop task-oriented methods of design of peptide-based antibiotics de novo.


title: Evolution of the dipole polarizability in the stable tin isotope chain

abstract: The dipole polarizability of stable even-mass tin isotopes 112,114,116,118,120,124 was extracted from inelastic proton scattering experiments at 295 MeV under very forward angles performed at RCNP. Predictions from energy density functionals cannot account for the present data and the polarizability of 208Pb simultaneously. The evolution of the polarizabilities in neighboring isotopes indicates a kink at 120Sn while all model results show a nearly linear increase with mass number after inclusion of pairing corrections.


title: Brain experiments imply adaptation mechanisms which outperform common AI learning algorithms

abstract: Attempting to imitate the brain functionalities, researchers have bridged between neuroscience and artificial intelligence for decades; however, experimental neuroscience has not directly advanced the field of machine learning. Here, using neuronal cultures, we demonstrate that increased training frequency accelerates the neuronal adaptation processes. This mechanism was implemented on artificial neural networks, where a local learning step-size increases for coherent consecutive learning steps and tested on a simple dataset of handwritten digits, MNIST. Based on our online learning results with a few handwriting examples, success rates for brain-inspired algorithms substantially outperform the commonly used machine learning algorithms. We speculate this emerging bridge from slow brain function to machine learning will promote ultrafast decision making under limited examples, which is the reality in many aspects of human activity, robotic control, and network optimization.


title: Sequential Gallery for Interactive Visual Design Optimization

abstract: Visual design tasks often involve tuning many design parameters. For example, color grading of a photograph involves many parameters, some of which non-expert users might be unfamiliar with. We propose a novel user-in-the-loop optimization method that allows users to efficiently find an appropriate parameter set by exploring such a high-dimensional design space through much easier two-dimensional search subtasks. This method, called sequential plane search, is based on Bayesian optimization to keep necessary queries to users as few as possible. To help users respond to plane-search queries, we also propose using a gallery-based interface that provides options in the two-dimensional subspace arranged in an adaptive grid view. We call this interactive framework Sequential Gallery since users sequentially select the best option from the options provided by the interface. Our experiment with synthetic functions shows that our sequential plane search can find satisfactory solutions in fewer iterations than baselines. We also conducted a preliminary user study, results of which suggest that novices can effectively complete search tasks with Sequential Gallery in a photo-enhancement scenario.


title: Computational modeling of Human-nCoV protein-protein interaction network

abstract: COVID-19 has created a global pandemic with high morbidity and mortality in 2020. Novel coronavirus (nCoV), also known as Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV2), is responsible for this deadly disease. International Committee on Taxonomy of Viruses (ICTV) has declared that nCoV is highly genetically similar to SARS-CoV epidemic in 2003 (89% similarity). Limited number of clinically validated Human-nCoV protein interaction data is available in the literature. With this hypothesis, the present work focuses on developing a computational model for nCoV-Human protein interaction network, using the experimentally validated SARS-CoV-Human protein interactions. Initially, level-1 and level-2 human spreader proteins are identified in SARS-CoV-Human interaction network, using Susceptible-Infected-Susceptible (SIS) model. These proteins are considered as potential human targets for nCoV bait proteins. A gene-ontology based fuzzy affinity function has been used to construct the nCoV-Human protein interaction network at 99.98% specificity threshold. This also identifies the level-1 human spreaders for COVID-19 in human protein-interaction network. Level-2 human spreaders are subsequently identified using the SIS model. The derived host-pathogen interaction network is finally validated using 7 potential FDA listed drugs for COVID-19 with significant overlap between the known drug target proteins and the identified spreader proteins.


title: Reconstructing the Gravitational Lensing Potential from the Lyman-$\alpha$ Forest

abstract: We demonstrate a method for reconstructing the weak lensing potential from the Lyman-$\alpha$ forest data. We derive an optimal estimator for the lensing potential on the sky based on the correlation between pixels in real space. This method effectively deals with irregularly spaced data, holes in the survey, missing data and inhomogeneous noise. We demonstrate an implementation of the method with simulated spectra and weak lensing. It is shown that with a source density of $>\sim 0.5$ per square arcminutes and $\sim 200$ pixels in each spectrum ($\lambda / \Delta\lambda = 1300$) the lensing potential can be reconstructed with high fidelity if the relative absorption in the spectral pixels is signal dominated. When noise dominates the measurement of the absorption in each pixel the noise in the lensing potential is higher, but for reasonable numbers of sources and noise levels and a high fidelity map the lensing potential is obtainable. The lensing estimator could also be applied to lensing of the Cosmic Microwave Background (CMB), 21 cm intensity mapping (IM) or any case in which the correlation function of the source can be accurately estimated.


title: On the integral form of rank 1 Kac-Moody algebras

abstract: In this paper we shall prove that the subalgebra generated over the integers by the divided powers of the Drinfeld generators $x_r^{\pm}$ of the Kac-Moody algebra of type $A_2^{(2)}$ is an integral form (strictly smaller than Mitzman's (see [Mi]) of the enveloping algebra, we shall exhibit a basis generalizing the one provided by Garland in [G] for the untwisted affine Kac-Moody algebras, and we shall determine explicitly the commutation relations. Moreover we prove that both in the untwisted and in the twisted case the positive (respectively negative) imaginary part of the integral form is an algebra of polynomials over the integers.


abstract: Domain Adaptation (DA) aims to generalize the classifier learned from the source domain to the target domain. Existing DA methods usually assume that rich labels could be available in the source domain. However, there are usually a large number of unlabeled data but only a few labeled data in the source domain, and how to transfer knowledge from this sparsely-labeled source domain to the target domain is still a challenge, which greatly limits their application in the wild. This paper proposes a novel Sparsely-Labeled Source Assisted Domain Adaptation (SLSA-DA) algorithm to address the challenge with limited labeled source domain samples. Specifically, due to the label scarcity problem, the projected clustering is conducted on both the source and target domains, so that the discriminative structures of data could be leveraged elegantly. Then the label propagation is adopted to propagate the labels from those limited labeled source samples to the whole unlabeled data progressively, so that the cluster labels are revealed correctly. Finally, we jointly align the marginal and conditional distributions to mitigate the cross-domain mismatch problem, and optimize those three procedures iteratively. However, it is nontrivial to incorporate those three procedures into a unified optimization framework seamlessly since some variables to be optimized are implicitly involved in their formulas, thus they could not promote to each other. Remarkably, we prove that the projected clustering and conditional distribution alignment could be reformulated as different expressions, thus the implicit variables are revealed in different optimization steps. As such, the variables related to those three quantities could be optimized in a unified optimization framework and facilitate to each other, to improve the recognition performance obviously.


title: On Training and Evaluation of Neural Network Approaches for Model Predictive Control

abstract: The contribution of this paper is a framework for training and evaluation of Model Predictive Control (MPC) implemented using constrained neural networks. Recent studies have proposed to use neural networks with differentiable convex optimization layers to implement model predictive controllers. The motivation is to replace real-time optimization in safety critical feedback control systems with learnt mappings in the form of neural networks with optimization layers. Such mappings take as the input the state vector and predict the control law as the output. The learning takes place using training data generated from off-line MPC simulations. However, a general framework for characterization of learning approaches in terms of both model validation and efficient training data generation is lacking in literature. In this paper, we take the first steps towards developing such a coherent framework. We discuss how the learning problem has similarities with system identification, in particular input design, model structure selection and model validation. We consider the study of neural network architectures in PyTorch with the explicit MPC constraints implemented as a differentiable optimization layer using CVXPY. We propose an efficient approach of generating MPC input samples subject to the MPC model constraints using a hit-and-run sampler. The corresponding true outputs are generated by solving the MPC offline using OSOP. We propose different metrics to validate the resulting approaches. Our study further aims to explore the advantages of incorporating domain knowledge into the network structure from a training and evaluation perspective. Different model structures are numerically tested using the proposed framework in order to obtain more insights in the properties of constrained neural networks based MPC.


title: Surjectivity of Convolution Operators on Noncompact Symmetric Spaces

abstract: Let $\mu$ be a $K$-invariant compactly supported distribution on a noncompact Riemannian symmetric space $X=G/K$. If the spherical Fourier transform $\widetilde\mu(\lambda)$ is slowly decreasing, it is known that the right convolution operator $c_\mu\colon f\mapsto f*\mu$ maps $\mathcal E(X)$ onto $\mathcal E(X)$. In this paper, we prove the converse of this result. We also prove that $c_\mu$ has a fundamental solution if and only if $\widetilde\mu(\lambda)$ is slowly decreasing.


title: SentiBERT: A Transferable Transformer-Based Architecture for Compositional Sentiment Semantics

abstract: We propose SentiBERT, a variant of BERT that effectively captures compositional sentiment semantics. The model incorporates contextualized representation with binary constituency parse tree to capture semantic composition. Comprehensive experiments demonstrate that SentiBERT achieves competitive performance on phrase-level sentiment classification. We further demonstrate that the sentiment composition learned from the phrase-level annotations on SST can be transferred to other sentiment analysis tasks as well as related tasks, such as emotion classification tasks. Moreover, we conduct ablation studies and design visualization methods to understand SentiBERT. We show that SentiBERT is better than baseline approaches in capturing negation and the contrastive relation and model the compositional sentiment semantics.


title: Barrow holographic dark energy

abstract: We formulate Barrow holographic dark energy, by applying the usual holographic principle at a cosmological framework, but using the Barrow entropy instead of the standard Bekenstein-Hawking one. The former is an extended black-hole entropy that arises due to quantum-gravitational effects which deform the black-hole surface by giving it an intricate, fractal form. We extract a simple differential equation for the evolution of the dark energy density parameter, which possesses standard holographic dark energy as a limiting sub-case, and we show that the scenario can describe the universe thermal history, with the sequence of matter and dark energy eras. Additionally, the new Barrow exponent $\Delta$ significantly affects the dark energy equation of state, and according to its value it can lead it to lie in the quintessence regime, in the phantom regime, or experience the phantom-divide crossing during the evolution.


title: Stochastic optimization methods for the simultaneous control of parameter-dependent systems

abstract: We address the application of stochastic optimization methods for the simultaneous control of parameter-dependent systems. In particular, we focus on the classical Stochastic Gradient Descent (SGD) approach of Robbins and Monro, and on the recently developed Continuous Stochastic Gradient (CSG) algorithm. We consider the problem of computing simultaneous controls through the minimization of a cost functional defined as the superposition of individual costs for each realization of the system. We compare the performances of these stochastic approaches, in terms of their computational complexity, with those of the more classical Gradient Descent (GD) and Conjugate Gradient (CG) algorithms, and we discuss the advantages and disadvantages of each methodology. In agreement with well-established results in the machine learning context, we show how the SGD and CSG algorithms can significantly reduce the computational burden when treating control problems depending on a large amount of parameters. This is corroborated by numerical experiments.


title: NTIRE 2020 Challenge on Real Image Denoising: Dataset, Methods and Results

abstract: This paper reviews the NTIRE 2020 challenge on real image denoising with focus on the newly introduced dataset, the proposed methods and their results. The challenge is a new version of the previous NTIRE 2019 challenge on real image denoising that was based on the SIDD benchmark. This challenge is based on a newly collected validation and testing image datasets, and hence, named SIDD+. This challenge has two tracks for quantitatively evaluating image denoising performance in (1) the Bayer-pattern rawRGB and (2) the standard RGB (sRGB) color spaces. Each track ~250 registered participants. A total of 22 teams, proposing 24 methods, competed in the final phase of the challenge. The proposed methods by the participating teams represent the current state-of-the-art performance in image denoising targeting real noisy images. The newly collected SIDD+ datasets are publicly available at: https://bit.ly/siddplus_data.


title: Beyond Accuracy: Behavioral Testing of NLP models with CheckList

abstract: Although measuring held-out accuracy has been the primary approach to evaluate generalization, it often overestimates the performance of NLP models, while alternative approaches for evaluating models either focus on individual tasks or on specific behaviors. Inspired by principles of behavioral testing in software engineering, we introduce CheckList, a task-agnostic methodology for testing NLP models. CheckList includes a matrix of general linguistic capabilities and test types that facilitate comprehensive test ideation, as well as a software tool to generate a large and diverse number of test cases quickly. We illustrate the utility of CheckList with tests for three tasks, identifying critical failures in both commercial and state-of-art models. In a user study, a team responsible for a commercial sentiment analysis model found new and actionable bugs in an extensively tested model. In another user study, NLP practitioners with CheckList created twice as many tests, and found almost three times as many bugs as users without it.


title: Predicting Imperfect Echo Dynamics in Many-Body Quantum Systems

abstract: Echo protocols provide a means to investigate the arrow of time in macroscopic processes. Starting from a nonequilibrium state, the many-body quantum system under study is evolved for a certain period of time $\tau$. Thereafter, an (effective) time reversal is performed that would -- if implemented perfectly -- take the system back to the initial state after another time period $\tau$. Typical examples are nuclear magnetic resonance imaging and polarization echo experiments. The presence of small, uncontrolled inaccuracies during the backward propagation results in deviations of the "echo signal" from the original evolution, and can be exploited to quantify the instability of nonequilibrium states and the irreversibility of the dynamics. We derive an analytic prediction for the typical dependence of this echo signal for macroscopic observables on the magnitude of the inaccuracies and on the duration $\tau$ of the process, and verify it in numerical examples.


title: K-EmoCon, a multimodal sensor dataset for continuous emotion recognition in naturalistic conversations

abstract: Recognizing emotions during social interactions has many potential applications with the popularization of low-cost mobile sensors, but a challenge remains with the lack of naturalistic affective interaction data. Most existing emotion datasets do not support studying idiosyncratic emotions arising in the wild as they were collected in constrained environments. Therefore, studying emotions in the context of social interactions requires a novel dataset, and K-EmoCon is such a multimodal dataset with comprehensive annotations of continuous emotions during naturalistic conversations. The dataset contains multimodal measurements, including audiovisual recordings, EEG, and peripheral physiological signals, acquired with off-the-shelf devices from 16 sessions of approximately 10-minute long paired debates on a social issue. Distinct from previous datasets, it includes emotion annotations from all three available perspectives: self, debate partner, and external observers. Raters annotated emotional displays at intervals of every 5 seconds while viewing the debate footage, in terms of arousal-valence and 18 additional categorical emotions. The resulting K-EmoCon is the first publicly available emotion dataset accommodating the multiperspective assessment of emotions during social interactions.


title: Evidence for Coupling of Evolved Star Atmospheres and Spiral Arms of the Milky Way

abstract: It is imperative to map the strength and distribution of feedback in galaxies to understand how feedback affects the galactic ecosystems. H$_2$O masers act as indicators of energy injection into the ISM. Our goal is to measure the strength and distribution of feedback traced by water masers in the Milky Way. We identify optical counterparts to H$_2$O masers discovered by the HOPS survey. The distribution and luminosities of H$_2$O masers in the Milky Way are determined using parallax measurements derived from the second Gaia Data Release. We provide evidence of a correlation between evolved stars, as traced by H$_2$O masers, and the spiral structure of the Milky Way, suggesting a link between evolved stars and the Galactic environment.


title: Asymptotic behaviour and functional limit theorems for a time changed Wiener process

abstract: We study the asymptotic behaviour of a properly normalized time changed Wiener processes. The time change reflects the fact that we consider the Laplace operator (which generates a Wiener process) multiplied by a possibly degenerate state-space dependent intensity $\lambda(x)$. Applying a functional limit theorem for the superposition of stochastic processes, we prove functional limit theorems for the normalized time changed Wiener process. The normalization depends on the asymptotic behaviour of the intensity function $\lambda$. One of the possible limits is a skew Brownian motion.


title: The ghosts of forgotten things: A study on size after forgetting

abstract: Forgetting is removing variables from a logical formula while preserving the constraints on the other variables. In spite of being a form of reduction, it does not always decrease the size of the formula and may sometimes increase it. This article discusses the implications of such an increase and analyzes the computational properties of the phenomenon. Given a propositional Horn formula, a set of variables and a maximum allowed size, deciding whether forgetting the variables from the formula can be expressed in that size is $D^p$-hard in $\Sigma^p_2$. The same problem for unrestricted propositional formulae is $D^p_2$-hard in $\Sigma^p_3$.


title: Symmetry-mixed bound-state order: extended degeneracy of $(d + ig)$-superconductivity in $\mathrm{Sr}_{2}\mathrm{Ru}\mathrm{O}_{4}$

abstract: We report a fluctuation-driven state of matter that develops near an accidental degeneracy point of two symmetry-distinct primary phases. Due to symmetry mixing, this bound-state order exhibits unique signatures, incompatible with either parent phase. Within a field-theoretical formalism, we derive the generic phase diagram for system with bound-state order, study its response to strain, and evaluate analytic expressions for a specific model. Our results support the $(d + ig)$-superconducting state as a candidate for $\mathrm{Sr}_{2}\mathrm{Ru}\mathrm{O}_{4}$: Most noticeably, the derived strain-dependence is in excellent agreement with recent experiments [Hicks \textit{et al.} Science (2014) and Grinenko \textit{et al.} arXiv (2020)]. The evolution above a non-vanishing strain from a joint onset of superconductivity and time-reversal symmetry-breaking to two split phase transitions provides a testable prediction for this scenario.


title: A Gauge Theory that mixes Bosonic and Fermionic Gauge Fields

abstract: Using a gauge symmetry derived by applying the Dirac constraint formalism to supergravity with cosmological term in 2+1 dimensions, we construct a gauge theory with many characteristics of Yang-Mills theory. The gauge transformation mixes two Bosonic fields and one Fermionic field.


title: GASDUINO-Wireless Air Quality Monitoring System Using Internet of Things

abstract: The Health Effects Institute (HEI) reported recently that the deaths from the negative health effects of the air pollution in the Middle East Region is about 500,000 people. Therefore, this paper presents a new design and development of portable system; called GASDUINO that allows the user to measure the quality of air using the Internet of Things (IoT). The main components of developed GASDUINO system are the Arduino microcontroller board, Gas sensor (MQ-135), Android user interface (UI) connected with all things via Remote XY Arduino cloud. The developed system can alarm the users about the dangerous levels of the air quality index (AQI) or the particle per million (PPM) levels in the range of 0 to above 200 PPM. The developed GASDUINO system is considered as an essential environmental module in the development and sustainability of future smart cities.


title: Gravitational Imprints from Heavy Kaluza-Klein Resonances

abstract: We systematically study the holographic phase transition of the radion field in a five-dimensional warped model which includes a scalar potential with a power-like behavior. We consider Kaluza-Klein (KK) resonances with masses $m_{\rm KK}$ at the TeV scale or beyond. The backreaction of the radion field on the gravitational metric is taken into account by using the superpotential formalism. The confinement/deconfinement first order phase transition leads to a gravitational wave stochastic background which mainly depends on the scale $m_{\rm KK}$ and the number of colors, $N$, in the dual theory. Its power spectrum peaks at a frequency that depends on the amount of tuning required in the electroweak sector. It turns out that the present and forthcoming gravitational wave observatories can probe scenarios where the KK resonances are very heavy. Current aLIGO data already rule out vector boson KK resonances with masses in the interval $m_{\rm KK}\sim(1 - 10) \times 10^5$ TeV. Future gravitational experiments will be sensitive to resonances with masses $m_{\rm KK}\lesssim 10^5$ TeV (LISA), $10^8$ TeV (aLIGO Design) and $10^9$ TeV (ET). Finally, we also find that the Big Bang Nucleosynthesis bound in the frequency spectrum turns into a lower bound for the nucleation temperature as $T_n \gtrsim 10^{-4}\sqrt{N} \,m_{\rm KK}$.


title: Semiclassical torus blocks in the t-channel

abstract: We explicitly demonstrate the relation between the 2-point t-channel torus block in the large-c regime and the geodesic length of a specific geodesic diagram stretched in the thermal AdS3 spacetime


title: Quantum causal correlations and non-Markovianity of quantum evolution

abstract: A non-Markovianity measure for quantum channels is introduced based on causality measure - a monotone of causal (temporal) correlations - arising out of the pseudo-density matrix (PDM) formalism which treats quantum correlations in space and time on an equal footing. Using the well known damped Jaynes-Cummings model of a two-level system interacting with a bosonic reservoir at zero temperature as an example, it is shown that breakdown of monotonicity of the causality measure is associated with the revival of temporal (causal) correlations hence with the negativity of the decay rate. Also, a note on the comparison with other well known non-Markovianity measures is given.


title: Kerr metric bundles. Killing horizons confinement, light-surfaces and horizons replicas

abstract: We provide a complete characterization of the metric Killing bundles (or metric bundles) of the Kerr geometry. Metric bundles, first introduced in [21] can be generally defined for axially symmetric spacetimes with Killing horizons and, for the case of Kerr geometries, are sets of black holes (BHs) or black holes and naked singularities (NSs) geometries. Each metric of a bundle has an equal limiting photon (orbital) frequency, which defines the bundle and coincides with the frequency of a Killing horizon in the extended plane. In this plane each bundle is represented as a curve tangent to the curve that represents the horizons, which thus emerge as the envelope surfaces of the metric bundles. We show that the horizons frequency can be used to establish a connection between BHs and NSs, providing an alternative representation of such spacetimes in the extended plane and an alternative definition of the BH horizons. We introduce the concept of inner horizon confinement and horizons replicas and study the possibility of detecting their frequencies. We study the bundle characteristic frequencies constraining the inner horizon confinement in the outer region of the plane i.e. the possibility of detect frequency related to the inner horizon, and the horizons replicas, structures which may be detectable, for example, from the emission spectra of BHs spacetimes. It is shown that such observations can be performed close to the rotation axis of the Kerr geometry, depending on the BH spin. We argue that these results could be used to further investigate black holes and their thermodynamic properties.


title: Bayesian Comparison of the Cosmic Duality Scenarios

abstract: The cosmic distance duality relation (CDDR), $D_{\rm L}(1+z)^{-2}/D_{\rm A}=\eta=1$, with $D_{\rm L}$ and $D_{\rm A}$, being the luminosity and angular diameter distances, respectively, is a crucial premise in cosmological scenarios. Many investigations try to test CDDR through observational approaches, even some of these ones also consider a deformed CDDR, i.e., $\eta=\eta(z)$. In this paper, we use type Ia supernovae luminosity distances and galaxy cluster measurements (their angular diameter distances and gas mass fractions) in order to perform a Bayesian model comparison between $ \eta(z) $ functions. We show that the data here used are unable to pinpoint, with a high degree of Bayesian evidence, which $\eta(z)$ function best captures the evolution of CDDR.


title: Asteroid: the PyTorch-based audio source separation toolkit for researchers

abstract: This paper describes Asteroid, the PyTorch-based audio source separation toolkit for researchers. Inspired by the most successful neural source separation systems, it provides all neural building blocks required to build such a system. To improve reproducibility, Kaldi-style recipes on common audio source separation datasets are also provided. This paper describes the software architecture of Asteroid and its most important features. By showing experimental results obtained with Asteroid's recipes, we show that our implementations are at least on par with most results reported in reference papers. The toolkit is publicly available at https://github.com/mpariente/asteroid .


title: A note on Stirling permutations

abstract: In this note we generalize an identity of John Riordan and Robert Donaghey relating the enumerator for Stirling permutations to the Eulerian polynomials.


title: On the Severi problem in arbitrary characteristic

abstract: In this paper, we show that Severi varieties parameterizing irreducible reduced planar curves of a given degree and geometric genus are either empty or irreducible in any characteristic. Following Severi's original idea, this gives a new proof of the irreducibility of the moduli space of smooth projective curves of a given genus in positive characteristic. It is the first proof that involves no reduction to the characteristic zero case. As a further consequence, we generalize Zariski's theorem to positive characteristic and show that a general reduced planar curve of a given geometric genus is nodal.


title: A short proof of the canonical polynomial van der Waerden theorem

abstract: We present a short new proof of the canonical polynomial van der Waerden theorem, recently established by Girao [arXiv:2004.07766].


title: Data-Free Network Quantization With Adversarial Knowledge Distillation

abstract: Network quantization is an essential procedure in deep learning for development of efficient fixed-point inference models on mobile or edge platforms. However, as datasets grow larger and privacy regulations become stricter, data sharing for model compression gets more difficult and restricted. In this paper, we consider data-free network quantization with synthetic data. The synthetic data are generated from a generator, while no data are used in training the generator and in quantization. To this end, we propose data-free adversarial knowledge distillation, which minimizes the maximum distance between the outputs of the teacher and the (quantized) student for any adversarial samples from a generator. To generate adversarial samples similar to the original data, we additionally propose matching statistics from the batch normalization layers for generated data and the original data in the teacher. Furthermore, we show the gain of producing diverse adversarial samples by using multiple generators and multiple students. Our experiments show the state-of-the-art data-free model compression and quantization results for (wide) residual networks and MobileNet on SVHN, CIFAR-10, CIFAR-100, and Tiny-ImageNet datasets. The accuracy losses compared to using the original datasets are shown to be very minimal.


title: Corrigendum and Supplement to "Improve Language Modelling for Code Completion through Learning General Token Repetition of Source Code (with Optimized Memory)"

abstract: This paper is written because I receive several inquiry emails saying it is hard to achieve good results when applying token repetition learning techniques. If REP (proposed by me) or Pointer-Mixture (proposed by Jian Li) is directly applied to source code to decide all token repetitions, the model performance will decrease sharply. As we use pre-order traversal to traverse the Abstract Syntax Tree (AST) to generate token sequence, tokens corresponding to AST grammar are ignored when learning token repetition. For non-grammar tokens, there are many kinds: strings, chars, numbers and identifiers. For each kind of tokens, we try to learn its repetition pattern and find that only identifiers have the property of token repetition. For identifiers, there are also many kinds such as variables, package names, method names, simple types, qualified types or qualified names. Actually, some kinds of identifiers such as package names, method names, qualified names or qualified types are unlikely to be repeated. Thus, we ignore these kinds of identifiers that are unlikely to be repeated when learning token repetition. This step is crucial and this important implementation trick is not clearly presented in the paper because we think it is trivial and too many details may bother readers. We offer the GitHub address of our model in our conference paper and readers can check the description and implementation in that repository. Thus, in this paper, we supplement the important implementation optimization details for the already published papers.


title: MBN Explorer atomistic simulations of 855 MeV electron propagation and radiation emission in oriented silicon bent crystal: theory versus experiment

abstract: The method of relativistic molecular dynamics is applied for accurate computational modelling and numerical analysis of the channelling phenomena for 855 MeV electrons in bent oriented silicon (111) crystal. Special attention is devoted to the transition from the axial channelling regime to the planar one in the course of the crystal rotation with respect to the incident beam. Distribution in the deflection angle of electrons and spectral distribution of the radiation emitted are analysed in detail. The results of calculations are compared with the experimental data collected at the MAinzer MIctrotron (MAMI) facility.


title: The scalable Birth-Death MCMC Algorithm for Mixed Graphical Model Learning with Application to Genomic Data Integration

abstract: Recent advances in biological research have seen the emergence of high-throughput technologies with numerous applications that allow the study of biological mechanisms at an unprecedented depth and scale. A large amount of genomic data is now distributed through consortia like The Cancer Genome Atlas (TCGA), where specific types of biological information on specific type of tissue or cell are available. In cancer research, the challenge is now to perform integrative analyses of high-dimensional multi-omic data with the goal to better understand genomic processes that correlate with cancer outcomes, e.g. elucidate gene networks that discriminate a specific cancer subgroups (cancer sub-typing) or discovering gene networks that overlap across different cancer types (pan-cancer studies). In this paper, we propose a novel mixed graphical model approach to analyze multi-omic data of different types (continuous, discrete and count) and perform model selection by extending the Birth-Death MCMC (BDMCMC) algorithm initially proposed by \citet{stephens2000bayesian} and later developed by \cite{mohammadi2015bayesian}. We compare the performance of our method to the LASSO method and the standard BDMCMC method using simulations and find that our method is superior in terms of both computational efficiency and the accuracy of the model selection results. Finally, an application to the TCGA breast cancer data shows that integrating genomic information at different levels (mutation and expression data) leads to better subtyping of breast cancers.


title: Deep-Learning Continuous Gravitational Waves: Multiple detectors and realistic noise

abstract: The sensitivity of wide-parameter-space searches for continuous gravitational waves is limited by computational cost. Recently it was shown that Deep Neural Networks (DNNs) can perform all-sky searches directly on (single-detector) strain data, potentially providing a low-computing-cost search method that could lead to a better overall sensitivity. Here we expand on this study in two respects: (i) using (simulated) strain data from two detectors simultaneously, and (ii) training for directed (i.e.\ single sky-position) searches in addition to all-sky searches. For a data timespan of $T = 10^5\, s$, the all-sky two-detector DNN is about $7\%$ less sensitive (in amplitude $h_0$) at low frequency ($f=20\,Hz$), and about $51\,\%$ less sensitive at high frequency ($f=1000\,Hz$) compared to fully-coherent matched-filtering (using WEAVE). In the directed case the sensitivity gap compared to matched-filtering ranges from about $7-14\%$ at $f=20\,Hz$ to about $37-49\%$ at $f=1500\,Hz$. Furthermore we assess the DNN's ability to generalize in signal frequency, spindown and sky-position, and we test its robustness to realistic data conditions, namely gaps in the data and using real LIGO detector noise. We find that the DNN performance is not adversely affected by gaps in the test data or by using a relatively undisturbed band of LIGO detector data instead of Gaussian noise. However, when using a more disturbed LIGO band for the tests, the DNN's detection performance is substantially degraded due to the increase in false alarms, as expected.


title: Critical Values Robust to P-hacking

abstract: P-hacking is prevalent in reality but absent from classical hypothesis testing theory. As a consequence, significant results are much more common than they are supposed to be when the null hypothesis is in fact true. In this paper, we build a model of hypothesis testing with p-hacking. From the model, we construct critical values such that, if the values are used to determine significance, and if scientists' p-hacking behavior adjusts to the new significance standards, significant results occur with the desired frequency. Such robust critical values allow for p-hacking so they are larger than classical critical values. To illustrate the amount of correction that p-hacking might require, we calibrate the model using evidence from the medical sciences. In the calibrated model the robust critical value for any test statistic is the classical critical value for the same test statistic with one fifth of the significance level.


title: Coupling enhanced sampling of the apo-receptor with template-based ligand conformers selection: Performance in pose prediction in the D3R-GC4

abstract: We report the performance of our newly introduced Ensemble Docking with Enhanced sampling of pocket Shape (EDES) protocol coupled to a template-based algorithm to generate near-native ligand conformations in the 2019 iteration of the Grand Challenge organized by the D3R consortium. Using either AutoDock4.2 or HADDOCK2.2 docking programs (each software in two variants of the protocol) our method generated native-like poses among the top 5 submitted for evaluation for most of the 20 targets with similar performances. The protein selected for GC4 was the human beta-site amyloid precursor protein cleaving enzyme 1 (BACE-1), a transmembrane aspartic-acid protease. We identified at least one pose whose heavy-atoms RMSD was less than 2.5 {\AA} from the native conformation for 16 (80%) and 17 (85%) of the twenty targets using AutoDock and HADDOCK, respectively. Dissecting the possible sources of errors revealed that: i) our EDES protocol (with minor modifications) was able to sample sub-{\aa}ngstrom conformations for all 20 protein targets, reproducing the correct conformation of the binding site within ~1 {\AA} RMSD; ii) as already shown by some of us in GC3, even in the presence of near-native protein structures, a proper selection of ligand conformers is crucial for the success of ensemble-docking calculations. Importantly, our approach performed best among the protocols exploiting only structural information of the apo protein to generate conformations of the receptor for ensemble-docking calculations.


title: Hyperspectral Image Restoration via Global Total Variation Regularized Local nonconvex Low-Rank matrix Approximation

abstract: Several bandwise total variation (TV) regularized low-rank (LR)-based models have been proposed to remove mixed noise in hyperspectral images (HSIs). Conventionally, the rank of LR matrix is approximated using nuclear norm (NN). The NN is defined by adding all singular values together, which is essentially a $L_1$-norm of the singular values. It results in non-negligible approximation errors and thus the resulting matrix estimator can be significantly biased. Moreover, these bandwise TV-based methods exploit the spatial information in a separate manner. To cope with these problems, we propose a spatial-spectral TV (SSTV) regularized non-convex local LR matrix approximation (NonLLRTV) method to remove mixed noise in HSIs. From one aspect, local LR of HSIs is formulated using a non-convex $L_{\gamma}$-norm, which provides a closer approximation to the matrix rank than the traditional NN. From another aspect, HSIs are assumed to be piecewisely smooth in the global spatial domain. The TV regularization is effective in preserving the smoothness and removing Gaussian noise. These facts inspire the integration of the NonLLR with TV regularization. To address the limitations of bandwise TV, we use the SSTV regularization to simultaneously consider global spatial structure and spectral correlation of neighboring bands. Experiment results indicate that the use of local non-convex penalty and global SSTV can boost the preserving of spatial piecewise smoothness and overall structural information.


title: Wonders of chaos for communication

abstract: This work shows that chaotic signals with different power spectrum are robust to linear superposition, meaning that the superposition preserves Ergodic quantities (Lyapunov exponents) and the information content of the source signals, even after being transmitted over non-ideal physical medium. This wonderful property that chaotic signals have allows me to propose a novel communication system based on chaos, where information composed from and to multiple users each operating with different base frequencies and that is carried by chaotic wavesignals can be fully preserved after transmission in the open air wireless physical medium, and it can be trivially decoded with low probability of errors. This work tackles with great detail how chaotic signals and their information content are affected when travelling through medium that presents the non-ideal properties of multipath propagation, noise and chaotic interference (linear superposition), and how this impacts on the proposed communication system. Physical media with other non-ideal properties (dispersion and interference with periodic signals) are also discussed.


title: On The Relational Width of First-Order Expansions of Finitely Bounded Homogeneous Binary Cores with Bounded Strict Width

abstract: The relational width of a finite structure, if bounded, is always (1,1) or (2,3). In this paper we study the relational width of first-order expansions of finitely bounded homogeneous binary cores where binary cores are structures with equality and some anti-reflexive binary relations such that for any two different elements a, b in the domain there is exactly one binary relation R with (a, b) in R. Our main result is that first-order expansions of liberal finitely bounded homogeneous binary cores with bounded strict width have relational width (2, MaxBound) where MaxBound is the size of the largest forbidden substructure, but is not less than 3, and liberal stands for structures that do not forbid certain finite structures of small size. This result is built on a new approach and concerns a broad class of structures including reducts of homogeneous digraphs for which the CSP complexity classification has not yet been obtained.


title: Phenomenological consequences of an interacting multicomponent dark sector

abstract: We consider a dark sector model containing stable fermions charged under an unbroken $U(1)$ gauge interaction, with a massless dark photon as force carrier, and interacting with ordinary matter via scalar messengers. We study its early Universe evolution by solving a set of coupled Boltzmann equations that track the number density of the different species, as well as entropy and energy exchanges between the dark and visible sectors. Phenomenologically viable realizations include: i) a heavy (order 1 TeV or more) lepton-like dark fermion playing the role of the dark matter candidate, with various production mechanisms active depending on the strength of the dark-visible sector portal; ii) light (few GeV to few tens of GeV) quark-like dark fermions, stable but with suppressed relic densities; iii) an extra radiation component in Universe due to dark photons, with temperature constrained by cosmic microwave background data, and in turn preventing dark fermions to be lighter than about 1 GeV. Extra constraints on our scenario stem from dark matter direct detection searches: the elastic scattering on nuclei is driven by dipole or charge radius interactions mediated by either Standard Model or dark photons, providing long-range effects which, however, are not always dominant, as usually assumed in this context. Projected sensitivities for next-generation detectors cover a significant portion of the viable parameter space and are competitive with respect to the model-dependent constraints derived from the magnetic dipole moments of leptons and cooling of stellar systems.


title: Quantum Natural Language Processing on Near-Term Quantum Computers

abstract: In this work, we describe a full-stack pipeline for natural language processing on near-term quantum computers, aka QNLP. The language-modelling framework we employ is that of compositional distributional semantics (DisCoCat), which extends and complements the compositional structure of pregroup grammars. Within this model, the grammatical reduction of a sentence is interpreted as a diagram, encoding a specific interaction of words according to the grammar. It is this interaction which, together with a specific choice of word embedding, realises the meaning (or "semantics") of a sentence. Building on the formal quantum-like nature of such interactions, we present a method for mapping DisCoCat diagrams to quantum circuits. Our methodology is compatible both with NISQ devices and with established Quantum Machine Learning techniques, paving the way to near-term applications of quantum technology to natural language processing.


title: Sideband Modulation by Sub-Cycle Interference

abstract: We experimentally and theoretically show that the electron energy spectra strongly depend on the relative helicity in highly intense, circularly polarized two-color laser fields which is an unexpected finding. The employed counter-rotating two-color (CRTC) fields and the co-rotating two-color (CoRTC) fields are both a superposition of circularly polarized laser pulses at a central wavelength of 390 nm and 780 nm (intensitiy ratio $I_{390}/I_{780}\approx 250$). For the CRTC field, the measured electron energy spectrum is dominated by peaks that are spaced by 3.18 eV (corresponds to the photon energy of light at a wavelength of 390 nm). For the CoRTC field, we observe additional energy peaks (sidebands). Using our semi-classical, trajectory-based models, we conclude that the sideband intensity is modulated by a sub-cycle interference, which sensitively depends on the relative helicity in circularly polarized two-color fields.


title: LinksIQ: Robust and Efficient Modulation Recognition with Imperfect Spectrum Scans

abstract: While critical for the practical progress of spectrum sharing, modulation recognition has so far been investigated under unrealistic assumptions: (i) a transmitter's bandwidth must be scanned alone and in full, (ii) prior knowledge of the technology must be available and (iii) a transmitter must be trustworthy. In reality these assumptions cannot be readily met, as a transmitter's bandwidth may only be scanned intermittently, partially, or alongside other transmitters, and modulation obfuscation may be introduced by short-lived scans or malicious activity. This paper presents LinksIQ, which bridges the gap between real-world spectrum sensing and the growing body of modrec methods designed under simplifying assumptions. Our key insight is that ordered IQ samples form distinctive patterns across modulations, which persist even with scan deficiencies. We mine these patterns through a Fisher Kernel framework and employ lightweight linear support vector machine for modulation classification. LinksIQ is robust to noise, scan partiality and data biases without utilizing prior knowledge of transmitter technology. Its accuracy consistently outperforms baselines in both simulated and real traces. We evaluate LinksIQ performance in a testbed using two popular SDR platforms, RTL-SDR and USRP. We demonstrate high detection accuracy (i.e. 0.74) even with a $20 RTL-SDR scanning at 50% transmitter overlap. This constitutes an average of 43% improvement over existing counterparts employed on RTL-SDR scans. We also explore the effects of platform-aware classifier training and discuss implications on real-world modrec system design. Our results demonstrate the feasibility of low-cost transmitter fingerprinting at scale.


title: A new obstruction for normal spanning trees

abstract: In a paper from 2001 (Journal of the LMS), Diestel and Leader offered a proof that a connected graph has a normal spanning tree if and only if it does not contain a minor from two specific forbidden classes of graphs, all of cardinality $\aleph_1$. Unfortunately, their proof contains a gap, and their result is incorrect. In this paper, we construct a third type of obstruction: an $\aleph_1$-sized graph without a normal spanning tree that contains neither of the two types described by Diestel and Leader as a minor. Further, we show that any list of forbidden minors characterising the graphs with normal spanning trees must contain graphs of arbitrarily large cardinality.


title: Swarm Programming Using Moth-Flame Optimization and Whale Optimization Algorithms

abstract: Automatic programming (AP) is an important area of Machine Learning (ML) where computer programs are generated automatically. Swarm Programming (SP), a newly emerging research area in AP, automatically generates the computer programs using Swarm Intelligence (SI) algorithms. This paper presents two grammar-based SP methods named as Grammatical Moth-Flame Optimizer (GMFO) and Grammatical Whale Optimizer (GWO). The Moth-Flame Optimizer and Whale Optimization algorithm are used as search engines or learning algorithms in GMFO and GWO respectively. The proposed methods are tested on Santa Fe Ant Trail, quartic symbolic regression, and 3-input multiplexer problems. The results are compared with Grammatical Bee Colony (GBC) and Grammatical Fireworks algorithm (GFWA). The experimental results demonstrate that the proposed SP methods can be used in automatic computer program generation.


title: Symbolic calculus for singular curve operators

abstract: We define a generalization of the T\''oplitz quantization, suitable for operators whose T\''oplitz symbols are singular. We then show that singular curve operators in Topological Quantum Fields Theory (TQFT) are precisely generalized T\''oplitz operators of this kind and we compute for some of them, and conjecture for the others, their main symbol, determined by the associated classical trace function.


title: A Hybrid Method for Training Convolutional Neural Networks

abstract: Artificial Intelligence algorithms have been steadily increasing in popularity and usage. Deep Learning, allows neural networks to be trained using huge datasets and also removes the need for human extracted features, as it automates the feature learning process. In the hearth of training deep neural networks, such as Convolutional Neural Networks, we find backpropagation, that by computing the gradient of the loss function with respect to the weights of the network for a given input, it allows the weights of the network to be adjusted to better perform in the given task. In this paper, we propose a hybrid method that uses both backpropagation and evolutionary strategies to train Convolutional Neural Networks, where the evolutionary strategies are used to help to avoid local minimas and fine-tune the weights, so that the network achieves higher accuracy results. We show that the proposed hybrid method is capable of improving upon regular training in the task of image classification in CIFAR-10, where a VGG16 model was used and the final test results increased 0.61%, in average, when compared to using only backpropagation.


title: A Non-Stationary Bandit-Learning Approach to Energy-Efficient Femto-Caching with Rateless-Coded Transmission

abstract: The ever-increasing demand for media streaming together with limited backhaul capacity renders developing efficient file-delivery methods imperative. One such method is femto-caching, which, despite its great potential, imposes several challenges such as efficient resource management. We study a resource allocation problem for joint caching and transmission in small cell networks, where the system operates in two consecutive phases: (i) cache placement, and (ii) joint file- and transmit power selection followed by broadcasting. We define the utility of every small base station in terms of the number of successful reconstructions per unit of transmission power. We then formulate the problem as to select a file from the cache together with a transmission power level for every broadcast round so that the accumulated utility over the horizon is maximized. The former problem boils down to a stochastic knapsack problem, and we cast the latter as a multi-armed bandit problem. We develop a solution to each problem and provide theoretical and numerical evaluations. In contrast to the state-of-the-art research, the proposed approach is especially suitable for networks with time-variant statistical properties. Moreover, it is applicable and operates well even when no initial information about the statistical characteristics of the random parameters such as file popularity and channel quality is available.