title: Symmetry classes of open fermionic quantum matter

abstract: We present a full symmetry classification of fermion matter in and out of thermal equilibrium. Our approach starts from first principles, the ten different classes of linear and anti-linear state transformations in fermionic Fock spaces, and symmetries defined via invariance properties of the dynamical equation for the density matrix. The object of classification are then the generators of reversible dynamics, dissipation and fluctuations featuring in the generally irreversible and interacting dynamical equations. A sharp distinction between the symmetries of equilibrium and out of equilibrium dynamics, respectively, arises from the different role played by `time' in these two cases: In unitary quantum mechanics as well as in `micro-reversible' thermal equilibrium, anti-linear transformations combined with an inversion of time define time reversal symmetry. However, out of equilibrium an inversion of time becomes meaningless, while anti--linear transformations in Fock space remain physically significant, and hence must be considered in autonomy. The practical consequence of this dichotomy is a novel realization of antilinear symmetries (six out of the ten fundamental classes) in non-equilibrium quantum dynamics that is fundamentally different from the established rules of thermal equilibrium. At large times, the dynamical generators thus symmetry classified determine the steady state non-equilibrium distributions for arbitrary interacting systems. To illustrate this principle, we consider the fixation of a symmetry protected topological phase in a system of interacting lattice fermions. More generally, we consider the practically important class of mean field interacting systems, represented by Gaussian states. This class is naturally described in the language of non-Hermitian matrices, which allows us to compare to previous classification schemes in the literature.


title: Sinkhorn Barycenter via Functional Gradient Descent

abstract: In this paper, we consider the problem of computing the barycenter of a set of probability distributions under the Sinkhorn divergence. This problem has recently found applications across various domains, including graphics, learning, and vision, as it provides a meaningful mechanism to aggregate knowledge. Unlike previous approaches which directly operate in the space of probability measures, we recast the Sinkhorn barycenter problem as an instance of unconstrained functional optimization and develop a novel functional gradient descent method named Sinkhorn Descent (SD). We prove that SD converges to a stationary point at a sublinear rate, and under reasonable assumptions, we further show that it asymptotically finds a global minimizer of the Sinkhorn barycenter problem. Moreover, by providing a mean-field analysis, we show that SD preserves the weak convergence of empirical measures. Importantly, the computational complexity of SD scales linearly in the dimension $d$ and we demonstrate its scalability by solving a $100$-dimensional Sinkhorn barycenter problem.


title: Geometric characterization of SARS-CoV-2 pandemic events

abstract: While the SARS-CoV-2 keeps spreading world-wide, comparing its evolution across different nations is a timely challenge of both theoretical and practical importance. The large variety of dissimilar and country-dependent epidemiological factors, in fact, makes extremely difficult to understand their influence on the epidemic trends within a unique and coherent framework. We present a geometric framework to characterize, in an integrated and low-dimensional fashion, the epidemic plume-like trajectories traced by the infection rate, $I$, and the fatality rate, $D$, in the $(I,D)$ plane. Our analysis enables the definition of an epidemiometric system based on three geometric observables rating the SARS-CoV-2 pandemic events via scales analogous to those for the magnitude and the intensity of seismic events. Being exquisitely geometric, our framework can be applied to classify other epidemic data and secondary waves, raising the possibility of designing epidemic alerts or early warning systems to enhance public and governmental responses to a rapidly emerging outbreak.


title: HPIPE: Heterogeneous Layer-Pipelined and Sparse-Aware CNN Inference for FPGAs

abstract: We present both a novel Convolutional Neural Network (CNN) accelerator architecture and a network compiler for FPGAs that outperforms all prior work. Instead of having generic processing elements that together process one layer at a time, our network compiler statically partitions available device resources and builds custom-tailored hardware for each layer of a CNN. By building hardware for each layer we can pack our controllers into fewer lookup tables and use dedicated routing. These efficiencies enable our accelerator to utilize 2x the DSPs and operate at more than 2x the frequency of prior work on sparse CNN acceleration on FPGAs. We evaluate the performance of our architecture on both sparse Resnet-50 and dense MobileNet Imagenet classifiers on a Stratix 10 2800 FPGA. We find that the sparse Resnet-50 model has throughput at a batch size of 1 of 4550 images/s, which is nearly 4x the throughput of NVIDIA's fastest machine learning targeted GPU, the V100, and outperforms all prior work on FPGAs.


title: Best Viewpoints for External Robots or Sensors Assisting Other Robots

abstract: This work creates a model of the value of different external viewpoints of a robot performing tasks. The current state of the practice is to use a teleoperated assistant robot to provide a view of a task being performed by a primary robot; however, the choice of viewpoints is ad hoc and does not always lead to improved performance. This research applies a psychomotor approach to develop a model of the relative quality of external viewpoints using Gibsonian affordances. In this approach, viewpoints for the affordances are rated based on the psychomotor behavior of human operators and clustered into manifolds of viewpoints with the equivalent value. The value of 30 viewpoints is quantified in a study with 31 expert robot operators for 4 affordances (Reachability, Passability, Manipulability, and Traversability) using a computer-based simulator of two robots. The adjacent viewpoints with similar values are clustered into ranked manifolds using agglomerative hierarchical clustering. The results show the validity of the affordance-based approach by confirming that there are manifolds of statistically significantly different viewpoint values, viewpoint values are statistically significantly dependent on the affordances, and viewpoint values are independent of a robot. Furthermore, the best manifold for each affordance provides a statistically significant improvement with a large Cohen's d effect size (1.1-2.3) in performance (improving time by 14%-59% and reducing errors by 87%-100%) and improvement in performance variation over the worst manifold. This model will enable autonomous selection of the best possible viewpoint and path planning for the assistant robot.


title: Points2Surf: Learning Implicit Surfaces from Point Cloud Patches

abstract: A key step in any scanning-based asset creation workflow is to convert unordered point clouds to a surface. Classical methods (e.g., Poisson reconstruction) start to degrade in the presence of noisy and partial scans. Hence, deep learning based methods have recently been proposed to produce complete surfaces, even from partial scans. However, such data-driven methods struggle to generalize to new shapes with large geometric and topological variations. We present Points2Surf, a novel patch-based learning framework that produces accurate surfaces directly from raw scans without normals. Learning a prior over a combination of detailed local patches and coarse global information improves generalization performance and reconstruction accuracy. Our extensive comparison on both synthetic and real data demonstrates a clear advantage of our method over state-of-the-art alternatives on previously unseen classes (on average, Points2Surf brings down reconstruction error by 30% over SPR and by 270%+ over deep learning based SotA methods) at the cost of longer computation times and a slight increase in small-scale topological noise in some cases. Our source code, pre-trained model, and dataset are available on: https://github.com/ErlerPhilipp/points2surf


title: Exploiting Process Variations to Secure Photonic NoC Architectures from Snooping Attacks

abstract: The compact size and high wavelength-selectivity of microring resonators (MRs) enable photonic networks-on-chip (PNoCs) to utilize dense-wavelength-division-multiplexing (DWDM) in their photonic waveguides, and as a result, attain high bandwidth on-chip data transfers. Unfortunately, a Hardware Trojan in a PNoC can manipulate the electrical driving circuit of its MRs to cause the MRs to snoop data from the neighboring wavelength channels in a shared photonic waveguide, which introduces a serious security threat. This paper presents a framework that utilizes process variation-based authentication signatures along with architecture-level enhancements to protect against data-snooping Hardware Trojans during unicast as well as multicast transfers in PNoCs. Evaluation results indicate that our framework can improve hardware security across various PNoC architectures with minimal overheads of up to 14.2% in average latency and of up to 14.6% in energy-delay-product (EDP).


title: The multilayer random dot product graph

abstract: We present a comprehensive extension of the latent position network model known as the random dot product graph to accommodate multiple graphs -- both undirected and directed -- which share a common subset of nodes, and propose a method for jointly embedding the associated adjacency matrices, or submatrices thereof, into a suitable latent space. Theoretical results concerning the asymptotic behaviour of the node representations thus obtained are established, showing that after the application of a linear transformation these converge uniformly in the Euclidean norm to the latent positions with Gaussian error. Within this framework, we present a generalisation of the stochastic block model to a number of different multiple graph settings, and demonstrate the effectiveness of our joint embedding method through several statistical inference tasks in which we achieve comparable or better results than rival spectral methods. Empirical improvements in link prediction over single graph embeddings are exhibited in a cyber-security example.


title: Searching for Cross-Correlation Between Stochastic Gravitational Wave Background and Galaxy Number Counts

abstract: Advanced LIGO and Advanced Virgo have recently published the upper limit measurement of persistent directional stochastic gravitational wave background (SGWB) based on data from their first and second observing runs (O1 and O2). In this paper we investigate whether a correlation exists between this maximal likelihood SGWB map and the electromagnetic tracers of matter structure in the universe, such as galaxy number counts. The method we develop will improve the sensitivity of future searches for anisotropy in the SGWB and expand the use of SGWB anisotropy to probe the formation of structure in the universe. In order to compute the cross-correlation, we used the spherical harmonic decomposition of SGWB in multiple frequency bands and converted them into pixel-based sky maps in HEALPix basis. For the electromagnetic (EM) part, we use the Sloan Digital Sky Survey (SDSS) galaxy catalog and form HEALPix sky maps of galaxy number counts at the same angular resolution as the SGWB maps. We compute the pixel-based coherence between these SGWB and galaxy count maps. After evaluating our results in different SGWB frequency bands and in different galaxy redshift bins, we conclude that the coherence between the SGWB and galaxy number count maps is dominated by the null measurement noise in the SGWB maps, and therefore not statistically significant. We expect the results of this analysis to be significantly improved by using the more sensitive upcoming SGWB measurements based on the third observing run (O3) of Advanced LIGO and Advanced Virgo.


title: Multi-agent Reinforcement Learning in Bayesian Stackelberg Markov Games for Adaptive Moving Target Defense

abstract: The field of cybersecurity has mostly been a cat-and-mouse game with the discovery of new attacks leading the way. To take away an attacker's advantage of reconnaissance, researchers have proposed proactive defense methods such as Moving Target Defense (MTD). To find good movement strategies, researchers have modeled MTD as leader-follower games between the defender and a cyber-adversary. We argue that existing models are inadequate in sequential settings when there is incomplete information about a rational adversary and yield sub-optimal movement strategies. Further, while there exists an array of work on learning defense policies in sequential settings for cyber-security, they are either unpopular due to scalability issues arising out of incomplete information or tend to ignore the strategic nature of the adversary simplifying the scenario to use single-agent reinforcement learning techniques. To address these concerns, we propose (1) a unifying game-theoretic model, called the Bayesian Stackelberg Markov Games (BSMGs), that can model uncertainty over attacker types and the nuances of an MTD system and (2) a Bayesian Strong Stackelberg Q-learning (BSS-Q) approach that can, via interaction, learn the optimal movement policy for BSMGs within a reasonable time. We situate BSMGs in the landscape of incomplete-information Markov games and characterize the notion of Strong Stackelberg Equilibrium (SSE) in them. We show that our learning approach converges to an SSE of a BSMG and then highlight that the learned movement policy (1) improves the state-of-the-art in MTD for web-application security and (2) converges to an optimal policy in MTD domains with incomplete information about adversaries even when prior information about rewards and transitions is absent.


title: i6mA-CNN: a convolution based computational approach towards identification of DNA N6-methyladenine sites in rice genome

abstract: DNA N6-methylation (6mA) in Adenine nucleotide is a post replication modification and is responsible for many biological functions. Experimental methods for genome wide 6mA site detection is an expensive and manual labour intensive process. Automated and accurate computational methods can help to identify 6mA sites in long genomes saving significant time and money. Our study develops a convolutional neural network based tool i6mA-CNN capable of identifying 6mA sites in the rice genome. Our model coordinates among multiple types of features such as PseAAC inspired customized feature vector, multiple one hot representations and dinucleotide physicochemical properties. It achieves area under the receiver operating characteristic curve of 0.98 with an overall accuracy of 0.94 using 5 fold cross validation on benchmark dataset. Finally, we evaluate our model on two other plant genome 6mA site identification datasets besides rice. Results suggest that our proposed tool is able to generalize its ability of 6mA site identification on plant genomes irrespective of plant species. Web tool for this research can be found at: https://cutt.ly/Co6KuWG. Supplementary data (benchmark dataset, independent test dataset, comparison purpose dataset, trained model, physicochemical property values, attention mechanism details for motif finding) are available at https://cutt.ly/PpDdeDH.


title: SeqPoint: Identifying Representative Iterations of Sequence-based Neural Networks

abstract: The ubiquity of deep neural networks (DNNs) continues to rise, making them a crucial application class for hardware optimizations. However, detailed profiling and characterization of DNN training remains difficult as these applications often run for hours to days on real hardware. Prior works exploit the iterative nature of DNNs to profile a few training iterations. While such a strategy is sound for networks like convolutional neural networks (CNNs), where the nature of the computation is largely input independent, we observe in this work that this approach is sub-optimal for sequence-based neural networks (SQNNs) such as recurrent neural networks (RNNs). The amount and nature of computations in SQNNs can vary for each input, resulting in heterogeneity across iterations. Thus, arbitrarily selecting a few iterations is insufficient to accurately summarize the behavior of the entire training run. To tackle this challenge, we carefully study the factors that impact SQNN training iterations and identify input sequence length as the key determining factor for variations across iterations. We then use this observation to characterize all iterations of an SQNN training run (requiring no profiling or simulation of the application) and select representative iterations, which we term SeqPoints. We analyze two state-of-the-art SQNNs, DeepSpeech2 and Google's Neural Machine Translation (GNMT), and show that SeqPoints can represent their entire training runs accurately, resulting in geomean errors of only 0.11% and 0.53%, respectively, when projecting overall runtime and 0.13% and 1.50% when projecting speedups due to architectural changes. This high accuracy is achieved while reducing the time needed for profiling by 345x and 214x for the two networks compared to full training runs. As a result, SeqPoint can enable analysis of SQNN training runs in mere minutes instead of hours or days.


title: Cortically based optimal transport

abstract: We introduce a model for image morphing in the primary visual cortex V1 to perform completion of missing images in time. We model the output of simple cells through a family of Gabor filters and the propagation of the neural signal accordingly to the functional geometry induced by horizontal connectivity. Then we model the deformation between two images as a path relying two different outputs. This path is obtained by optimal transport considering the Wasserstein distance geodesics associated to some probability measures naturally induced by the outputs on V1. The frame of Gabor filters allows to project back the output path, therefore obtaining an associated image stimulus deformation. We perform a numerical implementation of our cortical model, assessing its ability in reconstructing rigidi motions of simple shapes.


title: Column-Randomized Linear Programs: Performance Guarantees and Applications

abstract: We propose a randomized method for solving linear programs with a large number of columns but a relatively small number of constraints. Since enumerating all the columns is usually unrealistic, such linear programs are commonly solved by column generation, which is often still computationally challenging due to the intractability of the subproblem in many applications. Instead of iteratively introducing one column at a time as in column generation, our proposed method involves sampling a collection of columns according to a user-specified randomization scheme and solving the linear program consisting of the sampled columns. While similar methods for solving large-scale linear programs by sampling columns (or, equivalently, sampling constraints in the dual) have been proposed in the literature, in this paper we derive an upper bound on the optimality gap that holds with high probability. This bound converges at a rate $1 / \sqrt{K}$, where $K$ is the number of sampled columns, to the optimality gap of a linear program related to the sampling distribution. We analyze the gap of this latter linear program, which we dub the distributional counterpart, and derive conditions under which this gap will be small. Finally, we numerically demonstrate the effectiveness of the proposed method in the cutting-stock problem and in nonparametric choice model estimation.


title: Deep Local Volatility

abstract: Deep learning for option pricing has emerged as a novel methodology for fast computations with applications in calibration and computation of Greeks. However, many of these approaches do not enforce any no-arbitrage conditions, and the subsequent local volatility surface is never considered. In this article, we develop a deep learning approach for interpolation of European vanilla option prices which jointly yields the full surface of local volatilities. We demonstrate the modification of the loss function or the feed forward network architecture to enforce (hard constraints approach) or favor (soft constraints approach) the no-arbitrage conditions and we specify the experimental design parameters that are needed for adequate performance. A novel component is the use of the Dupire formula to enforce bounds on the local volatility associated with option prices, during the network fitting. Our methodology is benchmarked numerically on real datasets of DAX vanilla options.


title: Differentiable Joint Pruning and Quantization for Hardware Efficiency

abstract: We present a differentiable joint pruning and quantization (DJPQ) scheme. We frame neural network compression as a joint gradient-based optimization problem, trading off between model pruning and quantization automatically for hardware efficiency. DJPQ incorporates variational information bottleneck based structured pruning and mixed-bit precision quantization into a single differentiable loss function. In contrast to previous works which consider pruning and quantization separately, our method enables users to find the optimal trade-off between both in a single training procedure. To utilize the method for more efficient hardware inference, we extend DJPQ to integrate structured pruning with power-of-two bit-restricted quantization. We show that DJPQ significantly reduces the number of Bit-Operations (BOPs) for several networks while maintaining the top-1 accuracy of original floating-point models (e.g., 53x BOPs reduction in ResNet18 on ImageNet, 43x in MobileNetV2). Compared to the conventional two-stage approach, which optimizes pruning and quantization independently, our scheme outperforms in terms of both accuracy and BOPs. Even when considering bit-restricted quantization, DJPQ achieves larger compression ratios and better accuracy than the two-stage approach.


title: Embeddings of Ree unitals in a projective plane over a field

abstract: We show that the Ree unital $\mathcal{R}(q)$ has an embedding in a projective plane over a field $F$ if and only if $q=3$ and $\mathbb{F}_8$ is a subfield of $F$. In this case, the embedding is unique up to projective linear transformations. Besides elementary calculations, our proof uses the classification of the maximal subgroups of the simple Ree groups.


title: Novel repumping on $^{3}$P$_{0}$$\rightarrow$$^{3}$D$_{1}$ for Sr magneto-optical trap and Land\'e g factor measurement of $^{3}$D$_{1}$

abstract: We realize an experimental facility for cooling and trapping strontium (Sr) atoms and measure the Land\'e g factor of $^{3}$D$_{1}$ of $^{88}$Sr. Thanks to a novel repumping scheme with the $^{3}$P$_{2}$$\rightarrow$$^{3}$S$_{1}$ and $^{3}$P$_{0}$$\rightarrow$$^{3}$D$_{1}$ combination and the permanent magnets based self-assembled Zeeman slower, the peak atom number in the continuously repumped blue MOT is enhanced by a factor of 15 with respect to the non-repumping case, and reaches $\sim$1 billion. Furthermore, using the resolved-sideband Zeeman spectroscopy, the Land\'e g factor of $^{3}$D$_{1}$ is measured to be 0.4995(88) showing a good agreement with the theoretical value of 0.4988. The results will have an impact on various applications including atom laser, dipolar interactions, quantum information and precision measurements.


title: Detection, Attribution and Localization of GAN Generated Images

abstract: Recent advances in Generative Adversarial Networks (GANs) have led to the creation of realistic-looking digital images that pose a major challenge to their detection by humans or computers. GANs are used in a wide range of tasks, from modifying small attributes of an image (StarGAN [14]), transferring attributes between image pairs (CycleGAN [91]), as well as generating entirely new images (ProGAN [36], StyleGAN [37], SPADE/GauGAN [64]). In this paper, we propose a novel approach to detect, attribute and localize GAN generated images that combines image features with deep learning methods. For every image, co-occurrence matrices are computed on neighborhood pixels of RGB channels in different directions (horizontal, vertical and diagonal). A deep learning network is then trained on these features to detect, attribute and localize these GAN generated/manipulated images. A large scale evaluation of our approach on 5 GAN datasets comprising over 2.76 million images (ProGAN, StarGAN, CycleGAN, StyleGAN and SPADE/GauGAN) shows promising results in detecting GAN generated images.


title: Second-Order Pooling for Graph Neural Networks

abstract: Graph neural networks have achieved great success in learning node representations for graph tasks such as node classification and link prediction. Graph representation learning requires graph pooling to obtain graph representations from node representations. It is challenging to develop graph pooling methods due to the variable sizes and isomorphic structures of graphs. In this work, we propose to use second-order pooling as graph pooling, which naturally solves the above challenges. In addition, compared to existing graph pooling methods, second-order pooling is able to use information from all nodes and collect second-order statistics, making it more powerful. We show that direct use of second-order pooling with graph neural networks leads to practical problems. To overcome these problems, we propose two novel global graph pooling methods based on second-order pooling; namely, bilinear mapping and attentional second-order pooling. In addition, we extend attentional second-order pooling to hierarchical graph pooling for more flexible use in GNNs. We perform thorough experiments on graph classification tasks to demonstrate the effectiveness and superiority of our proposed methods. Experimental results show that our methods improve the performance significantly and consistently.


title: Fully Convolutional Spatio-Temporal Models for Representation Learning in Plasma Science

abstract: We have trained a fully convolutional spatio-temporal model for fast and accurate representation learning in the challenging exemplar application area of fusion energy plasma science. The onset of major disruptions is a critically important fusion energy science (FES) issue that must be resolved for advanced tokamak. While a variety of statistical methods have been used to address the problem of tokamak disruption prediction and control, recent approaches based on deep learning have proven particularly compelling. In the present paper, we introduce further improvements to the fusion recurrent neural network (FRNN) software suite. Up to now, FRNN was based on the long short-term memory (LSTM) variant of recurrent neural networks to leverage the temporal information in the data. Here, we implement and apply the temporal convolutional neural network (TCN) architecture to the time-dependent input signals, thus rendering the FRNN architecture fully convolutional. This allows highly optimized convolution operations to carry the majority of the computational load of training, thus enabling a reduction in training time, and the effective use of high performance computing (HPC) resources for hyperparameter tuning. At the same time, the TCN based architecture achieves equal or better predictive performance when compared with the LSTM architecture for a large, representative fusion database. Across data-rich scientific disciplines, these results have implications for the resource-effective training of general spatio-temporal feature extractors based on deep learning. Moreover, this challenging exemplar case study illustrates the advantages of a predictive platform with flexible architecture selection options capable of being readily tuned and adapted for responding to prediction needs that increasingly arise in large modern observational dataset.


title: Active MR k-space Sampling with Reinforcement Learning

abstract: Deep learning approaches have recently shown great promise in accelerating magnetic resonance image (MRI) acquisition. The majority of existing work have focused on designing better reconstruction models given a pre-determined acquisition trajectory, ignoring the question of trajectory optimization. In this paper, we focus on learning acquisition trajectories given a fixed image reconstruction model. We formulate the problem as a sequential decision process and propose the use of reinforcement learning to solve it. Experiments on a large scale public MRI dataset of knees show that our proposed models significantly outperform the state-of-the-art in active MRI acquisition, over a large range of acceleration factors.


title: Modular and Submodular Optimization with Multiple Knapsack Constraints via Fractional Grouping

abstract: A multiple knapsack constraint over a set of items is defined by a set of bins of arbitrary capacities, and a weight for each of the items. An assignment for the constraint is an allocation of subsets of items to the bins which adheres to bin capacities. In this paper we present a unified algorithm that yields efficient approximations for a wide class of submodular and modular optimization problems involving multiple knapsack constraints. One notable example is a polynomial time approximation scheme for Multiple-Choice Multiple Knapsack, improving upon the best known ratio of $2$. Another example is Non-monotone Submodular Multiple Knapsack, for which we obtain a $(0.385-\varepsilon)$-approximation, matching the best known ratio for a single knapsack constraint. The robustness of our algorithm is achieved by applying a novel fractional variant of the classical linear grouping technique, which is of independent interest.


title: Signatures of sunspot oscillations and the case for chromospheric resonances

abstract: Sunspots host a large variety of oscillatory phenomena, whose properties depend on the nature of the wave modes and the magnetic and thermodynamic structure of the spot. Umbral chromospheric oscillations exhibit significant differences compared to their photospheric counterparts. They show an enhanced power and a shorter dominant period, from waves with an amplitude of a few hundred meters per second in the five-minute band at the photosphere, to amplitudes of several kilometers per second in the three-minute band at the chromosphere. Various models have been proposed to explain this behaviour, including the presence of a chromospheric resonance cavity between the photosphere and the transition region. Jess et al. (2020, Nature Astronomy, 4, 220) claimed the detection of observational evidence supporting this model, obtained from the comparison of spectropolarimetric observations and numerical simulations. Here, it is shown that the observational insight reported by Jess et al. is not a common property of sunspots. More importantly, numerical modelling also shows that it is not an unequivocal signature of an acoustic resonator.


title: The failure of testing for cosmic opacity via the distance-duality relation

abstract: The distance-duality relation (DDR) between the luminosity distance $D_L$ and the angular diameter distance $D_A$ is viewed as a powerful tool for testing for the opacity of the Universe, being independent of any cosmological model. It was applied by many authors, who mostly confirm its validity and report a negligible opacity of the Universe. Nevertheless, a thorough analysis reveals that applying the DDR in cosmic opacity tests is tricky. Its applicability is strongly limited because of a non-unique interpretation of the $D_L$ data in terms of cosmic opacity and a rather low accuracy and deficient extent of currently available $D_A$ data. Moreover, authors usually assume that cosmic opacity is frequency independent and parametrize it in their tests by a prescribed phenomenological function. In this way, they only prove that cosmic opacity does not follow their assumptions. As a consequence, no convincing evidence of transparency of the universe using the DDR has so far been presented.


title: Geometric Shaping of 2-Dimensional Constellations in the Presence of Laser Phase Noise

abstract: In this paper, we propose a geometric shaping (GS) strategy to design 8, 16, 32 and 64-ary modulation formats for the optical fibre channel impaired by both additive white Gaussian (AWGN) and phase noise. The constellations were optimised to maximise generalised mutual information (GMI) using a mismatched channel model. The presented formats demonstrate an enhanced signal-to-noise ratio (SNR) tolerance in high phase noise regimes when compared with their quadrature amplitude modulation (QAM) or AWGN-optimised counterparts. By putting the optimisation results in the context of the 400ZR implementation agreement, we show that GS alone can either relax the laser linewidth (LW) or carrier phase estimation (CPE) requirements of 400 Gbit/s transmission links and beyond. Following the GMI validation, the performance of the presented formats was examined in terms of post forward error correction (FEC) bit-error-rate (BER) for a soft decision (SD) extended Hamming code (128, 120), implemented as per the 400ZR implementation agreement. We demonstrate gains of up to 1.2 dB when compared to the 64-ary AWGN shaped formats.


title: Gamma-ray emission in radio galaxies under the VLBI scope -- II. The relationship between gamma-ray emission and parsec-scale jets in radio galaxies

abstract: Following our study of the radio and high-energy properties of $\gamma$-ray-emitting radio galaxies, here we investigate the kinematic and spectral properties of the parsec-scale jets of radio galaxies that have not yet been detected by Fermi-LAT. We take advantage of the regular VLBI observations provided by the TANAMI monitoring program, and explore the kinematic properties of six $\gamma$-ray-faint radio galaxies. We include publicly available VLBI kinematics of $\gamma$-ray-quiet radio galaxies monitored by the MOJAVE program and perform a Fermi-LAT analysis, deriving upper limits. We combine these results with those from our previous paper to construct the largest sample of radio galaxies with combined VLBI and $\gamma$-ray measurements to date. We find superluminal motion up to $\beta_\mathrm{app}=3.6$ in the jet of PKS 2153$-$69. We find a clear trend of higher apparent speed as a function of distance from the jet core on scales of $\sim10^5\,R_s$, corresponding to the end of the collimation and acceleration zone in nearby radio galaxies. We find evidence of subluminal apparent motion in the jets of PKS 1258$-$321 and IC 4296, and no measurable motion for PKS 1549$-$79, PKS 1733$-$565 and PKS 2027$-$308. We compare the VLBI properties of $\gamma$-ray-detected and undetected radio galaxies, and find significantly different distributions of median core flux density, and, possibly, of median core brightness temperature. We find a significant correlation between median core flux density and $\gamma$-ray flux, but no correlation with typical Doppler boosting indicators such as median core brightness temperature and core dominance. Our study suggests that high-energy emission from radio galaxies is related to parsec-scale radio emission from the inner jet, but is not driven by Doppler boosting effects, in contrast to the situation in their blazar counterparts.


title: Relaxation to equilibrium in the one-dimensional thin-film equation with partial wetting

abstract: We investigate the large time behavior of compactly supported solutions for a one-dimensional thin-film equation with linear mobility in the regime of partial wetting. We show the stability of steady state solutions. The proof uses the Lagrangian coordinates. Our method is to establish and exploit differential relations between the energy and the dissipation as well as some interpolation inequalities. Our result is different from earlier results because here we consider solutions with finite mass.


title: A Discrete Fourier Transform-Based Framework for Analysis and Synthesis of Cylindrical Omega-bianisotropic Metasurfaces

abstract: This paper presents a framework for analyzing and designing cylindrical omega-bianisotropic metasurfaces, inspired by mode matching and digital signal processing techniques. Using the discrete Fourier transform, we decompose the the electromagnetic field distributions into orthogonal cylindrical modes and convert the azimuthally varying metasurface constituent parameters into their respective spectra. Then, by invoking appropriate boundary conditions, we set up systems of algebraic equations which can be rearranged to either predict the scattered fields of prespecified metasurfaces, or to synthesize metasurfaces which support arbitrarily stipulated field transformations. The proposed framework facilitates the efficient evaluation of field distributions that satisfy local power conservation, which is one of the key difficulties involved with the design of passive and lossless scalar metasurfaces. It represents a promising solution to circumvent the need for active components, controlled power dissipation, or tensorial surface polarizabilities in many state-of-the art conformal metasurface-based devices. To demonstrate the robustness and the versatility of the proposed technique, we design several devices intended for different applications and numerically verify them using finite element simulations.


title: Future Smart Connected Communities to Fight COVID-19 Outbreak

abstract: Internet of Things (IoT) has grown rapidly in the last decade and continue to develop in terms of dimension and complexity offering wide range of devices to support diverse set of applications. With ubiquitous Internet, connected sensors and actuators, networking and communication technology, and artificial intelligence (AI), smart cyber-physical systems (CPS) provide services rendering assistance to humans in their daily lives. However, the recent outbreak of COVID-19 (also known as coronavirus) pandemic has exposed and highlighted the limitations of current technological deployments to curtail this disease. IoT and smart connected technologies together with data-driven applications can play a crucial role not only in prevention, continuous monitoring, and mitigation of the disease, but also enable prompt enforcement of guidelines, rules and government orders to contain such future outbreaks. In this paper, we envision an IoT-enabled ecosystem for intelligent monitoring, pro-active prevention and control, and mitigation of COVID-19. We propose different architectures, applications and technology systems for various smart infrastructures including E-health, smart home, smart supply chain management, smart locality, and smart city, to develop future connected communities to manage and mitigate similar outbreaks. Furthermore, we present research challenges together with future directions to enable and develop these smart communities and infrastructures to fight and prepare against such outbreaks.


title: Promotion and cyclic sieving on families of SSYT

abstract: We examine a few families of semistandard Young tableaux, for which we observe the cyclic sieving phenomenon under promotion. The first family we consider consists of stretched hook shapes, where we use the cocharge generating polynomial as CSP-polynomial. The second family we consider consists of skew shapes, consisting of rectangles. Again, the charge generating polynomial together with promotion exhibits the cyclic sieving phenomenon. This generalizes earlier result by B. Rhoades and later B. Fontaine and J. Kamnitzer. Finally, we consider certain skew ribbons, where promotion behaves in a predictable manner. This result is stated in form of a bicyclic sieving phenomenon. One of the tools we use is a novel method for computing charge of skew semistandard tableaux, in the case when every number in the tableau occur with the same frequency.


title: Deep multi-metric learning for text-independent speaker verification

abstract: Text-independent speaker verification is an important artificial intelligence problem that has a wide spectrum of applications, such as criminal investigation, payment certification, and interest-based customer services. The purpose of text-independent speaker verification is to determine whether two given uncontrolled utterances originate from the same speaker or not. Extracting speech features for each speaker using deep neural networks is a promising direction to explore and a straightforward solution is to train the discriminative feature extraction network by using a metric learning loss function. However, a single loss function often has certain limitations. Thus, we use deep multi-metric learning to address the problem and introduce three different losses for this problem, i.e., triplet loss, n-pair loss and angular loss. The three loss functions work in a cooperative way to train a feature extraction network equipped with Residual connections and squeeze-and-excitation attention. We conduct experiments on the large-scale \texttt{VoxCeleb2} dataset, which contains over a million utterances from over $6,000$ speakers, and the proposed deep neural network obtains an equal error rate of $3.48\%$, which is a very competitive result. Codes for both training and testing and pretrained models are available at \url{https://github.com/GreatJiweix/DmmlTiSV}, which is the first publicly available code repository for large-scale text-independent speaker verification with performance on par with the state-of-the-art systems.


title: Review of light curves of novae in the modified scales. I. Recurrent novae

abstract: We reviewed the light curves of 10 known recurrent novae (RNs) in the modified scales of the "logarithmic of time, amplitude of outburst". A unified rule was established to normalize the time scale. Confirmation of the known result: in a series of recurrent outbursts, the light curve of nova retains its shape, was realized by distinguishing three groups amongst these 10 novae. The CI Aql (+V2487 Oph) and T Pyx (+ IM Nor) groups contain by one additional member. The V745 Sco group includes V394 CrA and V3890 Sgr. Three RNs: T CrB, RS Oph and U Sco, have its own uniqueness. After comparing the light curves of galactic novae with the light curves of some novae of the Large and Small Magellanic Clouds (LMC and SMC), we selected several candidates for recurrent novae in addition to 3 known recurrent novae in these galaxies. Assuming that the physical characteristics of the novae in the group coincide, we estimated the absolute magnitudes of the galactic novae: CI Aql and V2847 Oph have absolute magnitudes M_V=-7.5 mag, IM Nor and T Pyx - M_V=-7.2 mag, V3890 Sgr - M_V=-7.9 mag, U Sco - M_I=-9.0 mag. The comparison of the summarized light curves of recurrent novae with the light curves of some low-amplitude classical novae allowed us amongst the last to distinguish the list of 26 candidates in recurrent novae. Three of them are known from lists of other authors. An interesting example is the V1017 Sgr, which erupted in 1919 as a nova of the T Pyx type, and which also shows less bright outbursts classified as dwarf nova outbursts.


title: Exciton energy spectra in polyyne chains

abstract: Recently, we have experimentally observed signatures of sharp exciton peaks in the photoluminescence spectra of bundles of monoatomic carbon chains stabilized by gold nanoparticles and deposited on a glass substrate. Here, we estimate the characteristic energies of excitonic transitions in this complex quasi-one-dimensional nano-system with use of the variational method. We show that the characteristic energy scale for the experimentally observed excitonic fine structure is governed by the interplay between the hopping energy in a Van der Waals quasicrystal formed by parallel carbon chains, the neutral-charged exciton splitting and the positive-negative trion splitting. These three characteristic energies are an order of magnitude lower than the direct exciton binding energy.


title: Some Minkowski-type inequalities using generalized proportional Hadamard fractional integral operators

abstract: The main objective of present investigation to obtain some Minkowski-type fractional integral inequalities using generalised proportional Hadamard fractional integral operators which is introduced by Rahman et al in the paper (certain inequalities via generalized proportional Hadamard fractional integral operators), Advances in Differential Equations, (2019), 2019:454. In addition, we establish some other fractional integral inequalities for positive and continuous functions.


title: What are the minimal conditions required to define a SIC POVM?

abstract: Symmetric informationally complete (SIC) POVMs are a class of quantum measurements which, in addition to being informationally complete, satisfy three conditions: 1) every POVM element is rank one, 2) the Hilbert-Schmidt inner product between any two distinct elements is constant, and 3) the trace of each element is constant. The third condition is often overlooked, since it may give the impression that it follows trivially from the second. We show that this condition cannot be removed, as it leads to two distinct values for the trace of an element of the POVM. This observation has led us to define a broader class of measurements which we call semi-SIC POVMs. In dimension two we show that semi-SIC POVMs exist, and we construct the entire family. In higher dimensions, we characterize key properties and applications of semi-SIC POVMs, and note that the proof of their existence remains open.


title: Epitaxial Al/GaAs/Al tri-layers fabricated using a novel wafer-bonding technique

abstract: Epitaxial Al/GaAs/Al structures having controlled thickness of high-quality GaAs and pristine interfaces have been fabricated using a wafer-bonding technique. III-V semiconductor/Al structures are grown by molecular beam epitaxy on III-V semiconductor substrates and bonded to silicon and sapphire. Selective etching is used to remove the III-V substrate followed by surface cleaning and superconductor regrowth, resulting in epitaxial Al/GaAs/Al tri-layers on sapphire or silicon substrates. Structures are characterized with reflection high energy electron diffraction, atomic force microscopy, X-ray photoelectron spectroscopy, transmission electron microscopy, and X-ray diffraction. Applications of these structures to the field of quantum information processing is discussed.


title: AdvFoolGen: Creating Persistent Troubles for Deep Classifiers

abstract: Researches have shown that deep neural networks are vulnerable to malicious attacks, where adversarial images are created to trick a network into misclassification even if the images may give rise to totally different labels by human eyes. To make deep networks more robust to such attacks, many defense mechanisms have been proposed in the literature, some of which are quite effective for guarding against typical attacks. In this paper, we present a new black-box attack termed AdvFoolGen, which can generate attacking images from the same feature space as that of the natural images, so as to keep baffling the network even though state-of-the-art defense mechanisms have been applied. We systematically evaluate our model by comparing with well-established attack algorithms. Through experiments, we demonstrate the effectiveness and robustness of our attack in the face of state-of-the-art defense techniques and unveil the potential reasons for its effectiveness through principled analysis. As such, AdvFoolGen contributes to understanding the vulnerability of deep networks from a new perspective and may, in turn, help in developing and evaluating new defense mechanisms.


title: Analysis of the SARS-CoV-2 outbreak in Rio Grande do Sul / Brazil

abstract: This article contains a series of analyses done for the SARS-CoV-2 outbreak in Rio Grande do Sul (RS) in the south of Brazil. These analyses are focused on the high-incidence cities such as the state capital Porto Alegre and at the state level. We provide methodological details and estimates for the effective reproduction number $R_t$, a joint analysis of the mobility data together with the estimated $R_t$ as well as ICU simulations and ICU LoS (length of stay) estimation for hospitalizations in Porto Alegre/RS.


title: Swift/XRT, Chandra and XMM-Newton observations of IGR J17091-3624 as it returns into quiescence

abstract: IGR J17091-3624 is a low mass X-ray binary (LMXB) which received wide attention from the community thanks to its similarities with the bright black hole system GRS 1915+105. Both systems exhibit a wide range of highly structured X-ray variability during outburst, with time scales from few seconds to tens of minutes, which make them unique in the study of mass accretion in LMXBs. In this work we present a general overview into the long-term evolution of IGR J17091-3624, using Swift/XRT observations from the onset of the 2011-2013 outburst in February 2011 to the end of the last bright outburst in November 2016. We found 4 re-flares during the decay of the 2011 outburst, but no similar re-flares appear to be present in the latter one. We studied in detail the period with the lowest flux observed in the last 10 years, just at the tail end of the 2011-2013 outburst, using Chandra and XMM-Newton observations. We observed changes in flux as high as a factor of 10 during this period of relative quiescence, without strong evidence of softening in the spectra. This result suggests that the source has not been observed at its true quiescence so far. By comparing the spectral properties at low luminosities of IGR J17091-3624 and those observed for a well studied population of LMXBs, we concluded that IGR J17091-3624 is most likely to host a black hole as a compact companion rather than a neutron star.


title: Collective Motility, Mechanical Waves, and Durotaxis in Cell Clusters

abstract: Epithelial cell clusters often move collectively on a substrate. Mechanical signals play a major role in organizing this behavior. There are a number of experimental observations in these systems which await a comprehensive explanation. These include: the internal strains are tensile even for clusters that expand by proliferation; the tractions on the substrate are often confined to the edges of the cluster; there can exist density waves within the cluster; clusters can exhibit collective durotaxis when individual cells show no effect; and for cells in an annulus there is a transition between expanding clusters with proliferation and the case where cells fill the annulus and rotate around it. We formulate a mechanical model to examine these effects. We use a molecular clutch picture which allows "stalling" -- inhibition of cell contraction by external forces. Stalled cells are passive from a physical point of view and the un-stalled cells are active. By attaching cells to the substrate and to each other, and taking into account contact inhibition of locomotion, we get a simple picture for many of these findings as well as predictions that could be tested. SI text/figures included, SI movies at https://rice.box.com/s/xiy3mwsfj3203lfu7pk0udfklexcgsew


title: Topological dyonic Taub-Bolt/NUT-AdS: Thermodynamics and first law

abstract: Motivated by the absence of Misner string in the Euclidean Taub-Bolt/NUT solutions with flat horizons, we present a new treatment for studying the thermodynamics of these spactimes. This treatment is based on introducing a new charge, $N=\sigma \, n$ (where $n$ is the nut charge and $\sigma$ is some constant) and its conjugate thermodynamic potential $\Phi_N$. Upon identifying one of the spatial coordinates, the boundary of these solutions contains two annulus-like surfaces in addition to the constant-r surface. For these solutions, we show that these annuli surfaces receive electric, magnetic and mass/energy fluxes, therefore, they have nontrivial contributions to these conserved charges. Calculating these conserved charges we find, $Q_e = Q^{\infty}_e-2N\Phi_m$, $Q_m =Q^{\infty}_m+2N\Phi_e$ and $\mathfrak{M} =M-2N\Phi_N$, where $Q^{\infty}_e$, $Q^{\infty}_m$, $M$ are electric charge, magnetic charge and mass in the $n=0$ case, while $\Phi_e$ and $\Phi_m$ are the electric and magnetic potentials. The calculated thermodynamic quantities obey the first law of thermodynamics while the entropy is the area of the horizon. Furthermore, all these quantities obey Smarr's relation. We show the consistency of these results through calculating the Hamiltonian and its variation which reproduces the first law.


title: Estimating Probabilistic Safe WCET Ranges of Real-Time Systems at Design Stages

abstract: Estimating worst-case execution times (WCET) is an important activity at early design stages of real-time systems. Based on WCET estimates, engineers make design and implementation decisions to ensure that task executions always complete before their specified deadlines. However, in practice, engineers often cannot provide precise point WCET estimates and prefer to provide plausible WCET ranges. Given a set of real-time tasks with such ranges, we provide an automated technique to determine for what WCET values the system is likely to meet its deadlines, and hence operate safely with a probabilistic guarantee. Our approach combines a search algorithm for generating worst-case scheduling scenarios with polynomial logistic regression for inferring probabilistic safe WCET ranges. We evaluated our approach by applying it to three industrial systems from different domains and several synthetic systems. Our approach efficiently and accurately estimates probabilistic safe WCET ranges within which deadlines are likely to be satisfied with a high degree of confidence.


title: BeeSwarm: Enabling Scalability Tests in Continuous Integration

abstract: Testing is one of the most important steps in software development. It ensures the quality of software. Continuous Integration (CI) is a widely used testing system that can report software quality to the developer in a timely manner during the development progress. Performance, especially scalability, is another key factor for High Performance Computing (HPC) applications. Though there are many applications and tools to profile the performance of HPC applications, none of them are integrated into the continuous integration. On the other hand, no current continuous integration tools provide easy-to-use scalability test capabilities. In this work, we propose BeeSwarm, a scalability test system that can be easily applied to the current CI test environment enabling scalability test capability for HPC developers. As a showcase, BeeSwarm is integrated into Travis CI and GitLab CI to execute the scalability test workflow on Chameleon cloud.


title: Assessment of COVID-19 hospitalization forecasts from a simplified SIR model

abstract: We propose the SH model, a simplified version of the well-known SIR compartmental model of infectious diseases. With optimized parameters and initial conditions, this time-invariant two-parameter two-dimensional model is able to fit COVID-19 hospitalization data over several months with high accuracy (e.g., the root relative squared error is below 10% for Belgium over the period from 2020-03-15 to 2020-07-15). Moreover, we observed that, when the model is trained on a suitable three-week period around the first hospitalization peak for Belgium, it forecasts the subsequent two months with mean absolute percentage error (MAPE) under 4%. We repeated the experiment for each French department and found 14 of them where the MAPE was below 20%. However, when the model is trained in the increase phase, it is less successful at forecasting the subsequent evolution.


title: Minimax Policy for Heavy-tailed Bandits

abstract: We study the stochastic Multi-Armed Bandit (MAB) problem under worst-case regret and heavy-tailed reward distribution. We modify the minimax policy MOSS for the sub-Gaussian reward distribution by using saturated empirical mean to design a new algorithm called Robust MOSS. We show that if the moment of order $1+\epsilon$ for the reward distribution exists, then the refined strategy has a worst-case regret matching the lower bound while maintaining a distribution-dependent logarithm regret.


title: More on Wilson toroidal networks and torus blocks

abstract: We consider the Wilson line networks of the Chern-Simons $3d$ gravity theory with toroidal boundary conditions which calculate global conformal blocks of degenerate quasi-primary operators in torus $2d$ CFT. After general discussion that summarizes and further extends results known in the literature we explicitly obtain the one-point torus block and two-point torus blocks through particular matrix elements of toroidal Wilson network operators in irreducible finite-dimensional representations of $sl(2,\mathbb{R})$ algebra. The resulting expressions are given in two alternative forms using different ways to treat multiple tensor products of $sl(2,\mathbb{R})$ representations: (1) $3mj$ Wigner symbols and intertwiners of higher valence, (2) totally symmetric tensor products of the fundamental $sl(2,\mathbb{R})$ representation.


title: Sorted Pooling in Convolutional Networks for One-shot Learning

abstract: We present generalized versions of the commonly used maximum pooling operation: $k$th maximum and sorted pooling operations which selects the $k$th largest response in each pooling region, selecting locally consistent features of the input images. This method is able to increase the generalization power of a network and can be used to decrease training time and error rate of networks and it can significantly improve accuracy in case of training scenarios where the amount of available data is limited, like one-shot learning scenarios


title: The universal sheaf as an operator

abstract: We compute the universal sheaf of moduli spaces M of sheaves on a surface S, as an operator {Symmetric Polynomials} $\rightarrow$ K(M), thus generalizing the viewpoint of Carlsson-Nekrasov-Okounkov to arbitrary rank and general smooth surfaces.


title: CovidDeep: SARS-CoV-2/COVID-19 Test Based on Wearable Medical Sensors and Efficient Neural Networks

abstract: The novel coronavirus (SARS-CoV-2) has led to a pandemic. The current testing regime based on Reverse Transcription-Polymerase Chain Reaction for SARS-CoV-2 has been unable to keep up with testing demands, and also suffers from a relatively low positive detection rate in the early stages of the resultant COVID-19 disease. Hence, there is a need for an alternative approach for repeated large-scale testing of SARS-CoV-2/COVID-19. We propose a framework called CovidDeep that combines efficient DNNs with commercially available WMSs for pervasive testing of the virus. We collected data from 87 individuals, spanning three cohorts including healthy, asymptomatic, and symptomatic patients. We trained DNNs on various subsets of the features automatically extracted from six WMS and questionnaire categories to perform ablation studies to determine which subsets are most efficacious in terms of test accuracy for a three-way classification. The highest test accuracy obtained was 98.1%. We also augmented the real training dataset with a synthetic training dataset drawn from the same probability distribution to impose a prior on DNN weights and leveraged a grow-and-prune synthesis paradigm to learn both DNN architecture and weights. This boosted the accuracy of the various DNNs further and simultaneously reduced their size and floating-point operations.


title: Collaborative Cloud Computing Framework for Health Data with Open Source Technologies

abstract: The proliferation of sensor technologies and advancements in data collection methods have enabled the accumulation of very large amounts of data. Increasingly, these datasets are considered for scientific research. However, the design of the system architecture to achieve high performance in terms of parallelization, query processing time, aggregation of heterogeneous data types (e.g., time series, images, structured data, among others), and difficulty in reproducing scientific research remain a major challenge. This is specifically true for health sciences research, where the systems must be i) easy to use with the flexibility to manipulate data at the most granular level, ii) agnostic of programming language kernel, iii) scalable, and iv) compliant with the HIPAA privacy law. In this paper, we review the existing literature for such big data systems for scientific research in health sciences and identify the gaps of the current system landscape. We propose a novel architecture for software-hardware-data ecosystem using open source technologies such as Apache Hadoop, Kubernetes and JupyterHub in a distributed environment. We also evaluate the system using a large clinical data set of 69M patients.


title: A Gelfand-type duality for coarse metric spaces with property A

abstract: We prove the following two results for a given uniformly locally finite metric space with Yu's property A: 1) The group of outer automorphisms of its uniform Roe algebra is isomorphic to its group of bijective coarse equivalences modulo closeness. 2) The group of outer automorphisms of its Roe algebra is isomorphic to its group of coarse equivalences modulo closeness. The main difficulty lies in the latter. To prove that, we obtain several uniform approximability results for maps between Roe algebras and use them to obtain a theorem about the `uniqueness' of Cartan masas of Roe algebras. We finish the paper with several applications of the results above to concrete metric spaces.


title: The Effects of Approximate Multiplication on Convolutional Neural Networks

abstract: This paper analyzes the effects of approximate multiplication when performing inferences on deep convolutional neural networks (CNNs). The approximate multiplication can reduce the cost of the underlying circuits so that CNN inferences can be performed more efficiently in hardware accelerators. The study identifies the critical factors in the convolution, fully-connected, and batch normalization layers that allow more accurate CNN predictions despite the errors from approximate multiplication. The same factors also provide an arithmetic explanation of why bfloat16 multiplication performs well on CNNs. The experiments are performed with recognized network architectures to show that the approximate multipliers can produce predictions that are nearly as accurate as the FP32 references, without additional training. For example, the ResNet and Inception-v4 models with Mitch-$w$6 multiplication produces Top-5 errors that are within 0.2% compared to the FP32 references. A brief cost comparison of Mitch-$w$6 against bfloat16 is presented, where a MAC operation saves up to 80% of energy compared to the bfloat16 arithmetic. The most far-reaching contribution of this paper is the analytical justification that multiplications can be approximated while additions need to be exact in CNN MAC operations.


title: A Warm Start Method for Solving Chance Constrained Optimal Control Problems

abstract: A warm start method is developed for efficiently solving complex chance constrained optimal control problems. The warm start method addresses the computational challenges of solving chance constrained optimal control problems using biased kernel density estimators and Legendre-Gauss-Radau collocation with an $hp$ adaptive mesh refinement method. To address the computational challenges, the warm start method improves both the starting point for the chance constrained optimal control problem, as well as the efficiency of cycling through mesh refinement iterations. The improvement is accomplished by tuning a parameter of the kernel density estimator, as well as implementing a kernel switch as part of the solution process. Additionally, the number of samples for the biased kernel density estimator is set to incrementally increase through a series of mesh refinement iterations. Thus, the warm start method is a combination of tuning a parameter, a kernel switch, and an incremental increase in sample size. This warm start method is successfully applied to solve two challenging chance constrained optimal control problems in a computationally efficient manner using biased kernel density estimators and Legendre-Gauss-Radau collocation.


title: The Future AI in Healthcare: A Tsunami of False Alarms or a Product of Experts?

abstract: Recent significant increases in affordable and accessible computational power and data storage have enabled machine learning to provide almost unbelievable classification and prediction performances compared to well-trained humans. There have been some promising (but limited) results in the complex healthcare landscape, particularly in imaging. This promise has led some individuals to leap to the conclusion that we will solve an ever-increasing number of problems in human health and medicine by applying `artificial intelligence' to `big (medical) data'. The scientific literature has been inundated with algorithms, outstripping our ability to review them effectively. Unfortunately, I argue that most, if not all of these publications or commercial algorithms make several fundamental errors. I argue that because everyone (and therefore every algorithm) has blind spots, there are multiple `best' algorithms, each of which excels on different types of patients or in different contexts. Consequently, we should vote many algorithms together, weighted by their overall performance, their independence from each other, and a set of features that define the context (i.e., the features that maximally discriminate between the situations when one algorithm outperforms another). This approach not only provides a better performing classifier or predictor but provides confidence intervals so that a clinician can judge how to respond to an alert. Moreover, I argue that a sufficient number of (mostly) independent algorithms that address the same problem can be generated through a large international competition/challenge, lasting many months and define the conditions for a successful event. Finally, I propose introducing the requirement for major grantees to run challenges in the final year of funding to maximize the value of research and select a new generation of grantees.


title: A Model-based Chatbot Generation Approach to Converse with Open Data Sources

abstract: The Open Data movement promotes the free distribution of data. More and more companies and governmental organizations are making their data available online following the Open Data philosophy, resulting in a growing market of technologies and services to help publish and consume data. One of the emergent ways to publish such data is via Web APIs, which offer a powerful means to reuse this data and integrate it with other services. Socrata, CKAN or OData are examples of popular specifications for publishing data via Web APIs. Nevertheless, querying and integrating these Web APIs is time-consuming and requires technical skills that limit the benefits of Open Data movement for the regular citizen. In other contexts, chatbot applications are being increasingly adopted as a direct communication channel between companies and end-users. We believe the same could be true for Open Data as a way to bridge the gap between citizens and Open Data sources. This paper describes an approach to automatically derive full-fledged chatbots from API-based Open Data sources. Our process relies on a model-based intermediate representation (via UML class diagrams and profiles) to facilitate the customization of the chatbot to be generated.


title: Battlesnake Challenge: A Multi-agent Reinforcement Learning Playground with Human-in-the-loop

abstract: We present the Battlesnake Challenge, a framework for multi-agent reinforcement learning with Human-In-the-Loop Learning (HILL). It is developed upon Battlesnake, a multiplayer extension of the traditional Snake game in which 2 or more snakes compete for the final survival. The Battlesnake Challenge consists of an offline module for model training and an online module for live competitions. We develop a simulated game environment for the offline multi-agent model training and identify a set of baseline heuristics that can be instilled to improve learning. Our framework is agent-agnostic and heuristics-agnostic such that researchers can design their own algorithms, train their models, and demonstrate in the online Battlesnake competition. We validate the framework and baseline heuristics with our preliminary experiments. Our results show that agents with the proposed HILL methods consistently outperform agents without HILL. Besides, heuristics of reward manipulation had the best performance in the online competition. We open source our framework at https://github.com/awslabs/sagemaker-battlesnake-ai.


title: DeepNNK: Explaining deep models and their generalization using polytope interpolation

abstract: Modern machine learning systems based on neural networks have shown great success in learning complex data patterns while being able to make good predictions on unseen data points. However, the limited interpretability of these systems hinders further progress and application to several domains in the real world. This predicament is exemplified by time consuming model selection and the difficulties faced in predictive explainability, especially in the presence of adversarial examples. In this paper, we take a step towards better understanding of neural networks by introducing a local polytope interpolation method. The proposed Deep Non Negative Kernel regression (NNK) interpolation framework is non parametric, theoretically simple and geometrically intuitive. We demonstrate instance based explainability for deep learning models and develop a method to identify models with good generalization properties using leave one out estimation. Finally, we draw a rationalization to adversarial and generative examples which are inevitable from an interpolation view of machine learning.


title: Modeling the chronologies and size distributions of Ceres and Vesta craters

abstract: We infer the crater chronologies of Ceres and Vesta from a self-consistent dynamical model of asteroid impactors. The model accounts for planetary migration/instability early in the solar system history and tracks asteroid orbits over 4.56 Gy. It is calibrated on the current population of the asteroid belt. The model provides the number of asteroid impacts on different worlds at any time throughout the solar system history. We combine the results with an impactor-crater scaling relationship to determine the crater distribution of Ceres and Vesta and compare these theoretical predictions with observations. We find that: (i) The Ceres and Vesta chronologies are similar, whereas they significantly differ from the lunar chronology. Therefore, using the lunar chronology for main belt asteroids, as often done in previous publications, is incorrect. (ii) The model results match the number and size distribution of large (diameter $>90$ km) craters observed on Vesta, but overestimate the number of large craters on Ceres. This implies that large crater erasure is required for Ceres. (iii) In a model where planetary migration/instability happens early, the probability to form the Rheasilvia basin on Vesta during the last 1 Gy is 10\%, a factor of $\sim1.5$ higher than for the late instability case and $\sim2.5$ times higher than found in previous studies. Thus, while the formation of the Rheasilvia at $\sim1$ Gy ago (Ga) would be somewhat unusual, it cannot be ruled out at more than $\simeq1.5\sigma$. In broader context, our work provides a self-consistent framework for modeling asteroid crater records.


title: Moment-Matching Graph-Networks for Causal Inference

abstract: In this note we explore a fully unsupervised deep-learning framework for simulating non-linear structural equation models from observational training data. The main contribution of this note is an architecture for applying moment-matching loss functions to the edges of a causal Bayesian graph, resulting in a generative conditional-moment-matching graph-neural-network. This framework thus enables automated sampling of latent space conditional probability distributions for various graphical interventions, and is capable of generating out-of-sample interventional probabilities that are often faithful to the ground truth distributions well beyond the range contained in the training set. These methods could in principle be used in conjunction with any existing autoencoder that produces a latent space representation containing causal graph structures.


title: Ultralong spin coherence times for rubidium atoms in solid parahydrogen via dynamical decoupling

abstract: Coherence time is an essential parameter for quantum sensing, quantum information, and quantum computation. In this work, we demonstrate electron spin coherence times as long as 0.1 s for an ensemble of rubidium atoms trapped in a solid parahydrogen matrix. We explore the underlying physics limiting the coherence time. The properties of these matrix isolated atoms are very promising for future applications, including quantum sensing of nuclear spins. If combined with efficient single-atom readout, this would enable NMR and magnetic resonance imaging of single molecules cotrapped with alkali-metal atom quantum sensors within a parahydrogen matrix.


title: Implications of triangular features in the Gaia skymap for the Caustic Ring Model of the Milky Way halo

abstract: The Gaia map of the Milky Way reveals a pair of triangular features at nearly symmetric locations on opposite sides of the Galactic Center. In this paper we explore the implications of these features assuming they are manifestations of a caustic ring in the dark matter distribution of the Milky Way halo. The existence of a series of such rings is predicted by the Caustic Ring Model. The model's phase-space distribution is that acquired by a rethermalizing Bose-Einstein condensate of axions or axion-like particles. We show that dust is gravitationally entrained by cold axion flows and propose this as an explanation for the sharpness of the triangular features. The locations of the features imply that we on Earth are much closer to the fifth caustic ring than thought on the basis of pre-Gaia observations. Most likely we are inside its tricusp cross-section. In that case the dark matter density on Earth is dominated by four cold flows, termed Big, Little, Up and Down. If we are outside the tricusp cross-section the dark matter density on Earth is dominated by two cold flows, Big and Little. We use the triangular features in the Gaia map, and a matching feature in the IRAS map, to estimate the velocity vectors and densities of the four locally dominant flows.


title: Minimum Weighted Szeged Index Trees

abstract: Weighted Szeged index is a recently introduced extension of the well-known Szeged index. In this paper, we present a new tool to analyze and characterize minimum weighted Szeged index trees. We exhibit the best trees with up to 81 vertices and use this information, together with our results, to propose various conjectures on the structure of minimum weighted Szeged index trees.


title: Rational Curves on Moduli Spaces of Vector Bundles

abstract: We completely describe the components of expected dimension of the Hilbert Scheme of rational curves of fixed degree $k$ in the moduli space ${\rm SU}_{C}(r,L)$ of semistable vector bundles of rank $r$ and determinant $L$ on a curve $C$. We show that for every $k \geq 1$ there are ${\rm gcd}(r, \deg L)$ unobstructed components. In addition, if $k$ is divisible by $r_1(r-r_1)(g-1)$ for $1\le r_1\le r-1$, there is an additional obstructed component of the expected dimension for each such $r_1$. We construct families of obstructed components and show that their generic point is not the generic vector bundle of given rank and determinant. Finally, we also obtain an upper bound on the degree of rational connectedness of ${\rm SU}_{C}(r,L)$ which is linear in the dimension.


title: ATPG-Guided Fault Injection Attacks on Logic Locking

abstract: Logic Locking is a well-accepted protection technique to enable trust in the outsourced design and fabrication processes of integrated circuits (ICs) where the original design is modified by incorporating additional key gates in the netlist, resulting in a key-dependent functional circuit. The original functionality of the chip is recovered once it is programmed with the secret key, otherwise, it produces incorrect results for some input patterns. Over the past decade, different attacks have been proposed to break logic locking, simultaneously motivating researchers to develop more secure countermeasures. In this paper, we propose a novel stuck-at fault-based differential fault analysis (DFA) attack, which can be used to break logic locking that relies on a stored secret key. This proposed attack is based on self-referencing, where the secret key is determined by injecting faults in the key lines and comparing the response with its fault-free counterpart. A commercial ATPG tool can be used to generate test patterns that detect these faults, which will be used in DFA to determine the secret key. One test pattern is sufficient to determine one key bit, which results in at most |K| test patterns to determine the entire secret key of size |K|. The proposed attack is generic and can be extended to break any logic locked circuits.


title: Confidential Attestation: Efficient in-Enclave Verification of Privacy Policy Compliance

abstract: A trusted execution environment (TEE) such as Intel Software Guard Extension (SGX) runs a remote attestation to prove to a data owner the integrity of the initial state of an enclave, including the program to operate on her data. For this purpose, the data-processing program is supposed to be open to the owner, so its functionality can be evaluated before trust can be established. However, increasingly there are application scenarios in which the program itself needs to be protected. So its compliance with privacy policies as expected by the data owner should be verified without exposing its code. To this end, this paper presents CAT, a new model for TEE-based confidential attestation. Our model is inspired by Proof-Carrying Code, where a code generator produces proof together with the code and a code consumer verifies the proof against the code on its compliance with security policies. Given that the conventional solutions do not work well under the resource-limited and TCB-frugal TEE, we propose a new design that allows an untrusted out-enclave generator to analyze the source code of a program when compiling it into binary and a trusted in-enclave consumer efficiently verifies the correctness of the instrumentation and the presence of other protection before running the binary. Our design strategically moves most of the workload to the code generator, which is responsible for producing well-formatted and easy-to-check code, while keeping the consumer simple. Also, the whole consumer can be made public and verified through a conventional attestation. We implemented this model on Intel SGX and demonstrate that it introduces a very small part of TCB. We also thoroughly evaluated its performance on micro- and macro- benchmarks and real-world applications, showing that the new design only incurs a small overhead when enforcing several categories of security policies.


title: Optimization of a Lossy Microring Resonator System for the Generation of Quadrature-Squeezed States

abstract: The intensity buildup of light inside a lossy microring resonator can be used to enhance the generation of squeezed states via spontaneous parametric downconversion (SPDC). In this work, we model the generation of squeezed light in a microring resonator that is pumped with a Gaussian pulse via a side-coupled channel waveguide. We theoretically determine the optimum pump pulse duration and ring-to-channel coupling constant to minimize the quadrature noise (maximize the squeezing) in the ring for a fixed input pump energy. We derive approximate analytic expressions for the optimal coupling and pump pulse duration as a function of scattering loss in the ring. These results will enable researchers to easily determine the optimal design of microring resonator systems for the generation of quadrature-squeezed states.


title: A Generic Compilation Strategy for the Unitary Coupled Cluster Ansatz

abstract: We describe a compilation strategy for Variational Quantum Eigensolver (VQE) algorithms which use the Unitary Coupled Cluster (UCC) ansatz, designed to reduce circuit depth and gate count. This is achieved by partitioning Pauli exponential terms into mutually commuting sets. These sets are then diagonalised using Clifford circuits and synthesised using the phase polynomial formalism. This strategy reduces cx depth by 75.4% on average, and by up to 89.9%, compared to naive synthesis for a variety of molecules, qubit encodings and basis sets.


title: Catalyzed entanglement concentration of qubit pairs

abstract: We analytically obtain the maximum probability of converting a finite number of copies of an arbitrary two-qubit pure state to a single copy of a maximally entangled two-qubit pure state via entanglement assisted local operations and classical communications using a two-qubit catalyst state. We show that the optimal catalyst for this transformation is always more entangled than the initial state but any two-qubit state can act as a (non-optimal) catalyst. Interestingly, the entanglement of the optimal two-qubit catalyst state is shown to decrease with that of the initial state. Entanglement assisted strategies for obtaining multiple Bell states are discussed.


title: Efficient Formulation of Polarizable Gaussian Multipole Electrostatics for Biomolecular Simulations

abstract: Molecular dynamics simulations of biomolecules have been widely adopted in biomedical studies. As classical point-charge models continue to be used in routine biomolecular applications, there have been growing demands on developing polarizable force fields for handling more complicated biomolecular processes. Here we focus on a recently proposed polarizable Gaussian Multipole (pGM) model for biomolecular simulations. A key benefit of pGM is its screening of all short-range electrostatic interactions in a physically consistent manner, which is critical for stable charge-fitting and is needed to reproduce molecular anisotropy. Another advantage of pGM is that each atom's multipoles are represented by a single Gaussian function or its derivatives, allowing for more efficient electrostatics than other Gaussian-based models. In this study we present an efficient formulation for the pGM model defined with respect to a local frame formed with a set of covalent basis vectors. The covalent basis vectors are chosen to be along each atom's covalent bonding directions. The new local frame allows molecular flexibility during molecular simulations and facilitates an efficient formulation of analytical electrostatic forces without explicit torque computation. Subsequent numerical tests show that analytical atomic forces agree excellently with numerical finite-difference forces for the tested system. Finally, the new pGM electrostatics algorithm is interfaced with the PME implementation in Amber for molecular simulations under the periodic boundary conditions. To validate the overall pGM/PME electrostatics, we conducted an NVE simulation for a small water box of 512 water molecules. Our results show that, to achieve energy conservation in the polarizable model, it is important to ensure enough accuracy on both PME and induction iteration.


title: The expected number of viable autocatalytic sets in chemical reaction systems

abstract: The emergence of self-sustaining autocatalytic networks in chemical reaction systems has been studied as a possible mechanism for modelling how living systems first arose. It has been known for several decades that such networks will form within systems of polymers (under cleavage and ligation reactions) under a simple process of random catalysis, and this process has since been mathematically analysed. In this paper, we provide an exact expression for the expected number of self-sustaining autocatalytic networks that will form in a general chemical reaction system, and the expected number of these networks that will also be uninhibited (by some molecule produced by the system). Using these equations, we are able to describe the patterns of catalysis and inhibition that maximise or minimise the expected number of such networks. We apply our results to derive a general theorem concerning the trade-off between catalysis and inhibition, and to provide some insight into the extent to which the expected number of self-sustaining autocatalytic networks coincides with the probability that at least one such system is present.


title: SynRG: Syntax Guided Synthesis of Expressions with Alternating Quantifiers

abstract: Program synthesis is the task of automatically generating expressions that satisfy a given specification. Program synthesis techniques have been used to automate the generation of loop invariants in code, synthesize function summaries, and to assist programmers via program sketching. Syntax-guided synthesis has been a successful paradigm in this area, however, one area where the state-of-the-art solvers fall-down is reasoning about potentially unbounded data structures such as arrays where both specifications and solutions may require quantifiers and quantifier alternations. We present SynRG, a synthesis algorithm based on restricting the synthesis problem to generate candidate solutions with quantification over a finite domain, and then generalizing these candidate solutions to the unrestricted domain of the original specification. We report experiments on invariant synthesis benchmarks and on program sketching benchmarks taken from the Java StringUtils class and show that our technique can synthesize expressions out of reach of all existing solvers.


title: Tomographic Reconstruction using Tilted Laue Analyser Based X-ray Phase-Contrast Imaging

abstract: Analyser-Based Phase-Contrast imaging (ABPCI) is a phase-contrast imaging method that produces high contrast images of weakly absorbing materials. However, it is only sensitive to phase variations lying in the diffraction plane of the analyser crystal (i.e in one dimension; 1-D), as it is highly sensitive to phase variations lying in the diffraction plane of the analyser crystal. In order to accurately account for and measure phase effects produced by the wavefield-sample interaction, ABPCI and other 1-D phase sensitive methods must achieve 2-D phase sensitivity. We applied an inclined geometry method to a Laue geometry setup for X-ray ABPCI through rotation of the detector and object about the optical axis. This allowed this traditionally 1-D phase sensitive phase contrast method to possess 2-D phase sensitivity. We acquired tomographic datasets over 360 degrees of a multi-material phantom with the detector and sample tilted by 8 degrees. The real and imaginary parts of the refractive index were reconstructed for the phantom.


title: DeepCorn: A Semi-Supervised Deep Learning Method for High-Throughput Image-Based Corn Kernel Counting and Yield Estimation

abstract: The success of modern farming and plant breeding relies on accurate and efficient collection of data. For a commercial organization that manages large amounts of crops, collecting accurate and consistent data is a bottleneck. Due to limited time and labor, accurately phenotyping crops to record color, head count, height, weight, etc. is severely limited. However, this information, combined with other genetic and environmental factors, is vital for developing new superior crop species that help feed the world's growing population. Recent advances in machine learning, in particular deep learning, have shown promise in mitigating this bottleneck. In this paper, we propose a novel deep learning method for counting on-ear corn kernels in-field to aid in the gathering of real-time data and, ultimately, to improve decision making to maximize yield. We name this approach DeepCorn, and show that this framework is robust under various conditions. DeepCorn estimates the density of corn kernels in an image of corn ears and predicts the number of kernels based on the estimated density map. DeepCorn uses a truncated VGG-16 as a backbone for feature extraction and merges feature maps from multiple scales of the network to make it robust against image scale variations. We also adopt a semi-supervised learning approach to further improve the performance of our proposed method. Our proposed method achieves the MAE and RMSE of 41.36 and 60.27 in the corn kernel counting task, respectively. Our experimental results demonstrate the superiority and effectiveness of our proposed method compared to other state-of-the-art methods.


title: New bounds on maximal linkless graphs

abstract: We construct a family of maximal linklessly embeddable graphs on $n$ vertices and $3n-5$ edges for all $n\ge 10$, and another family on $n$ vertices and $m< \frac{25n}{12}-\frac{1}{4}$ edges for all $n\ge 13$. The latter significantly improves the lowest edge-to-vertex ratio for any previously known infinite family. We construct a family of graphs showing that the class of maximal linklessly embeddable graphs differs from the class of graphs that are maximal without a $K_6$ minor studied by L. Jorgensen. We give necessary and sufficient conditions for when the clique sum of two maximal linklessly embeddable graphs over $K_2$, $K_3$, or $K_4$ is a maximal linklessly embeddable graph, and use these results to prove our constructions yield maximal linklessly embeddable graphs.


title: Replica wormhole and island incompatibility with monogamy of entanglement

abstract: We argue that the `island conjecture' and the replica wormhole derivation of the Page curve break monogamy of entanglement through allowing black hole interior states to be non-classically correlated while also pairwise entangled with radiation states. The reason is that quantum degrees of freedom (present in any half of a Hawking pair) cannot all be identified with the environment at semi-classical pair production, and can only be fixed relative to a subsystem, as required for the Page curve, by correlations equivalent to entanglement - regardless of what those correlations are attributed to. This implies that the recent gravity (replica wormhole) and holographic (island conjecture) derivations of the Page curve entail new physics not yet properly taken into account.


title: Approximate solutions to one-phase Stefan-like problems with space-dependent latent heat

abstract: The work in this paper concerns the study of different approximations for one-dimensional one-phase Stefan-like problems with a space-dependent latent heat. It is considered two different problems, which differ from each other in their boundary condition imposed at the fixed face: Dirichlet and Robin conditions. The approximate solutions are obtained by applying the heat balance integral method (HBIM), a modified heat balance integral method, the refined integral method (RIM) . Taking advantage of the exact analytical solutions we compare and test the accuracy of the approximate solutions. The analysis is carried out using the dimensionless generalized Stefan number (Ste) and Biot number (Bi). It is also studied the case when Bi goes to infinity in the problem with a convective condition, recovering the approximate solutions when a temperature condition is imposed at the fixed face. Some numerical simulations are provided in order to assert which of the approximate integral methods turns out to be optimal. Moreover, we pose an approximate technique based on minimizing the least-squares error, obtaining also approximate solutions for the classical Stefan problem.


title: Sequential Quadratic Optimization for Nonlinear Equality Constrained Stochastic Optimization

abstract: Sequential quadratic optimization algorithms are proposed for solving smooth nonlinear optimization problems with equality constraints. The main focus is an algorithm proposed for the case when the constraint functions are deterministic, and constraint function and derivative values can be computed explicitly, but the objective function is stochastic. It is assumed in this setting that it is intractable to compute objective function and derivative values explicitly, although one can compute stochastic function and gradient estimates. As a starting point for this stochastic setting, an algorithm is proposed for the deterministic setting that is modeled after a state-of-the-art line-search SQP algorithm, but uses a stepsize selection scheme based on Lipschitz constants (or adaptively estimated Lipschitz constants) in place of the line search. This sets the stage for the proposed algorithm for the stochastic setting, for which it is assumed that line searches would be intractable. Under reasonable assumptions, convergence (resp.,~convergence in expectation) from remote starting points is proved for the proposed deterministic (resp.,~stochastic) algorithm. The results of numerical experiments demonstrate the practical performance of our proposed techniques.


title: Analytic approach for the number statistics of non-Hermitian random matrices

abstract: We introduce a powerful analytic method to study the statistics of the number $\mathcal{N}_{\textbf{A}}(\gamma)$ of eigenvalues inside any contour $\gamma \in \mathbb{C}$ for infinitely large non-Hermitian random matrices ${\textbf A}$. Our generic approach can be applied to different random matrix ensembles, even when the analytic expression for the joint distribution of eigenvalues is not known. We illustrate the method on the adjacency matrices of weighted random graphs with asymmetric couplings, for which standard random-matrix tools are inapplicable. The main outcome is an effective theory that determines the cumulant generating function of $\mathcal{N}_{\textbf{A}}$ via a path integral along $\gamma$, with the path probability distribution following from the solution of a self-consistent equation. We derive the expressions for the mean and the variance of $\mathcal{N}_{\textbf{A}}$ as well as for the rate function governing rare fluctuations of ${\mathcal{N}}_{\textbf{A}}{(\gamma)}$. All theoretical results are compared with direct diagonalization of finite random matrices, exhibiting an excellent agreement.


title: Navigating the Trade-Off between Multi-Task Learning and Learning to Multitask in Deep Neural Networks

abstract: The terms multi-task learning and multitasking are easily confused. Multi-task learning refers to a paradigm in machine learning in which a network is trained on various related tasks to facilitate the acquisition of tasks. In contrast, multitasking is used to indicate, especially in the cognitive science literature, the ability to execute multiple tasks simultaneously. While multi-task learning exploits the discovery of common structure between tasks in the form of shared representations, multitasking is promoted by separating representations between tasks to avoid processing interference. Here, we build on previous work involving shallow networks and simple task settings suggesting that there is a trade-off between multi-task learning and multitasking, mediated by the use of shared versus separated representations. We show that the same tension arises in deep networks and discuss a meta-learning algorithm for an agent to manage this trade-off in an unfamiliar environment. We display through different experiments that the agent is able to successfully optimize its training strategy as a function of the environment.


title: B-FERL: Blockchain based Framework for Securing Smart Vehicles

abstract: The ubiquity of connecting technologies in smart vehicles and the incremental automation of its functionalities promise significant benefits, including a significant decline in congestion and road fatalities. However, increasing automation and connectedness broadens the attack surface and heightens the likelihood of a malicious entity successfully executing an attack. In this paper, we propose a Blockchain based Framework for sEcuring smaRt vehicLes (B-FERL). B-FERL uses permissioned blockchain technology to tailor information access to restricted entities in the connected vehicle ecosystem. It also uses a challenge-response data exchange between the vehicles and roadside units to monitor the internal state of the vehicle to identify cases of in-vehicle network compromise. In order to enable authentic and valid communication in the vehicular network, only vehicles with a verifiable record in the blockchain can exchange messages. Through qualitative arguments, we show that B-FERL is resilient to identified attacks. Also, quantitative evaluations in an emulated scenario show that B-FERL ensures a suitable response time and required storage size compatible with realistic scenarios. Finally, we demonstrate how B-FERL achieves various important functions relevant to the automotive ecosystem such as trust management, vehicular forensics and secure vehicular networks.