title: Towards Domain Independence in CNN-based Acoustic Localization using Deep Cross Correlations

abstract: Time delay estimation is essential in Acoustic Source Localization (ASL) systems. One of the most used techniques for this purpose is the Generalized Cross Correlation (GCC) between a pair of signals and its use in Steered Response Power (SRP) techniques, which estimate the acoustic power at a specific location. Nowadays, Deep Learning strategies may outperform these methods. However, they are generally dependent on the geometric and sensor configuration conditions that are available during the training phases, thus having limited generalization capabilities when facing new environments if no re-training nor adaptation is applied. In this work, we propose a method based on an encoder-decoder CNN architecture capable of outperforming the well known SRP-PHAT algorithm, and also other Deep Learning strategies when working in mismatched training-testing conditions without requiring a model re-training. Our proposal aims to estimate a smoothed version of the correlation signals, that is then used to generate a refined acoustic power map, which leads to better performance on the ASL task. Our experimental evaluation uses three publicly available realistic datasets and provides a comparison with the SRP-PHAT algorithm and other recent proposals based on Deep Learning.


title: A note on local higher regularity in the dynamic linear relaxed micromorphic model

abstract: We consider the regularity question of solutions for the dynamic initial-boundary value problem for the linear relaxed micromorphic model. This generalized continuum model couples a wave-type equation for the displacement with a generalized Maxwell-type wave equation for the micro-distortion. Naturally solutions are found in ${\rm H}^1$ for the displacement $u$ and ${\rm H}({\rm Curl})$ for the microdistortion $P$. Using energy estimates for difference quotients, we improve this regularity. We show ${\rm H}^1_{\rm loc}$-regularity for the displacement field, ${\rm H}^1_{\rm loc}$-regularity for the micro-distortion tensor $P$ and that ${\rm Curl}\,P$ is ${\rm H}^1$-regular if the data is sufficiently smooth.


title: A Theoretical Framework for Symbolic Quick Error Detection

abstract: Symbolic quick error detection (SQED) is a formal pre-silicon verification technique targeted at processor designs. It leverages bounded model checking (BMC) to check a design for counterexamples to a self-consistency property: given the instruction set architecture (ISA) of the design, executing an instruction sequence twice on the same inputs must always produce the same outputs. Self-consistency is a universal, implementation-independent property. Consequently, in contrast to traditional verification approaches that use implementation-specific assertions (often generated manually), SQED does not require a full formal design specification or manually-written properties. Case studies have shown that SQED is effective for commercial designs and that SQED substantially improves design productivity. However, until now there has been no formal characterization of its bug-finding capabilities. We aim to close this gap by laying a formal foundation for SQED. We use a transition-system processor model and define the notion of a bug using an abstract specification relation. We prove the soundness of SQED, i.e., that any bug reported by SQED is in fact a real bug in the processor. Importantly, this result holds regardless of what the actual specification relation is. We next describe conditions under which SQED is complete, that is, what kinds of bugs it is guaranteed to find. We show that for a large class of bugs, SQED can always find a trace exhibiting the bug. Ultimately, we prove full completeness of a variant of SQED that uses specialized state reset instructions. Our results enable a rigorous understanding of SQED and its bug-finding capabilities and give insights on how to optimize implementations of SQED in practice.


title: Stabilization of the wheeled inverted pendulum on a soft surface

abstract: We study dynamics of an wheeled inverted pendulum under a proportional-integral-derivative controller on horizontal, inclined and soft surfaces. An oscillatory area and conditions of the stability for the control are shown on the phase portraits of the dynamical systems. Particularly, we study a differential inclusion for moving on the soft surface, and we find semi-stable stationary solutions in our mathematical model. Due to rounding errors of the numerical modelling or external perturbations of robotics equipment the semistability looks as a limit cycle in simulations.


title: A generalized Bayes framework for probabilistic clustering

abstract: Loss-based clustering methods, such as k-means and its variants, are standard tools for finding groups in data. However, the lack of quantification of uncertainty in the estimated clusters is a disadvantage. Model-based clustering based on mixture models provides an alternative, but such methods face computational problems and large sensitivity to the choice of kernel. This article proposes a generalized Bayes framework that bridges between these two paradigms through the use of Gibbs posteriors. In conducting Bayesian updating, the log likelihood is replaced by a loss function for clustering, leading to a rich family of clustering methods. The Gibbs posterior represents a coherent updating of Bayesian beliefs without needing to specify a likelihood for the data, and can be used for characterizing uncertainty in clustering. We consider losses based on Bregman divergence and pairwise similarities, and develop efficient deterministic algorithms for point estimation along with sampling algorithms for uncertainty quantification. Several existing clustering algorithms, including k-means, can be interpreted as generalized Bayes estimators under our framework, and hence we provide a method of uncertainty quantification for these approaches.


title: About the possibility to observe diurnal variations of the count rate of dark photons by the multicathode counters

abstract: The possibility to observe the diurnal variations in the count rate of dark photons using the multicathode counters is investigated. We show that placing detectors at three different mines at different latitudes: Pyh\"asalmi in Finland, Baksan at Russia and INO in India and conducting the measurements with three different orientations of detectors one can obtain quite a complete series of data to determine the direction of the dark photon field. We present the results of the measurements fulfilled by the presently developed counters.


title: Skew band structure and anomalous conductivity of PdCrO$_2$

abstract: A model of magnetic interaction of CrO$_2$ and Pd hexagonal layers in PdCrO$_2$ is proposed. Since Cr-O-Pd bridges do not provide an interlayer magnetic coupling in case of a 120$^0$ magnetic ordering, a direct exchange interaction between magnetic chromium ions and conductive palladium layers is assumed. It is shown that this interaction leads to a novel state of itinerant electrons (skew bands). It is characterized by abnormally high conductivity at low temperatures due to strong suppression of umklapp electron-phonon scattering.


title: Noisy One-bit Compressed Sensing with Side-Information

abstract: We consider the problem of sparse signal reconstruction from noisy one-bit compressed measurements when the receiver has access to side-information (SI). We assume that compressed measurements are corrupted by additive white Gaussian noise before quantization and sign-flip error after quantization. A generalized approximate message passing-based method for signal reconstruction from noisy one-bit compressed measurements is proposed, which is then extended for the case where the receiver has access to a signal that aids signal reconstruction, i.e., side-information. Two different scenarios of side-information are considered-a) side-information consisting of support information only, and b) side information consisting of support and amplitude information. SI is either a noisy version of the signal or a noisy estimate of the support of the signal. We develop reconstruction algorithms from one-bit measurements using noisy SI available at the receiver. Laplacian distribution and Bernoulli distribution are used to model the two types of noises which, when applied to the signal and the support, yields the SI for the above two cases, respectively. The Expectation-Maximization algorithm is used to estimate the noise parameters using noisy one-bit compressed measurements and the SI. We show that one-bit compressed measurement-based signal reconstruction is quite sensitive to noise, and the reconstruction performance can be significantly improved by exploiting available side-information at the receiver.


title: Robust Bayesian variable selection for gene-environment interactions

abstract: Gene-environment (G$\times$E) interactions have important implications to elucidate the etiology of complex diseases beyond the main genetic and environmental effects. Outliers and data contamination in disease phenotypes of G$\times$E studies have been commonly encountered, leading to the development of a broad spectrum of robust regularization methods. Nevertheless, within the Bayesian framework, the issue has not been taken care of in existing studies. We develop a fully Bayesian robust variable selection method for G$\times$E interaction studies. The proposed Bayesian method can effectively accommodate heavy-tailed errors and outliers in the response variable while conducting variable selection by accounting for structural sparsity. In particular, for the robust sparse group selection, the spike-and-slab priors have been imposed on both individual and group levels to identify important main and interaction effects robustly. An efficient Gibbs sampler has been developed to facilitate fast computation. Extensive simulation studies and analysis of both the diabetes data with SNP measurements from the Nurses' Health Study and TCGA melanoma data with gene expression measurements demonstrate the superior performance of the proposed method over multiple competing alternatives.


title: Dialog Policy Learning for Joint Clarification and Active Learning Queries

abstract: Intelligent systems need to be able to recover from mistakes, resolve uncertainty, and adapt to novel concepts not seen during training. Dialog interaction can enable this by the use of clarifications for correction and resolving uncertainty, and active learning queries to learn new concepts encountered during operation. Prior work on dialog systems has either focused on exclusively learning how to perform clarification/ information seeking, or to perform active learning. In this work, we train a hierarchical dialog policy to jointly perform both clarification and active learning in the context of an interactive language-based image retrieval task motivated by an online shopping application, and demonstrate that jointly learning dialog policies for clarification and active learning is more effective than the use of static dialog policies for one or both of these functions.


title: Minimum wave speeds in monostable reaction-diffusion equations: sharp bounds by polynomial optimization

abstract: Many monostable reaction-diffusion equations admit one-dimensional travelling waves if and only if the wave speed is sufficiently high. The values of these minimum wave speeds are not known exactly, except in a few simple cases. We present methods for finding upper and lower bounds on minimum wave speed. They rely on constructing trapping boundaries for dynamical systems whose heteroclinic connections correspond to the travelling waves. Simple versions of this approach can be carried out analytically but often give overly conservative bounds on minimum wave speed. When the reaction-diffusion equations being studied have polynomial nonlinearities, our approach can be implemented computationally using polynomial optimization. For scalar reaction-diffusion equations, we present a general method and then apply it to examples from the literature where minimum wave speeds were unknown. The extension of our approach to multi-component reaction-diffusion systems is then illustrated using a cubic autocatalysis model from the literature. In all three examples and with many different parameter values, polynomial optimization computations give upper and lower bounds that are within 0.1% of each other and thus nearly sharp. Upper bounds are derived analytically as well for the scalar RD equations.


title: Exact and asymptotic properties of $\delta$-records in the linear drift model

abstract: The study of records in the Linear Drift Model (LDM) has attracted much attention recently due to applications in several fields. In the present paper we study $\delta$-records in the LDM, defined as observations which are greater than all previous observations, plus a fixed real quantity $\delta$. We give analytical properties of the probability of $\delta$-records and study the correlation between $\delta$-record events. We also analyse the asymptotic behaviour of the number of $\delta$-records among the first $n$ observations and give conditions for convergence to the Gaussian distribution. As a consequence of our results, we solve a conjecture posed in J. Stat. Mech. 2010, P10013, regarding the total number of records in a LDM with negative drift. Examples of application to particular distributions, such as Gumbel or Pareto are also provided. We illustrate our results with a real data set of summer temperatures in Spain, where the LDM is consistent with the global-warming phenomenon.


title: Privacy For Free: Wireless Federated Learning Via Uncoded Transmission With Adaptive Power Control

abstract: Federated Learning (FL) refers to distributed protocols that avoid direct raw data exchange among the participating devices while training for a common learning task. This way, FL can potentially reduce the information on the local data sets that is leaked via communications. In order to provide formal privacy guarantees, however, it is generally necessary to put in place additional masking mechanisms. When FL is implemented in wireless systems via uncoded transmission, the channel noise can directly act as a privacy-inducing mechanism. This paper demonstrates that, as long as the privacy constraint level, measured via differential privacy (DP), is below a threshold that decreases with the signal-to-noise ratio (SNR), uncoded transmission achieves privacy "for free", i.e., without affecting the learning performance. More generally, this work studies adaptive power allocation (PA) for decentralized gradient descent in wireless FL with the aim of minimizing the learning optimality gap under privacy and power constraints. Both orthogonal multiple access (OMA) and non-orthogonal multiple access (NOMA) transmission with "over-the-air-computing" are studied, and solutions are obtained in closed form for an offline optimization setting. Furthermore, heuristic online methods are proposed that leverage iterative one-step-ahead optimization. The importance of dynamic PA and the potential benefits of NOMA versus OMA are demonstrated through extensive simulations.


title: Designing Stable Elections: A Survey

abstract: We survey the design of elections that are resilient to attempted interference by third parties. For example, suppose votes have been cast in an election between two candidates, and then each vote is randomly changed with a small probability, independently of the other votes. It is desirable to keep the outcome of the election the same, regardless of the changes to the votes. It is well known that the US electoral college system is about 5 times more likely to have a changed outcome due to vote corruption, when compared to a majority vote. In fact, Mossel, O'Donnell and Oleszkiewicz proved in 2005 that the majority voting method is most stable to this random vote corruption, among voting methods where each person has a small influence on the election. We discuss some recent progress on the analogous result for elections between more than two candidates. In this case, plurality should be most stable to corruption in votes. We also survey results on adversarial election manipulation (where an adversary can select particular votes to change, perhaps in a non-random way), and we briefly discuss ranked choice voting methods (where a vote is a ranked list of candidates).


title: Is there any measurable redshift dependence on the SN Ia absolute magnitude?

abstract: We test the cosmological implications of a varying absolute magnitude of Type Ia supernovae using the Pantheon compilation, by reconstructing different phenomenological approaches that could justify a varying absolute magnitude, but also approaches based on cosmic voids, modified gravity models and a binning scheme. In all the cases considered in this work, we find good agreement with the expected values of the standard $\Lambda$CDM model and no evidence of new physics.


title: Towards an Understanding of the Massive Red Spiral Galaxy Formation

abstract: To understand the formation and quenching processes of local massive red spiral galaxies with $M_{\ast} > 10^{10.5}M_{\odot}$, we perform a statistical analysis of their spectroscopic and structural properties, and compare them with elliptical and blue spiral galaxies of similar mass. The sample was selected from the stellar mass catalog of galaxies in SDSS DR7, according to their locations on the u-r color-stellar mass diagram. We find that red spirals harbor compact cores with high stellar mass surface densities measured by $\Sigma_1$ and they are bulge-dominated. Particularly, the red spirals, especially their bulges follow the $\Sigma_1$-$M_{\ast}$ ridgeline for quenched galaxies. Furthermore, the red spirals show similarly large central D$_n(4000)$, high [Mg/Fe] and dark matter halo mass to ellipticals. These results suggest that the bulges of red spirals formed within a short timescale before redshift ~ 1-2 and were quenched via a fast mode, similar to ellipticals. Careful examinations of the optical morphologies reveal that ~70% of red spirals show strong bars, rings/shells and even merging features, which suggests that interactions or mergers might have played an important role in the formation of red spirals. In contrast, most of the massive blue spirals have completely different spectral and structural properties from red spirals. However, the blue spirals with high $\Sigma_1$ ($\Sigma_1 > 10^{9.5} M_\odot \, {\rm kpc}^{-2}$) show similar structural and morphological properties, as well as similar halo mass and HI mass to red spirals. We discuss rejuvenation from red to blue as a possible explanation for these high $\Sigma_1$ blue spirals.


title: Axiomatizing recursion-free, regular monitors

abstract: Monitors are a key tool in the field of runtime verification, where they are used to verify system properties by analyzing execution traces generated by processes. Work on runtime monitoring carried out in a series of papers by Aceto et al.$~$has specified monitors using a variation on the regular fragment of Milner's CCS and studied two trace-based notions of equivalence over monitors, namely verdict and $\omega$-verdict equivalence. This article is devoted to the study of the equational logic of monitors modulo those two notions of equivalence. It presents complete equational axiomatizations of verdict and $\omega$-verdict equivalence for closed and open terms over recursion-free monitors. It is also shown that verdict equivalence has no finite equational axiomatization over open monitors when the set of actions is finite and contains at least two actions.


title: The Max k-Cut Game: On Stable Optimal Colorings

abstract: We study the max k-cut game on an undirected and unweighted graph in order to find out whether an optimal solution is also a strong equilibrium. While we do fail to show that, by proving an alternate formula for computing the cut value difference for a strong deviation, we show that optimal solutions are 7-stable equilibria. Furthermore, we prove some properties of minimal subsets with respect to a strong deviation, showing that each of their nodes will deviate towards the color of one of their neighbors and that those subsets induce connected subgraphs.


title: Study of the process $e^+e^- \to \eta\pi^0\gamma$ in the energy range $\sqrt{s} = \mbox{1.05-2.00}$ GeV with the SND detector

abstract: The process $e^+e^-\to\eta\pi^0\gamma$ is studied in the center-of-mass energy range 1.05-2.00 GeV using data with an integrated luminosity of 94.5 pb$^{-1}$ collected by the SND detector at the VEPP-2000 $e^+e^-$ collider. The $e^+e^-\to\eta\pi^0\gamma$ cross section is measured for the first time. It is shown that the dominant mechanism of this reaction is the transition through the $\omega\eta$ intermediate state. The measured cross section of the subprocess $e^+e^-\to\omega\eta\to\eta\pi^0\gamma$ is consistent with previous measurements in the $e^+e^-\to\pi^+\pi^-\pi^0\eta$ mode. It is found, with a significance of 5.6$\sigma$, that the process $e^+e^-\to\eta\pi^0\gamma$ is not completely described by hadronic vector-pseudoscalar intermediate states. The cross section of this missing contribution, which can originate from radiation processes, e. g. $e^+e^-\to a_{0}(1450)\gamma$, is measured. It is found to be 15-20 pb in the wide energy range from 1.3 to 1.9 GeV.


title: Hypothesis Testing for Shapes using Vectorized Persistence Diagrams

abstract: Topological data analysis involves the statistical characterization of the shape of data. Persistent homology is a primary tool of topological data analysis, which can be used to analyze topological features and perform statistical inference. In this paper, we present a two-stage hypothesis test for vectorized persistence diagrams. The first stage filters vector elements in the vectorized persistence diagrams to enhance the power of the test. The second stage consists of multiple hypothesis tests, with false positives controlled by false discovery rates. We demonstrate the flexibility of our method by applying it to a variety of simulated and real-world data types. Our results show that the proposed hypothesis test enables accurate and informative inferences on the shape of data compared to the existing hypothesis testing methods for persistent homology.


title: Pruning neural networks without any data by iteratively conserving synaptic flow

abstract: Pruning the parameters of deep neural networks has generated intense interest due to potential savings in time, memory and energy both during training and at test time. Recent works have identified, through an expensive sequence of training and pruning cycles, the existence of winning lottery tickets or sparse trainable subnetworks at initialization. This raises a foundational question: can we identify highly sparse trainable subnetworks at initialization, without ever training, or indeed without ever looking at the data? We provide an affirmative answer to this question through theory driven algorithm design. We first mathematically formulate and experimentally verify a conservation law that explains why existing gradient-based pruning algorithms at initialization suffer from layer-collapse, the premature pruning of an entire layer rendering a network untrainable. This theory also elucidates how layer-collapse can be entirely avoided, motivating a novel pruning algorithm Iterative Synaptic Flow Pruning (SynFlow). This algorithm can be interpreted as preserving the total flow of synaptic strengths through the network at initialization subject to a sparsity constraint. Notably, this algorithm makes no reference to the training data and consistently competes with or outperforms existing state-of-the-art pruning algorithms at initialization over a range of models (VGG and ResNet), datasets (CIFAR-10/100 and Tiny ImageNet), and sparsity constraints (up to 99.99 percent). Thus our data-agnostic pruning algorithm challenges the existing paradigm that, at initialization, data must be used to quantify which synapses are important.

categories: cs.LG cond-mat.dis-nn cs.CV q-bio.NC stat.ML


title: Variational Auto-Regressive Gaussian Processes for Continual Learning

abstract: Through sequential construction of posteriors on observing data online, Bayes' theorem provides a natural framework for continual learning. We develop Variational Auto-Regressive Gaussian Processes (VAR-GPs), a principled posterior updating mechanism to solve sequential tasks in continual learning. By relying on sparse inducing point approximations for scalable posteriors, we propose a novel auto-regressive variational distribution which reveals two fruitful connections to existing results in Bayesian inference, expectation propagation and orthogonal inducing points. Mean predictive entropy estimates show VAR-GPs prevent catastrophic forgetting, which is empirically supported by strong performance on modern continual learning benchmarks against competitive baselines. A thorough ablation study demonstrates the efficacy of our modeling choices.


title: Examination and Extension of Strategies for Improving Personalized Language Modeling via Interpolation

abstract: In this paper, we detail novel strategies for interpolating personalized language models and methods to handle out-of-vocabulary (OOV) tokens to improve personalized language models. Using publicly available data from Reddit, we demonstrate improvements in offline metrics at the user level by interpolating a global LSTM-based authoring model with a user-personalized n-gram model. By optimizing this approach with a back-off to uniform OOV penalty and the interpolation coefficient, we observe that over 80% of users receive a lift in perplexity, with an average of 5.2% in perplexity lift per user. In doing this research we extend previous work in building NLIs and improve the robustness of metrics for downstream tasks.


title: Standardised convolutional filtering for radiomics

abstract: The Image Biomarker Standardisation Initiative (IBSI) aims to improve reproducibility of radiomics studies by standardising the computational process of extracting image biomarkers (features) from images. We have previously established reference values for 169 commonly used features, created a standard radiomics image processing scheme, and developed reporting guidelines for radiomic studies. However, several aspects are not standardised. Here we present a complete version of a reference manual on the use of convolutional filters in radiomics and quantitative image analysis. Filters, such as wavelets or Laplacian of Gaussian filters, play an important part in emphasising specific image characteristics such as edges and blobs. Features derived from filter response maps were found to be poorly reproducible. This reference manual provides definitions for convolutional filters, parameters that should be reported, reference feature values, and tests to verify software compliance with the reference standard.


title: High Purity Germanium Based Radiation Detectors with Segmented Amorphous Semiconductor Electrical Contacts: Fabrication Procedures

abstract: Radiation detectors constructed from large volume high purity Ge (HPGe) single crystals are widely used for gamma-ray spectroscopy. The detectors for this application can be simple in that they need only have two electrical contacts for voltage application and signal readout. Such HPGe based detectors have been commercially produced for many decades using standard semiconductor fabrication processes. For the applications of gamma-ray imaging and particle tracking, however, interaction position measurement within the detector as well as the measurement of the deposited energy is required. This necessitates a more complex detector often with the electrical contacts divided into a large number of segments that can be individually instrumented for signal readout. The reliable and cost-effective implementation of contact segmentation with the standard commercial processes is a challenge. An alternative fabrication technology based on thin film amorphous semiconductor layers was developed at Lawrence Berkeley National Laboratory (LBNL) and can be used to produce finely segmented, fully passivated HPGe detectors. Over the last almost two decades, a large number of segmented contact HPGe detectors have been produced at LBNL using this technology. This paper provides a set of procedures that has been used at LBNL for the manufacture of the segmented amorphous semiconductor contact HPGe detectors.


title: Evidence of liquid-liquid phase transition in compressed Ar probed by the thermal expansion of Mo, Ta and W at high pressures

abstract: The long standing controversy between the melting curves of the bcc Mo,Ta,W and vanadium (V) metals measured by diamond anvil Cells (DAC) and the shock dynamic experiments is explained by the behavior the liquid or solid pressure transmitting mediums compressed by the thermal expansion of the these transition metals. This explains the observed isobaric behavior of the laser heated DAC experiments containing different transmitting mediums reported in the literature, thus solving the standing enigma described in very many publications.


title: Sharp subcritical and critical $L^{p}$ Hardy inequalities on the sphere

abstract: We prove sharp inequalities of Hardy type for functions in the Sobolev space $W^{1,p}$ on the unit sphere $\mathbb{S}^{n-1}$ in $\mathbb{R}^{n}$. We achieve this in both the subcritical and critical cases. The method we use to show optimality takes into account all the constants involved in our inequalities.


title: Improving Cross-Lingual Transfer Learning for End-to-End Speech Recognition with Speech Translation

abstract: Transfer learning from high-resource languages is known to be an efficient way to improve end-to-end automatic speech recognition (ASR) for low-resource languages. Pre-trained or jointly trained encoder-decoder models, however, do not share the language modeling (decoder) for the same language, which is likely to be inefficient for distant target languages. We introduce speech-to-text translation (ST) as an auxiliary task to incorporate additional knowledge of the target language and enable transferring from that target language. Specifically, we first translate high-resource ASR transcripts into a target low-resource language, with which a ST model is trained. Both ST and target ASR share the same attention-based encoder-decoder architecture and vocabulary. The former task then provides a fully pre-trained model for the latter, bringing up to 24.6% word error rate (WER) reduction to the baseline (direct transfer from high-resource ASR). We show that training ST with human translations is not necessary. ST trained with machine translation (MT) pseudo-labels brings consistent gains. It can even outperform those using human labels when transferred to target ASR by leveraging only 500K MT examples. Even with pseudo-labels from low-resource MT (200K examples), ST-enhanced transfer brings up to 8.9% WER reduction to direct transfer.


title: Simple and efficient algorithms for training machine learning potentials to force data

abstract: Abstract Machine learning models, trained on data from ab initio quantum simulations, are yielding molecular dynamics potentials with unprecedented accuracy. One limiting factor is the quantity of available training data, which can be expensive to obtain. A quantum simulation often provides all atomic forces, in addition to the total energy of the system. These forces provide much more information than the energy alone. It may appear that training a model to this large quantity of force data would introduce significant computational costs. Actually, training to all available force data should only be a few times more expensive than training to energies alone. Here, we present a new algorithm for efficient force training, and benchmark its accuracy by training to forces from real-world datasets for organic chemistry and bulk aluminum.


title: The crux of using the cascaded emission of a 3-level quantum ladder system to generate indistinguishable photons

abstract: We investigate the degree of indistinguishability of cascaded photons emitted from a 3-level quantum ladder system; in our case the biexciton-exciton cascade of semiconductor quantum dots. For the 3-level quantum ladder system we theoretically demonstrate that the indistinguishability is inherently limited for both emitted photons and determined by the ratio of the lifetimes of the excited and intermediate states. We experimentally confirm this finding by comparing the quantum interference visibility of non-cascaded emission and cascaded emission from the same semiconductor quantum dot. Quantum optical simulations produce very good agreement with the measurements and allow to explore a large parameter space. Based on our model, we propose photonic structures to optimize the lifetime ratio and overcome the limited indistinguishability of cascaded photon emission from a 3-level quantum ladder system.


title: Unsupervised Paraphrase Generation using Pre-trained Language Models

abstract: Large scale Pre-trained Language Models have proven to be very powerful approach in various Natural language tasks. OpenAI's GPT-2 \cite{radford2019language} is notable for its capability to generate fluent, well formulated, grammatically consistent text and for phrase completions. In this paper we leverage this generation capability of GPT-2 to generate paraphrases without any supervision from labelled data. We examine how the results compare with other supervised and unsupervised approaches and the effect of using paraphrases for data augmentation on downstream tasks such as classification. Our experiments show that paraphrases generated with our model are of good quality, are diverse and improves the downstream task performance when used for data augmentation.


title: ToolNet: Using Commonsense Generalization for Predicting Tool Use for Robot Plan Synthesis

abstract: A robot working in a physical environment (like home or factory) needs to learn to use various available tools for accomplishing different tasks, for instance, a mop for cleaning and a tray for carrying objects. The number of possible tools is large and it may not be feasible to demonstrate usage of each individual tool during training. Can a robot learn commonsense knowledge and adapt to novel settings where some known tools are missing, but alternative unseen tools are present? We present a neural model that predicts the best tool from the available objects for achieving a given declarative goal. This model is trained by user demonstrations, which we crowd-source through humans instructing a robot in a physics simulator. This dataset maintains user plans involving multi-step object interactions along with symbolic state changes. Our neural model, ToolNet, combines a graph neural network to encode the current environment state, and goal-conditioned spatial attention to predict the appropriate tool. We find that providing metric and semantic properties of objects, and pre-trained object embeddings derived from a commonsense knowledge repository such as ConceptNet, significantly improves the model's ability to generalize to unseen tools. The model makes accurate and generalizable tool predictions. When compared to a graph neural network baseline, it achieves 14-27% accuracy improvement for predicting known tools from new world scenes, and 44-67% improvement in generalization for novel objects not encountered during training.


title: Probabilistic Autoencoder

abstract: Principal Component Analysis (PCA) minimizes the reconstruction error given a class of linear models of fixed component dimensionality. Probabilistic PCA adds a probabilistic structure by learning the probability distribution of the PCA latent space weights, thus creating a generative model. Autoencoders (AE) minimize the reconstruction error in a class of nonlinear models of fixed latent space dimensionality and outperform PCA at fixed dimensionality. Here, we introduce the Probabilistic Autoencoder (PAE) that learns the probability distribution of the AE latent space weights using a normalizing flow (NF). The PAE is fast and easy to train and achieves small reconstruction errors, high sample quality, and good performance in downstream tasks. We compare the PAE to Variational AE (VAE), showing that the PAE trains faster, reaches a lower reconstruction error, and produces good sample quality without requiring special tuning parameters or training procedures. We further demonstrate that the PAE is a powerful model for performing the downstream tasks of probabilistic image reconstruction in the context of Bayesian inference of inverse problems for inpainting and denoising applications. Finally, we identify latent space density from NF as a promising outlier detection metric.


title: DcardNet: Diabetic Retinopathy Classification at Multiple Levels Based on Structural and Angiographic Optical Coherence Tomography

abstract: Objective: Optical coherence tomography (OCT) and its angiography (OCTA) have several advantages for the early detection and diagnosis of diabetic retinopathy (DR). However, automated, complete DR classification frameworks based on both OCT and OCTA data have not been proposed. In this study, a convolutional neural network (CNN) based method is proposed to fulfill a DR classification framework using en face OCT and OCTA. Methods: A densely and continuously connected neural network with adaptive rate dropout (DcardNet) is designed for the DR classification. In addition, adaptive label smoothing was proposed and used to suppress overfitting. Three separate classification levels are generated for each case based on the International Clinical Diabetic Retinopathy scale. At the highest level the network classifies scans as referable or non-referable for DR. The second level classifies the eye as non-DR, non-proliferative DR (NPDR), or proliferative DR (PDR). The last level classifies the case as no DR, mild and moderate NPDR, severe NPDR, and PDR. Results: We used 10-fold cross-validation with 10% of the data to assess the networks performance. The overall classification accuracies of the three levels were 95.7%, 85.0%, and 71.0% respectively. Conclusion/Significance: A reliable, sensitive and specific automated classification framework for referral to an ophthalmologist can be a key technology for reducing vision loss related to DR.


title: An inverse problem involving a viscous Eikonal equation with applications in electrophysiology

abstract: In this work we discuss the reconstruction of cardiac activation instants based on a viscous Eikonal equation from boundary observations. The problem is formulated as an least squares problem and solved by a projected version of the Levenberg Marquardt method. Moreover, we analyze the wellposeness of the state equation and derive the gradient of the least squares functional with respect to the activation instants. In the numerical examples we also conduct an experiment in which the location of the activation sites and the activation instants are reconstructed jointly based on an adapted version of the shape gradient method from https://link.springer.com/article/10.1007/s00285-019-01419-3. We are able to reconstruct the activation instants as well as the locations of the activations with high accuracy relative to the noise level.


title: Coresets for Near-Convex Functions

abstract: Coreset is usually a small weighted subset of $n$ input points in $\mathbb{R}^d$, that provably approximates their loss function for a given set of queries (models, classifiers, etc.). Coresets become increasingly common in machine learning since existing heuristics or inefficient algorithms may be improved by running them possibly many times on the small coreset that can be maintained for streaming distributed data. Coresets can be obtained by sensitivity (importance) sampling, where its size is proportional to the total sum of sensitivities. Unfortunately, computing the sensitivity of each point is problem dependent and may be harder to compute than the original optimization problem at hand. We suggest a generic framework for computing sensitivities (and thus coresets) for wide family of loss functions which we call near-convex functions. This is by suggesting the $f$-SVD factorization that generalizes the SVD factorization of matrices to functions. Example applications include coresets that are either new or significantly improves previous results, such as SVM, Logistic regression, M-estimators, and $\ell_z$-regression. Experimental results and open source are also provided.


title: Blockchain in the management of science: conceptual models, promises and challenges

abstract: Blockchain has received much attention recently, due to its promises of verifiable, permanent, decentralized, and efficient data handling. In 2017-2019 blockchain and associated technologies such as smart contracts has progressed beyond cryptocurrencies, and has been adopted in banking, retail, healthcare, and other fields. This study critically examines recent applications of blockchain in science, touching upon different stages of research cycle, from data management to publishing, peer review, research evaluation and funding. The paper is based upon a review of blockchain projects, relevant literature, a set of interviews and focus groups with startup founders, scholars, librarians, IT experts from the EU, USA, Russia, and Belarus. Proponents of blockchain for science present this technology as a tool to make science free from bias, red tape, data fraud, as well as provide innovative means to secure financial backing for new ideas. However, these projects face a set of challenges. One issue concerns introducing crypto economy, with its financial incentives, into science, a field that emphasizes disinterested and non-pecuniary pursuit of truth. Another source of concern relates to the ongoing conflict between the principle of decentralization inherent to blockchain and the practice of forcing it from above, by the state and other centralized entities.


title: Chiral Quasi-Bound States in the Continuum

abstract: Quasi-bound states in the continuum (q-BICs) are resonant states of suitably tailored nanostructures with long optical lifetimes controlled by symmetry-breaking perturbations. While in planarized ultrathin devices the resulting Fano resonance is limited to linear polarizations, we show here that chiral perturbations extend q-BIC concepts to arbitrary elliptical polarizations. Using geometric phase engineering, we realize metasurfaces with ultrasharp Fano spectral features that can shape the impinging wavefront with near-unity efficiency, while at the same time precisely filtering their spectral content.


title: Off-the-shelf sensor vs. experimental radar -- How much resolution is necessary in automotive radar classification?

abstract: Radar-based road user detection is an important topic in the context of autonomous driving applications. The resolution of conventional automotive radar sensors results in a sparse data representation which is tough to refine during subsequent signal processing. On the other hand, a new sensor generation is waiting in the wings for its application in this challenging field. In this article, two sensors of different radar generations are evaluated against each other. The evaluation criterion is the performance on moving road user object detection and classification tasks. To this end, two data sets originating from an off-the-shelf radar and a high resolution next generation radar are compared. Special attention is given on how the two data sets are assembled in order to make them comparable. The utilized object detector consists of a clustering algorithm, a feature extraction module, and a recurrent neural network ensemble for classification. For the assessment, all components are evaluated both individually and, for the first time, as a whole. This allows for indicating where overall performance improvements have their origin in the pipeline. Furthermore, the generalization capabilities of both data sets are evaluated and important comparison metrics for automotive radar object detection are discussed. Results show clear benefits of the next generation radar. Interestingly, those benefits do not actually occur due to better performance at the classification stage, but rather because of the vast improvements at the clustering stage.