title: Efficient Generalized Spherical CNNs

abstract: Many problems across computer vision and the natural sciences require the analysis of spherical data, for which representations may be learned efficiently by encoding equivariance to rotational symmetries. We present a generalized spherical CNN framework that encompasses various existing approaches and allows them to be leveraged alongside each other. The only existing non-linear spherical CNN layer that is strictly equivariant has complexity $\mathcal{O}(C^2L^5)$, where $C$ is a measure of representational capacity and $L$ the spherical harmonic bandlimit. Such a high computational cost often prohibits the use of strictly equivariant spherical CNNs. We develop two new strictly equivariant layers with reduced complexity $\mathcal{O}(CL^4)$ and $\mathcal{O}(CL^3 \log L)$, making larger, more expressive models computationally feasible. Moreover, we adopt efficient sampling theory to achieve further computational savings. We show that these developments allow the construction of more expressive hybrid models that achieve state-of-the-art accuracy and parameter efficiency on spherical benchmark problems.


title: Newton-type method for bilevel programs with linear lower level problem and application to toll optimization

abstract: We consider a bilevel program involving a linear lower level problem with left-hand-side perturbation. We then consider the Karush-Kuhn-Tucker reformulation of the problem and subsequently build a tractable optimization problem with linear constraints by means of a partial exact penalization. A semismooth system of equations is then generated from the later problem and a Newton-type method is developed to solve it. Finally, we illustrate the convergence and practical implementation of the algorithm on the optimal toll-setting problem in transportation networks.


title: Symbolic Self-triggered Control of Continuous-time Non-deterministic Systems without Stability Assumptions for 2-LTL Specifications

abstract: We propose a symbolic self-triggered controller synthesis procedure for non-deterministic continuous-time nonlinear systems without stability assumptions. The goal is to compute a controller that satisfies two objectives. The first objective is represented as a specification in a fragment of LTL, which we call 2-LTL. The second one is an energy objective, in the sense that control inputs are issued only when necessary, which saves energy. To this end, we first quantise the state and input spaces, and then translate the controller synthesis problem to the computation of a winning strategy in a mean-payoff parity game. We illustrate the feasibility of our method on the example of a navigating nonholonomic robot.


title: On the inducibility of oriented graphs on four vertices

abstract: We consider the problem of determining the inducibility (maximum possible asymptotic density of induced copies) of oriented graphs on four vertices. We provide exact values for more than half of the graphs, and very close lower and upper bounds for all the remaining ones. It occurs that, for some graphs, the structure of extremal constructions maximizing density of its induced copies is very sophisticated and complex.


title: Spike and slab variational Bayes for high dimensional logistic regression

abstract: Variational Bayes (VB) is a popular scalable alternative to Markov chain Monte Carlo for Bayesian inference. We study a mean-field spike and slab VB approximation of widely used Bayesian model selection priors in sparse high-dimensional logistic regression. We provide non-asymptotic theoretical guarantees for the VB posterior in both $\ell_2$ and prediction loss for a sparse truth, giving optimal (minimax) convergence rates. Since the VB algorithm does not depend on the unknown truth to achieve optimality, our results shed light on effective prior choices. We confirm the improved performance of our VB algorithm over common sparse VB approaches in a numerical study.


title: Reducing Unintended Identity Bias in Russian Hate Speech Detection

abstract: Toxicity has become a grave problem for many online communities and has been growing across many languages, including Russian. Hate speech creates an environment of intimidation, discrimination, and may even incite some real-world violence. Both researchers and social platforms have been focused on developing models to detect toxicity in online communication for a while now. A common problem of these models is the presence of bias towards some words (e.g. woman, black, jew) that are not toxic, but serve as triggers for the classifier due to model caveats. In this paper, we describe our efforts towards classifying hate speech in Russian, and propose simple techniques of reducing unintended bias, such as generating training data with language models using terms and words related to protected identities as context and applying word dropout to such words.


title: Python (deep learning and machine learning) for EEG signal processing on the example of recognizing the disease of alcoholism

abstract: Alcoholism is one of the most common diseases in the world. This type of substance abuse leads to mental and physical dependence on ethanol-containing drinks. Alcoholism is accompanied by progressive degradation of the personality and damage to the internal organs. Today still not exists a quick diagnosis method to detect this disease. This article presents the method for the quick and anonymous alcoholism diagnosis by neural networks. For this method, don't need any private information about the subject. For the implementation, we considered various algorithms of machine learning and deep neural networks. In detail analyzed the correlation of the signals from electrodes by neural networks. The wavelet transforms and the fast Fourier transform was considered. The manuscript demonstrates that the deep neural network which operates only with a dataset of EEG correlation signals can anonymously classify the alcoholic and control groups with high accuracy. On the one hand, this method will allow subjects to be tested for alcoholism without any personal data, which will not cause inconvenience or shame in the subject, and on the other hand, the subject will not be able to deceive specialists who diagnose the subject for the presence of the disease.


title: IVOA Data Access Layer: roadmap as of year 2020

abstract: The IVOA works towards standardising interoperability and curation of data and service holdings of the global astrophysical community. Within the IVOA, the Data Access Layer (DAL) Working Group's goal is to provide technical standards for accessing data collections and catalogues; filtering data holdings based on their metadata; and retrieving the ones in scope, or operating on them. In recent years the DAL community has addressed the multi-dimensional and multi-wavelength scenarios, and kept core standards up-to-date. It has also tackled new topics such as the observation location and object visibility information retrieval, and payed back attention to outstanding topics like time domain and radio astronomy data. DAL work in the next few years will involve a mixture of revising existing standards, listening to feedback on recently updated and released standards, and defining new standards. Community feedback and contributions are needed for all DAL activities. Particularly important are the experiences of data providers and projects that are using VO technologies to address their scientific community's requirements. This is not a trivial task since the development of a standardised interface for the final user often requires more than one Recommendation to be implemented. This contribution aims to summarise the current DAL status and progress, in order to help new end-users understand how DAL can be beneficial. It also discusses the future changes to DAL standards and lists topics (No-SQL, code-to-data, parametric querying, actionable retrieval, ...) worth investigating in the future to keep access layer standardisation up to date with current needs.


title: Electronic structure of ytterbium monohydroxide molecule to search for axionlike particles

abstract: Recently the YbOH molecule has been suggested as a candidate to search for the electron electric dipole moment (eEDM) which violates spatial parity (P) and time-reversal (T) symmetries [I. Kozyryev and N. R. Hutzler, Phys. Rev. Lett. 119, 133002 (2017)]. In the present paper we show that the same system can be used to measure coupling constants of the interaction of electrons and nucleus with axionlike particles. The electron-nucleus interaction produced by the axion exchange induces T,P-violating a EDM of the whole molecular system. We express the corresponding T,P-violating energy shift produced by this effect in terms of the axion mass and product of the axion-nucleus and axion-electron coupling constants.


title: Finding all $S$-Diophantine quadruples for a fixed set of primes $S$

abstract: Given a finite set of primes $S$ and a $m$-tuple $(a_1,\dots,a_m)$ of positive, distinct integers we call the $m$-tuple $S$-Diophantine, if for each $1\leq i < j\leq m$ the quantity $a_ia_j+1$ has prime divisors coming only from the set $S$. For a given set $S$ we give a practical algorithm to find all $S$-Diophantine quadruples, provided that $|S|=3$.


title: Motion Planning Combines Psychological Safety and Motion Prediction for a Sense Motive Robot

abstract: Human safety is the most important demand for human robot interaction and collaboration (HRIC), which not only refers to physical safety, but also includes psychological safety. Although many robots with different configurations have entered our living and working environments, the human safety problem is still an ongoing research problem in human-robot coexistence scenarios. This paper addresses the human safety issue by covering both the physical safety and psychological safety aspects. First, we introduce an adaptive robot velocity control and step size adjustment method according to human facial expressions, such that the robot can adjust its movement to keep safety when the human emotion is unusual. Second, we predict the human motion by detecting the suddenly changes of human head pose and gaze direction, such that the robot can infer whether the human attention is distracted, predict the next move of human and rebuild a repulsive force to avoid potential collision. Finally, we demonstrate our idea using a 7 DOF TIAGo robot in a dynamic HRIC environment, which shows that the robot becomes sense motive, and responds to human action and emotion changes quickly and efficiently.


title: CycleGAN-VC3: Examining and Improving CycleGAN-VCs for Mel-spectrogram Conversion

abstract: Non-parallel voice conversion (VC) is a technique for learning mappings between source and target speeches without using a parallel corpus. Recently, cycle-consistent adversarial network (CycleGAN)-VC and CycleGAN-VC2 have shown promising results regarding this problem and have been widely used as benchmark methods. However, owing to the ambiguity of the effectiveness of CycleGAN-VC/VC2 for mel-spectrogram conversion, they are typically used for mel-cepstrum conversion even when comparative methods employ mel-spectrogram as a conversion target. To address this, we examined the applicability of CycleGAN-VC/VC2 to mel-spectrogram conversion. Through initial experiments, we discovered that their direct applications compromised the time-frequency structure that should be preserved during conversion. To remedy this, we propose CycleGAN-VC3, an improvement of CycleGAN-VC2 that incorporates time-frequency adaptive normalization (TFAN). Using TFAN, we can adjust the scale and bias of the converted features while reflecting the time-frequency structure of the source mel-spectrogram. We evaluated CycleGAN-VC3 on inter-gender and intra-gender non-parallel VC. A subjective evaluation of naturalness and similarity showed that for every VC pair, CycleGAN-VC3 outperforms or is competitive with the two types of CycleGAN-VC2, one of which was applied to mel-cepstrum and the other to mel-spectrogram. Audio samples are available at http://www.kecl.ntt.co.jp/people/kaneko.takuhiro/projects/cyclegan-vc3/index.html.


title: Understanding the Lithium Ion Transport in Concentrated Block-Copolymer Electrolytes on a Microscopic Level

abstract: Block-copolymer electrolytes with lamellar microstructure show promising results regarding the ion transport in experiments. Motivated by these observations we study block-copolymers consisting of a polystyrene (PS) block and a poly(ethylene oxide) (PEO) block which were assembled in a lamellar structure. The lamella was doped with various amounts of lithium-bis(trifluoromethane)sulfonimide (LiTFSI) until very high loadings with ratios of EO monomers to cations up to 1:1 were reached. We present insights into the structure and ion transport from extensive Molecular Dynamics simulations. For high salt concentrations most cations are not coordinated by PEO but rather by TFSI and THF. More specifically, LiTFSI partially separates from the PEO domain and forms a network-like structure in the middle of the lamella. This central salt-rich layer plays a decisive role to enable remarkably good cationic mobilities as well as high transport numbers in agreement with the experimental results.


title: Status of low mass LSP in SUSY

abstract: In this article we review the case for a light ($< m_{h_{125}}/2$) neutralino and sneutrino being a viable Dark Matter (DM) candidate in Supersymmetry(SUSY). To that end we recapitulate, very briefly, three issues related to the DM which impact the discussions : calculation of DM relic density, detection of the DM in Direct and Indirect experiments and creation /detection at the Colliders. In case of SUSY, the results from Higgs and SUSY searches at the colliders also have implications for the DM mass and couplings. In view of the constraints coming from all these sources, the possibility of a light neutralino is all but ruled out for the constrained MSSM : cMSSM. The pMSSM, where the gaugino masses are not related at high scale, is also quite constrained and under tension in case of thermal DM and will be put to very stern test in the near future in Direct Detection (DD) experiments as well as by the LHC analyses. However in the pMSSM with modified cosmology and hence non-thermal DM or in the NMSSM, a light neutralino is much more easily accommodated. A light RH sneutrino is also still a viable DM candidate although it requires extending the MSSM with additional singlet neutrino superfields. All of these possibilities can be indeed tested jointly in the upcoming SUSY-electroweakino and Higgs searches at the HL/HE luminosity LHC, the upcoming experiments for the Direct Detection (DD) and indirect detection for the DM as well as the high precision electron-positron colliders under planning.


title: Optimization-Based Visual-Inertial SLAM Tightly Coupled with Raw GNSS Measurements

abstract: Unlike loose coupling approaches and the EKF-based approaches in the literature, we propose an optimization-based visual-inertial SLAM tightly coupled with raw Global Navigation Satellite System (GNSS) measurements, a first attempt of this kind in the literature to our knowledge. More specifically, reprojection error, IMU pre-integration error and raw GNSS measurement error are jointly minimized within a sliding window, in which the asynchronism between images and raw GNSS measurements is accounted for. In addition, issues such as marginalization, noisy measurements removal, as well as tackling vulnerable situations are also addressed. Experimental results on public dataset in complex urban scenes show that our proposed approach outperforms state-of-the-art visual-inertial SLAM, GNSS single point positioning, as well as a loose coupling approach, including scenes mainly containing low-rise buildings and those containing urban canyons.


title: Input-Shaping for Feed-Forward Control of Cable-Driven Parallel Robots

abstract: This paper deals with the use of input-shaping filters in conjunction with a feed-forward control of Cable-Driven Parallel Robots (CDPRs), while integrating cable tension calculation to satisfy positive cable tensions along the prescribed trajectory of the moving-platform. This method aims to attenuate the oscillatory motions of the moving-platform. Thus, the input signal is modified to make it self-cancel residual vibrations. 5 The effectiveness, in terms of moving-platform oscillation attenuation, of the proposed closed-loop control method combined with shaping inputs is experimentally studied on a suspended and non-redundant CDPR prototype. This confirms residual vibration reduction improvement with respect to the unshaped control in terms of Peak-to-Peak amplitude of velocity error, which can achieve 72 % while using input-shaping filters.


title: Second layer data governance for permissioned blockchains: the privacy management challenge

abstract: Data privacy is a trending topic in the internet era. Given such importance, many challenges emerged in order to collect, manage, process, and publish data. In this sense, personal data have got attention, and many regulations emerged, such as GDPR in the European Union and LGPD in Brazil. This regulation model aims to protect users' data from misusage and leakage and allow users to request an explanation from companies when needed. In pandemic situations, such as the COVID-19 and Ebola outbreak, the action related to sharing health data between different organizations is/ was crucial to develop a significant movement to avoid the massive infection and decrease the number of deaths. However, the data subject, i.e., the users, should have the right to request the purpose of data use, anonymization, and data deletion. In this sense, permissioned blockchain technology emerges to empower users to get their rights providing data ownership, transparency, and security through an immutable, unified, and distributed database ruled by smart contracts. The governance model discussed in blockchain applications is usually regarding the first layer governance, i.e., public and permissioned models. However, this discussion is too superficial, and they do not cover compliance with the data regulations. Therefore, in order to organize the relationship between data owners and the stakeholders, i.e., companies and governmental entities, we developed a second layer data governance model for permissioned blockchains based on the Governance Analytical Framework principles applied in pandemic situations preserving the users' privacy and their duties. From the law perspective, we based our model on the UE GDPR in regard to data privacy concerns.


title: Neglected X-ray discovered polars: III. RX J0154.0-5947, RX J0600.5-2709, RX J0859.1+0537, RX J0953.1+1458, and RX J1002.2-1925

abstract: We report results on the ROSAT-discovered noneclipsing short-period polars RX J0154.0-5947, RX J0600.5-2709, RX J0859.1+0537, RX J0953.1+1458, and RX J1002.2-1925 collected over 30 years. We present accurate linear orbital ephemerides that allow a correct phasing of data taken decades apart. Three of the systems show cyclotron and Zeeman lines that yield magnetic field strengths of 36 MG, 19 MG, and 33 MG for the last three targets, respectively. RX J0154.0-5947, RX J0859.1+0537, and RX J1002.2-1925 show evidence for part-time accretion at both magnetic poles, while RX J0953.1+1458 is a polar with a stable one-pole geometry. RX J1002.2-1925 shows large variations in the shapes of its light curves that we associate with an unstable accretion geometry. Nevertheless, it appears to be synchronized. We determined the bolometric soft and hard X-ray fluxes and the luminosities at the Gaia distances of the five stars. Combined with estimates of the cyclotron luminosities, we derived high-state accretion rates that range from $\dot M = 2.9 \times 10^{-11}$ $M_{\odot}$yr$^{-1}$ to $9.7 \times 10^{-11}$ $M_{\odot}$yr$^{-1}$ for white dwarf masses between 0.61 and 0.82 $M_\odot$, in agreement with predictions based on the observed effective temperatures of white dwarfs in polars and the theory of compressional heating. Our analysis lends support to the hypothesis that different mean accretion rates appply for the subgroups of short-period polars and nonmagnetic cataclysmic variables.


title: DPAttack: Diffused Patch Attacks against Universal Object Detection

abstract: Recently, deep neural networks (DNNs) have been widely and successfully used in Object Detection, e.g. Faster RCNN, YOLO, CenterNet. However, recent studies have shown that DNNs are vulnerable to adversarial attacks. Adversarial attacks against object detection can be divided into two categories, whole-pixel attacks and patch attacks. While these attacks add perturbations to a large number of pixels in images, we proposed a diffused patch attack (\textbf{DPAttack}) to successfully fool object detectors by diffused patches of asteroid-shaped or grid-shape, which only change a small number of pixels. Experiments show that our DPAttack can successfully fool most object detectors with diffused patches and we get the second place in the Alibaba Tianchi competition: Alibaba-Tsinghua Adversarial Challenge on Object Detection. Our code can be obtained from https://github.com/Wu-Shudeng/DPAttack.


title: A new CMY camera technology using Al-TiO2-Al nanorod filter mosaic integrated on a CMOS image sensor

abstract: A CMY colour camera differs from its RGB counterpart in that it employs a subtractive colour space of cyan, magenta and yellow. CMY cameras tend to performs better than RGB cameras in low light conditions due to their much higher transmittance. However, conventional CMY colour filter technology made of pigments and dyes are limited in performance for the next generation image sensors with submicron pixel sizes. These conventional filters are difficult to fabricate at nanoscale dimensions as they use their absorption properties to subtract colours. This paper presents a CMOS compatible nanoscale thick CMY colour mosaic made of Al-TiO2-Al nanorods forming an array 0.82 million colour pixels of 4.4 micron each, arranged in a CMYM pattern. The colour mosaic was then integrated onto a MT9P031 monochrome image sensor to make a CMY camera and the colour imaging demonstrated using a 12 colour Macbeth chart. The developed technology will have applications in astronomy, low exposure time imaging in biology and photography.


title: Learning Panoptic Segmentation from Instance Contours

abstract: Panoptic Segmentation aims to provide an understanding of background (stuff) and instances of objects (things) at a pixel level. It combines the separate tasks of semantic segmentation (pixel level classification) and instance segmentation to build a single unified scene understanding task. Typically, panoptic segmentation is derived by combining semantic and instance segmentation tasks that are learned separately or jointly (multi-task networks). In general, instance segmentation networks are built by adding a foreground mask estimation layer on top of object detectors or using instance clustering methods that assign a pixel to an instance center. In this work, we present a fully convolution neural network that learns instance segmentation from semantic segmentation and instance contours (boundaries of things). Instance contours along with semantic segmentation yield a boundary aware semantic segmentation of things. Connected component labeling on these results produces instance segmentation. We merge semantic and instance segmentation results to output panoptic segmentation. We evaluate our proposed method on the CityScapes dataset to demonstrate qualitative and quantitative performances along with several ablation studies. Our overview video can be accessed from url:https://youtu.be/wBtcxRhG3e0.


title: Lung Nodule Classification Using Biomarkers, Volumetric Radiomics and 3D CNNs

abstract: We present a hybrid algorithm to estimate lung nodule malignancy that combines imaging biomarkers from Radiologist's annotation with image classification of CT scans. Our algorithm employs a 3D Convolutional Neural Network (CNN) as well as a Random Forest in order to combine CT imagery with biomarker annotation and volumetric radiomic features. We analyze and compare the performance of the algorithm using only imagery, only biomarkers, combined imagery + biomarkers, combined imagery + volumetric radiomic features and finally the combination of imagery + biomarkers + volumetric features in order to classify the suspicion level of nodule malignancy. The National Cancer Institute (NCI) Lung Image Database Consortium (LIDC) IDRI dataset is used to train and evaluate the classification task. We show that the incorporation of semi-supervised learning by means of K-Nearest-Neighbors (KNN) can increase the available training sample size of the LIDC-IDRI thereby further improving the accuracy of malignancy estimation of most of the models tested although there is no significant improvement with the use of KNN semi-supervised learning if image classification with CNNs and volumetric features are combined with descriptive biomarkers. Unexpectedly, we also show that a model using image biomarkers alone is more accurate than one that combines biomarkers with volumetric radiomics, 3D CNNs, and semi-supervised learning. We discuss the possibility that this result may be influenced by cognitive bias in LIDC-IDRI because malignancy estimates were recorded by the same radiologist panel as biomarkers, as well as future work to incorporate pathology information over a subset of study participants.


title: An Analysis of Simple Data Augmentation for Named Entity Recognition

abstract: Simple yet effective data augmentation techniques have been proposed for sentence-level and sentence-pair natural language processing tasks. Inspired by these efforts, we design and compare data augmentation for named entity recognition, which is usually modeled as a token-level sequence labeling problem. Through experiments on two data sets from the biomedical and materials science domains (i2b2-2010 and MaSciP), we show that simple augmentation can boost performance for both recurrent and transformer-based models, especially for small training sets.


title: Disentangling Action Sequences: Discovering Correlated Samples

abstract: Disentanglement is a highly desirable property of representation due to its similarity with human's understanding and reasoning. This improves interpretability, enables the performance of down-stream tasks, and enables controllable generative models. However, this domain is challenged by the abstract notion and incomplete theories to support unsupervised disentanglement learning. We demonstrate the data itself, such as the orientation of images, plays a crucial role in disentanglement and instead of the factors, and the disentangled representations align the latent variables with the action sequences. We further introduce the concept of disentangling action sequences which facilitates the description of the behaviours of the existing disentangling approaches. An analogy for this process is to discover the commonality between the things and categorizing them. Furthermore, we analyze the inductive biases on the data and find that the latent information thresholds are correlated with the significance of the actions. For the supervised and unsupervised settings, we respectively introduce two methods to measure the thresholds. We further propose a novel framework, fractional variational autoencoder (FVAE), to disentangle the action sequences with different significance step-by-step. Experimental results on dSprites and 3D Chairs show that FVAE improves the stability of disentanglement.


title: DocStruct: A Multimodal Method to Extract Hierarchy Structure in Document for General Form Understanding

abstract: Form understanding depends on both textual contents and organizational structure. Although modern OCR performs well, it is still challenging to realize general form understanding because forms are commonly used and of various formats. The table detection and handcrafted features in previous works cannot apply to all forms because of their requirements on formats. Therefore, we concentrate on the most elementary components, the key-value pairs, and adopt multimodal methods to extract features. We consider the form structure as a tree-like or graph-like hierarchy of text fragments. The parent-child relation corresponds to the key-value pairs in forms. We utilize the state-of-the-art models and design targeted extraction modules to extract multimodal features from semantic contents, layout information, and visual images. A hybrid fusion method of concatenation and feature shifting is designed to fuse the heterogeneous features and provide an informative joint representation. We adopt an asymmetric algorithm and negative sampling in our model as well. We validate our method on two benchmarks, MedForm and FUNSD, and extensive experiments demonstrate the effectiveness of our method.


title: A Very Compact Embedded CNN Processor Design Based on Logarithmic Computing

abstract: In this paper, we propose a very compact embedded CNN processor design based on a modified logarithmic computing method using very low bit-width representation. Our high-quality CNN processor can easily fit into edge devices. For Yolov2, our processing circuit takes only 0.15 mm2 using TSMC 40 nm cell library. The key idea is to constrain the activation and weight values of all layers uniformly to be within the range [-1, 1] and produce low bit-width logarithmic representation. With the uniform representations, we devise a unified, reusable CNN computing kernel and significantly reduce computing resources. The proposed approach has been extensively evaluated on many popular image classification CNN models (AlexNet, VGG16, and ResNet-18/34) and object detection models (Yolov2). The hardware-implemented results show that our design consumes only minimal computing and storage resources, yet attains very high accuracy. The design is thoroughly verified on FPGAs, and the SoC integration is underway with promising results. With extremely efficient resource and energy usage, our design is excellent for edge computing purposes.


title: PlenoptiCam v1.0: A light-field imaging framework

abstract: Light-field cameras play a vital role for rich 3-D information retrieval in narrow range depth sensing applications. The key obstacle in composing light-fields from exposures taken by a plenoptic camera is to computationally calibrate, align and rearrange four-dimensional image data. Several attempts have been proposed to enhance the overall image quality by tailoring pipelines dedicated to particular plenoptic cameras and improving the consistency across viewpoints at the expense of high computational loads. The framework presented herein advances prior outcomes thanks to its novel micro image scale-space analysis for generic camera calibration independent of the lens specifications and its parallax-invariant, cost-effective viewpoint color equalization from optimal transport theory. Artifacts from the sensor and micro lens grid are compensated in an innovative way to enable superior quality in sub-aperture image extraction, computational refocusing and Scheimpflug rendering with sub-sampling capabilities. Benchmark comparisons using established image metrics suggest that our proposed pipeline outperforms state-of-the-art tool chains in the majority of cases. Results from a Wasserstein distance further show that our color transfer outdoes the existing transport methods. Our algorithms are released under an open-source license, offer cross-platform compatibility with few dependencies and different user interfaces. This makes the reproduction of results and experimentation with plenoptic camera technology convenient for peer researchers, developers, photographers, data scientists and others working in this field.


title: Parallel data readout for background rejection in CANDLES experiment

abstract: CANDLES experiment in Kamioka Underground Observatory aims to obtain the neutrino-less double beta decay ($0\nu\beta\beta$) from $^{48}$Ca. This measurement is a big challenge due to the extremely rare decay rate of $^{48}$Ca. Thus, in order to obtain 0\nu\beta\beta, it is needed to reduce background as much as possible. Series of alpha and beta decays originated from radioactive impurities can remain as background in the energy region of $0\nu\beta\beta$. Because they are sequential decays, we can remove them by tagging preceding and following events. This tagging method requires minimized dead-time of DAQ system. A new DAQ system was introduced in CANDLES with new FADC (Flash Analog-to-Digital Converter) modules using 8 event buffers and SpaceWire-to-GigabitEthernet network for data readout. To reduce the dead-time, we developed our DAQ system with 4 parallel reading processes. As a result, the read-time is reduced by 4 times: 40msec down to 10msec, which is in equivalent to a half of previous DAQ's read-time. With reduced read-time accompanied by multiple event buffers, the new DAQ system is realized with efficiency is very close to 100$\%$ (no event lost at 20cps, which is CANDLES trigger rate, after 63 hours of data taking). With improved performance, it is expected to achieve higher background suppression for CANDLES experiment.


title: Cross-Spectral Iris Matching Using Conditional Coupled GAN

abstract: Cross-spectral iris recognition is emerging as a promising biometric approach to authenticating the identity of individuals. However, matching iris images acquired at different spectral bands shows significant performance degradation when compared to single-band near-infrared (NIR) matching due to the spectral gap between iris images obtained in the NIR and visual-light (VIS) spectra. Although researchers have recently focused on deep-learning-based approaches to recover invariant representative features for more accurate recognition performance, the existing methods cannot achieve the expected accuracy required for commercial applications. Hence, in this paper, we propose a conditional coupled generative adversarial network (CpGAN) architecture for cross-spectral iris recognition by projecting the VIS and NIR iris images into a low-dimensional embedding domain to explore the hidden relationship between them. The conditional CpGAN framework consists of a pair of GAN-based networks, one responsible for retrieving images in the visible domain and other responsible for retrieving images in the NIR domain. Both networks try to map the data into a common embedding subspace to ensure maximum pair-wise similarity between the feature vectors from the two iris modalities of the same subject. To prove the usefulness of our proposed approach, extensive experimental results obtained on the PolyU dataset are compared to existing state-of-the-art cross-spectral recognition methods.


title: Rapid parameter determination of discrete damped sinusoidal oscillations

abstract: We present different computational approaches for the rapid extraction of the signal parameters of discretely sampled damped sinusoidal signals. We compare time- and frequency-domain-based computational approaches in terms of their accuracy and precision and computational time required in estimating the frequencies of such signals, and observe a general trade-off between precision and speed. Our motivation is precise and rapid analysis of damped sinusoidal signals as these become relevant in view of the recent experimental developments in cavity-enhanced polarimetry and ellipsometry, where the relevant time scales and frequencies are typically within the $\sim1-10\,\mu$s and $\sim1-100$MHz ranges, respectively. In such experimental efforts, single-shot analysis with high accuracy and precision becomes important when developing experiments that study dynamical effects and/or when developing portable instrumentations. Our results suggest that online, running-fashion, microsecond-resolved analysis of polarimetric/ellipsometric measurements with fractional uncertainties at the $10^{-6}$ levels, is possible, and using a proof-of-principle experimental demonstration we show that using a frequency-based analysis approach we can monitor and analyze signals at kHz rates and accurately detect signal changes at microsecond time-scales.

categories: physics.ins-det eess.SP physics.app-ph physics.optics


title: Tackling problems of marker-based augmented reality under water

abstract: Underwater sites are a harsh environment for augmented reality applications. Obstacles that must be battled include poor visibility conditions, difficult navigation, and hard manipulation with devices under water. This chapter focuses on the problem of localizing a device under water using markers. It discusses various filters that enhance and improve images recorded under water, and their impact on marker-based tracking. It presents various combinations of 10 image improving algorithms and 4 marker detecting algorithms, and tests their performance in real situations. All solutions are designed to run real-time on mobile devices to provide a solid basis for augmented reality. Usability of this solution is evaluated on locations in Mediterranean Sea. It is shown that image improving algorithms with carefully chosen parameters can reduce the problems with visibility under water and improve the detection of markers. The best results are obtained with marker detecting algorithms that are specifically designed for underwater environments.


title: Conversion and Implementation of State-of-the-Art Deep Learning Algorithms for the Classification of Diabetic Retinopathy

abstract: Diabetic retinopathy (DR) is a retinal microvascular condition that emerges in diabetic patients. DR will continue to be a leading cause of blindness worldwide, with a predicted 191.0 million globally diagnosed patients in 2030. Microaneurysms, hemorrhages, exudates, and cotton wool spots are common signs of DR. However, they can be small and hard for human eyes to detect. Early detection of DR is crucial for effective clinical treatment. Existing methods to classify images require much time for feature extraction and selection, and are limited in their performance. Convolutional Neural Networks (CNNs), as an emerging deep learning (DL) method, have proven their potential in image classification tasks. In this paper, comprehensive experimental studies of implementing state-of-the-art CNNs for the detection and classification of DR are conducted in order to determine the top performing classifiers for the task. Five CNN classifiers, namely Inception-V3, VGG19, VGG16, ResNet50, and InceptionResNetV2, are evaluated through experiments. They categorize medical images into five different classes based on DR severity. Data augmentation and transfer learning techniques are applied since annotated medical images are limited and imbalanced. Experimental results indicate that the ResNet50 classifier has top performance for binary classification and that the InceptionResNetV2 classifier has top performance for multi-class DR classification.


title: Disorder effects of vacancies on the electronic transport properties of realistic topological insulators nanoribbons: the case of bismuthene

abstract: The robustness of topological materials against disorder and defects is presumed but has not been demonstrated explicitly in realistic systems. In this work, we use state-of-the-art density functional theory and recursive nonequilibrium Green's functions methods to study the effect of disorder in the electronic transport of long nanoribbons, up to 157 nm, as a function of vacancy concentration. In narrow nanoribbons, even for small vacancy concentrations, defect-like localized states give rise to hybridization between the edge states erasing topological protection and enabling backscattering events. We show that the topological protection is more robust for wide nanoribbons, but surprisingly it breaks down at moderate structural disorder. Our study helps to establish some bounds on defective bismuthene nanoribbons as promising candidates for spintronic applications.


title: Unsupervised Representation Learning by InvariancePropagation

abstract: Unsupervised learning methods based on contrastive learning have drawn increasing attention and achieved promising results. Most of them aim to learn representations invariant to instance-level variations, which are provided by different views of the same instance. In this paper, we propose Invariance Propagation to focus on learning representations invariant to category-level variations, which are provided by different instances from the same category. Our method recursively discovers semantically consistent samples residing in the same high-density regions in representation space. We demonstrate a hard sampling strategy to concentrate on maximizing the agreement between the anchor sample and its hard positive samples, which provide more intra-class variations to help capture more abstract invariance. As a result, with a ResNet-50 as the backbone, our method achieves 71.3% top-1 accuracy on ImageNet linear classification and 78.2% top-5 accuracy fine-tuning on only 1% labels, surpassing previous results. We also achieve state-of-the-art performance on other downstream tasks, including linear classification on Places205 and Pascal VOC, and transfer learning on small scale datasets.


title: Automatic Data Augmentation for 3D Medical Image Segmentation

abstract: Data augmentation is an effective and universal technique for improving generalization performance of deep neural networks. It could enrich diversity of training samples that is essential in medical image segmentation tasks because 1) the scale of medical image dataset is typically smaller, which may increase the risk of overfitting; 2) the shape and modality of different objects such as organs or tumors are unique, thus requiring customized data augmentation policy. However, most data augmentation implementations are hand-crafted and suboptimal in medical image processing. To fully exploit the potential of data augmentation, we propose an efficient algorithm to automatically search for the optimal augmentation strategies. We formulate the coupled optimization w.r.t. network weights and augmentation parameters into a differentiable form by means of stochastic relaxation. This formulation allows us to apply alternative gradient-based methods to solve it, i.e. stochastic natural gradient method with adaptive step-size. To the best of our knowledge, it is the first time that differentiable automatic data augmentation is employed in medical image segmentation tasks. Our numerical experiments demonstrate that the proposed approach significantly outperforms existing build-in data augmentation of state-of-the-art models.


title: BlendTorch: A Real-Time, Adaptive Domain Randomization Library

abstract: Solving complex computer vision tasks by deep learning techniques relies on large amounts of (supervised) image data, typically unavailable in industrial environments. The lack of training data starts to impede the successful transfer of state-of-the-art methods in computer vision to industrial applications. We introduce BlendTorch, an adaptive Domain Randomization (DR) library, to help creating infinite streams of synthetic training data. BlendTorch generates data by massively randomizing low-fidelity simulations and takes care of distributing artificial training data for model learning in real-time. We show that models trained with BlendTorch repeatedly perform better in an industrial object detection task than those trained on real or photo-realistic datasets.


title: A Data Set and a Convolutional Model for Iconography Classification in Paintings

abstract: Iconography in art is the discipline that studies the visual content of artworks to determine their motifs and themes andto characterize the way these are represented. It is a subject of active research for a variety of purposes, including the interpretation of meaning, the investigation of the origin and diffusion in time and space of representations, and the study of influences across artists and art works. With the proliferation of digital archives of art images, the possibility arises of applying Computer Vision techniques to the analysis of art images at an unprecedented scale, which may support iconography research and education. In this paper we introduce a novel paintings data set for iconography classification and present the quantitativeand qualitative results of applying a Convolutional Neural Network (CNN) classifier to the recognition of the iconography of artworks. The proposed classifier achieves good performances (71.17% Precision, 70.89% Recall, 70.25% F1-Score and 72.73% Average Precision) in the task of identifying saints in Christian religious paintings, a task made difficult by the presence of classes with very similar visual features. Qualitative analysis of the results shows that the CNN focuses on the traditional iconic motifs that characterize the representation of each saint and exploits such hints to attain correct identification. The ultimate goal of our work is to enable the automatic extraction, decomposition, and comparison of iconography elements to support iconographic studies and automatic art work annotation.


title: OCT-GAN: Single Step Shadow and Noise Removal from Optical Coherence Tomography Images of the Human Optic Nerve Head

abstract: Speckle noise and retinal shadows within OCT B-scans occlude important edges, fine textures and deep tissues, preventing accurate and robust diagnosis by algorithms and clinicians. We developed a single process that successfully removed both noise and retinal shadows from unseen single-frame B-scans within 10.4ms. Mean average gradient magnitude (AGM) for the proposed algorithm was 57.2% higher than current state-of-the-art, while mean peak signal to noise ratio (PSNR), contrast to noise ratio (CNR), and structural similarity index metric (SSIM) increased by 11.1%, 154% and 187% respectively compared to single-frame B-scans. Mean intralayer contrast (ILC) improvement for the retinal nerve fiber layer (RNFL), photoreceptor layer (PR) and retinal pigment epithelium (RPE) layers decreased from 0.362 \pm 0.133 to 0.142 \pm 0.102, 0.449 \pm 0.116 to 0.0904 \pm 0.0769, 0.381 \pm 0.100 to 0.0590 \pm 0.0451 respectively. The proposed algorithm reduces the necessity for long image acquisition times, minimizes expensive hardware requirements and reduces motion artifacts in OCT images.


title: Generative Model-Enhanced Human Motion Prediction

abstract: The task of predicting human motion is complicated by the natural heterogeneity and compositionality of actions, necessitating robustness to distributional shifts as far as out-of-distribution (OoD). Here we formulate a new OoD benchmark based on the Human3.6M and CMU motion capture datasets, and introduce a hybrid framework for hardening discriminative architectures to OoD failure by augmenting them with a generative model. When applied to current state-of-the-art discriminative models, we show that the proposed approach improves OoD robustness without sacrificing in-distribution performance, and can theoretically facilitate model interpretability. We suggest human motion predictors ought to be constructed with OoD challenges in mind, and provide an extensible general framework for hardening diverse discriminative architectures to extreme distributional shift. The code is available at https://github.com/bouracha/OoDMotion.


title: On Benchmarking Iris Recognition within a Head-mounted Display for AR/VR Application

abstract: Augmented and virtual reality is being deployed in different fields of applications. Such applications might involve accessing or processing critical and sensitive information, which requires strict and continuous access control. Given that Head-Mounted Displays (HMD) developed for such applications commonly contains internal cameras for gaze tracking purposes, we evaluate the suitability of such setup for verifying the users through iris recognition. In this work, we first evaluate a set of iris recognition algorithms suitable for HMD devices by investigating three well-established handcrafted feature extraction approaches, and to complement it, we also present the analysis using four deep learning models. While taking into consideration the minimalistic hardware requirements of stand-alone HMD, we employ and adapt a recently developed miniature segmentation model (EyeMMS) for segmenting the iris. Further, to account for non-ideal and non-collaborative capture of iris, we define a new iris quality metric that we termed as Iris Mask Ratio (IMR) to quantify the iris recognition performance. Motivated by the performance of iris recognition, we also propose the continuous authentication of users in a non-collaborative capture setting in HMD. Through the experiments on a publicly available OpenEDS dataset, we show that performance with EER = 5% can be achieved using deep learning methods in a general setting, along with high accuracy for continuous user authentication.


title: Spatial Attention as an Interface for Image Captioning Models

abstract: The internal workings of modern deep learning models stay often unclear to an external observer, although spatial attention mechanisms are involved. The idea of this work is to translate these spatial attentions into natural language to provide a simpler access to the model's function. Thus, I took a neural image captioning model and measured the reactions to external modification in its spatial attention for three different interface methods: a fixation over the whole generation process, a fixation for the first time-steps and an addition to the generator's attention. The experimental results for bounding box based spatial attention vectors have shown that the captioning model reacts to method dependent changes in up to 52.65% and includes in 9.00% of the cases object categories, which were otherwise unmentioned. Afterwards, I established such a link to a hierarchical co-attention network for visual question answering by extraction of its word, phrase and question level spatial attentions. Here, generated captions for the word level included details of the question-answer pairs in up to 55.20% of the cases. This work indicates that spatial attention seen as an external interface for image caption generators is an useful method to access visual functions in natural language.


title: MLOD: Awareness of Extrinsic Perturbation in Multi-LiDAR 3D Object Detection for Autonomous Driving

abstract: Extrinsic perturbation always exists in multiple sensors. In this paper, we focus on the extrinsic uncertainty in multi-LiDAR systems for 3D object detection. We first analyze the influence of extrinsic perturbation on geometric tasks with two basic examples. To minimize the detrimental effect of extrinsic perturbation, we propagate an uncertainty prior on each point of input point clouds, and use this information to boost an approach for 3D geometric tasks. Then we extend our findings to propose a multi-LiDAR 3D object detector called MLOD. MLOD is a two-stage network where the multi-LiDAR information is fused through various schemes in stage one, and the extrinsic perturbation is handled in stage two. We conduct extensive experiments on a real-world dataset, and demonstrate both the accuracy and robustness improvement of MLOD. The code, data and supplementary materials are available at: https://ram-lab.com/file/site/mlod


title: Fast and Incremental Loop Closure Detection with Deep Features and Proximity Graphs

abstract: In recent years, the robotics community has extensively examined methods concerning the place recognition task within the scope of simultaneous localization and mapping applications.This article proposes an appearance-based loop closure detection pipeline named ``FILD++" (Fast and Incremental Loop closure Detection).First, the system is fed by consecutive images and, via passing them twice through a single convolutional neural network, global and local deep features are extracted.Subsequently, a hierarchical navigable small-world graph incrementally constructs a visual database representing the robot's traversed path based on the computed global features.Finally, a query image, grabbed each time step, is set to retrieve similar locations on the traversed route.An image-to-image pairing follows, which exploits local features to evaluate the spatial information. Thus, in the proposed article, we propose a single network for global and local feature extraction in contrast to our previous work (FILD), while an exhaustive search for the verification process is adopted over the generated deep local features avoiding the utilization of hash codes. Exhaustive experiments on eleven publicly available datasets exhibit the system's high performance (achieving the highest recall score on eight of them) and low execution times (22.05 ms on average in New College, which is the largest one containing 52480 images) compared to other state-of-the-art approaches.


title: Using Conditional Generative Adversarial Networks to Reduce the Effects of Latency in Robotic Telesurgery

abstract: The introduction of surgical robots brought about advancements in surgical procedures. The applications of remote telesurgery range from building medical clinics in underprivileged areas, to placing robots abroad in military hot-spots where accessibility and diversity of medical experience may be limited. Poor wireless connectivity may result in a prolonged delay, referred to as latency, between a surgeon's input and action a robot takes. In surgery, any micro-delay can injure a patient severely and in some cases, result in fatality. One was to increase safety is to mitigate the effects of latency using deep learning aided computer vision. While the current surgical robots use calibrated sensors to measure the position of the arms and tools, in this work we present a purely optical approach that provides a measurement of the tool position in relation to the patient's tissues. This research aimed to produce a neural network that allowed a robot to detect its own mechanical manipulator arms. A conditional generative adversarial networks (cGAN) was trained on 1107 frames of mock gastrointestinal robotic surgery data from the 2015 EndoVis Instrument Challenge and corresponding hand-drawn labels for each frame. When run on new testing data, the network generated near-perfect labels of the input images which were visually consistent with the hand-drawn labels and was able to do this in 299 milliseconds. These accurately generated labels can then be used as simplified identifiers for the robot to track its own controlled tools. These results show potential for conditional GANs as a reaction mechanism such that the robot can detect when its arms move outside the operating area within a patient. This system allows for more accurate monitoring of the position of surgical instruments in relation to the patient's tissue, increasing safety measures that are integral to successful telesurgery systems.


title: A simplified procedure to numerically evaluate triggering of static liquefaction in upstream-raised tailings storage facilities

abstract: The interest of the mining industry on the assessment of tailings static liquefaction has exacerbated after recent failures of upstream-raised tailings storage facilities (TSF). Standard practices to evaluate global stability of TSFs entail the use of limit equilibrium analyses considering peak and residual undrained shear strengths; thus, neglecting the work input required to drive the softening process that leads to progressive failure of susceptible tailings. This paper presents a simplified procedure to evaluate the static liquefaction triggering of upstream-raised TSFs by means of finite element models employing the well-known Hardening Soil model with small-strain stiffness (HSS). A calibration methodology is proposed to overcome the model limitation of not being implemented in a critical state framework, focusing on the stiffness parameters that control the rate of shear-induced plastic volumetric strains. A real TSF is modelled in Plaxis 2D to evaluate its vulnerability to liquefy due to an undrained lateral spreading at the foundation. Results show that minor movements near the toe induce the material into a strain-softening regime that leads to a progressive failure towards the structure crest.


title: Approximating the Minimal Lookahead Needed to Win Infinite Games

abstract: We present an exponential-time algorithm approximating the minimal lookahead necessary to win an $\omega$-regular delay game.


title: Quantifying quantum coherence based on the Tsallis relative operator entropy

abstract: Coherence is a fundamental ingredient in quantum physics and a key resource in quantum information processing. The quantification of quantum coherence is of great importance. We present a family of coherence quantifiers based on the Tsallis relative operator entropy. Shannon inequality and its reverse one in Hilbert space operators derived by Furuta [Linear Algebra Appl. 381 (2004) 219] are extended in terms of the parameter of the Tsallis relative operator entropy. These quantifiers are shown to satisfy all the standard criteria for a well-defined measure of coherence and include some existing coherence measures as special cases. Detailed examples are given to show the relations among the measures of quantum coherence.


title: Context-aware surrogate modeling for balancing approximation and sampling costs in multi-fidelity importance sampling and Bayesian inverse problems

abstract: Multi-fidelity methods leverage low-cost surrogate models to speed up computations and make occasional recourse to expensive high-fidelity models to establish accuracy guarantees. Because surrogate and high-fidelity models are used together, poor predictions by surrogate models can be compensated with frequent recourse to high-fidelity models. Thus, there is a trade-off between investing computational resources to improve the accuracy of surrogate models versus simply making more frequent recourse to expensive high-fidelity models; however, this trade-off is ignored by traditional modeling methods that construct surrogate models that are meant to replace high-fidelity models rather than being used together with high-fidelity models. This work considers multi-fidelity importance sampling and theoretically and computationally trades off increasing the fidelity of surrogate models for constructing more accurate biasing densities and the numbers of samples that are required from the high-fidelity models to compensate poor biasing densities. Numerical examples demonstrate that such context-aware surrogate models for multi-fidelity importance sampling have lower fidelity than what typically is set as tolerance in traditional model reduction, leading to runtime speedups of up to one order of magnitude in the presented examples.


title: A novel convolutional neural network model to remove muscle artifacts from EEG

abstract: The recorded electroencephalography (EEG) signals are usually contaminated by many artifacts. In recent years, deep learning models have been used for denoising of electroencephalography (EEG) data and provided comparable performance with that of traditional techniques. However, the performance of the existing networks in electromyograph (EMG) artifact removal was limited and suffered from the over-fitting problem. Here we introduce a novel convolutional neural network (CNN) with gradually ascending feature dimensions and downsampling in time series for removing muscle artifacts in EEG data. Compared with other types of convolutional networks, this model largely eliminates the over-fitting and significantly outperforms four benchmark networks in EEGdenoiseNet. Our study suggested that the deep network architecture might help avoid overfitting and better remove EMG artifacts in EEG.


title: Dyson-Schwinger approach to pion-nucleon scattering using time-ordered perturbation theory

abstract: We present a simple description of pion-nucleon ($\pi N$) scattering taking into account the full complexity of pion absorption and creation on the nucleon. To do this we solve Dyson-Schwinger equations within the framework of Time-Ordered Perturbation Theory. This enables us to construct partial wave separable $ \pi N$ t matrices that can be useful in models of nuclear processes involving fully dressed nucleons. At the same time, our approach demonstrates features of Quantum Field Theory, like particle dressing, renormalisation, and the use of Dyson-Schwinger equations, in a non-relativistic context that is maximally close to that of Quantum Mechanics. For this reason, this article may also be of pedagogical interest.


title: Multi-view Graph Contrastive Representation Learning for Drug-Drug Interaction Prediction

abstract: Drug-drug interaction(DDI) prediction is an important task in the medical health machine learning community. This study presents a new method, multi-view graph contrastive representation learning for drug-drug interaction prediction, MIRACLE for brevity, to capture inter-view molecule structure and intra-view interactions between molecules simultaneously. MIRACLE treats a DDI network as a multi-view graph where each node in the interaction graph itself is a drug molecular graph instance. We use GCNs and bond-aware attentive message passing networks to encode DDI relationships and drug molecular graphs in the MIRACLE learning stage, respectively. Also, we propose a novel unsupervised contrastive learning component to balance and integrate the multi-view information. Comprehensive experiments on multiple real datasets show that MIRACLE outperforms the state-of-the-art DDI prediction models consistently.


title: Trajectory Tracking for Robotic Arms with Input Saturation and Only Position Measurements

abstract: In this work, we propose a passivity-based control approach that addresses the trajectory tracking problem for a class of mechanical systems that comprises a broad range of robotic arms. The resulting controllers can be naturally saturated and do not require velocity measurements. Moreover, the proposed methodology does not require the implementation of observers, and the structure of the closed-loop system permits the identification of a Lyapunov function, which eases the convergence analysis. To corroborate the effectiveness of the methodology, we perform experiments with the Philips Experimental Robot Arm.


title: Joint Power Allocation and User Association Optimization for IRS-Assisted mmWave Systems

abstract: Intelligent reflect surface (IRS) is a potential technology to build programmable wireless environment in future communication systems. In this paper, we consider an IRS-assisted multi-base station (multi-BS) multi-user millimeter wave (mmWave) downlink communication system, exploiting IRS to extend mmWave signal coverage to blind spots. Considering the impact of IRS on user association in multi-BS mmWave systems, we formulate a sum rate maximization problem by jointly optimizing passive beamforming at IRS, power allocation and user association. This leads to an intractable nonconvex problem, for which to tackle we propose a computationally affordable iterative algorithm, capitalizing on alternating optimization, sequential fractional programming (SFP) and forward-reverse auction (FRA). In particular, passive beamforming at IRS is optimized by utilizing the SFP method, power allocation is solved through means of standard convex optimization method, and user association is handled by the network optimization based FRA algorithm. Simulation results demonstrate that the proposed algorithm can achieve significant performance gains, e.g., it can provide up to 175% higher sum rate compared with the benchmark and 140% higher energy efficiency compared with amplify-and-forward relay.


title: Restoring Negative Information in Few-Shot Object Detection

abstract: Few-shot learning has recently emerged as a new challenge in the deep learning field: unlike conventional methods that train the deep neural networks (DNNs) with a large number of labeled data, it asks for the generalization of DNNs on new classes with few annotated samples. Recent advances in few-shot learning mainly focus on image classification while in this paper we focus on object detection. The initial explorations in few-shot object detection tend to simulate a classification scenario by using the positive proposals in images with respect to certain object class while discarding the negative proposals of that class. Negatives, especially hard negatives, however, are essential to the embedding space learning in few-shot object detection. In this paper, we restore the negative information in few-shot object detection by introducing a new negative- and positive-representative based metric learning framework and a new inference scheme with negative and positive representatives. We build our work on a recent few-shot pipeline RepMet with several new modules to encode negative information for both training and testing. Extensive experiments on ImageNet-LOC and PASCAL VOC show our method substantially improves the state-of-the-art few-shot object detection solutions. Our code is available at https://github.com/yang-yk/NP-RepMet.


title: Relativistic $N$-particle energy shift in finite volume

abstract: We present a general method for deriving the energy shift of an interacting system of $N$ spinless particles in a finite volume. To this end, we use the nonrelativistic effective field theory (NREFT), and match the pertinent low-energy constants to the scattering amplitudes. Relativistic corrections are explicitly included up to a given order in the $1/L$ expansion. We apply this method to obtain the ground state of $N$ particles, and the first excited state of two and three particles to order $L^{-6}$ in terms of the threshold parameters of the two- and three-particle relativistic scattering amplitudes. We use these expressions to analyze the $N$-particle ground state energy shift in the complex $\varphi^4$ theory.


title: Robust Audio-Based Vehicle Counting in Low-to-Moderate Traffic Flow

abstract: The paper presents a method for audio-based vehicle counting (VC) in low-to-moderate traffic using one-channel sound. We formulate VC as a regression problem, i.e., we predict the distance between a vehicle and the microphone. Minima of the proposed distance function correspond to vehicles passing by the microphone. VC is carried out via local minima detection in the predicted distance. We propose to set the minima detection threshold at a point where the probabilities of false positives and false negatives coincide so they statistically cancel each other in total vehicle number. The method is trained and tested on a traffic-monitoring dataset comprising $422$ short, $20$-second one-channel sound files with a total of $ 1421 $ vehicles passing by the microphone. Relative VC error in a traffic location not used in the training is below $ 2 \%$ within a wide range of detection threshold values. Experimental results show that the regression accuracy in noisy environments is improved by introducing a novel high-frequency power feature.


title: Perturbative Reheating in the Mixed Higgs-$R^2$ Model

abstract: The preheating process in the mixed Higgs-$ R^2 $ model has been investigated in depth recently, but the analysis of perturbative reheating is still missing. In this paper, we discuss the effect of perturbative decay during (p)reheating in this model. It is shown that perturbative decay can play an important role throughout the whole reheating process. Depending on the model parameters, perturbative decay can affect different stages of the reheating. We study the perturbative reheating with and without the presence of early preheating stage, and calculate the reheating temperature and the duration of the whole perturbative process. We find that the detail of the early preheating stage may not affect the final reheating temperature while it can affect the number of e-folds of reheating.


title: Analysis of the BUT Diarization System for VoxConverse Challenge

abstract: This paper describes the system developed by the BUT team for the fourth track of the VoxCeleb Speaker Recognition Challenge, focusing on diarization on the VoxConverse dataset. The system consists of signal pre-processing, voice activity detection, speaker embedding extraction, an initial agglomerative hierarchical clustering followed by diarization using a Bayesian hidden Markov model, a reclustering step based on per-speaker global embeddings and overlapped speech detection and handling. We provide comparisons for each of the steps and share the implementation of the most relevant modules of our system. Our system scored second in the challenge in terms of the primary metric (diarization error rate) and first according to the secondary metric (Jaccard error rate).


title: Conformance Checking for a Medical Training Process Using Petri net Simulation and Sequence Alignment

abstract: Process Mining has recently gained popularity in healthcare due to its potential to provide a transparent, objective and data-based view on processes. Conformance checking is a sub-discipline of process mining that has the potential to answer how the actual process executions deviate from existing guidelines. In this work, we analyze a medical training process for a surgical procedure. Ten students were trained to install a Central Venous Catheters (CVC) with ultrasound. Event log data was collected directly after instruction by the supervisors during a first test run and additionally after a subsequent individual training phase. In order to provide objective performance measures, we formulate an optimal, global sequence alignment problem inspired by approaches in bioinformatics. Therefore, we use the Petri net model representation of the medical process guideline to simulate a representative set of guideline conform sequences. Next, we calculate the optimal, global sequence alignment of the recorded and simulated event logs. Finally, the output measures and visualization of aligned sequences are provided for objective feedback.


title: A study of the Multicriteria decision analysis based on the time-series features and a TOPSIS method proposal for a tensorial approach

abstract: A number of Multiple Criteria Decision Analysis (MCDA) methods have been developed to rank alternatives based on several decision criteria. Usually, MCDA methods deal with the criteria value at the time the decision is made without considering their evolution over time. However, it may be relevant to consider the criteria' time series since providing essential information for decision-making (e.g., an improvement of the criteria). To deal with this issue, we propose a new approach to rank the alternatives based on the criteria time-series features (tendency, variance, etc.). In this novel approach, the data is structured in three dimensions, which require a more complex data structure, as the \textit{tensors}, instead of the classical matrix representation used in MCDA. Consequently, we propose an extension for the TOPSIS method to handle a tensor rather than a matrix. Computational results reveal that it is possible to rank the alternatives from a new perspective by considering meaningful decision-making information.


title: Multifaceted Context Representation using Dual Attention for Ontology Alignment

abstract: Ontology Alignment is an important research problem that finds application in various fields such as data integration, data transfer, data preparation etc. State-of-the-art (SOTA) architectures in Ontology Alignment typically use naive domain-dependent approaches with handcrafted rules and manually assigned values, making them unscalable and inefficient. Deep Learning approaches for ontology alignment use domain-specific architectures that are not only in-extensible to other datasets and domains, but also typically perform worse than rule-based approaches due to various limitations including over-fitting of models, sparsity of datasets etc. In this work, we propose VeeAlign, a Deep Learning based model that uses a dual-attention mechanism to compute the contextualized representation of a concept in order to learn alignments. By doing so, not only does our approach exploit both syntactic and semantic structure of ontologies, it is also, by design, flexible and scalable to different domains with minimal effort. We validate our approach on various datasets from different domains and in multilingual settings, and show its superior performance over SOTA methods.


title: Prediction-Based GNSS Spoofing Attack Detection for Autonomous Vehicles

abstract: Global Navigation Satellite System (GNSS) provides Positioning, Navigation, and Timing (PNT) services for autonomous vehicles (AVs) using satellites and radio communications. Due to the lack of encryption, open-access of the coarse acquisition (C/A) codes, and low strength of the signal, GNSS is vulnerable to spoofing attacks compromising the navigational capability of the AV. A spoofed attack is difficult to detect as a spoofer (attacker who performs spoofing attack) can mimic the GNSS signal and transmit inaccurate location coordinates to an AV. In this study, we have developed a prediction-based spoofing attack detection strategy using the long short-term memory (LSTM) model, a recurrent neural network model. The LSTM model is used to predict the distance traveled between two consecutive locations of an autonomous vehicle. In order to develop the LSTM prediction model, we have used a publicly available real-world comma2k19 driving dataset. The training dataset contains different features (i.e., acceleration, steering wheel angle, speed, and distance traveled between two consecutive locations) extracted from the controlled area network (CAN), GNSS, and inertial measurement unit (IMU) sensors of AVs. Based on the predicted distance traveled between the current location and the immediate future location of an autonomous vehicle, a threshold value is established using the positioning error of the GNSS device and prediction error (i.e., maximum absolute error) related to distance traveled between the current location and the immediate future location. Our analysis revealed that the prediction-based spoofed attack detection strategy can successfully detect the attack in real-time.


title: Learning from Suboptimal Demonstration via Self-Supervised Reward Regression

abstract: Learning from Demonstration (LfD) seeks to democratize robotics by enabling non-roboticist end-users to teach robots to perform a task by providing a human demonstration. However, modern LfD techniques, e.g. inverse reinforcement learning (IRL), assume users provide at least stochastically optimal demonstrations. This assumption fails to hold in most real-world scenarios. Recent attempts to learn from sub-optimal demonstration leverage pairwise rankings and following the Luce-Shepard rule. However, we show these approaches make incorrect assumptions and thus suffer from brittle, degraded performance. We overcome these limitations in developing a novel approach that bootstraps off suboptimal demonstrations to synthesize optimality-parameterized data to train an idealized reward function. We empirically validate we learn an idealized reward function with ~0.95 correlation with ground-truth reward versus ~0.75 for prior work. We can then train policies achieving ~200% improvement over the suboptimal demonstration and ~90% improvement over prior work. We present a physical demonstration of teaching a robot a topspin strike in table tennis that achieves 32% faster returns and 40% more topspin than user demonstration.


title: LID 2020: The Learning from Imperfect Data Challenge Results

abstract: Learning from imperfect data becomes an issue in many industrial applications after the research community has made profound progress in supervised learning from perfectly annotated datasets. The purpose of the Learning from Imperfect Data (LID) workshop is to inspire and facilitate the research in developing novel approaches that would harness the imperfect data and improve the data-efficiency during training. A massive amount of user-generated data nowadays available on multiple internet services. How to leverage those and improve the machine learning models is a high impact problem. We organize the challenges in conjunction with the workshop. The goal of these challenges is to find the state-of-the-art approaches in the weakly supervised learning setting for object detection, semantic segmentation, and scene parsing. There are three tracks in the challenge, i.e., weakly supervised semantic segmentation (Track 1), weakly supervised scene parsing (Track 2), and weakly supervised object localization (Track 3). In Track 1, based on ILSVRC DET, we provide pixel-level annotations of 15K images from 200 categories for evaluation. In Track 2, we provide point-based annotations for the training set of ADE20K. In Track 3, based on ILSVRC CLS-LOC, we provide pixel-level annotations of 44,271 images for evaluation. Besides, we further introduce a new evaluation metric proposed by \cite{zhang2020rethinking}, i.e., IoU curve, to measure the quality of the generated object localization maps. This technical report summarizes the highlights from the challenge. The challenge submission server and the leaderboard will continue to open for the researchers who are interested in it. More details regarding the challenge and the benchmarks are available at https://lidchallenge.github.io


title: What do CNN neurons learn: Visualization & Clustering

abstract: In recent years convolutional neural networks (CNN) have shown striking progress in various tasks. However, despite the high performance, the training and prediction process remains to be a black box, leaving it a mystery to extract what neurons learn in CNN. In this paper, we address the problem of interpreting a CNN from the aspects of the input image's focus and preference, and the neurons' domination, activation and contribution to a concrete final prediction. Specifically, we use two techniques - visualization and clustering - to tackle the problems above. Visualization means the method of gradient descent on image pixel, and in clustering section two algorithms are proposed to cluster respectively over image categories and network neurons. Experiments and quantitative analyses have demonstrated the effectiveness of the two methods in explaining the question: what do neurons learn.


title: Stability for a formally determined inverse problem for a hyperbolic PDE with space and time dependent coefficients

abstract: We prove stability for a formally determined inverse problem for a hyperbolic PDE where the coefficients depend on space and time variables. The hyperbolic operator has constant wave speed and we study the recovery of zeroth order and first order coefficients and the space dimension can be one or higher. We use a modification of the Bukhgeim-Klibanov method to obtain our results.


title: Vision-Based Layout Detection from Scientific Literature using Recurrent Convolutional Neural Networks

abstract: We present an approach for adapting convolutional neural networks for object recognition and classification to scientific literature layout detection (SLLD), a shared subtask of several information extraction problems. Scientific publications contain multiple types of information sought by researchers in various disciplines, organized into an abstract, bibliography, and sections documenting related work, experimental methods, and results; however, there is no effective way to extract this information due to their diverse layout. In this paper, we present a novel approach to developing an end-to-end learning framework to segment and classify major regions of a scientific document. We consider scientific document layout analysis as an object detection task over digital images, without any additional text features that need to be added into the network during the training process. Our technical objective is to implement transfer learning via fine-tuning of pre-trained networks and thereby demonstrate that this deep learning architecture is suitable for tasks that lack very large document corpora for training ab initio. As part of the experimental test bed for empirical evaluation of this approach, we created a merged multi-corpus data set for scientific publication layout detection tasks. Our results show good improvement with fine-tuning of a pre-trained base network using this merged data set, compared to the baseline convolutional neural network architecture.


title: A highly efficient and accurate exponential semi-implicit scalar auxiliary variable (ESI-SAV) approach for dissipative system

abstract: The scalar auxiliary variable (SAV) approach is a very popular and efficient method to simulate various phase field models. To save the computational cost, a new SAV approach is given by introducing a new variable $\theta$. The new SAV approach can be proved to save nearly half CPU time of the original SAV approach while keeping all its other advantages. In this paper, we propose a novel technique to construct an exponential semi-implicit scalar auxiliary variable (ESI-SAV) approach without introducing any extra variables. The new proposed method also only needs to solve one linear equation with constant coefficients at each time step. Furthermore, the constructed ESI-SAV method does not need the bounded below restriction of nonlinear free energy potential which is more reasonable and effective for various phase field models. Meanwhile it is easy to construct first-order, second-order and higher-order unconditionally energy stable time-stepping schemes. Other than that, the ESI-SAV approach can be proved to be effective to solve the non-gradient but dissipative system such as Navier-Stokes equations. Several numerical examples are provided to demonstrate the improved efficiency and accuracy of the proposed method.


title: Effects of precession versus instabilities on the jets of GRS 1758-258

abstract: Aims. The prototypical microquasar GRS 1758-258 exhibits large-scale morphological changes in radio maps over time which have been attributed to the rise of instabilities. Here, we investigate whether these effects could be attributed to jet precession instead. Methods.We used new and archival radio maps to fit a kinematic jet precession model. The value of the parameters thus obtained were analysed in order to get constraints on the physical properties of the GRS 1758-258 system. Their consistency with different theories of the origins for the jet precession, such as Lense-Thirring effect and tidal torques induced by the secondary star, has previously been studied. Alternatively, we also assessed the possibility that observations are compatible with eventual jet instabilities. Results. The new radio data presented here confirm that the large-scale radio morphology of GRS 1758-258 is changing over time. Our study shows that the 18.48 day period could plausibly be ascribed to precession, thus implying a reinterpretation of assumptions made for the orbital period to date. However, the observed structural changes in radio jets cannot be easily attributed to jet precession according to our analysis. In contrast, the growth of instabilities certainly appears to be a more realistic explanation of these effects.


title: Maximum Black Hole mass across Cosmic Time

abstract: At the end of its life, a very massive star is expected to collapse into a black hole. The recent detection of an 85 Msun black hole from the gravitational wave event GW 190521 appears to present a fundamental problem as to how such heavy black holes exist above the approximately 50 Msun pair-instability limit where stars are expected to be blown to pieces with no remnant left. Using MESA, we show that for stellar models with non-extreme assumptions, 90..100 Msun stars at reduced metallicity (Z/Zsun < 0.1) can produce blue supergiant progenitors with core masses sufficiently small to remain below the fundamental pair-instability limit, yet at the same time lose an amount of mass via stellar winds that is small enough to end up in the range of an "impossible" 85 Msun black hole. The two key points are the proper consideration of core overshooting and stellar wind physics with an improved scaling of mass loss with iron (Fe) contents characteristic for the host galaxy metallicity. Our modelling provides a robust scenario that not only doubles the maximum black hole mass set by pair instability, but also allows us to probe the maximum stellar black hole mass as a function of metallicity and Cosmic time in a physically sound framework.

categories: astro-ph.HE astro-ph.CO astro-ph.GA astro-ph.SR


title: Improving BERT Performance for Aspect-Based Sentiment Analysis

abstract: Aspect-Based Sentiment Analysis (ABSA) studies the consumer opinion on the market products. It involves examining the type of sentiments as well as sentiment targets expressed in product reviews. Analyzing the language used in a review is a difficult task that requires a deep understanding of the language. In recent years, deep language models, such as BERT \cite{devlin2019bert}, have shown great progress in this regard. In this work, we propose two simple modules called Parallel Aggregation and Hierarchical Aggregation to be utilized on top of BERT for two main ABSA tasks namely Aspect Extraction (AE) and Aspect Sentiment Classification (ASC) in order to improve the model's performance. We show that applying the proposed models eliminates the need for further training of the BERT model. The source code is available on the Web for further research and reproduction of the results.


title: A Cluster-Matching-Based Method for Video Face Recognition

abstract: Face recognition systems are present in many modern solutions and thousands of applications in our daily lives. However, current solutions are not easily scalable, especially when it comes to the addition of new targeted people. We propose a cluster-matching-based approach for face recognition in video. In our approach, we use unsupervised learning to cluster the faces present in both the dataset and targeted videos selected for face recognition. Moreover, we design a cluster matching heuristic to associate clusters in both sets that is also capable of identifying when a face belongs to a non-registered person. Our method has achieved a recall of 99.435% and a precision of 99.131% in the task of video face recognition. Besides performing face recognition, it can also be used to determine the video segments where each person is present.


title: Multi-Radar Tracking Optimization for Collaborative Combat

abstract: Smart Grids of collaborative netted radars accelerate kill chains through more efficient cross-cueing over centralized command and control. In this paper, we propose two novel reward-based learning approaches to decentralized netted radar coordination based on black-box optimization and Reinforcement Learning (RL). To make the RL approach tractable, we use a simplification of the problem that we proved to be equivalent to the initial formulation. We apply these techniques on a simulation where radars can follow multiple targets at the same time and show they can learn implicit cooperation by comparing them to a greedy baseline.


title: Identification of deep breath while moving forward based on multiple body regions and graph signal analysis

abstract: This paper presents an unobtrusive solution that can automatically identify deep breath when a person is walking past the global depth camera. Existing non-contact breath assessments achieve satisfactory results under restricted conditions when human body stays relatively still. When someone moves forward, the breath signals detected by depth camera are hidden within signals of trunk displacement and deformation, and the signal length is short due to the short stay time, posing great challenges for us to establish models. To overcome these challenges, multiple region of interests (ROIs) based signal extraction and selection method is proposed to automatically obtain the signal informative to breath from depth video. Subsequently, graph signal analysis (GSA) is adopted as a spatial-temporal filter to wipe the components unrelated to breath. Finally, a classifier for identifying deep breath is established based on the selected breath-informative signal. In validation experiments, the proposed approach outperforms the comparative methods with the accuracy, precision, recall and F1 of 75.5%, 76.2%, 75.0% and 75.2%, respectively. This system can be extended to public places to provide timely and ubiquitous help for those who may have or are going through physical or mental trouble.


title: Self-Supervised Learning of Part Mobility from Point Cloud Sequence

abstract: Part mobility analysis is a significant aspect required to achieve a functional understanding of 3D objects. It would be natural to obtain part mobility from the continuous part motion of 3D objects. In this study, we introduce a self-supervised method for segmenting motion parts and predicting their motion attributes from a point cloud sequence representing a dynamic object. To sufficiently utilize spatiotemporal information from the point cloud sequence, we generate trajectories by using correlations among successive frames of the sequence instead of directly processing the point clouds. We propose a novel neural network architecture called PointRNN to learn feature representations of trajectories along with their part rigid motions. We evaluate our method on various tasks including motion part segmentation, motion axis prediction and motion range estimation. The results demonstrate that our method outperforms previous techniques on both synthetic and real datasets. Moreover, our method has the ability to generalize to new and unseen objects. It is important to emphasize that it is not required to know any prior shape structure, prior shape category information, or shape orientation. To the best of our knowledge, this is the first study on deep learning to extract part mobility from point cloud sequence of a dynamic object.


title: Auger recombination in narrow band quantum well CdxHg1-xTe/CdyHg1-yTe heterostructures

abstract: We present detailed theoretical and experimental studies of Auger recombination in narrow-gap mercury cadmium telluride quantum wells (HgCdTe QWs). We calculate the Auger recombination probabilities as functions of non-equilibrium carrier density, temperature and composition of quantum wells taking into account the complex band dispersions and wave functions of the structures. Our theory is validated by comparison with measured kinetics of photoconductivity relaxation in QW with band gap of 76 meV at a temperature of 77 K. We find good agreement of theory and experiment using a single fitting parameter: the initial density of non-equilibrium carriers. The model is further used to optimize the composition of QWs and find the most suitable conditions for far-infrared lasing. Particularly, for band gap of 40 meV (lasing wavelength {\lambda}=31 \mu m) the lasing is favored in QWs with 6.5% cadmium fraction. We also find that at very large non-equilibrium carrier densities, the main recombination channel is associated with emission of two-dimensional plasmons and not with Auger process


title: Efficient Projection-Free Algorithms for Saddle Point Problems

abstract: The Frank-Wolfe algorithm is a classic method for constrained optimization problems. It has recently been popular in many machine learning applications because its projection-free property leads to more efficient iterations. In this paper, we study projection-free algorithms for convex-strongly-concave saddle point problems with complicated constraints. Our method combines Conditional Gradient Sliding with Mirror-Prox and shows that it only requires $\tilde{O}(1/\sqrt{\epsilon})$ gradient evaluations and $\tilde{O}(1/\epsilon^2)$ linear optimizations in the batch setting. We also extend our method to the stochastic setting and propose first stochastic projection-free algorithms for saddle point problems. Experimental results demonstrate the effectiveness of our algorithms and verify our theoretical guarantees.


title: Optimising Stochastic Routing for Taxi Fleets with Model Enhanced Reinforcement Learning

abstract: The future of mobility-as-a-Service (Maas)should embrace an integrated system of ride-hailing, street-hailing and ride-sharing with optimised intelligent vehicle routing in response to a real-time, stochastic demand pattern. We aim to optimise routing policies for a large fleet of vehicles for street-hailing services, given a stochastic demand pattern in small to medium-sized road networks. A model-based dispatch algorithm, a high performance model-free reinforcement learning based algorithm and a novel hybrid algorithm combining the benefits of both the top-down approach and the model-free reinforcement learning have been proposed to route the \emph{vacant} vehicles. We design our reinforcement learning based routing algorithm using proximal policy optimisation and combined intrinsic and extrinsic rewards to strike a balance between exploration and exploitation. Using a large-scale agent-based microscopic simulation platform to evaluate our proposed algorithms, our model-free reinforcement learning and hybrid algorithm show excellent performance on both artificial road network and community-based Singapore road network with empirical demands, and our hybrid algorithm can significantly accelerate the model-free learner in the process of learning.


title: Structural and Magnetic Characterization of CuxMn1-xFe2O4 (x= 0.0, 0.25) Ferrites Using Neutron Diffraction and Other Techniques

abstract: Manganese ferrite (MnFe2O4) and copper doped manganese ferrite (Mn0.75Cu0.25Fe2O4) soft materials were synthesized through solid-state sintering method. The phase purity and quality were confirmed from x-ray diffraction patterns. Then the samples were subjected to neutron diffraction experiment and the diffraction data were analyzed using FullProf software package. The surface morphology of the soft material samples was studied using a scanning electron microscope (SEM). Crystal parameters, crystallite parameters, occupancy at A and B sites of the spinel structure, magnetic moments of the atoms at various locations, symmetries, oxygen position parameters, bond lengths etc. were measured and compared with the reference data. In MnFe2O4, both octahedral (A) and tetrahedral (B) positions are shared by Mn2+ and Fe2+/3+ cations, here A site is predominantly occupied by Fe2+ and B site is occupied by Mn at 0.825 occupancy. The Cu2+ ions in Cu0.25Mn0.75Fe2O4 mostly occupy the B site. Copper mostly occupy the Octahedral (16d) sites. The length of the cubic lattice decreases with the increasing Copper content. The magnetic properties, i.e. A or B site magnetic moments, net magnetic moment etc. were measured using neutron diffraction analysis and compared with the bulk magnetic properties measured with VSM studies.


title: Robust Low-tubal-rank Tensor Completion based on Tensor Factorization and Maximum Correntopy Criterion

abstract: The goal of tensor completion is to recover a tensor from a subset of its entries, often by exploiting its low-rank property. Among several useful definitions of tensor rank, the low-tubal-rank was shown to give a valuable characterization of the inherent low-rank structure of a tensor. While some low-tubal-rank tensor completion algorithms with favorable performance have been recently proposed, these algorithms utilize second-order statistics to measure the error residual, which may not work well when the observed entries contain large outliers. In this paper, we propose a new objective function for low-tubal-rank tensor completion, which uses correntropy as the error measure to mitigate the effect of the outliers. To efficiently optimize the proposed objective, we leverage a half-quadratic minimization technique whereby the optimization is transformed to a weighted low-tubal-rank tensor factorization problem. Subsequently, we propose two simple and efficient algorithms to obtain the solution and provide their convergence and complexity analysis. Numerical results using both synthetic and real data demonstrate the robust and superior performance of the proposed algorithms.


title: Ultra-low power on-chip learning of speech commands with phase-change memories

abstract: Embedding artificial intelligence at the edge (edge-AI) is an elegant solution to tackle the power and latency issues in the rapidly expanding Internet of Things. As edge devices typically spend most of their time in sleep mode and only wake-up infrequently to collect and process sensor data, non-volatile in-memory computing (NVIMC) is a promising approach to design the next generation of edge-AI devices. Recently, we proposed an NVIMC-based neuromorphic accelerator using the phase change memories (PCMs), which we call as Raven. In this work, we demonstrate the ultra-low-power on-chip training and inference of speech commands using Raven. We showed that Raven can be trained on-chip with power consumption as low as 30~uW, which is suitable for edge applications. Furthermore, we showed that at iso-accuracies, Raven needs 70.36x and 269.23x less number of computations to be performed than a deep neural network (DNN) during inference and training, respectively. Owing to such low power and computational requirements, Raven provides a promising pathway towards ultra-low-power training and inference at the edge.

categories: eess.AS cond-mat.dis-nn cs.AR cs.LG cs.SD