title: Solar Orbiter/RPW antenna calibration in the radio domain and its application to type III burst observations

abstract: In order to allow for a comparison with the measurements from other antenna systems, the voltage power spectral density measured by the Radio and Plasma waves receiver (RPW) on board Solar Orbiter needs to be converted into physical quantities that depend on the intrinsic properties of the radiation itself.The main goal of this study is to perform a calibration of the RPW dipole antenna system that allows for the conversion of the voltage power spectral density measured at the receiver's input into the incoming flux density. We used space observations from the Thermal Noise Receiver (TNR) and the High Frequency Receiver (HFR) to perform the calibration of the RPW dipole antenna system. Observations of type III bursts by the Wind spacecraft are used to obtain a reference radio flux density for cross-calibrating the RPW dipole antennas. The analysis of a large sample of HFR observations (over about ten months), carried out jointly with an analysis of TNR-HFR data and prior to the antennas' deployment, allowed us to estimate the reference system noise of the TNR-HFR receivers. We obtained the effective length of the RPW dipoles and the reference system noise of TNR-HFR in space, where the antennas and pre-amplifiers are embedded in the solar wind plasma. The obtained $l_{eff}$ values are in agreement with the simulation and measurements performed on the ground. By investigating the radio flux intensities of 35 type III bursts simultaneously observed by Solar Orbiter and Wind, we found that while the scaling of the decay time as a function of the frequency is the same for the Waves and RPW instruments, their median values are higher for the former. This provides the first observational evidence that Type III radio waves still undergo density scattering, even when they propagate from the source, in a medium with a plasma frequency that is well below their own emission frequency.


title: Metric properties of incomparability graphs with an emphasis on paths

abstract: We describe some metric properties of incomparability graphs. We consider the problem of the existence of infinite paths, either induced or isometric, in the incomparability graph of a poset. Among other things, we show that if the incomparability graph of a poset is connected and has infinite diameter, then it contains an infinite induced path. Furthermore, if the diameter of the set of vertices of degree at least $3$ is infinite, then the graph contains as an induced subgraph either a comb or a kite.


title: On the Stokes-type resolvent problem associated with time-periodic flow around a rotating obstacle

abstract: Consider the resolvent problem associated with the linearized viscous flow around a rotating body. Within a setting of classical Sobolev spaces, this problem is not well posed on the whole imaginary axis. Therefore, a framework of homogeneous Sobolev spaces is introduced where existence of a unique solution can be guaranteed for every purely imaginary resolvent parameter. For this purpose, the problem is reduced to an auxiliary problem, which is studied by means of Fourier analytic tools in a group setting. In the end, uniform resolvent estimates can be derived, which lead to the existence of solutions to the associated time-periodic linear problem.


title: Learnable Multi-level Frequency Decomposition and Hierarchical Attention Mechanism for Generalized Face Presentation Attack Detection

abstract: With the increased deployment of face recognition systems in our daily lives, face presentation attack detection (PAD) is attracting much attention and playing a key role in securing face recognition systems. Despite the great performance achieved by the hand-crafted and deep-learning-based methods in intra-dataset evaluations, the performance drops when dealing with unseen scenarios. In this work, we propose a dual-stream convolution neural networks (CNNs) framework. One stream adapts four learnable frequency filters to learn features in the frequency domain, which are less influenced by variations in sensors/illuminations. The other stream leverages the RGB images to complement the features of the frequency domain. Moreover, we propose a hierarchical attention module integration to join the information from the two streams at different stages by considering the nature of deep features in different layers of the CNN. The proposed method is evaluated in the intra-dataset and cross-dataset setups, and the results demonstrate that our proposed approach enhances the generalizability in most experimental setups in comparison to state-of-the-art, including the methods designed explicitly for domain adaption/shift problems. We successfully prove the design of our proposed PAD solution in a step-wise ablation study that involves our proposed learnable frequency decomposition, our hierarchical attention module design, and the used loss function. Training codes and pre-trained models are publicly released


title: Overview of Tencent Multi-modal Ads Video Understanding Challenge

abstract: Multi-modal Ads Video Understanding Challenge is the first grand challenge aiming to comprehensively understand ads videos. Our challenge includes two tasks: video structuring in the temporal dimension and multi-modal video classification. It asks the participants to accurately predict both the scene boundaries and the multi-label categories of each scene based on a fine-grained and ads-related category hierarchy. Therefore, our task has four distinguishing features from previous ones: ads domain, multi-modal information, temporal segmentation, and multi-label classification. It will advance the foundation of ads video understanding and have a significant impact on many ads applications like video recommendation. This paper presents an overview of our challenge, including the background of ads videos, an elaborate description of task and dataset, evaluation protocol, and our proposed baseline. By ablating the key components of our baseline, we would like to reveal the main challenges of this task and provide useful guidance for future research of this area. In this paper, we give an extended version of our challenge overview. The dataset will be publicly available at https://algo.qq.com/.


title: Remarks on the Bernstein inequality for higher order operators and related results

abstract: This note is devoted to several results about frequency localized functions and associated Bernstein inequalities for higher order operators. In particular, we construct some counterexamples for the frequency-localized Bernstein inequalities for higher order Laplacians. We show also that the heat semi-group associated to powers larger than one of the laplacian does not satisfy the strict maximum principle in general. Finally, in a suitable range we provide several positive results.


title: Efficient Attribute Injection for Pretrained Language Models

abstract: Metadata attributes (e.g., user and product IDs from reviews) can be incorporated as additional inputs to neural-based NLP models, by modifying the architecture of the models, in order to improve their performance. Recent models however rely on pretrained language models (PLMs), where previously used techniques for attribute injection are either nontrivial or ineffective. In this paper, we propose a lightweight and memory-efficient method to inject attributes to PLMs. We extend adapters, i.e. tiny plug-in feed-forward modules, to include attributes both independently of or jointly with the text. To limit the increase of parameters especially when the attribute vocabulary is large, we use low-rank approximations and hypercomplex multiplications, significantly decreasing the total parameters. We also introduce training mechanisms to handle domains in which attributes can be multi-labeled or sparse. Extensive experiments and analyses on eight datasets from different domains show that our method outperforms previous attribute injection methods and achieves state-of-the-art performance on various datasets.


title: Improving Unsupervised Question Answering via Summarization-Informed Question Generation

abstract: Question Generation (QG) is the task of generating a plausible question for a given <passage, answer> pair. Template-based QG uses linguistically-informed heuristics to transform declarative sentences into interrogatives, whereas supervised QG uses existing Question Answering (QA) datasets to train a system to generate a question given a passage and an answer. A disadvantage of the heuristic approach is that the generated questions are heavily tied to their declarative counterparts. A disadvantage of the supervised approach is that they are heavily tied to the domain/language of the QA dataset used as training data. In order to overcome these shortcomings, we propose an unsupervised QG method which uses questions generated heuristically from summaries as a source of training data for a QG system. We make use of freely available news summary data, transforming declarative summary sentences into appropriate questions using heuristics informed by dependency parsing, named entity recognition and semantic role labeling. The resulting questions are then combined with the original news articles to train an end-to-end neural QG model. We extrinsically evaluate our approach using unsupervised QA: our QG model is used to generate synthetic QA pairs for training a QA model. Experimental results show that, trained with only 20k English Wikipedia-based synthetic QA pairs, the QA model substantially outperforms previous unsupervised models on three in-domain datasets (SQuAD1.1, Natural Questions, TriviaQA) and three out-of-domain datasets (NewsQA, BioASQ, DuoRC), demonstrating the transferability of the approach.


title: Quality-aware Cine Cardiac MRI Reconstruction and Analysis from Undersampled k-space Data

abstract: Cine cardiac MRI is routinely acquired for the assessment of cardiac health, but the imaging process is slow and typically requires several breath-holds to acquire sufficient k-space profiles to ensure good image quality. Several undersampling-based reconstruction techniques have been proposed during the last decades to speed up cine cardiac MRI acquisition. However, the undersampling factor is commonly fixed to conservative values before acquisition to ensure diagnostic image quality, potentially leading to unnecessarily long scan times. In this paper, we propose an end-to-end quality-aware cine short-axis cardiac MRI framework that combines image acquisition and reconstruction with downstream tasks such as segmentation, volume curve analysis and estimation of cardiac functional parameters. The goal is to reduce scan time by acquiring only a fraction of k-space data to enable the reconstruction of images that can pass quality control checks and produce reliable estimates of cardiac functional parameters. The framework consists of a deep learning model for the reconstruction of 2D+t cardiac cine MRI images from undersampled data, an image quality-control step to detect good quality reconstructions, followed by a deep learning model for bi-ventricular segmentation, a quality-control step to detect good quality segmentations and automated calculation of cardiac functional parameters. To demonstrate the feasibility of the proposed approach, we perform simulations using a cohort of selected participants from the UK Biobank (n=270), 200 healthy subjects and 70 patients with cardiomyopathies. Our results show that we can produce quality-controlled images in a scan time reduced from 12 to 4 seconds per slice, enabling reliable estimates of cardiac functional parameters such as ejection fraction within 5% mean absolute error.


title: On the ordering of credibility factors

abstract: Traditional credibility analysis of risks in insurance is based on the random effects model, where the heterogeneity across the policyholders is assumed to be time-invariant. One popular extension is the dynamic random effects (or state-space) model. However, while the latter allows for time-varying heterogeneity, its application to the credibility analysis should be conducted with care due to the possibility of negative credibilities per period [see Pinquet (2020a)]. Another important but under-explored topic is the ordering of the credibility factors in a monotonous manner -- recent claims ought to have larger weights than the old ones. This paper shows that the ordering of the covariance structure of the random effects in the dynamic random effects model does not necessarily imply that of the credibility factors. Subsequently, we show that the state-space model, with AR(1)-type autocorrelation function, guarantees the ordering of the credibility factors. Simulation experiments and a case study with a real dataset are conducted to show the relevance in insurance applications.


title: Real Time Monocular Vehicle Velocity Estimation using Synthetic Data

abstract: Vision is one of the primary sensing modalities in autonomous driving. In this paper we look at the problem of estimating the velocity of road vehicles from a camera mounted on a moving car. Contrary to prior methods that train end-to-end deep networks that estimate the vehicles' velocity from the video pixels, we propose a two-step approach where first an off-the-shelf tracker is used to extract vehicle bounding boxes and then a small neural network is used to regress the vehicle velocity from the tracked bounding boxes. Surprisingly, we find that this still achieves state-of-the-art estimation performance with the significant benefit of separating perception from dynamics estimation via a clean, interpretable and verifiable interface which allows us distill the statistics which are crucial for velocity estimation. We show that the latter can be used to easily generate synthetic training data in the space of bounding boxes and use this to improve the performance of our method further.


title: TruthfulQA: Measuring How Models Mimic Human Falsehoods

abstract: We propose a benchmark to measure whether a language model is truthful in generating answers to questions. The benchmark comprises 817 questions that span 38 categories, including health, law, finance and politics. We crafted questions that some humans would answer falsely due to a false belief or misconception. To perform well, models must avoid generating false answers learned from imitating human texts. We tested GPT-3, GPT-Neo/J, GPT-2 and a T5-based model. The best model was truthful on 58% of questions, while human performance was 94%. Models generated many false answers that mimic popular misconceptions and have the potential to deceive humans. The largest models were generally the least truthful. This contrasts with other NLP tasks, where performance improves with model size. However, this result is expected if false answers are learned from the training distribution. We suggest that scaling up models alone is less promising for improving truthfulness than fine-tuning using training objectives other than imitation of text from the web.


title: Unbalanced multi-drawing urn with random addition matrix II

abstract: An extended Polya urn Model with two colors, black and white, is studied with some SLLN and CLT on the proportion of white balls.


title: Efficient and Effective Generation of Test Cases for Pedestrian Detection -- Search-based Software Testing of Baidu Apollo in SVL

abstract: With the growing capabilities of autonomous vehicles, there is a higher demand for sophisticated and pragmatic quality assurance approaches for machine learning-enabled systems in the automotive AI context. The use of simulation-based prototyping platforms provides the possibility for early-stage testing, enabling inexpensive testing and the ability to capture critical corner-case test scenarios. Simulation-based testing properly complements conventional on-road testing. However, due to the large space of test input parameters in these systems, the efficient generation of effective test scenarios leading to the unveiling of failures is a challenge. This paper presents a study on testing pedestrian detection and emergency braking system of the Baidu Apollo autonomous driving platform within the SVL simulator. We propose an evolutionary automated test generation technique that generates failure-revealing scenarios for Apollo in the SVL environment. Our approach models the input space using a generic and flexible data structure and benefits a multi-criteria safety-based heuristic for the objective function targeted for optimization. This paper presents the results of our proposed test generation technique in the 2021 IEEE Autonomous Driving AI Test Challenge. In order to demonstrate the efficiency and effectiveness of our approach, we also report the results from a baseline random generation technique. Our evaluation shows that the proposed evolutionary test case generator is more effective at generating failure-revealing test cases and provides higher diversity between the generated failures than the random baseline.


title: Internal Friction Measures to Study Precipitates Formation in EP and N-Doped Bulk Nb for SRF Applications

abstract: Main focus of this study is the investigation of thermodynamics phenomena responsible for the High Field Q Slope (HFQS) in SRF cavities by Internal Friction (IF) measurement. Mechanical spectroscopy is, indeed, a well-established technique to study precipitate formations in BCC materials and several works on the effects of impurities as N and O on the Snoek peak have been published so far and will be taken as reference to explain the mechanisms behind the observed dissipation effects. Internal Friction measurements were performed in Belgium at IMCE on Nb rectangular shape samples with different RRR values prepared at Fermilab by using Electro Polishing (EP), N-doping and heat treatments in order to reproduce the same conditions during the standard treatments applied on bulk Nb SRF cavities. From IF spectra, the H trapping mechanism by interstitial atoms (N and O and/or vacancies, depending on the purity level, RRR) can be easily recognized leading to results that perfectly corroborate previous findings on Q-disease, HFQS and RRR phenomena.


title: Stochastic Modelling of Symmetric Positive Definite Material Tensors

abstract: Spatial symmetries and invariances play an important role in the behaviour of materials and should be respected in the description and modelling of material properties. The focus here is the class of physically symmetric and positive definite tensors, as they appear often in the description of materials, and one wants to be able to prescribe certain classes of spatial symmetries and invariances for each member of the whole ensemble, while at the same time demanding that the mean or expected value of the ensemble be subject to a possibly 'higher' spatial invariance class. We formulate a modelling framework which not only respects these two requirements$-$positive definiteness and invariance$-$but also allows a fine control over orientation on one hand, and strength/size on the other. As the set of positive definite tensors is not a linear space, but rather an open convex cone in the linear space of physically symmetric tensors, we consider it advantageous to widen the notion of mean to the so-called Fr\'echet mean on a metric space, which is based on distance measures or metrics between positive definite tensors other than the usual Euclidean one. It is shown how the random ensemble can be modelled and generated, independently in its scaling and orientational or directional aspects, with a Lie algebra representation via a memoryless transformation. The parameters which describe the elements in this Lie algebra are then to be considered as random fields on the domain of interest. As an example, a 2D and a 3D model of steady-state heat conduction in a human proximal femur, a bone with high material anisotropy, is modelled with a random thermal conductivity tensor, and the numerical results show the distinct impact of incorporating into the constitutive model different material uncertainties$-$scaling, orientation, and prescribed material symmetry$-$on the desired quantities of interest.


title: Reconstruction of high-energy part of gamma-ray spectrum in thermal neutron capture by $^{113}$Cd

abstract: The average gamma-ray spectrum $^{114}$Cd after thermal neutron capture in $^{113}$Cd was evaluated in units of mb/MeV. Two approaches are considered for estimation of the average gamma-ray spectrum with normalization of the experimental data: mean spectra for all gamma-energies were found by averaging frequency polygon for experimental data histogram, and mean spectra were estimated as the combination of theoretical values at low gamma-ray energies and averaging experimental data in high-energy range. The experi mental spectra were evaluated from the gamma-intensities presented by Mheemeed et al. [A. Mheemeed et al., Nucl. Phys. A 412 (1984) 113] and Belgya et al [T. Belgya et al., EPJ Web of Conf. 146 (2017) 05009]. They were normalized to the average theoretical spectrum which was calculated using EMPIRE and TALYS codes. The procedure of normalization of the high-energy part of the spectrum was described. Estimated $\gamma$- spectra for $^{113}$Cd(n,{x$\gamma$}) reaction induced by thermal neutrons were presented.


title: The BIG X-ray tail

abstract: Galaxy clusters grow primarily through the continuous accretion of group-scale haloes. Group galaxies experience preprocessing during their journey into clusters. A star-bursting compact group, the Blue Infalling Group (BIG), is plunging into the nearby cluster A1367. Previous optical observations reveal rich tidal features in the BIG members, and a long H$\alpha$ trail behind. Here we report the discovery of a projected $\sim 250$ kpc X-ray tail behind the BIG using Chandra and XMM-Newton observations. The total hot gas mass in the tail is $\sim 7\times 10^{10}\ {\rm M}_\odot$ with an X-ray bolometric luminosity of $\sim 3.8\times 10^{41}$ erg s$^{-1}$. The temperature along the tail is $\sim 1$ keV, but the apparent metallicity is very low, an indication of the multi-$T$ nature of the gas. The X-ray and H$\alpha$ surface brightnesses in the front part of the BIG tail follow the tight correlation established from a sample of stripped tails in nearby clusters, which suggests the multiphase gas originates from the mixing of the stripped interstellar medium (ISM) with the hot intracluster medium (ICM). Because thermal conduction and hydrodynamic instabilities are significantly suppressed, the stripped ISM can be long lived and produce ICM clumps. The BIG provides us a rare laboratory to study galaxy transformation and preprocessing.


title: On the chiral anomaly and the Yang-Mills gradient flow

abstract: There are currently two singularity-free universal expressions for the topological susceptibility in QCD, one based on the Yang-Mills gradient flow and the other on density-chain correlation functions. While the latter link the susceptibility to the anomalous chiral Ward identities, the gradient flow permits the emergence of the topological sectors in lattice QCD to be understood. Here the two expressions are shown to coincide in the continuum theory, for any number of quark flavours in the range where the theory is asymptotically free.


title: Marginal regeneration-induced drainage of surface bubbles

abstract: The prediction of the lifetime of surface bubbles necessitates a better understanding of the thinning dynamics of the bubble cap. In 1959, Mysel \textit{et al.} \cite{mysels1959soap}, proposed that \textit{marginal regeneration} i.e. the rise of patches, thinner than the film should be taken into account to describe the film drainage. Nevertheless, an accurate description of these buoyant patches and of their dynamics as well as a quantification of their contribution to the thinning dynamics is still lacking. In this paper, we visualize the patches, and show that their rising velocities and sizes are in good agreement with models respectively based on the balance of gravitational and surface viscous forces and on a Rayleigh-Taylor like instability \cite{Seiwert2017,Shabalina2019}. Our results suggest that, in an environment saturated in humidity, the drainage induced by their dynamics correctly describes the film drainage at the apex of the bubble within the experimental error bars. We conclude that the film thinning of soap bubbles is indeed controlled, to a large extent, by \textit{marginal regeneration} in the absence of evaporation.


title: Charmonium suppression in ultra-relativistic proton-proton collisions at LHC energies: A hint for QGP in small systems

abstract: Proton-proton ($pp$) collision has been considered as a baseline to study the system produced in relativistic heavy-ion (AA) collisions with the basic assumption that no thermal medium is formed in $pp$ collisions. This warrants a cautious analysis of the system produced in $pp$ collisions at relativistic energies.In this work we investigate the charmonium suppression in $pp$ collisions at $\sqrt{s} = 5.02, 7$ and $13$ TeV energies. Further, charmonium suppression has been studied for various event multiplicities and transverse momenta by including the mechanisms of color screening, gluonic dissociation, collisional damping along with regeneration due to correlated $c\bar c$ pairs. Here we obtain a net suppression of charmonia at high-multiplicity events indicating the possibility of the formation of quark-gluon plasma in $pp$ collisions.


title: Alquist 4.0: Towards Social Intelligence Using Generative Models and Dialogue Personalization

abstract: The open domain-dialogue system Alquist has a goal to conduct a coherent and engaging conversation that can be considered as one of the benchmarks of social intelligence. The fourth version of the system, developed within the Alexa Prize Socialbot Grand Challenge 4, brings two main innovations. The first addresses coherence, and the second addresses the engagingness of the conversation. For innovations regarding coherence, we propose a novel hybrid approach combining hand-designed responses and a generative model. The proposed approach utilizes hand-designed dialogues, out-of-domain detection, and a neural response generator. Hand-designed dialogues walk the user through high-quality conversational flows. The out-of-domain detection recognizes that the user diverges from the predefined flow and prevents the system from producing a scripted response that might not make sense for unexpected user input. Finally, the neural response generator generates a response based on the context of the dialogue that correctly reacts to the unexpected user input and returns the dialogue to the boundaries of hand-designed dialogues. The innovations for engagement that we propose are mostly inspired by the famous exploration-exploitation dilemma. To conduct an engaging conversation with the dialogue partners, one has to learn their preferences and interests -- exploration. Moreover, to engage the partner, we have to utilize the knowledge we have already learned -- exploitation. In this work, we present the principles and inner workings of individual components of the open-domain dialogue system Alquist developed within the Alexa Prize Socialbot Grand Challenge 4 and the experiments we have conducted to evaluate them.


title: Lightlike hypersurfaces and time-minimizing geodesics in cone structures

abstract: Some well-known Lorentzian concepts are transferred into the more general setting of cone structures, which provide both the causality of the spacetime and the notion of cone geodesics without making use of any metric. Lightlike hypersurfaces are defined within this framework, showing that they admit a unique folitation by cone geodesics. This property becomes crucial after proving that, in globally hyperbolic spacetimes, achronal boundaries are lightlike hypersurfaces under some restrictions, allowing one to easily obtain some time-minimization properties of cone geodesics among causal curves departing from a hypersurface of the spacetime.


title: Constant mean curvature graphs in $\mathbb{H}^3$ defined in exterior domains

abstract: Given $H\in [0,1)$ and given a $C^0$ exterior domain $\Omega$ in a $H-$hypersphere of $\mathbb{H}^3,$ the existence of hyperbolic Killing graphs of CMC $H$ defined in $\overline{\Omega}$ with boundary $ \partial \Omega $ included in the $H-$hypersphere is obtained.


title: Do Language Models Know the Way to Rome?

abstract: The global geometry of language models is important for a range of applications, but language model probes tend to evaluate rather local relations, for which ground truths are easily obtained. In this paper we exploit the fact that in geography, ground truths are available beyond local relations. In a series of experiments, we evaluate the extent to which language model representations of city and country names are isomorphic to real-world geography, e.g., if you tell a language model where Paris and Berlin are, does it know the way to Rome? We find that language models generally encode limited geographic information, but with larger models performing the best, suggesting that geographic knowledge can be induced from higher-order co-occurrence statistics.


title: A unified Green's function approach for spectral and thermodynamic properties from algorithmic inversion of dynamical potentials

abstract: Dynamical potentials appear in many advanced electronic-structure methods, including self-energies from many-body perturbation theory, dynamical mean-field theory, electronic-transport formulations, and many embedding approaches. Here, we propose a novel treatment for the frequency dependence, introducing an algorithmic inversion method that can be applied to dynamical potentials expanded as sum over poles. This approach allows for an exact solution of Dyson-like equations at all frequencies via a mapping to a matrix diagonalization, and provides simultaneously frequency-dependent (spectral) and frequency-integrated (thermodynamic) properties of the Dyson-inverted propagators. The transformation to a sum over poles is performed introducing $n$-th order generalized Lorentzians as an improved basis set to represent the spectral function of a propagator, and using analytic expressions to recover the sum-over-poles form. Numerical results for the homogeneous electron gas at the $G_0W_0$ level are provided to argue for the accuracy and efficiency of such unified approach.


title: Skyrmion-driven topological Hall effect in a Shastry-Sutherland magnet

abstract: The Shastry-Sutherland model and its generalizations have been shown to capture emergent complex magnetic properties from geometric frustration in several quasi-two-dimensional quantum magnets. Using an $sd$ exchange model, we show here that metallic Shastry-Sutherland magnets can exhibit a topological Hall effect driven by magnetic skyrmions under realistic conditions. The magnetic properties are modeled with competing symmetric Heisenberg and asymmetric Dzyaloshinskii-Moriya exchange interactions, while a coupling between the spins of the itinerant electrons and the localized moments describes the magnetotransport behavior. Our results, employing complementary Monte Carlo simulations and a novel machine learning analysis to investigate the magnetic phases, provide evidence for field-driven skyrmion crystal formation for an extended range of Hamiltonian parameters. By constructing an effective tight-binding model of conduction electrons coupled to the skyrmion lattice, we clearly demonstrate the appearance of the topological Hall effect. We further elaborate on the effects of finite temperatures on both magnetic and magnetotransport properties.


title: Behavioural assume-guarantee contracts for linear dynamical systems

abstract: Motivated by the growing requirements on the operation of complex engineering systems, we present contracts as specifications for continuous-time linear dynamical systems with inputs and outputs. A contract is defined as a pair of assumptions and guarantees, both characterized in a behavioural framework. The assumptions encapsulate the available information about the dynamic behaviour of the environment in which the system is supposed to operate, while the guarantees express the desired dynamic behaviour of the system when interconnected with relevant environments. In addition to defining contracts, we characterize contract implementation, and we find necessary conditions for the existence of an implementation. We also characterize contract refinement, which is used to characterize contract conjunction in two special cases. These concepts are then illustrated by an example of a vehicle following system.


title: An extremum seeking algorithm for monotone Nash equilibrium problems

abstract: In this paper we consider the problem of finding a Nash equilibrium (NE) via zeroth-order feedback information in games with merely monotone pseudogradient mapping. Based on hybrid system theory, we propose a novel extremum seeking algorithm which converges to the set of Nash equilibria in a semi-global practical sense. Finally, we present two simulation examples. The first shows that the standard extremum seeking algorithm fails, while ours succeeds in reaching NE. In the second, we simulate an allocation problem with fixed demand.


title: Scalable massively parallel computing using continuous-time data representation in nanoscale crossbar array

abstract: The growth of connected intelligent devices in the Internet of Things has created a pressing need for real-time processing and understanding of large volumes of analogue data. The difficulty in boosting the computing speed renders digital computing unable to meet the demand for processing analogue information that is intrinsically continuous in magnitude and time. By utilizing a continuous data representation in a nanoscale crossbar array, parallel computing can be implemented for the direct processing of analogue information in real time. Here, we propose a scalable massively parallel computing scheme by exploiting a continuous-time data representation and frequency multiplexing in a nanoscale crossbar array. This computing scheme enables the parallel reading of stored data and the one-shot operation of matrix-matrix multiplications in the crossbar array. Furthermore, we achieve the one-shot recognition of 16 letter images based on two physically interconnected crossbar arrays and demonstrate that the processing and modulation of analogue information can be simultaneously performed in a memristive crossbar array.


title: Convex strategies for trajectory optimisation: application to the Polytope Traversal Problem

abstract: Non-linear Trajectory Optimisation (TO) methods require good initial guesses to converge to a locally optimal solution. A feasible guess can often be obtained by allocating a large amount of time for the trajectory to complete. However for unstable dynamical systems such as humanoid robots, this quasi-static assumption does not always hold. We propose a conservative formulation of the TO problem that simultaneously computes a feasible path and its time allocation. The problem is solved as an efficient convex optimisation problem guaranteed to converge to a locally optimal solution. The interest of the approach is illustrated with the computation of feasible trajectories that traverse sequentially a sequence of polytopes. We demonstrate that on instances of the problem where the quasi static solutions are not admissible, our approach is able to find a feasible solution with a success rate above $80 \%$ in all the scenarios considered, in less than 10ms for problems involving traversing less than 5 polytopes and less than 1s for problems involving 20 polytopes, thus demonstrating its ability to reliably provide initial guesses to advanced non linear solvers.


title: On variable selection in joint modeling of mean and dispersion

abstract: The joint modeling of mean and dispersion (JMMD) provides an efficient method to obtain useful models for the mean and dispersion, especially in problems of robust design experiments. However, in the literature on JMMD there are few works dedicated to variable selection and this theme is still a challenge. In this article, we propose a procedure for selecting variables in JMMD, based on hypothesis testing and the quality of the model's fit. A criterion for checking the goodness of fit is used, in each iteration of the selection process, as a filter for choosing the terms that will be evaluated by a hypothesis test. Three types of criteria were considered for checking the quality of the model fit in our variable selection procedure. The criteria used were: the extended Akaike information criterion, the corrected Akaike information criterion and a specific criterion for the JMMD, proposed by us, a type of extended adjusted coefficient of determination. Simulation studies were carried out to verify the efficiency of our variable selection procedure. In all situations considered, the proposed procedure proved to be effective and quite satisfactory. The variable selection process was applied to a real example from an industrial experiment.


title: Identifying efficient ensemble perturbations for initializing subseasonal-to-seasonal prediction

abstract: The prediction of the weather at subseasonal-to-seasonal (S2S) timescales is dependent on both initial and boundary conditions. An open question is how to best initialize a relatively small-sized ensemble of numerical model integrations to produce reliable forecasts at these timescales. Reliability in this case means that the statistical properties of the ensemble forecast are consistent with the actual uncertainties about the future state of the geophysical system under investigation. In the present work, a method is introduced to construct initial conditions that produce reliable ensemble forecasts by projecting onto the eigenfunctions of the Koopman or the Perron-Frobenius operators, which describe the time-evolution of observables and probability distributions of the system dynamics, respectively. These eigenfunctions can be approximated from data by using the Dynamic Mode Decomposition (DMD) algorithm. The effectiveness of this approach is illustrated in the framework of a low-order ocean-atmosphere model exhibiting multiple characteristic timescales, and is compared to other ensemble initialization methods based on the Empirical Orthogonal Functions (EOFs) of the model trajectory and on the backward and covariant Lyapunov vectors of the model dynamics. Projecting initial conditions onto a subset of the Koopman or Perron-Frobenius eigenfunctions that are characterized by time scales with fast-decaying oscillations is found to produce highly reliable forecasts at all lead times investigated, ranging from one week to two months. Reliable forecasts are also obtained with the adjoint covariant Lyapunov vectors, which are the eigenfunctions of the Koopman operator in the tangent space. The advantages of these different methods are discussed.


title: Emergent new symmetry from the Higgs shadow

abstract: We show in this Letter how a new hidden gauge symmetry responsible for neutrino mass as well as dark matter (DM) in the Universe can be discovered through scalar mediators responsible for breaking the new symmetry. The new force mediator ($Z'$) may be lighter than the Standard Model (SM) gauge bosons but cannot be observed in traditional searches for new gauge bosons. We highlight a novel way of discovering such a symmetry at the Large Hadron Collider (LHC) by incorporating an existing ATLAS analysis on four lepton final states which include the Higgs resonance. In addition, we show that the hidden sector also introduces flavor violation in the lepton sector which can become a significant channel of discovery for the new force.


title: Asymptotic Properties of $\mathcal{S}$-$\mathcal{AB}$ Method with Diminishing Stepsize

abstract: The popular $\mathcal{AB}$/push-pull method for distributed optimization problem may unify much of the existing decentralized first-order methods based on gradient tracking technique. More recently, the stochastic gradient variant of $\mathcal{AB}$/Push-Pull method ($\mathcal{S}$-$\mathcal{AB}$) has been proposed, which achieves the linear rate of converging to a neighborhood of the global minimizer when the step-size is constant. This paper is devoted to the asymptotic properties of $\mathcal{S}$-$\mathcal{AB}$ with diminishing stepsize. Specifically, under the condition that each local objective is smooth and the global objective is strongly-convex, we first present the boundedness of the iterates of $\mathcal{S}$-$\mathcal{AB}$ and then show that the iterates converge to the global minimizer with the rate $\mathcal{O}\left(1/\sqrt{k}\right)$. Furthermore, the asymptotic normality of Polyak-Ruppert averaged $\mathcal{S}$-$\mathcal{AB}$ is obtained and applications on statistical inference are discussed. Finally, numerical tests are conducted to demonstrate the theoretic results.


title: R3LIVE: A Robust, Real-time, RGB-colored, LiDAR-Inertial-Visual tightly-coupled state Estimation and mapping package

abstract: In this letter, we propose a novel LiDAR-Inertial-Visual sensor fusion framework termed R3LIVE, which takes advantage of measurement of LiDAR, inertial, and visual sensors to achieve robust and accurate state estimation. R3LIVE is contained of two subsystems, the LiDAR-inertial odometry (LIO) and visual-inertial odometry (VIO). The LIO subsystem (FAST-LIO) takes advantage of the measurement from LiDAR and inertial sensors and builds the geometry structure of (i.e. the position of 3D points) global maps. The VIO subsystem utilizes the data of visual-inertial sensors and renders the map's texture (i.e. the color of 3D points). More specifically, the VIO subsystem fuses the visual data directly and effectively by minimizing the frame-to-map photometric error. The developed system R3LIVE is developed based on our previous work R2LIVE, with careful architecture design and implementation. Experiment results show that the resultant system achieves more robustness and higher accuracy in state estimation than current counterparts (see our attached video). R3LIVE is a versatile and well-engineered system toward various possible applications, which can not only serve as a SLAM system for real-time robotic applications, but can also reconstruct the dense, precise, RGB-colored 3D maps for applications like surveying and mapping. Moreover, to make R3LIVE more extensible, we develop a series of offline utilities for reconstructing and texturing meshes, which further minimizes the gap between R3LIVE and various of 3D applications such as simulators, video games and etc (see our demos video). To share our findings and make contributions to the community, we open source R3LIVE on our Github, including all of our codes, software utilities, and the mechanical design of our device.


title: Let the CAT out of the bag: Contrastive Attributed explanations for Text

abstract: Contrastive explanations for understanding the behavior of black box models has gained a lot of attention recently as they provide potential for recourse. In this paper, we propose a method Contrastive Attributed explanations for Text (CAT) which provides contrastive explanations for natural language text data with a novel twist as we build and exploit attribute classifiers leading to more semantically meaningful explanations. To ensure that our contrastive generated text has the fewest possible edits with respect to the original text, while also being fluent and close to a human generated contrastive, we resort to a minimal perturbation approach regularized using a BERT language model and attribute classifiers trained on available attributes. We show through qualitative examples and a user study that our method not only conveys more insight because of these attributes, but also leads to better quality (contrastive) text. Quantitatively, we show that our method outperforms other state-of-the-art methods across four data sets on four benchmark metrics.


title: Rigidity of free boundary MOTS

abstract: The aim of this work is to present an initial data version of Hawking's theorem on the topology of back hole spacetimes in the context of manifolds with boundary. More precisely, we generalize the results of G. J. Galloway and R. Schoen [13] and G. J. Galloway [11, 12] by proving that a compact free boundary stable marginally outer trapped surface (MOTS) $\Sigma$ in an initial data set with boundary satisfying natural dominant energy conditions (DEC) is of positive Yamabe type, i.e. $\Sigma$ admits a metric of positive scalar curvature with minimal boundary, provided $\Sigma$ is outermost. To do so, we prove that if $\Sigma$ is a compact free boundary stable MOTS which does not admit a metric of positive scalar curvature with minimal boundary in an initial data set satisfying the interior and the boundary DEC, then an outer neighborhood of $\Sigma$ can be foliated by free boundary MOTS $\Sigma_t$, assuming that $\Sigma$ is weakly outermost. Moreover, each $\Sigma_t$ has vanishing outward null second fundamental form, is Ricci flat with totally geodesic boundary, and the dominant energy conditions saturate on $\Sigma_t$.


title: Deformed Cartan matrices and generalized preprojective algebras I: Finite type

abstract: We give an interpretation of the $(q,t)$-deformed Cartan matrices of finite type and their inverses in terms of bigraded modules over the generalized preprojective algebras of Langlands dual type in the sense of Gei\ss-Leclerc-Schr\"{o}er [Invent. math. 209 (2017)]. As an application, we compute the first extension groups between the generic kernels introduced by Hernandez-Leclerc [J. Eur. Math. Soc. 18 (2016)], and propose a conjecture that their dimensions coincide with the pole orders of the normalized $R$-matrices between the corresponding Kirillov-Reshetikhin modules.


title: Harnessing Perceptual Adversarial Patches for Crowd Counting

abstract: Crowd counting, which has been widely adopted for estimating the number of people in safety-critical scenes, is shown to be vulnerable to adversarial examples in the physical world (e.g., adversarial patches). Though harmful, adversarial examples are also valuable for evaluating and better understanding model robustness. However, existing adversarial example generation methods for crowd counting lack strong transferability among different black-box models, which limits their practicability for real-world systems. Motivated by the fact that attacking transferability is positively correlated to the model-invariant characteristics, this paper proposes the Perceptual Adversarial Patch (PAP) generation framework to tailor the adversarial perturbations for crowd counting scenes using the model-shared perceptual features. Specifically, we handcraft an adaptive crowd density weighting approach to capture the invariant scale perception features across various models and utilize the density guided attention to capture the model-shared position perception. Both of them are demonstrated to improve the attacking transferability of our adversarial patches. Extensive experiments show that our PAP could achieve state-of-the-art attacking performance in both the digital and physical world, and outperform previous proposals by large margins (at most +685.7 MAE and +699.5 MSE). Besides, we empirically demonstrate that adversarial training with our PAP can benefit the performance of vanilla models in alleviating several practical challenges in crowd counting scenarios, including generalization across datasets (up to -376.0 MAE and -354.9 MSE) and robustness towards complex backgrounds (up to -10.3 MAE and -16.4 MSE).


title: A Partially Random Trotter Algorithm for Quantum Hamiltonian Simulations

abstract: Given the Hamiltonian, the evaluation of unitary operators has been at the heart of many quantum algorithms. Motivated by existing deterministic and random methods, we present a hybrid approach, where Hamiltonians with large amplitude are evaluated at each time step, while the remaining terms are evaluated at random. The bound for the mean square error is obtained, together with a concentration bound. The mean square error consists of a variance term and a bias term, arising respectively from the random sampling of the Hamiltonian terms and the operator splitting error. Leveraging on the bias/variance trade-off, the error can be minimized by balancing the two. The concentration bound provides an estimate on the number of gates. The estimates are verified by using numerical experiments on classical computers.


title: The Enduring Effects of COVID-19 on Travel Behavior in the United States: A Panel Study on Observed and Expected Changes in Telecommuting, Mode Choice, Online Shopping and Air Travel

abstract: The explosive nature of Covid-19 transmission drastically altered the rhythm of daily life by forcing billions of people to stay at their homes. A critical challenge facing transportation planners is to identify the type and the extent of changes in people's activity-travel behavior in the post-pandemic world. In this study, we investigated the travel behavior evolution by analyzing a longitudinal two-wave panel survey data conducted in the United States from April 2020 to October 2020 (wave 1) and from November 2020 to May 2021(wave 2). Encompassing nearly 3,000 respondents across different states, we explored pandemic-induced changes and underlying reasons in four major categories of telecommute/telemedicine, commute mode choice, online shopping, and air travel. Upon concrete evidence, our findings substantiate significantly observed and expected changes in habits and preferences. According to results, nearly half of employees anticipate having the alternative to telecommute and among which 71% expect to work from home at least twice a week after the pandemic. In the post-pandemic period, auto and transit commuters are expected to be 9% and 31% less than pre-pandemic, respectively. A considerable rise in hybrid work and grocery/non-grocery online shopping is expected. Moreover, 41% of pre-covid business travelers expect to have fewer flights (after the pandemic) while only 8% anticipate more, compared to the pre-pandemic. Upon our analyses, we discuss a spectrum of policy implications in all mentioned areas.


title: On Misbehaviour and Fault Tolerance in Machine Learning Systems

abstract: Machine learning (ML) provides us with numerous opportunities, allowing ML systems to adapt to new situations and contexts. At the same time, this adaptability raises uncertainties concerning the run-time product quality or dependability, such as reliability and security, of these systems. Systems can be tested and monitored, but this does not provide protection against faults and failures in adapted ML systems themselves. We studied software designs that aim at introducing fault tolerance in ML systems so that possible problems in ML components of the systems can be avoided. The research was conducted as a case study, and its data was collected through five semi-structured interviews with experienced software architects. We present a conceptualisation of the misbehaviour of ML systems, the perceived role of fault tolerance, and the designs used. Common patterns to incorporating ML components in design in a fault tolerant fashion have started to emerge. ML models are, for example, guarded by monitoring the inputs and their distribution, and enforcing business rules on acceptable outputs. Multiple, specialised ML models are used to adapt to the variations and changes in the surrounding world, and simpler fall-over techniques like default outputs are put in place to have systems up and running in the face of problems. However, the general role of these patterns is not widely acknowledged. This is mainly due to the relative immaturity of using ML as part of a complete software system: the field still lacks established frameworks and practices beyond training to implement, operate, and maintain the software that utilises ML. ML software engineering needs further analysis and development on all fronts.


title: Context-aware Entity Typing in Knowledge Graphs

abstract: Knowledge graph entity typing aims to infer entities' missing types in knowledge graphs which is an important but under-explored issue. This paper proposes a novel method for this task by utilizing entities' contextual information. Specifically, we design two inference mechanisms: i) N2T: independently use each neighbor of an entity to infer its type; ii) Agg2T: aggregate the neighbors of an entity to infer its type. Those mechanisms will produce multiple inference results, and an exponentially weighted pooling method is used to generate the final inference result. Furthermore, we propose a novel loss function to alleviate the false-negative problem during training. Experiments on two real-world KGs demonstrate the effectiveness of our method. The source code and data of this paper can be obtained from https://github.com/CCIIPLab/CET.


title: ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations

abstract: Multisensory object-centric perception, reasoning, and interaction have been a key research topic in recent years. However, the progress in these directions is limited by the small set of objects available -- synthetic objects are not realistic enough and are mostly centered around geometry, while real object datasets such as YCB are often practically challenging and unstable to acquire due to international shipping, inventory, and financial cost. We present ObjectFolder, a dataset of 100 virtualized objects that addresses both challenges with two key innovations. First, ObjectFolder encodes the visual, auditory, and tactile sensory data for all objects, enabling a number of multisensory object recognition tasks, beyond existing datasets that focus purely on object geometry. Second, ObjectFolder employs a uniform, object-centric, and implicit representation for each object's visual textures, acoustic simulations, and tactile readings, making the dataset flexible to use and easy to share. We demonstrate the usefulness of our dataset as a testbed for multisensory perception and control by evaluating it on a variety of benchmark tasks, including instance recognition, cross-sensory retrieval, 3D reconstruction, and robotic grasping.


title: Measurement of $\mathrm{D}$-meson production as a function of charged-particle multiplicity in proton--proton collisions at $\sqrt{s} = 13$ TeV with ALICE at the LHC

abstract: Heavy quarks (charm and beauty) are produced in hard-scattering processes and the study of their production in proton--proton (pp) collisions is an important test for calculations based on perturbative Quantum Chromodynamics (pQCD). Heavy-flavor production as a function of charged-particle multiplicity provides insight into the processes occurring at the partonic level and the interplay between the hard and soft particle production mechanisms in pp collisions. In this contribution, measurements of open heavy-flavor production as a function of multiplicity, via the study of the $\mathrm{D}$-meson self-normalized yields in pp collisions at the center-of-mass energy of $\sqrt{s} = 13$ TeV is presented. The $\mathrm{D}$-meson self-normalized yield is found to increase stronger than linearly with increasing charged-particle multiplicity. The measurements are compared to theoretical model calculations, and with the results at $\sqrt{s} = 7$ TeV.


title: Thermofractals and the Nonextensive Finite Ideal Gas

abstract: The underlying connection between the degrees of freedom of a system and its nonextensive thermodynamic behavior is addressed. The problem is handled by starting from a thermodynamical system with fractal structure and its analytical reduction to a finite ideal gas. In the limit where the thermofractal has no internal structure, it is found that it reproduces the basic properties of a nonextensive ideal gas with a finite number of particles as recently discussed (Lima \& Deppman, Phys. Rev. E 101, 040102(R) 2020). In particular, the entropic $q$-index is calculated in terms of the number of particles both for the nonrelativistic and relativistic cases. In light of such results, the possible nonadditivity or additivity of the entropic structures are also critically analysed and new expressions to the entropy (per particle) for a composed system of thermofractals and its limiting case are derived.


title: KnowMAN: Weakly Supervised Multinomial Adversarial Networks

abstract: The absence of labeled data for training neural models is often addressed by leveraging knowledge about the specific task, resulting in heuristic but noisy labels. The knowledge is captured in labeling functions, which detect certain regularities or patterns in the training samples and annotate corresponding labels for training. This process of weakly supervised training may result in an over-reliance on the signals captured by the labeling functions and hinder models to exploit other signals or to generalize well. We propose KnowMAN, an adversarial scheme that enables to control influence of signals associated with specific labeling functions. KnowMAN forces the network to learn representations that are invariant to those signals and to pick up other signals that are more generally associated with an output label. KnowMAN strongly improves results compared to direct weakly supervised learning with a pre-trained transformer language model and a feature-based baseline.


title: Towards Defensive Autonomous Driving: Collecting and Probing Driving Demonstrations of Mixed Qualities

abstract: Designing or learning an autonomous driving policy is undoubtedly a challenging task as the policy has to maintain its safety in all corner cases. In order to secure safety in autonomous driving, the ability to detect hazardous situations, which can be seen as an out-of-distribution (OOD) detection problem, becomes crucial. However, most conventional datasets only provide expert driving demonstrations, although some non-expert or uncommon driving behavior data are needed to implement a safety guaranteed autonomous driving platform. To this end, we present a novel dataset called the R3 Driving Dataset, composed of driving data with different qualities. The dataset categorizes abnormal driving behaviors into eight categories and 369 different detailed situations. The situations include dangerous lane changes and near-collision situations. To further enlighten how these abnormal driving behaviors can be detected, we utilize different uncertainty estimation and anomaly detection methods to the proposed dataset. From the results of the proposed experiment, it can be inferred that by using both uncertainty estimation and anomaly detection, most of the abnormal cases in the proposed dataset can be discriminated. The dataset of this paper can be downloaded from https://rllab-snu.github.io/projects/R3-Driving-Dataset/doc.html.


title: On the Local Behavior of Local Weak Solutions to some Singular Anisotropic Elliptic Equations

abstract: We study the local behavior of bounded local weak solutions to a class of anisotropic singular equations that involves both non-degenerate and singular operators. Throughout a parabolic approach to expansion of positivity we obtain the interior H\"older continuity, and some integral and pointwise Harnack inequalities.


title: Magnetoelectric polarizability and optical activity: spin and frequency dependence

abstract: We extend a microscopic theory of polarization and magnetization to include the spin degree of freedom of the electrons, introducing a general spin orbit coupling and Zeeman interaction term in the Hamiltonian. At finite frequencies and including spin, the magnetoelectric polarizability tensor is replaced by two separate tensors, one that relates the polarization \textbf{P} to the magnetic field \textbf{B} and a separate tensor that relates the magnetization \textbf{M} to the electric field \textbf{E}. When combined with other relevant response tensors a third rank tensor that relates the induced current density to gradients in the electric field can be introduced; it is gauge invariant, in a form suitable for numerical calculations, and describes optical activity -- including spin effects -- even in materials that may lack time reversal symmetry.


title: Strictly localized three-dimensional states close to single photons

abstract: A class of strictly localized states which can be made arbitrarily close to single photons is constructed, and expressions for central properties are provided. It is demonstrated that single photon states can be well approximated by these states down to localization scales on the order of a few pulse cycles. The results readily generalize to states close to $n$-photons. We also provide upper and lower bounds for the fidelity between a given single photon and any state strictly localized to a given volume. These results constitute the limit of photon localization, complementary to the weak-localization limit (I. Bialynicki-Birula, Phys. Rev. Lett. 80, 5247 (1998)).


title: Learning from Peers: Deep Transfer Reinforcement Learning for Joint Radio and Cache Resource Allocation in 5G RAN Slicing

abstract: Network slicing is a critical technique for 5G communications that covers radio access network (RAN), edge, transport and core slicing.The evolving network architecture requires the orchestration of multiple network resources such as radio and cache resources. In recent years, machine learning (ML) techniques have been widely applied for network management. However, most existing works do not take advantage of the knowledge transfer capability in ML. In this paper, we propose a deep transfer reinforcement learning (DTRL) scheme for joint radio and cache resource allocation to serve 5G RAN slicing. We first define a hierarchical architecture for joint resource allocation. Then we propose two DTRL algorithms: Q-value-based deep transfer reinforcement learning (QDTRL) and action selection-based deep transfer reinforcement learning (ADTRL). In the proposed schemes, learner agents utilize expert agents' knowledge to improve their performance on current tasks. The proposed algorithms are compared with both the model-free exploration bonus deep Q-learning (EB-DQN) and the model-based priority proportional fairness and time-to-live (PPF-TTL) algorithms. Compared with EB-DQN, our proposed DTRL-based method presents 21.4% lower delay for Ultra Reliable Low Latency Communications (URLLC) slice and 22.4% higher throughput for enhanced Mobile Broad Band (eMBB) slice, while achieving significantly faster convergence than EB-DQN. Moreover, 40.8% lower URLLC delay and 59.8% higher eMBB throughput are observed with respect to PPF-TTL.


title: A Variational Formulation of Resolvent Analysis

abstract: The conceptual picture underlying resolvent analysis(RA) is that the nonlinear term in the Navier-Stokes(NS) equations provides an intrinsic forcing to the linear dynamics, a description inspired by control theory. The inverse of the linear operator, defined as the resolvent, is interpreted as a transfer function between the forcing and the velocity response. This inversion obscures the physical interpretation of the governing equations and is prohibitive to analytical manipulation, and for large systems leads to significant computational cost and memory requirements. In this work we suggest an alternative, inverse free, definition of the resolvent basis based on an extension of the Courant-Fischer-Weyl min-max principle in which resolvent modes are defined as stationary points of a constrained variational problem. This leads to a straightforward approach to approximate the resolvent (response) modes of complex flows as expansions in any basis. The proposed method avoids matrix inversions and requires only the spectral decomposition of a matrix of significantly reduced size as compared to the original system. To illustrate this method and the advantages of the variational formulation we present three examples. First, we consider streamwise constant fluctuations in turbulent channel flow where an asymptotic analysis allows us to derive closed form expressions for the optimal resolvent modes. Second, to illustrate the cost saving potential, and investigate the limits, of the proposed method we apply our method to both a 2-dimensional, 3-component equilibrium solution in Couette flow and, finally, to a streamwise developing turbulent boundary layer. For these larger systems we achieve a model reduction of up to two orders of magnitude. Such savings have the potential to open RA to the investigation of larger domains and more complex flow configurations.


title: New electroweak challenges and opportunities at the LHeC

abstract: The Large Hadron-Electron Collider (LHeC) will operate at $\sqrt{s}$ = 1.2 TeV and accumulate about 1/ab of integrated electron-proton luminosity. Novel studies of high energy photon-photon interactions at the LHeC, at the $\gamma\gamma$ center-of-mass energy up to 1 TeV, will open new frontiers in the electroweak physics as well as in searches for physics beyond the Standard Model. Despite a very high $ep$ luminosity, the experimental conditions will be very favorable at the LHeC - a negligible event pileup will allow for unique studies of a number of processes involving the exclusive production via photon-photon fusion.


title: SAFRAN: An interpretable, rule-based link prediction method outperforming embedding models

abstract: Neural embedding-based machine learning models have shown promise for predicting novel links in knowledge graphs. Unfortunately, their practical utility is diminished by their lack of interpretability. Recently, the fully interpretable, rule-based algorithm AnyBURL yielded highly competitive results on many general-purpose link prediction benchmarks. However, current approaches for aggregating predictions made by multiple rules are affected by redundancies. We improve upon AnyBURL by introducing the SAFRAN rule application framework, which uses a novel aggregation approach called Non-redundant Noisy-OR that detects and clusters redundant rules prior to aggregation. SAFRAN yields new state-of-the-art results for fully interpretable link prediction on the established general-purpose benchmarks FB15K-237, WN18RR and YAGO3-10. Furthermore, it exceeds the results of multiple established embedding-based algorithms on FB15K-237 and WN18RR and narrows the gap between rule-based and embedding-based algorithms on YAGO3-10.


title: The NiuTrans System for the WMT21 Efficiency Task

abstract: This paper describes the NiuTrans system for the WMT21 translation efficiency task (http://statmt.org/wmt21/efficiency-task.html). Following last year's work, we explore various techniques to improve efficiency while maintaining translation quality. We investigate the combinations of lightweight Transformer architectures and knowledge distillation strategies. Also, we improve the translation efficiency with graph optimization, low precision, dynamic batching, and parallel pre/post-processing. Our system can translate 247,000 words per second on an NVIDIA A100, being 3$\times$ faster than last year's system. Our system is the fastest and has the lowest memory consumption on the GPU-throughput track. The code, model, and pipeline will be available at NiuTrans.NMT (https://github.com/NiuTrans/NiuTrans.NMT).


title: Comparison theorem for neutral stochastic functional differential equations driven by G-Brownian motion

abstract: In this paper, we investigate suffcient and necessary conditions for the comparison theorem of neutral stochastic functional differential equations driven by G-Brownian motion (G-NSFDE). Moreover, the results extend the ones in the linear expectation case [1] and nonlinear expectation framework [8].


title: Elucidating proximity magnetism through polarized neutron reflectometry and machine learning

abstract: Polarized neutron reflectometry is a powerful technique to interrogate the structures of multilayered magnetic materials with depth sensitivity and nanometer resolution. However, reflectometry profiles often inhabit a complicated objective function landscape using traditional fitting methods, posing a significant challenge to parameter retrieval. In this work, we develop a data-driven framework to recover the sample parameters from polarized neutron reflectometry data with minimal user intervention. We train a variational autoencoder to map reflectometry profiles with moderate experimental noise to an interpretable, low-dimensional space from which sample parameters can be extracted with high resolution. We apply our method to recover the scattering length density profiles of the topological insulator-ferromagnetic insulator heterostructure Bi$_2$Se$_3$/EuS exhibiting proximity magnetism, in good agreement with the results of conventional fitting. We further analyze a more challenging reflectometry profile of the topological insulator-antiferromagnet heterostructure (Bi,Sb)$_2$Te$_3$/Cr$_2$O$_3$ and identify possible interfacial proximity magnetism in this material. We anticipate the framework developed here can be applied to resolve hidden interfacial phenomena in a broad range of layered systems.


title: Deep Algorithmic Question Answering: Towards a Compositionally Hybrid AI for Algorithmic Reasoning

abstract: An important aspect of artificial intelligence (AI) is the ability to reason in a step-by-step "algorithmic" manner that can be inspected and verified for its correctness. This is especially important in the domain of question answering (QA). We argue that the challenge of algorithmic reasoning in QA can be effectively tackled with a "systems" approach to AI which features a hybrid use of symbolic and sub-symbolic methods including deep neural networks. Additionally, we argue that while neural network models with end-to-end training pipelines perform well in narrow applications such as image classification and language modelling, they cannot, on their own, successfully perform algorithmic reasoning, especially if the task spans multiple domains. We discuss a few notable exceptions and point out how they are still limited when the QA problem is widened to include other intelligence-requiring tasks. However, deep learning, and machine learning in general, do play important roles as components in the reasoning process. We propose an approach to algorithm reasoning for QA, Deep Algorithmic Question Answering (DAQA), based on three desirable properties: interpretability, generalizability, and robustness which such an AI system should possess, and conclude that they are best achieved with a combination of hybrid and compositional AI.


title: Graph Fourier Transform based Audio Zero-watermarking

abstract: The frequent exchange of multimedia information in the present era projects an increasing demand for copyright protection. In this work, we propose a novel audio zero-watermarking technology based on graph Fourier transform for enhancing the robustness with respect to copyright protection. In this approach, the combined shift operator is used to construct the graph signal, upon which the graph Fourier analysis is performed. The selected maximum absolute graph Fourier coefficients representing the characteristics of the audio segment are then encoded into a feature binary sequence using K-means algorithm. Finally, the resultant feature binary sequence is XOR-ed with the watermark binary sequence to realize the embedding of the zero-watermarking. The experimental studies show that the proposed approach performs more effectively in resisting common or synchronization attacks than the existing state-of-the-art methods.


title: The NiuTrans System for WNGT 2020 Efficiency Task

abstract: This paper describes the submissions of the NiuTrans Team to the WNGT 2020 Efficiency Shared Task. We focus on the efficient implementation of deep Transformer models \cite{wang-etal-2019-learning, li-etal-2019-niutrans} using NiuTensor (https://github.com/NiuTrans/NiuTensor), a flexible toolkit for NLP tasks. We explored the combination of deep encoder and shallow decoder in Transformer models via model compression and knowledge distillation. The neural machine translation decoding also benefits from FP16 inference, attention caching, dynamic batching, and batch pruning. Our systems achieve promising results in both translation quality and efficiency, e.g., our fastest system can translate more than 40,000 tokens per second with an RTX 2080 Ti while maintaining 42.9 BLEU on \textit{newstest2018}. The code, models, and docker images are available at NiuTrans.NMT (https://github.com/NiuTrans/NiuTrans.NMT).


title: Sparse logistic functional principal component analysis for binary data

abstract: Functional binary datasets occur frequently in real practice, whereas discrete characteristics of the data can bring challenges to model estimation. In this paper, we propose a sparse logistic functional principal component analysis (SLFPCA) method to handle the functional binary data. The SLFPCA looks for local sparsity of the eigenfunctions to obtain convenience in interpretation. We formulate the problem through a penalized Bernoulli likelihood with both roughness penalty and sparseness penalty terms. An efficient algorithm is developed for the optimization of the penalized likelihood using majorization-minimization (MM) algorithm. The theoretical results indicate both consistency and sparsistency of the proposed method. We conduct a thorough numerical experiment to demonstrate the advantages of the SLFPCA approach. Our method is further applied to a physical activity dataset.


title: WildWood: a new Random Forest algorithm

abstract: We introduce WildWood (WW), a new ensemble algorithm for supervised learning of Random Forest (RF) type. While standard RF algorithms use bootstrap out-of-bag samples to compute out-of-bag scores, WW uses these samples to produce improved predictions given by an aggregation of the predictions of all possible subtrees of each fully grown tree in the forest. This is achieved by aggregation with exponential weights computed over out-of-bag samples, that are computed exactly and very efficiently thanks to an algorithm called context tree weighting. This improvement, combined with a histogram strategy to accelerate split finding, makes WW fast and competitive compared with other well-established ensemble methods, such as standard RF and extreme gradient boosting algorithms.


title: Surgery Applications to a Generalized Rudyak Conjecture

abstract: Rudyak's conjecture states that cat$(M) \geq$ cat$(N)$ given a degree one map $f:M \to N$ between closed manifolds. We generalize this conjecture to sectional category, and follow the methodology of [5] to get the following result: Given a normal map of degree one $f:M \to N$ between smooth closed manifolds, fibrations $p^M:E^M \to M$ and $p^N:E^N \to N$, and lift $\overline{f}$ of $f$ with respect to $p^M$ and $p^N$, i.e., $fp^M = \overline{f} p^N$; then if $f$ has no surgery obstructions and $N$ satisfies the inequality $5 \leq \dim N \leq 2r$ secat$(p^N) - 3$ (where the fiber of $p^N$ is $(r-2)$-connected for some $r \geq 1$), then secat$(p^M) \geq$secat$(p^N)$. Finally, we apply this result to the case of higher topological complexity when $N$ is simply connected.


title: The Altered State of $\eta$Carinae: HST's Photometric Record 1998--2021

abstract: Hubble Space Telescope photometry of $\eta$ Carinae spans 23 years, including five spectroscopic events. The rapid brightening rate decreased after 2010, and the spectroscopic events in 2014 and 2020 had light curves different from their predecessors. Together with other indicators, these developments probably foretell the conclusion of $\eta$ Car's change of state.


title: Detecting Propaganda Techniques in Memes

abstract: Propaganda can be defined as a form of communication that aims to influence the opinions or the actions of people towards a specific goal; this is achieved by means of well-defined rhetorical and psychological devices. Propaganda, in the form we know it today, can be dated back to the beginning of the 17th century. However, it is with the advent of the Internet and the social media that it has started to spread on a much larger scale than before, thus becoming major societal and political issue. Nowadays, a large fraction of propaganda in social media is multimodal, mixing textual with visual content. With this in mind, here we propose a new multi-label multimodal task: detecting the type of propaganda techniques used in memes. We further create and release a new corpus of 950 memes, carefully annotated with 22 propaganda techniques, which can appear in the text, in the image, or in both. Our analysis of the corpus shows that understanding both modalities together is essential for detecting these techniques. This is further confirmed in our experiments with several state-of-the-art multimodal models.


title: Fractional integration of summable functions: Maz'ya's $\Phi$-inequalities

abstract: We study the inequalities of the type $|\int_{\mathbb{R}^d} \Phi(K*f)| \lesssim \|f\|_{L_1(\mathbb{R}^d)}^p$, where the kernel $K$ is homogeneous of order $\alpha - d$ and possibly vector-valued, the function $\Phi$ is positively $p$-homogeneous, and $p = d/(d-\alpha)$. Under mild regularity assumptions on $K$ and $\Phi$, we find necessary and sufficient conditions on these functions under which the inequality holds true with a uniform constant for all sufficiently regular functions $f$.


title: Singular equivalences of Morita type with level, Gorenstein algebras, and universal deformation rings

abstract: Let $\mathbf{k}$ be a field of arbitrary characteristic, let $\Lambda$ be a finite dimensional $\mathbf{k}$-algebra, and let $V$ be an indecomposable finitely generated non-projective Gorenstein-projective left $\Lambda$-module whose stable endomorphism ring is isomorphic to $\mathbf{k}$. In this article, we prove that the universal deformation rings $R(\Lambda,V)$ and $R(\Lambda,\Omega_\Lambda V)$ are isomorphic, where $\Omega_\Lambda V$ denotes the first syzygy of $V$ as a left $\Lambda$-module. We also prove the following result. Assume that $\Lambda$ is Gorenstein and that $\Gamma$ is another Gorenstein $\mathbf{k}$-algebra such that there exists $\ell \geq 0$ and a pair of bimodules $({_\Gamma}X_\Lambda, {_\Lambda}Y_\Gamma)$ that induces a singular equivalence of Morita type with level $\ell$ (as introduced by Z. Wang) between $\Lambda$ and $\Gamma$. Then the left $\Gamma$-module $X\otimes_\Lambda V$ is also Gorenstein-projective with stable endomorphism ring isomorphic to $\mathbf{k}$ and the universal deformation ring $R(\Gamma, X\otimes_\Lambda V)$ is isomorphic to $R(\Lambda, V)$.


title: Molecule-molecule and atom-molecule collisions with ultracold RbCs molecules

abstract: Understanding ultracold collisions involving molecules is of fundamental importance for current experiments, where inelastic collisions typically limit the lifetime of molecular ensembles in optical traps. Here we present a broad study of optically trapped ultracold RbCs molecules in collisions with one another, in reactive collisions with Rb atoms, and in nonreactive collisions with Cs atoms. For experiments with RbCs alone, we show that by modulating the intensity of the optical trap, such that the molecules spend 75% of each modulation cycle in the dark, we partially suppress collisional loss of the molecules. This is evidence for optical excitation of molecule pairs mediated via sticky collisions. We find that the suppression is less effective for molecules not prepared in the spin-stretched hyperfine ground state. This may be due either to longer lifetimes for complexes or to laser-free decay pathways. For atom-molecule mixtures, RbCs+Rb and RbCs+Cs, we demonstrate that the rate of collisional loss of molecules scales linearly with the density of atoms. This indicates that, in both cases, the loss of molecules is rate-limited by two-body atom-molecule processes. For both mixtures, we measure loss rates that are below the thermally averaged universal limit.


title: Super-resolution data assimilation

abstract: Increasing the resolution of a model can improve the performance of a data assimilation system: first because model field are in better agreement with high resolution observations, then the corrections are better sustained and, with ensemble data assimilation, the forecast error covariances are improved. However, resolution increase is associated with a cubical increase of the computational costs. Here we are testing an approach inspired from images super-resolution techniques and called "Super-resolution data assimilation" (SRDA). Starting from a low-resolution forecast, a neural network (NN) emulates a high-resolution field that is then used to assimilate high-resolution observations. We apply the SRDA to a quasi-geostrophic model representing simplified surface ocean dynamics, with a model resolution up to four times lower than the reference high-resolution and we use the Ensemble Kalman Filter data assimilation method. We show that SRDA outperforms the low-resolution data assimilation approach and a SRDA version with cubic spline interpolation instead of NN. The NN's ability to anticipate the systematic differences between low and high resolution model dynamics explains the enhanced performance, for example by correcting the difference of propagation speed of eddies. Increasing the computational cost by 55\% above the LR data assimilation system (using a 25-members ensemble), the SRDA reduces the errors by 40\% making the performance very close to the HR system (16\% larger, compared to 92\% larger for the LR EnKF). The reliability of the ensemble system is not degraded by SRDA.

categories: physics.ao-ph cs.LG nlin.CD physics.comp-ph physics.data-an


title: On the design of particle filters inspired by animal noses

abstract: Passive filtering is a common strategy used to reduce airborne disease transmission and particulate contaminants in buildings and individual covers. The engineering of high-performance filters with relatively low flow resistance but high virus- or particle-blocking efficiency is a nontrivial problem of paramount relevance, as evidenced in the variety of industrial filtration systems and the worldwide use of face masks. In this case, standard N95-level covers have high virus-blocking efficiency, but they can cause breathing discomfort. Next-generation industrial filters and masks should retain sufficiently small droplets and aerosols while having low resistance. We introduce a novel 3D printable particle filter inspired by animals' complex nasal anatomy. Unlike standard random-media-based filters, the proposed concept relies on equally spaced channels with tortuous airflow paths. These two strategies induce distinct effects: a reduced resistance and a high likelihood of particle trapping by altering their trajectories with tortuous paths and induced local flow instability. The structures are tested for pressure drop and particle filtering efficiency over a wide range of airflow rates. We have also cross-validated the observed efficiency through numerical simulations. The designed filters exhibit a lower pressure drop than the commercial mask and air filters (N95, surgical, and high-efficiency particulate air (HEPA)). The concept provides a new approach to developing scalable, flexible, high-efficiency air filters for various engineering applications.


title: Characteristic of Paddle Squeezing Angle and AMBU Bag Air Volume in Bag Valve Mask Ventilator

abstract: In the COVID-19 period, the number of deaths has increased every day around the world. The pandemic has impacted the life and economy. Especially, there is a shortage in medical including a lack of technology, facility and equipment. One of those, ventilators are the essential equipment that does not provide enough requirements for the hospital. A ventilator is an essential unit in hospitals because it seems to be the first step to protect the life of the patient getting sick. Some low-income countries aim to make a simple ventilator using locally available and low-cost materials for primary care and palliative care. One of the simple principles of ventilators is to adopt an artificial manual breath unit (AMBU) bag with paddles. Unfortunately, the squeezing angle of paddles is not proportional to the exhaust air volume from the AMBU bag. This paper analyzes the character of the squeezing angle of the paddles and the exhaust air volume of the adult AMBU bag through experiments. The result can be used to control the squeezing angle through a DC motor mounted with paddles to obtain the desired air volume.


title: The pitfalls of using open data to develop deep learning solutions for COVID-19 detection in chest X-rays

abstract: Since the emergence of COVID-19, deep learning models have been developed to identify COVID-19 from chest X-rays. With little to no direct access to hospital data, the AI community relies heavily on public data comprising numerous data sources. Model performance results have been exceptional when training and testing on open-source data, surpassing the reported capabilities of AI in pneumonia-detection prior to the COVID-19 outbreak. In this study impactful models are trained on a widely used open-source data and tested on an external test set and a hospital dataset, for the task of classifying chest X-rays into one of three classes: COVID-19, non-COVID pneumonia and no-pneumonia. Classification performance of the models investigated is evaluated through ROC curves, confusion matrices and standard classification metrics. Explainability modules are implemented to explore the image features most important to classification. Data analysis and model evaluations show that the popular open-source dataset COVIDx is not representative of the real clinical problem and that results from testing on this are inflated. Dependence on open-source data can leave models vulnerable to bias and confounding variables, requiring careful analysis to develop clinically useful/viable AI tools for COVID-19 detection in chest X-rays.


title: Predicting Users' Value Changes by the Friends' Influence from Social Media Usage

abstract: Basic human values represent a set of values such as security, independence, success, kindness, and pleasure, which we deem important to our lives. Each of us holds different values with different degrees of significance. Existing studies show that values of a person can be identified from their social network usage. However, the value priority of a person may change over time due to different factors such as life experiences, influence, social structure and technology. Existing studies do not conduct any analysis regarding the change of users' value from the social influence, i.e., group persuasion, form the social media usage. In our research, first, we predict users' value score by the influence of friends from their social media usage. We propose a Bounded Confidence Model (BCM) based value dynamics model from 275 different ego networks in Facebook that predicts how social influence may persuade a person to change their value over time. Then, to predict better, we use particle swarm optimization based hyperparameter tuning technique. We observe that these optimized hyperparameters produce accurate future value score. We also run our approach with different machine learning based methods and find support vector regression (SVR) outperforms other regressor models. By using SVR with the best hyperparameters of BCM model, we find the lowest Mean Squared Error (MSE) score 0.00347.


title: Meta-Path-based Fake News Detection Leveraging Multi-level Social Context Information

abstract: Fake news, false or misleading information presented as news, has a significant impact on many aspects of society, such as in politics or healthcare domains. Due to the deceiving nature of fake news, applying Natural Language Processing (NLP) techniques to the news content alone is insufficient. The multi-level social context information (news publishers and engaged users in social media) and temporal information of user engagement are important information in fake news detection. The proper usage of this information, however, introduces three chronic difficulties: 1) multi-level social context information is hard to be used without information loss, 2) temporal information is hard to be used along with multi-level social context information, 3) news representation with multi-level social context and temporal information is hard to be learned in an end-to-end manner. To overcome all three difficulties, we propose a novel fake news detection framework, Hetero-SCAN. We use Meta-Path to extract meaningful multi-level social context information without loss. Meta-Path, a composite relation connecting two node types, is proposed to capture the semantics in the heterogeneous graph. We then propose Meta-Path instance encoding and aggregation methods to capture the temporal information of user engagement and produce news representation end-to-end. According to our experiment, Hetero-SCAN yields significant performance improvement over state-of-the-art fake news detection methods.


title: The Concept of Semantic Value in Social Network Analysis: an Application to Comparative Mythology

abstract: Human sciences have traditionally relied on human reasoning and intelligence to infer knowledge from a wide range of sources, such as oral and written narrations, reports, and traditions. Here we develop an extension of classical social network analysis approaches to incorporate the concept of meaning in each actor, as a mean to quantify and infer further knowledge from the original source of the network. This extension is based on a new affinity function, the semantic affinity, that establishes fuzzy-like relationships between the different actors in the network, using combinations of affinity functions. We also propose a new heuristic algorithm based on the shortest capacity problem to compute this affinity function. We use these concept of meaning and semantic affinity to analyze and compare the gods and heroes from three different classical mythologies: Greek, Celtic and Nordic. We study the relationships of each individual mythology and those of common structure that is formed when we fuse the three of them. We show a strong connection between the Celtic and Nordic gods and that Greeks put more emphasis on heroic characters rather than deities. Our approach provides a technique to highlight and quantify important relationships in the original domain of the network not deducible from its structural properties.


title: Semi-Supervised Wide-Angle Portraits Correction by Multi-Scale Transformer

abstract: We propose a semi-supervised network for wide-angle portraits correction. Wide-angle images often suffer from skew and distortion affected by perspective distortion, especially noticeable at the face regions. Previous deep learning based approaches need the ground-truth correction flow maps for training guidance. However, such labels are expensive, which can only be obtained manually. In this work, we design a semi-supervised scheme and build a high-quality unlabeled dataset with rich scenarios, allowing us to simultaneously use labeled and unlabeled data to improve performance. Specifically, our semi-supervised scheme takes advantage of the consistency mechanism, with several novel components such as direction and range consistency (DRC) and regression consistency (RC). Furthermore, different from the existing methods, we propose the Multi-Scale Swin-Unet (MS-Unet) based on the multi-scale swin transformer block (MSTB), which can simultaneously learn short-distance and long-distance information to avoid artifacts. Extensive experiments demonstrate that the proposed method is superior to the state-of-the-art methods and other representative baselines. The source code and dataset are available at: https://github.com/megvii-research/Portraits_Correction.


title: Scaling Up Silicon Photonic-based Accelerators: Challenges and Opportunities

abstract: Digital accelerators in the latest generation of CMOS processes support multiply and accumulate (MAC) operations at energy efficiencies spanning 10-to-100~fJ/Op. But the operating speed for such MAC operations are often limited to a few hundreds of MHz. Optical or optoelectronic MAC operations on today's SOI-based silicon photonic integrated circuit platforms can be realized at a speed of tens of GHz, leading to much lower latency and higher throughput. In this paper, we study the energy efficiency of integrated silicon photonic MAC circuits based on Mach-Zehnder modulators and microring resonators. We describe the bounds on energy efficiency and scaling limits for NxN optical networks with today's technology, based on the optical and electrical link budget. We also describe research directions that can overcome the current limitations.


title: EVAGAN: Evasion Generative Adversarial Network for Low Data Regimes

abstract: A myriad of recent literary works has leveraged generative adversarial networks (GANs) to generate unseen evasion samples. The purpose is to annex the generated data with the original train set for adversarial training to improve the detection performance of machine learning (ML) classifiers. The quality of generated adversarial samples relies on the adequacy of training data samples. However, in low data regimes like medical diagnostic imaging and cybersecurity, the anomaly samples are scarce in number. This paper proposes a novel GAN design called Evasion Generative Adversarial Network (EVAGAN) that is more suitable for low data regime problems that use oversampling for detection improvement of ML classifiers. EVAGAN not only can generate evasion samples, but its discriminator can act as an evasion-aware classifier. We have considered Auxiliary Classifier GAN (ACGAN) as a benchmark to evaluate the performance of EVAGAN on cybersecurity (ISCX-2014, CIC-2017 and CIC2018) botnet and computer vision (MNIST) datasets. We demonstrate that EVAGAN outperforms ACGAN for unbalanced datasets with respect to detection performance, training stability and time complexity. EVAGAN's generator quickly learns to generate the low sample class and hardens its discriminator simultaneously. In contrast to ML classifiers that require security hardening after being adversarially trained by GAN-generated data, EVAGAN renders it needless. The experimental analysis proves that EVAGAN is an efficient evasion hardened model for low data regimes for the selected cybersecurity and computer vision datasets. Code will be available at HTTPS://www.github.com/rhr407/EVAGAN.


title: Robust Stability Analysis of an Uncertain Aircraft Model with Scalar Parametric Uncertainty

abstract: A robust controller is specified, and the stability bounds of the uncertain closed-loop system are determined using the small gain, circle, positive real, and Popov criteria. A graphical approach is employed in order to demonstrate the ease with which the above robustness tests can be carried out on a problem of practical interest. A significant improvement in stability bounds is observed as the analysis moves from the small gain test to the circle, positive real, and Popov tests. In particular, small gain analysis results in the most conservative robust stability bounds, while Popov analysis yields significantly less conservative bounds. This is because traditional small gain type tests allow the uncertainty to be arbitrarily time-varying, whereas Popov analysis restricts the uncertainty to be constant, real parametric uncertainty. Therefore, the results reported here indicate the conservatism associated with small gain analysis, and the effectiveness of Popov analysis, in gauging robust stability in the presence of constant, real parametric uncertainty.


title: Neural Architecture Search in operational context: a remote sensing case-study

abstract: Deep learning has become in recent years a cornerstone tool fueling key innovations in the industry, such as autonomous driving. To attain good performances, the neural network architecture used for a given application must be chosen with care. These architectures are often handcrafted and therefore prone to human biases and sub-optimal selection. Neural Architecture Search (NAS) is a framework introduced to mitigate such risks by jointly optimizing the network architectures and its weights. Albeit its novelty, it was applied on complex tasks with significant results - e.g. semantic image segmentation. In this technical paper, we aim to evaluate its ability to tackle a challenging operational task: semantic segmentation of objects of interest in satellite imagery. Designing a NAS framework is not trivial and has strong dependencies to hardware constraints. We therefore motivate our NAS approach selection and provide corresponding implementation details. We also present novel ideas to carry out other such use-case studies.


title: Image Captioning for Effective Use of Language Models in Knowledge-Based Visual Question Answering

abstract: Integrating outside knowledge for reasoning in visio-linguistic tasks such as visual question answering (VQA) is an open problem. Given that pretrained language models have been shown to include world knowledge, we propose to use a unimodal (text-only) train and inference procedure based on automatic off-the-shelf captioning of images and pretrained language models. Our results on a visual question answering task which requires external knowledge (OK-VQA) show that our text-only model outperforms pretrained multimodal (image-text) models of comparable number of parameters. In contrast, our model is less effective in a standard VQA task (VQA 2.0) confirming that our text-only method is specially effective for tasks requiring external knowledge. In addition, we show that increasing the language model's size improves notably its performance, yielding results comparable to the state-of-the-art with our largest model, significantly outperforming current multimodal systems, even though augmented with external knowledge. Our qualitative analysis on OK-VQA reveals that automatic captions often fail to capture relevant information in the images, which seems to be balanced by the better inference ability of the text-only language models. Our work opens up possibilities to further improve inference in visio-linguistic tasks