title: Shared-Memory n-level Hypergraph Partitioning

abstract: We present a shared-memory algorithm to compute high-quality solutions to the balanced $k$-way hypergraph partitioning problem. This problem asks for a partition of the vertex set into $k$ disjoint blocks of bounded size that minimizes the connectivity metric (i.e., the sum of the number of different blocks connected by each hyperedge). High solution quality is achieved by parallelizing the core technique of the currently best sequential partitioner KaHyPar: the most extreme $n$-level version of the widely used multilevel paradigm, where only a single vertex is contracted on each level. This approach is made fast and scalable through intrusive algorithms and data structures that allow precise control of parallelism through atomic operations and fine-grained locking. We perform extensive experiments on more than 500 real-world hypergraphs with up to $140$ million vertices and two billion pins (sum of hyperedge sizes). We find that our algorithm computes solutions that are on par with a comparable configuration of KaHyPar while being an order of magnitude faster on average. Moreover, we show that recent non-multilevel algorithms specifically designed to partition large instances have considerable quality penalties and no clear advantage in running time.


title: Cross-Modal Retrieval Augmentation for Multi-Modal Classification

abstract: Recent advances in using retrieval components over external knowledge sources have shown impressive results for a variety of downstream tasks in natural language processing. Here, we explore the use of unstructured external knowledge sources of images and their corresponding captions for improving visual question answering (VQA). First, we train a novel alignment model for embedding images and captions in the same space, which achieves substantial improvement in performance on image-caption retrieval w.r.t. similar methods. Second, we show that retrieval-augmented multi-modal transformers using the trained alignment model improve results on VQA over strong baselines. We further conduct extensive experiments to establish the promise of this approach, and examine novel applications for inference time such as hot-swapping indices.


title: Split Learning Meets Koopman Theory for Wireless Remote Monitoring and Prediction

abstract: Remote state monitoring over wireless is envisaged to play a pivotal role in enabling beyond 5G applications ranging from remote drone control to remote surgery. One key challenge is to identify the system dynamics that is non-linear with a large dimensional state. To obviate this issue, in this article we propose to train an autoencoder whose encoder and decoder are split and stored at a state sensor and its remote observer, respectively. This autoencoder not only decreases the remote monitoring payload size by reducing the state representation dimension, but also learns the system dynamics by lifting it via a Koopman operator, thereby allowing the observer to locally predict future states after training convergence. Numerical results under a non-linear cart-pole environment demonstrate that the proposed split learning of a Koopman autoencoder can locally predict future states, and the prediction accuracy increases with the representation dimension and transmission power.


title: LU-BZU at SemEval-2021 Task 2: Word2Vec and Lemma2Vec performance in Arabic Word-in-Context disambiguation

abstract: This paper presents a set of experiments to evaluate and compare between the performance of using CBOW Word2Vec and Lemma2Vec models for Arabic Word-in-Context (WiC) disambiguation without using sense inventories or sense embeddings. As part of the SemEval-2021 Shared Task 2 on WiC disambiguation, we used the dev.ar-ar dataset (2k sentence pairs) to decide whether two words in a given sentence pair carry the same meaning. We used two Word2Vec models: Wiki-CBOW, a pre-trained model on Arabic Wikipedia, and another model we trained on large Arabic corpora of about 3 billion tokens. Two Lemma2Vec models was also constructed based on the two Word2Vec models. Each of the four models was then used in the WiC disambiguation task, and then evaluated on the SemEval-2021 test.ar-ar dataset. At the end, we reported the performance of different models and compared between using lemma-based and word-based models.


title: NeuroRAN: Rethinking Virtualization for AI-native Radio Access Networks in 6G

abstract: Network softwarization has revolutionized the architecture of cellular wireless networks. State-of-the-art container based virtual radio access networks (vRAN) provide enormous flexibility and reduced life cycle management costs, but they also come with prohibitive energy consumption. We argue that for future AI-native wireless networks to be flexible and energy efficient, there is a need for a new abstraction in network softwarization that caters for neural network type of workloads and allows a large degree of service composability. In this paper we present the NeuroRAN architecture, which leverages stateful function as a user facing execution model, and is complemented with virtualized resources and decentralized resource management. We show that neural network based implementations of common transceiver functional blocks fit the proposed architecture, and we discuss key research challenges related to compilation and code generation, resource management, reliability and security.


title: Grassmann Iterative Linear Discriminant Analysis with Proxy Matrix Optimization

abstract: Linear Discriminant Analysis (LDA) is commonly used for dimensionality reduction in pattern recognition and statistics. It is a supervised method that aims to find the most discriminant space of reduced dimension that can be further used for classification. In this work, we present a Grassmann Iterative LDA method (GILDA) that is based on Proxy Matrix Optimization (PMO). PMO makes use of automatic differentiation and stochastic gradient descent (SGD) on the Grassmann manifold to arrive at the optimal projection matrix. Our results show that GILDAoutperforms the prevailing manifold optimization method.


title: On the Use of Field RR Lyrae as Galactic Probes. III. The $\alpha$-element abundances

abstract: We provide the largest and most homogeneous sample of $\alpha$-element (Mg, Ca, Ti) and iron abundances for field RR Lyrae (RRLs, 162 variables) by using high-resolution spectra. The current measurements were complemented with similar abundances available in the literature for 46 field RRLs brought to our metallicity scale. We ended up with a sample of old (t$\ge$ 10 Gyr), low-mass stellar tracers (208 RRLs: 169 fundamental, 38 first overtone, 1 mixed mode) covering three dex in iron abundance (-3.00$\le$[Fe/H]$\le$0.24). We found that field RRLs are $\sim$0.3 dex more $\alpha$-poor than typical Halo tracers in the metal-rich regime, ([Fe/H]$\ge$-1.2) while in the metal-poor regime ([Fe/H]$\le$-2.2) they seem to be on average $\sim$0.1 dex more $\alpha$-enhanced. This is the first time that the depletion in $\alpha$-elements for solar iron abundances is detected on the basis of a large, homogeneous and coeval sample of old stellar tracers. Interestingly, we also detected a close similarity in the [$\alpha$/Fe] trend between $\alpha$-poor, metal-rich RRLs and red giants (RGs) in the Sagittarius dwarf galaxy as well as between $\alpha$-enhanced, metal-poor RRLs and RGs in ultra faint dwarf galaxies. These results are supported by similar elemental abundances for 46 field Horizontal Branch (HB) stars. These stars share with RRLs the same evolutionary phase and the same progenitors. This evidence further supports the key role that old stellar tracers play in constraining the early chemical enrichment of the Halo and, in particular, in investigating the impact that dwarf galaxies have had in the mass assembly of the Galaxy.


title: AI-driven Bayesian inference of statistical microstructure descriptors from finite-frequency waves

abstract: The ability to image materials at the microscale from long-wavelength wave data is a major challenge to the geophysical, engineering and medical fields. Here, we present a framework to constrain microstructure geometry and properties from long-scale waves. To realistically quantify microstructures we use two-point statistics, from which we derive scale-dependent effective wave properties - wavespeed and attenuation - using strong-contrast expansions (SCE) for (visco)elastic wavefields. By evaluating various two-point correlation functions we observe that both effective wavespeeds and attenuation of long-scale waves predominantly depend on volume fraction and phase properties, and that especially attenuation at small scales is highly sensitive to the geometry of microstructure heterogeneity (e.g. geometric hyperuniformity) due to incoherent inference of sub-wavelength multiple scattering. Our goal is to infer microstructure properties from observed effective wave parameters. To this end, we use the supervised machine learning method of Random Forests (RF) to construct a Bayesian inference approach. We can accurately resolve two-point correlation functions sampled from various microstructural configurations, including: a bead pack, Berea sandstone and Ketton limestone samples. Importantly, we show that inversion of small scale-induced effective elastic waves yields the best results, particularly compared to single-wave-mode (e.g., acoustic only) information. Additionally, we show that the retrieval of microscale medium contrasts is more difficult - as it is highly ill-posed - and can only be achieved with specific a priori knowledge. Our results are promising for many applications, such as earthquake hazard monitoring,non-destructive testing, imaging fluid flow in porous media, quantifying tissue properties in medical ultrasound, or designing materials with tailor-made wave properties.


title: Schauder estimates up to the boundary on H-type groups: an approach via the double layer potential

abstract: We establish the Schauder estimates at the boundary away from the characteristic points for the Dirichlet problem by means of the double layer potential in a Heisenberg-type group $\mathbb{G}$. Despite its singularity we manage to invert the double layer potential restricted to the boundary thanks to a reflection technique for an approximate operator in $\mathbb{G}$. This is the first instance where a reflection-type argument appears to be useful in the sub-Riemannian setting.


title: Temporal Adaptation of BERT and Performance on Downstream Document Classification: Insights from Social Media

abstract: Language use differs between domains and even within a domain, language use changes over time. For pre-trained language models like BERT, domain adaptation through continued pre-training has been shown to improve performance on in-domain downstream tasks. In this article, we investigate whether temporal adaptation can bring additional benefits. For this purpose, we introduce a corpus of social media comments sampled over three years. It contains unlabelled data for adaptation and evaluation on an upstream masked language modelling task as well as labelled data for fine-tuning and evaluation on a downstream document classification task. We find that temporality matters for both tasks: temporal adaptation improves upstream and temporal fine-tuning downstream task performance. Time-specific models generally perform better on past than on future test sets, which matches evidence on the bursty usage of topical words. However, adapting BERT to time and domain does not improve performance on the downstream task over only adapting to domain. Token-level analysis shows that temporal adaptation captures event-driven changes in language use in the downstream task, but not those changes that are actually relevant to task performance. Based on our findings, we discuss when temporal adaptation may be more effective.


title: Minimal microscopic model for liquid polyamorphism and water-like anomalies

abstract: Liquid polyamorphism is the intriguing possibility for a single component substance to exist in multiple liquid phases. We propose a minimal model for this phenomenon. Starting with a binary lattice model with critical azeotropy and liquid-liquid demixing, we allow interconversion of the two species, turning the system into a single-component fluid with two states differing in energy and entropy. Unveiling the phase diagram of the non-interconverting binary mixture gives unprecedented insight on the phase behaviors accessible to the interconverting fluid, such as a liquid-liquid transition with a critical point, or a singularity-free scenario, exhibiting thermodynamic anomalies without polyamorphism. The model provides a unified theoretical framework to describe supercooled water and a variety of polyamorphic liquids with water-like anomalies.


title: Modeling the COVID-19 pandemic: A primer and overview of mathematical epidemiology

abstract: Since the start of the still ongoing COVID-19 pandemic, there have been many modeling efforts to assess several issues of importance to public health. In this work, we review the theory behind some important mathematical models that have been used to answer questions raised by the development of the pandemic. We start revisiting the basic properties of simple Kermack-McKendrick type models. Then, we discuss extensions of such models and important epidemiological quantities applied to investigate the role of heterogeneity in disease transmission e.g. mixing functions and superspreading events, the impact of non-pharmaceutical interventions in the control of the pandemic, vaccine deployment, herd-immunity, viral evolution and the possibility of vaccine escape. From the perspective of mathematical epidemiology, we highlight the important properties, findings, and, of course, deficiencies, that all these models have.


title: Amplification of Elliptically Polarized Sub-Femtosecond Pulses in IR-Field-Dressed Neon-Like Active Medium of a Plasma-Based X-ray Laser

abstract: We propose a method for amplifying a train of sub-femtosecond pulses of circularly or elliptically polarized extreme ultraviolet (XUV) radiation constituted by high-order harmonics of an infrared (IR) laser field, in a neon-like active medium of a plasma-based X-ray laser, additionally irradiated with a replica of a fundamental frequency IR field. It is shown that the ellipticity of the pulses can be maintained or increased during the amplification process. The experimental implementation is suggested in an active medium of an X-ray laser based on neon-like Ti^{12+} ions irradiated by an IR laser field with a wavelength of 3.9 microns.


title: Orthogonal Features Based EEG Signals Denoising Using Fractional and Compressed One-Dimensional CNN AutoEncoder

abstract: This paper presents a fractional one-dimensional convolutional neural network (CNN) autoencoder for denoising the Electroencephalogram (EEG) signals which often get contaminated with noise during the recording process, mostly due to muscle artifacts (MA), introduced by the movement of muscles. The existing EEG denoising methods make use of decomposition, thresholding and filtering techniques. In the proposed approach, EEG signals are first transformed to orthogonal domain using Tchebichef moments before feeding to the proposed architecture. A new hyper-parameter ($\alpha$) is introduced which refers to the fractional order with respect to which gradients are calculated during back-propagation. It is observed that by tuning $\alpha$, the quality of the restored signal improves significantly. Motivated by the high usage of portable low energy devices which make use of compressed deep learning architectures, the trainable parameters of the proposed architecture are compressed using randomized singular value decomposition (RSVD) algorithm. The experiments are performed on the standard EEG datasets, namely, Mendeley and Bonn. The study shows that the proposed fractional and compressed architecture performs better than existing state-of-the-art signal denoising methods.


title: Coherent control in atomic chains: to trap and release a traveling excitation

abstract: We introduce a protocol for dynamical dispersion engineering in an atomic chain consisting of an ordered array of multi-level atoms with subwavelength lattice constant. This chain supports dark states that are protected from dissipation in the form of photon emission and can be understood as propagating spin waves traveling along the array. By using an external control field with a spatially-varying elliptical polarization we correlate internal and external degrees of freedom of the array in a controllable way. The coherent control over the atomic states translates into control over the group velocity of the spin waves. A traveling excitation can be stored and released without dissipation by adiabatically changing the control field amplitude. This protocol is an alternative to the more conventional electromagnetically-induced transparency, and exemplifies the rich physics born of the interplay between coherent control and correlated decay.


title: Benchmarking Machine Learning Techniques for THz Channel Estimation Problems

abstract: Terahertz communication is one of the most promising wireless communication technologies for 6G generation and beyond. For THz systems to be practically adopted, channel estimation is one of the key issues. We consider the problem of channel modeling and estimation with deterministic channel propagation and the related physical characteristics of THz bands, and benchmark various machine learning algorithms to estimate THz channel, including neural networks (NN), logistic regression (LR), and projected gradient ascent (PGA). Numerical results show that PGA algorithm yields the most promising performance at SNR=0 dB with NMSE of -12.8 dB.


title: A context-aware pedestrian trajectory prediction framework for automated vehicles

abstract: With the unprecedented shift towards automated urban environments in recent years, a new paradigm is required to study pedestrian behaviour. Studying pedestrian behaviour in futuristic scenarios requires modern data sources that consider both the Automated Vehicle (AV) and pedestrian perspectives. Current open datasets on AVs predominantly fail to account for the latter, as they do not include an adequate number of events and associated details that involve pedestrian and vehicle interactions. To address this issue, we propose using Virtual Reality (VR) data as a complementary resource to current datasets, which can be designed to measure pedestrian behaviour under specific conditions. In this research, we focus on the context-aware pedestrian trajectory prediction framework for automated vehicles at mid-block unsignalized crossings. For this purpose, we develop a novel multi-input network of Long Short-Term Memory (LSTM) and fully connected dense layers. In addition to past trajectories, the proposed framework incorporates pedestrian head orientations and distance to the upcoming vehicles as sequential input data. By merging the sequential data with contextual information of the environment, we train a model to predict the future pedestrian trajectory. Our results show that the prediction error and overfitting to the training data are reduced by considering contextual information in the model. To analyze the application of the methods to real AV data, the proposed framework is trained and applied to pedestrian trajectory extracted from an open-access video dataset. Finally, by implementing a game theory-based model interpretability method, we provide detailed insights and propose recommendations to improve the current automated vehicle sensing systems from a pedestrian-oriented point of view.


title: Large spin-to-charge conversion at room temperature in extended epitaxial Sb2Te3 topological insulator chemically grown on Silicon

abstract: Spin-charge interconversion phenomena at the interface between magnetic materials and topological insulators (TIs) are attracting enormous interest in the research effort towards the development of fast and ultra-low power devices for the future information and communication technology. We report a large spin-to-charge conversion efficiency in Au/Co/Au/Sb2Te3/Si(111) heterostructures based on Sb2Te3 TIs grown by metal organic chemical vapor deposition on 4 inches Si(111) substrates. By conducting room temperature spin pumping ferromagnetic resonance, we measure an inverse Edelstein Effect length {\lambda}IEE up to 0.75 nm, a record value for 3-dimensional chalcogenide-based TIs heterostructures. Our results open the path toward the use of chemical methods to produce TIs on large area Si substrates and characterized by highly performing spin-charge conversion, thus marking a milestone toward future technology-transfer.


title: Amplification and ellipticity enhancement of sub-femtosecond XUV pulses in IR-field-dressed neon-like active medium of a plasma-based X-ray laser

abstract: In [I.R. Khairulin et al., submitted to Phys. Rev. Lett.] we propose a method for amplifying a train of sub-femtosecond pulses of circularly or elliptically polarized extreme ultraviolet (XUV) radiation, constituted by high-order harmonics of an infrared (IR) laser field, in a neon-like active medium of a plasma-based X-ray laser, additionally irradiated with a replica of a fundamental frequency laser field used to generate harmonics, and show the possibility of maintaining or enhancing the ellipticity of high-harmonic radiation during its amplification. In the present paper we describe this process in detail both for a single harmonic component and a sub-femtosecond pulse train formed by a set of harmonics. We derive the analytical theory and describe both analytically and numerically the evolution of the high-harmonic field during its propagation through the medium. We discuss also the possibility of an experimental implementation of the suggested technique in an active medium of an X-ray laser based on neon-like Ti^{12+} ions irradiated by an IR laser field with a wavelength of 3.9 microns.


title: Exploiting Global and Local Attentions for Heavy Rain Removal on Single Images

abstract: Heavy rain removal from a single image is the task of simultaneously eliminating rain streaks and fog, which can dramatically degrade the quality of captured images. Most existing rain removal methods do not generalize well for the heavy rain case. In this work, we propose a novel network architecture consisting of three sub-networks to remove heavy rain from a single image without estimating rain streaks and fog separately. The first sub-net, a U-net-based architecture that incorporates our Spatial Channel Attention (SCA) blocks, extracts global features that provide sufficient contextual information needed to remove atmospheric distortions caused by rain and fog. The second sub-net learns the additive residues information, which is useful in removing rain streak artifacts via our proposed Residual Inception Modules (RIM). The third sub-net, the multiplicative sub-net, adopts our Channel-attentive Inception Modules (CIM) and learns the essential brighter local features which are not effectively extracted in the SCA and additive sub-nets by modulating the local pixel intensities in the derained images. Our three clean image results are then combined via an attentive blending block to generate the final clean image. Our method with SCA, RIM, and CIM significantly outperforms the previous state-of-the-art single-image deraining methods on the synthetic datasets, shows considerably cleaner and sharper derained estimates on the real image datasets. We present extensive experiments and ablation studies supporting each of our method's contributions on both synthetic and real image datasets.


title: Hardware Efficient Joint Radar-Communications with Hybrid Precoding and RF Chain Optimization

abstract: In this paper, we aim to achieve energy efficient design with minimum hardware requirement for hybrid precoding, which enables a large number of antennas with minimal number of RF chains, and sub-arrayed multiple-input multiple-output (MIMO) radar based joint radar-communication (JRC) systems. A dynamic active RF chain selection mechanism is implemented in the baseband processing and the energy efficiency (EE) maximization problem is solved using fractional programming to obtain the optimal number of RF chains at the current channel state. Subsequently hybrid precoders are computed employing a sub-arrayed MIMO structure for EE maximization with weighted formulation of the communication and radar metrics, and the solution is based on alternating minimization. The simulation results show that the proposed method with minimum hardware achieves the best EE while maintaining the rate performance, and an efficient trade-off between sensing and communication.


title: Room temperature single-photon emitters in silicon nitride

abstract: Single-photon emitters are essential for enabling several emerging applications in quantum information technology, quantum sensing and quantum communication. Scalable photonic platforms capable of hosting intrinsic or directly embedded sources of single-photon emission are of particular interest for the realization of integrated quantum photonic circuits. Here, we report on the first-time observation of room-temperature single-photon emitters in silicon nitride (SiN) films grown on silicon dioxide substrates. As SiN has recently emerged as one of the most promising materials for integrated quantum photonics, the proposed platform is suitable for scalable fabrication of quantum on-chip devices. Photophysical analysis reveals bright (>$10^5$ counts/s), stable, linearly polarized, and pure quantum emitters in SiN films with the value of the second-order autocorrelation function at zero time delay $g^{(2)}(0)$ below 0.2 at room temperatures. The emission is suggested to originate from a specific defect center in silicon nitride due to the narrow wavelength distribution of the observed luminescence peak. Single-photon emitters in silicon nitride have the potential to enable direct, scalable and low-loss integration of quantum light sources with the well-established photonic on-chip platform.


title: On weak solution of SDE driven by inhomogeneous singular L\'evy noise

abstract: We study a time-inhomogeneous SDE in $\R^d$ driven by a cylindrical L\'evy process with independent coordinates which may have different scaling properties. Such a structure of the driving noise makes it strongly spatially inhomogeneous and complicates the analysis of the model significantly. We prove that the weak solution to the SDE is uniquely defined, is Markov, and has the strong Feller property. The heat kernel of the process is presented as a combination of an explicit `principal part' and a `residual part', subject to certain $L^\infty(dx)\otimes L^1(dy)$ and $L^\infty(dx)\otimes L^\infty(dy)$-estimates showing that this part is negligible in a short time, in a sense. The main tool of the construction is the analytic parametrix method, specially adapted to L\'evy-type generators with strong spatial inhomogeneities.


title: $\{log\}$: Set Formulas as Programs

abstract: $\{log\}$ is a programming language at the intersection of Constraint Logic Programming, set programming and declarative programming. But $\{log\}$ is also a satisfiability solver for a theory of finite sets and finite binary relations. With $\{log\}$ programmers can write abstract programs using all the power of set theory and binary relations. These programs are not very efficient but they are very close to specifications. Then, their correctness is more evident. Furthermore, $\{log\}$ programs are also set formulas. Hence, programmers can use $\{log\}$ again to automatically prove their programs verify non trivial properties. In this paper we show this development methodology by means of several examples.


title: Automatic quality control of brain T1-weighted magnetic resonance images for a clinical data warehouse

abstract: Many studies on machine learning (ML) for computer-aided diagnosis have so far been mostly restricted to high-quality research data. Clinical data warehouses, gathering routine examinations from hospitals, offer great promises for training and validation of ML models in a realistic setting. However, the use of such clinical data warehouses requires quality control (QC) tools. Visual QC by experts is time-consuming and does not scale to large datasets. In this paper, we propose a convolutional neural network (CNN) for the automatic QC of 3D T1-weighted brain MRI for a large heterogeneous clinical data warehouse. To that purpose, we used the data warehouse of the hospitals of the Greater Paris area (Assistance Publique-H\^opitaux de Paris [AP-HP]). Specifically, the objectives were: 1) to identify images which are not proper T1-weighted brain MRIs; 2) to identify acquisitions for which gadolinium was injected; 3) to rate the overall image quality. We used 5000 images for training and validation and a separate set of 500 images for testing. In order to train/validate the CNN, the data were annotated by two trained raters according to a visual QC protocol that we specifically designed for application in the setting of a data warehouse. For objectives 1 and 2, our approach achieved excellent accuracy (balanced accuracy and F1-score \textgreater 90\%), similar to the human raters. For objective 3, the performance was good but substantially lower than that of human raters. Nevertheless, the automatic approach accurately identified (balanced accuracy and F1-score \textgreater 80\%) low quality images, which would typically need to be excluded. Overall, our approach shall be useful for exploiting hospital data warehouses in medical image computing.


title: A simple and robust Abaqus implementation of the phase field fracture method

abstract: The phase field fracture method is attracting significant interest. Phase field approaches have enabled predicting - on arbitrary geometries and dimensions - complex fracture phenomena such as crack branching, coalescence, deflection and nucleation. In this work, we present a simple and robust implementation of the phase field fracture method in the commercial finite element package Abaqus. The implementation exploits the analogy between the phase field evolution law and the heat transfer equation, enabling the use of Abaqus' in-built features and circumventing the need for defining user elements. The framework is general, and is shown to accommodate different solution schemes (staggered and monolithic), as well as various constitutive choices for preventing damage under compression. The robustness and applicability of the numerical framework presented is demonstrated by addressing several 2D and 3D boundary value problems of particular interest. Focus is on the solution of paradigmatic case studies that are known to be particularly demanding from a convergence perspective. The results reveal that our phase field fracture implementation can be readily combined with other advanced computational features, such as contact, and deliver robust and precise solutions. The code developed can be downloaded from www.empaneda.com/codes.


title: Inverse linear problems on Hilbert space and their Krylov solvability

abstract: This monograph is centred at the intersection of three mathematical topics, that are theoretical in nature, yet with motivations and relevance deep rooted in applications: the linear inverse problems on abstract, in general infinite-dimensional Hilbert space; the notion of Krylov subspace associated to an inverse problem, i.e., the cyclic subspace built upon the datum of the inverse problem by repeated application of the linear operator; the possibility to solve the inverse problem by means of Krylov subspace methods, namely projection methods where the finite-dimensional truncation is made with respect to the Krylov subspace and the approximants converge to an exact solution to the inverse problem.


title: Integrating Domain Knowledge in Data-driven Earth Observation with Process Convolutions

abstract: The modelling of Earth observation data is a challenging problem, typically approached by either purely mechanistic or purely data-driven methods. Mechanistic models encode the domain knowledge and physical rules governing the system. Such models, however, need the correct specification of all interactions between variables in the problem and the appropriate parameterization is a challenge in itself. On the other hand, machine learning approaches are flexible data-driven tools, able to approximate arbitrarily complex functions, but lack interpretability and struggle when data is scarce or in extrapolation regimes. In this paper, we argue that hybrid learning schemes that combine both approaches can address all these issues efficiently. We introduce Gaussian process (GP) convolution models for hybrid modelling in Earth observation (EO) problems. We specifically propose the use of a class of GP convolution models called latent force models (LFMs) for EO time series modelling, analysis and understanding. LFMs are hybrid models that incorporate physical knowledge encoded in differential equations into a multioutput GP model. LFMs can transfer information across time-series, cope with missing observations, infer explicit latent functions forcing the system, and learn parameterizations which are very helpful for system analysis and interpretability. We consider time series of soil moisture from active (ASCAT) and passive (SMOS, AMSR2) microwave satellites. We show how assuming a first order differential equation as governing equation, the model automatically estimates the e-folding time or decay rate related to soil moisture persistence and discovers latent forces related to precipitation. The proposed hybrid methodology reconciles the two main approaches in remote sensing parameter estimation by blending statistical learning and mechanistic modeling.


title: Sharp bounds for the number of regions of maxout networks and vertices of Minkowski sums

abstract: We present results on the number of linear regions of the functions that can be represented by artificial feedforward neural networks with maxout units. A rank-k maxout unit is a function computing the maximum of $k$ linear functions. For networks with a single layer of maxout units, the linear regions correspond to the upper vertices of a Minkowski sum of polytopes. We obtain face counting formulas in terms of the intersection posets of tropical hypersurfaces or the number of upper faces of partial Minkowski sums, along with explicit sharp upper bounds for the number of regions for any input dimension, any number of units, and any ranks, in the cases with and without biases. Based on these results we also obtain asymptotically sharp upper bounds for networks with multiple layers.


title: Approximating the Earth Mover's Distance between sets of geometric objects

abstract: Given two distributions $P$ and $S$ of equal total mass, the Earth Mover's Distance measures the cost of transforming one distribution into the other, where the cost of moving a unit of mass is equal to the distance over which it is moved. We give approximation algorithms for the Earth Mover's Distance between various sets of geometric objects. We give a $(1 + \varepsilon)$-approximation when $P$ is a set of weighted points and $S$ is a set of line segments, triangles or $d$-dimensional simplices. When $P$ and $S$ are both sets of line segments, sets of triangles or sets of simplices, we give a $(1 + \varepsilon)$-approximation with a small additive term. All algorithms run in time polynomial in the size of $P$ and $S$, and actually calculate the transport plan (that is, a specification of how to move the mass), rather than just the cost. To our knowledge, these are the first combinatorial algorithms with a provable approximation ratio for the Earth Mover's Distance when the objects are continuous rather than discrete points.


title: Hierarchical Human-Motion Prediction and Logic-Geometric Programming for Minimal Interference Human-Robot Tasks

abstract: In this paper, we tackle the problem of human-robot coordination in sequences of manipulation tasks. Our approach integrates hierarchical human motion prediction with Task and Motion Planning (TAMP). We first devise a hierarchical motion prediction approach by combining Inverse Reinforcement Learning and short-term motion prediction using a Recurrent Neural Network. In a second step, we propose a dynamic version of the TAMP algorithm Logic-Geometric Programming (LGP). Our version of Dynamic LGP, replans periodically to handle the mismatch between the human motion prediction and the actual human behavior. We assess the efficacy of the approach by training the prediction algorithms and testing the framework on the publicly available MoGaze dataset.


title: It\^{o}--F\"{o}llmer Calculus in Banach Spaces I: The It\^{o} Formula

abstract: We prove F\"{o}llmer's pathwise It\^{o} formula for a Banach space-valued c\`{a}dl\`{a}g path. We also relax the assumption on the sequence of partitions along which we treat the quadratic variation of a path.


title: Towards Variable-Length Textual Adversarial Attacks

abstract: Adversarial attacks have shown the vulnerability of machine learning models, however, it is non-trivial to conduct textual adversarial attacks on natural language processing tasks due to the discreteness of data. Most previous approaches conduct attacks with the atomic \textit{replacement} operation, which usually leads to fixed-length adversarial examples and therefore limits the exploration on the decision space. In this paper, we propose variable-length textual adversarial attacks~(VL-Attack) and integrate three atomic operations, namely \textit{insertion}, \textit{deletion} and \textit{replacement}, into a unified framework, by introducing and manipulating a special \textit{blank} token while attacking. In this way, our approach is able to more comprehensively find adversarial examples around the decision boundary and effectively conduct adversarial attacks. Specifically, our method drops the accuracy of IMDB classification by $96\%$ with only editing $1.3\%$ tokens while attacking a pre-trained BERT model. In addition, fine-tuning the victim model with generated adversarial samples can improve the robustness of the model without hurting the performance, especially for length-sensitive models. On the task of non-autoregressive machine translation, our method can achieve $33.18$ BLEU score on IWSLT14 German-English translation, achieving an improvement of $1.47$ over the baseline model.


title: Structural phase stability, electronic structure, magnetic properties and chemical bonding analysis of transition metal ammine borohydrides with amphoteric hydrogen for hydrogen storage

abstract: Usually the ions of a particular element in solids are in positive or negative oxidation states, depending upon the chemical environment. It is highly unusual for an atom having both positive as well as negative oxidation states simultaneously within the same structural framework in a particular compound. Our structural and chemical bonding analyses show that the hydrogen ions in the transition metal ammine borohydrides (TMABHs) with the chemical formula M(BH4)2(NH3)2 (M = Sc, Ti, V, Cr, Mn, Fe, Co, Ni, Cu and Zn) have both positive and negative oxidation states. Our detailed analyses confirm the amphoteric behaviour of hydrogen where hydrogen closer to boron is in negative oxidation state and that closer to nitrogen is in the positive oxidation state. From the spin polarised van der Waals interaction included calculation, we found that TMABHs has antiferromagnetic ordering as ground state. Our nudged elastic band calculation show that the migration barrier for ammonia diffusion in these materials are more than 1 eV and hence these compounds may be used for energy storage applications since they have high weight percentage of hydrogen. The presence of amphoteric behaviour of hydrogen in TMABHs has implication in designing volume efficient hydrides for hydrogen storage applications.


title: Analysis of multiple data sequences with different distributions: defining common principal component axes by ergodic sequence generation and multiple reweighting composition

abstract: Principal component analysis (PCA) defines a reduced space described by PC axes for a given multidimensional-data sequence to capture the variations of the data. In practice, we need multiple data sequences that accurately obey individual probability distributions and for a fair comparison of the sequences we need PC axes that are common for the multiple sequences but properly capture these multiple distributions. For these requirements, we present individual ergodic samplings for these sequences and provide special reweighting for recovering the target distributions.


title: Supervising Model Attention with Human Explanations for Robust Natural Language Inference

abstract: Natural Language Inference (NLI) models are known to learn from biases and artefacts within their training data, impacting how well they generalise to other unseen datasets. Existing de-biasing approaches focus on preventing the models from learning these biases, which can result in restrictive models and lower performance. We instead investigate teaching the model how a human would approach the NLI task, in order to learn features that will generalise better to previously unseen examples. Using natural language explanations, we supervise the model's attention weights to encourage more attention to be paid to the words present in the explanations, significantly improving model performance. Our experiments show that the in-distribution improvements of this method are also accompanied by out-of-distribution improvements, with the supervised models learning from features that generalise better to other NLI datasets. Analysis of the model indicates that human explanations encourage increased attention on the important words, with more attention paid to words in the premise and less attention paid to punctuation and stop-words.


title: Efficient space-time adaptivity for parabolic evolution equations using wavelets in time and finite elements in space

abstract: Considering the space-time adaptive method for parabolic evolution equations introduced in [arXiv:2101.03956 [math.NA]], this work discusses an implementation of the method in which every step is of linear complexity. Exploiting the product structure of the space-time cylinder, the method allows for a family of trial spaces given as the spans of wavelets-in-time tensorized with (locally refined) finite element spaces-in-space. On spaces whose bases are indexed by double-trees, we derive an algorithm that applies the resulting bilinear forms in linear complexity. We provide extensive numerical experiments to demonstrate the linear runtime of the resulting adaptive loop.


title: Contribui\c{c}\~ao do ecoturismo para o uso sustent\'avel dos recursos h\'idricos do munic\'ipio de Rondon\'opolis-MT

abstract: The Municipality of Rondon\'opolis possesses several touristic attractions such as a great diversity of waterfalls and little beaches located in the surroundings of the urban area, which attract tourists from various locations. Aiming to understand how ecotourism can contribute to the conservation of water resources in the leisure areas, as well as their potential development of touristic activities in those places. The procedures included the use of various techniques subsidized in remote sensing and geoprocessing tools that allowed the analysis and spatial distribution of tourism activities of the main leisure areas. The spatial distribution of the waterfalls and its surroundings, we observe the biophysical characters such as: the endemic vegetation, the cachoeiras, the waterfalls, the rocky outcrops, rivers, little beaches and espraiados. The results showed a correct perception of respondents on existing inter-relationships between ecotourism practices and the sustainable use of water resources. In conclusion though, a long way must be performed in order to prevent the economic benefits of ecotourism generate an inappropriate exploitation of natural resources, causing environmental problems, particularly to water resources in the surroundings.


title: KI-BERT: Infusing Knowledge Context for Better Language and Domain Understanding

abstract: Contextualized entity representations learned by state-of-the-art transformer-based language models (TLMs) like BERT, GPT, T5, etc., leverage the attention mechanism to learn the data context from training data corpus. However, these models do not use the knowledge context. Knowledge context can be understood as semantics about entities and their relationship with neighboring entities in knowledge graphs. We propose a novel and effective technique to infuse knowledge context from multiple knowledge graphs for conceptual and ambiguous entities into TLMs during fine-tuning. It projects knowledge graph embeddings in the homogeneous vector-space, introduces new token-types for entities, aligns entity position ids, and a selective attention mechanism. We take BERT as a baseline model and implement the "Knowledge-Infused BERT" by infusing knowledge context from ConceptNet and WordNet, which significantly outperforms BERT and other recent knowledge-aware BERT variants like ERNIE, SenseBERT, and BERT_CS over eight different subtasks of GLUE benchmark. The KI-BERT-base model even significantly outperforms BERT-large for domain-specific tasks like SciTail and academic subsets of QQP, QNLI, and MNLI.


title: Prospects of light charged scalars in a three Higgs doublet model with $Z_3$ symmetry

abstract: The stringent constraints from the direct searches for exotic scalars at the LHC as well as indirect bounds from flavor physics measurements have imposed severe restrictions on the parameter space of new physics models featuring extended Higgs sectors. In the Type-II 2HDM, this implies a lower bound on the charged Higgs masses of $\cal O$(600 GeV). In this work we analyze the phenomenology of a Z3HDM in the alignment limit focusing on the impact of flavor physics constraints on its parameter space. We show that the couplings of the two charged Higgs bosons in this model feature an additional suppression factor compared to Type-II 2HDM. This gives rise to a significant relaxation of the flavor physics constraints in this model, allowing the charged Higgs masses to be as low as $\cal O$(200 GeV). We also consider the constraints coming from precision electroweak observables and the observed diphoton decay rate of the 125 GeV Higgs boson at the LHC. The bounds coming from the direct searches of nonstandard Higgs bosons at the LHC, particularly those from resonance searches in the ditau channel, prove to be very effective in constraining this scenario further.


title: Uncertainty Surrogates for Deep Learning

abstract: In this paper we introduce a novel way of estimating prediction uncertainty in deep networks through the use of uncertainty surrogates. These surrogates are features of the penultimate layer of a deep network that are forced to match predefined patterns. The patterns themselves can be, among other possibilities, a known visual symbol. We show how our approach can be used for estimating uncertainty in prediction and out-of-distribution detection. Additionally, the surrogates allow for interpretability of the ability of the deep network to learn and at the same time lend robustness against adversarial attacks. Despite its simplicity, our approach is superior to the state-of-the-art approaches on standard metrics as well as computational efficiency and ease of implementation. A wide range of experiments are performed on standard datasets to prove the efficacy of our approach.


title: Robust quantum classifier with minimal overhead

abstract: To witness quantum advantages in practical settings, substantial efforts are required not only at the hardware level but also on theoretical research to reduce the computational cost of a given protocol. Quantum computation has the potential to significantly enhance existing classical machine learning methods, and several quantum algorithms for binary classification based on the kernel method have been proposed. These algorithms rely on estimating an expectation value, which in turn requires an expensive quantum data encoding procedure to be repeated many times. In this work, we calculate explicitly the number of repetition necessary for acquiring a fixed success probability and show that the Hadamard-test and the swap-test circuits achieve the optimal variance in terms of the quantum circuit parameters. The variance, and hence the number of repetition, can be further reduced only via optimization over data-related parameters. We also show that the kernel-based binary classification can be performed with a single-qubit measurement regardless of the number and the dimension of the data. Finally, we show that for a number of relevant noise models the classification can be performed reliably without quantum error correction. Our findings are useful for designing quantum classification experiments under limited resources, which is the common challenge in the noisy intermediate-scale quantum era.


title: MHD equilibria with nonconstant pressure in nondegenerate toroidal domains

abstract: We prove the existence of piecewise smooth MHD equilibria in three-dimensional toroidal domains of $\mathbf{R}^3$ where the pressure is constant on the boundary but not in the interior. The pressure is piecewise constant and the plasma current exhibits an arbitrary number of current sheets. We also establish the existence of free boundary steady states surrounded by vacuum with an external surface current. The toroidal domains where these equilibria are shown to exist do not need to be small perturbations of an axisymmetric domain, and in fact they can have any knotted topology. The building blocks we use in our construction are analytic toroidal domains satisfying a certain nondegeneracy condition, which roughly states that there exists a force-free field that is ergodic on the surface of the domain. The proof involves three main ingredients: a gluing construction of piecewise smooth MHD equilibria, a Hamilton-Jacobi equation on the two-dimensional torus that can be understood as a nonlinear deformation of the cohomological equation (so the nondegeneracy assumption plays a major role in the corresponding analysis), and a new KAM theorem tailored for the study of divergence-free fields in three dimensions whose Poincar\'e map cannot be computed explicitly.


title: The adjoint Reidemeister torsion for the connected sum of knots

abstract: Let $K$ be the connected sum of knots $K_1,\ldots,K_n$. It is known that the $\mathrm{SL}_2(\mathbb{C})$-character variety of the knot exterior of $K$ has a component of dimension $\geq 2$ as the connected sum admits a so-called bending. We show that there is a natural way to define the adjoint Reidemeister torsion for such a high-dimensional component and prove that it is locally constant on a subset of the character variety where the trace of a meridian is constant. We also prove that the adjoint Reidemeister torsion of $K$ satisfies the vanishing identity if each $K_i$ does so.


title: The Millimeter-Wave Spectrum of Doubly Deuterated Propylene Oxide CH$_3$CHCD$_2$O

abstract: Spectra of doubly deuterated propylene oxide, CH$_3$CHCD$_2$O, were recorded in the millimeter-wave spectral region up to 330 GHz utilizing a 2f frequency modulated Terahertz spectrometer. Rotational and centrifugal distortion constants and tunneling parameters for the description of the internal rotation of the methyl group were retrieved. The software XIAM was used to describe the A-E tunneling splitting with a frequency uncertainty of 82 kHz. Molecular parameters derived from our measurements are complemented by quantum chemical anharmonic frequency calculations on the B3LYP/augcc-pVTZ level of theory. In addition, the barrier height to internal rotation of the methyl group,V3, was derived experimentally and found to slightly differ from the value reported for the main isotopologue. In view of astrophysical observations we provide accurate line lists to search for doubly deuterated propylene oxide in space. Furthermore, we deliver improved molecular parameters to further investigate the properties of a simple chiral molecule possessing internal large amplitude motions.


title: Experimental assessment of physical realism in a quantum-controlled device

abstract: Bohr's complementarity principle has been challenged by quantum delayed-choice experiments wherein quantum systems are claimed to behave neither as wave nor as a particle, but in an intermediary way. However, this conclusion has been supported by retro-inference and with no direct link with the system quantum state. Here, we consider a framework that employs an operational criterion of physical reality to diagnosis the system ontology directly from the quantum state at each instant of time. We show that, in disparity with previous proposals, our setup ensures a formal link between the output visibility and elements of reality within the interferometer. An experimental proof-of-principle is provided for a two-spin-1/2 system in an interferometric setup implemented in a nuclear magnetic resonance platform. We discuss how our results validate, to a great extent, Bohr's original formulation of the complementarity principle and unveil morphing reality states.


title: An Empirical Study of Graph-Based Approaches for Semi-Supervised Time Series Classification

abstract: Time series data play an important role in many applications and their analysis reveals crucial information for understanding the underlying processes. Among the many time series learning tasks of great importance, we here focus on semi-supervised learning based on a graph representation of the data. Two main aspects are involved in this task. A suitable distance measure to evaluate the similarities between time series, and a learning method to make predictions based on these distances. However, the relationship between the two aspects has never been studied systematically in the context of graph-based learning. We describe four different distance measures, including (Soft) DTW and MPDist, a distance measure based on the Matrix Profile, as well as four successful semi-supervised learning methods, including the graph Allen--Cahn method and a Graph Convolutional Neural Network. We then compare the performance of the algorithms on binary classification data sets. In our findings we compare the chosen graph-based methods using all distance measures and observe that the results vary strongly with respect to the accuracy. As predicted by the ``no free lunch'' theorem, no clear best combination to employ in all cases is found. Our study provides a reproducible framework for future work in the direction of semi-supervised learning for time series with a focus on graph representations.


title: Counter-Interference Adapter for Multilingual Machine Translation

abstract: Developing a unified multilingual model has long been a pursuit for machine translation. However, existing approaches suffer from performance degradation -- a single multilingual model is inferior to separately trained bilingual ones on rich-resource languages. We conjecture that such a phenomenon is due to interference caused by joint training with multiple languages. To accommodate the issue, we propose CIAT, an adapted Transformer model with a small parameter overhead for multilingual machine translation. We evaluate CIAT on multiple benchmark datasets, including IWSLT, OPUS-100, and WMT. Experiments show that CIAT consistently outperforms strong multilingual baselines on 64 of total 66 language directions, 42 of which see above 0.5 BLEU improvement. Our code is available at \url{https://github.com/Yaoming95/CIAT}~.


title: A practical workflow for land seismic wavefield recovery with weighted matrix factorization

abstract: While wavefield reconstruction through weighted low-rank matrix factorizations has been shown to perform well on marine data, out-of-the-box application of this technology to land data is hampered by ground roll. The presence of these strong surface waves tends to dominate the reconstruction at the expense of the weaker body waves. Because ground roll is slow, it also suffers more from aliasing. To overcome these challenges, we introduce a practical workflow where the ground roll and body wave components are recovered separately and combined. We test the proposed approach blindly on a subset of the 3D SEAM Barrett dataset. With our technique, we recover densely sampled data from 25 percent randomly subsampled receivers. Independent comparisons on a single shot demonstrate significant improvements achievable with the presented workflow.


title: Fast ABC with joint generative modelling and subset simulation

abstract: We propose a novel approach for solving inverse-problems with high-dimensional inputs and an expensive forward mapping. It leverages joint deep generative modelling to transfer the original problem spaces to a lower dimensional latent space. By jointly modelling input and output variables and endowing the latent with a prior distribution, the fitted probabilistic model indirectly gives access to the approximate conditional distributions of interest. Since model error and observational noise with unknown distributions are common in practice, we resort to likelihood-free inference with Approximate Bayesian Computation (ABC). Our method calls on ABC by Subset Simulation to explore the regions of the latent space with dissimilarities between generated and observed outputs below prescribed thresholds. We diagnose the diversity of approximate posterior solutions by monitoring the probability content of these regions as a function of the threshold. We further analyze the curvature of the resulting diagnostic curve to propose an adequate ABC threshold. When applied to a cross-borehole tomography example from geophysics, our approach delivers promising performance without using prior knowledge of the forward nor of the noise distribution.


title: Capturing patterns of variation unique to a specific dataset

abstract: Capturing patterns of variation present in a dataset is important in exploratory data analysis and unsupervised learning. Contrastive dimension reduction methods, such as contrastive principal component analysis (cPCA), find patterns unique to a target dataset of interest by contrasting with a carefully chosen background dataset representing unwanted or uninteresting variation. However, such methods typically require a tuning parameter that governs the level of contrast, and it is unclear how to choose this parameter objectively. Furthermore, it is frequently of interest to contrast against multiple backgrounds, which is difficult to accomplish with existing methods. We propose unique component analysis (UCA), a tuning-free method that identifies low-dimensional representations of a target dataset relative to one or more comparison datasets. It is computationally efficient even with large numbers of features. We show in several experiments that UCA with a single background dataset achieves similar results compared to cPCA with various tuning parameters, and that UCA with multiple individual background datasets is superior to both cPCA with any single background data and cPCA with a pooled background dataset.


title: Governance for Security, Risks, Competition and Cooperation: Mapping the knowledge

abstract: The study aims to generate a map of the knowledge based on the research on topics related to governance and security, risks, competition and cooperation for the FDDI (Fudan Development Institute) proceedings publishing project: 'Reflections on Governance: Security and Risks, Competition and Cooperation.' That mapping exercise would enable a broader audience to delve into the current state, and interdisciplinary pathways of the research published worldwide for addressing complex problems of governance. Following this introduction, the second section presents the bibliometric methods used and the results' interpretation. The third section presents the results, followed by the fourth and fifth sections of discussion and conclusion, respectively.


title: Rigid body equations on spaces of pseudo-differential operators with renormalized trace

abstract: We equip the regular Fr\'echet Lie group of invertible, odd-class, classical pseudodifferential operators $Cl^{0,*}_{odd}(M,E)$ -- in which $M$ is a compact smooth manifold and $E$ a (complex) vector bundle over $M$ -- with pseudo-Riemannian metrics, and we use these metrics to introduce a large class of rigid body equations. We adapt to our infinite-dimensional setting Manakov's classical observation on the integrability of Euler's equations for the rigid body, and we show that our equations can be written in Lax form (with parameter) and that they admit an infinite number of integrals of motion. We also prove the existence of metric connections, we show that our rigid body equations determine geodesics on $Cl^{0,*}_{odd}(M,E)$, and we present rigorous formulas for the corresponding curvature and sectional curvature. Our main tool is the theory of renormalized traces of pseudodifferential operators on compact smooth manifolds without boundary.


title: Locally Aware Piecewise Transformation Fields for 3D Human Mesh Registration

abstract: Registering point clouds of dressed humans to parametric human models is a challenging task in computer vision. Traditional approaches often rely on heavily engineered pipelines that require accurate manual initialization of human poses and tedious post-processing. More recently, learning-based methods are proposed in hope to automate this process. We observe that pose initialization is key to accurate registration but existing methods often fail to provide accurate pose initialization. One major obstacle is that, regressing joint rotations from point clouds or images of humans is still very challenging. To this end, we propose novel piecewise transformation fields (PTF), a set of functions that learn 3D translation vectors to map any query point in posed space to its correspond position in rest-pose space. We combine PTF with multi-class occupancy networks, obtaining a novel learning-based framework that learns to simultaneously predict shape and per-point correspondences between the posed space and the canonical space for clothed human. Our key insight is that the translation vector for each query point can be effectively estimated using the point-aligned local features; consequently, rigid per bone transformations and joint rotations can be obtained efficiently via a least-square fitting given the estimated point correspondences, circumventing the challenging task of directly regressing joint rotations from neural networks. Furthermore, the proposed PTF facilitate canonicalized occupancy estimation, which greatly improves generalization capability and results in more accurate surface reconstruction with only half of the parameters compared with the state-of-the-art. Both qualitative and quantitative studies show that fitting parametric models with poses initialized by our network results in much better registration quality, especially for extreme poses.


title: Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema

abstract: The Winograd Schema (WS) has been proposed as a test for measuring commonsense capabilities of models. Recently, pre-trained language model-based approaches have boosted performance on some WS benchmarks but the source of improvement is still not clear. This paper suggests that the apparent progress on WS may not necessarily reflect progress in commonsense reasoning. To support this claim, we first show that the current evaluation method of WS is sub-optimal and propose a modification that uses twin sentences for evaluation. We also propose two new baselines that indicate the existence of artifacts in WS benchmarks. We then develop a method for evaluating WS-like sentences in a zero-shot setting to account for the commonsense reasoning abilities acquired during the pretraining and observe that popular language models perform randomly in this setting when using our more strict evaluation. We conclude that the observed progress is mostly due to the use of supervision in training WS models, which is not likely to successfully support all the required commonsense reasoning skills and knowledge.


title: Theta liftings of non-generic representations on double covers of orthogonal groups

abstract: We study the generalized theta lifting between the double covers of split special orthogonal groups, which uses the non-minimal theta representations constructed by Bump, Friedberg and Ginzburg. We focus on the theta liftings of non-generic representations and make a conjecture that gives an upper bound of the first non-zero occurrence of the liftings, depending only on the unipotent orbit. We prove both global and local results that support the conjecture.


title: Finding Motifs in Knowledge Graphs using Compression

abstract: We introduce a method to find network motifs in knowledge graphs. Network motifs are useful patterns or meaningful subunits of the graph that recur frequently. We extend the common definition of a network motif to coincide with a basic graph pattern. We introduce an approach, inspired by recent work for simple graphs, to induce these from a given knowledge graph, and show that the motifs found reflect the basic structure of the graph. Specifically, we show that in random graphs, no motifs are found, and that when we insert a motif artificially, it can be detected. Finally, we show the results of motif induction on three real-world knowledge graphs.


title: Editing Factual Knowledge in Language Models

abstract: The factual knowledge acquired during pre-training and stored in the parameters of Language Models (LMs) can be useful in downstream tasks (e.g., question answering or textual inference). However, some facts can be incorrectly induced or become obsolete over time. We present KnowledgeEditor, a method which can be used to edit this knowledge and, thus, fix 'bugs' or unexpected predictions without the need for expensive re-training or fine-tuning. Besides being computationally efficient, KnowledgeEditordoes not require any modifications in LM pre-training (e.g., the use of meta-learning). In our approach, we train a hyper-network with constrained optimization to modify a fact without affecting the rest of the knowledge; the trained hyper-network is then used to predict the weight update at test time. We show KnowledgeEditor's efficacy with two popular architectures and knowledge-intensive tasks: i) a BERT model fine-tuned for fact-checking, and ii) a sequence-to-sequence BART model for question answering. With our method, changing a prediction on the specific wording of a query tends to result in a consistent change in predictions also for its paraphrases. We show that this can be further encouraged by exploiting (e.g., automatically-generated) paraphrases during training. Interestingly, our hyper-network can be regarded as a 'probe' revealing which components need to be changed to manipulate factual knowledge; our analysis shows that the updates tend to be concentrated on a small subset of components. Source code available at https://github.com/nicola-decao/KnowledgeEditor


title: The Cuntz semigroup of unital commutative AI-algebras

abstract: We provide an abstract characterization for the Cuntz semigroup of unital commutative AI-algebras, as well as a characterization for abstract Cuntz semigroups of the form $\text{Lsc} (X,\overline{\mathbb{N}})$ for some $T_1$-space $X$. In our investigations, we also uncover new properties that the Cuntz semigroup of all AI-algebras satisfies.


title: Automatic Termination for Hyperparameter Optimization

abstract: Bayesian optimization (BO) is a widely popular approach for the hyperparameter optimization (HPO) in machine learning. At its core, BO iteratively evaluates promising configurations until a user-defined budget, such as wall-clock time or number of iterations, is exhausted. While the final performance after tuning heavily depends on the provided budget, it is hard to pre-specify an optimal value in advance. In this work, we propose an effective and intuitive termination criterion for BO that automatically stops the procedure if it is sufficiently close to the global optimum. Our key insight is that the discrepancy between the true objective (predictive performance on test data) and the computable target (validation performance) suggests stopping once the suboptimality in optimizing the target is dominated by the statistical estimation error. Across an extensive range of real-world HPO problems and baselines, we show that our termination criterion achieves a better trade-off between the test performance and optimization time. Additionally, we find that overfitting may occur in the context of HPO, which is arguably an overlooked problem in the literature, and show how our termination criterion helps to mitigate this phenomenon on both small and large datasets.


title: Improving Hyper-Relational Knowledge Graph Completion

abstract: Different from traditional knowledge graphs (KGs) where facts are represented as entity-relation-entity triplets, hyper-relational KGs (HKGs) allow triplets to be associated with additional relation-entity pairs (a.k.a qualifiers) to convey more complex information. How to effectively and efficiently model the triplet-qualifier relationship for prediction tasks such as HKG completion is an open challenge for research. This paper proposes to improve the best-performing method in HKG completion, namely STARE, by introducing two novel revisions: (1) Replacing the computation-heavy graph neural network module with light-weight entity/relation embedding processing techniques for efficiency improvement without sacrificing effectiveness; (2) Adding a qualifier-oriented auxiliary training task for boosting the prediction power of our approach on HKG completion. The proposed approach consistently outperforms STARE in our experiments on three benchmark datasets, with significantly improved computational efficiency.


title: Probing Cosmic Dawn : Ages and Star Formation Histories of Candidate $z\geq$9 Galaxies

abstract: We discuss the spectral energy distributions and physical properties of six galaxies whose photometric redshifts suggest they lie beyond a redshift $z\simeq$9. Each was selected on account of a prominent excess seen in the Spitzer/IRAC 4.5$\mu$m band which, for a redshift above $z=9.0$, likely indicates the presence of a rest-frame Balmer break and a stellar component that formed earlier than a redshift $z\simeq10$. In addition to constraining the earlier star formation activity on the basis of fits using stellar population models with BAGPIPES, we have undertaken the necessary, but challenging, follow-up spectroscopy for each candidate using various combinations of Keck/MOSFIRE, VLT/X-shooter, Gemini/FLAMINGOS2 and ALMA. Based on either Lyman-$\alpha$ or [OIII] 88 $\mu$m emission, we determine a convincing redshift of $z$=8.78 for GN-z-10-3 and a likely redshift of $z$=9.28 for the lensed galaxy MACS0416-JD. For GN-z9-1, we conclude the case remains promising for a source beyond $z\simeq$9. Together with earlier spectroscopic data for MACS1149-JD1, our analysis of this enlarged sample provides further support for a cosmic star formation history extending beyond redshifts $z\simeq$10. We use our best-fit stellar population models to reconstruct the past rest-frame UV luminosities of our sources and discuss the implications for tracing earlier progenitors of such systems with the James Webb Space Telescope.


title: Spin-2 KK Mode Scattering in Models with a Massive Radion

abstract: We calculate tree-level scattering amplitudes of massive spin-2 KK particles in models of stabilized compact extra-dimensional theories. Naively introducing a mass for the radion in an extra-dimensional model without accounting for the dynamics responsible for stabilizing the extra dimension upsets the cancellations relating the masses and couplings of the spin-2 modes, resulting in KK scattering amplitudes which grow like $E^{4}$ instead of $E^{2}$. We therefore investigate scattering of the Kaluza-Klein states in theories incorporating the Goldberger-Wise mechanism to stabilize the size of the extra dimension. We demonstrate that the cancellations occur only when one includes not only the massive radion, but also the massive spin-0 modes arising from the Goldberger-Wise scalar. We compute the revised sum rules which are satisfied in a stabilized model to ensure a consistent high-energy scattering amplitude. We introduce a simple model of a stabilized extra dimension which is a small deformation of a flat (toroidal) five-dimensional model, and demonstrate the cancellations in computations performed to leading nontrivial order in the deformation. These results are the first complete KK scattering computation in an extra-dimensional model with a stabilized extra dimension, with implications for the theory and phenomenology of these models.


title: Density of States of the lattice Schwinger model

abstract: Using a recently introduced tensor network method, we study the density of states of the lattice Schwinger model, a standard testbench for lattice gauge theory numerical techniques, but also the object of recent experimental quantum simulations. We identify regimes of parameters where the spectrum appears to be symmetric and displays the expected continuum properties even for finite lattice spacing and number of sites. However, we find that for moderate system sizes and lattice spacing of $ga\sim O(1)$, the spectral density can exhibit very different properties with a highly asymmetric form. We also explore how the method can be exploited to extract thermodynamic quantities.


title: Safe Exploration in Model-based Reinforcement Learning using Control Barrier Functions

abstract: This paper develops a model-based reinforcement learning (MBRL) framework for learning online the value function of an infinite-horizon optimal control problem while obeying safety constraints expressed as control barrier functions (CBFs). Our approach is facilitated by the development of a novel class of CBFs, termed Lyapunov-like CBFs (LCBFs), that retain the beneficial properties of CBFs for developing minimally-invasive safe control policies while also possessing desirable Lyapunov-like qualities such as positive semi-definiteness. We show how these LCBFs can be used to augment a learning-based control policy to guarantee safety and then leverage this approach to develop a safe exploration framework in a MBRL setting. We demonstrate that our approach can handle more general safety constraints than comparative methods via numerical examples.


title: Optimizing the Stability of FETs Based on Two-Dimensional Materials by Fermi Level Tuning

abstract: Despite the enormous progress achieved during the past decade, nanoelectronic devices based on two-dimensional (2D) semiconductors still suffer from a limited electrical stability. This limited stability has been shown to result from the interaction of charge carriers originating from the 2D semiconductors with defects in the surrounding insulating materials. The resulting dynamically trapped charges are particularly relevant in field effect transistors (FETs) and can lead to a large hysteresis, which endangers stable circuit operation. Based on the notion that charge trapping is highly sensitive to the energetic alignment of the channel Fermi-level with the defect band in the insulator, we propose to optimize device stability by deliberately tuning the channel Fermi-level. Our approach aims to minimize the amount of electrically active border traps without modifying the total number of traps in the insulator. We demonstrate the applicability of this idea by using two differently doped graphene layers in otherwise identical FETs with Al$_2$O$_3$ as a gate oxide mounted on a flexible substrate. Our results clearly show that by increasing the distance of the Fermi-level to the defect band, the hysteresis is significantly reduced. Furthermore, since long-term reliability is also very sensitive to trapped charges, a corresponding improvement in reliability is both expected theoretically and demonstrated experimentally. Our study paves the way for the construction of more stable and reliable 2D FETs in which the channel material is carefully chosen and tuned to maximize the energetic distance between charge carriers in the channel and the defect bands in the insulator employed.


title: Word2rate: training and evaluating multiple word embeddings as statistical transitions

abstract: Using pretrained word embeddings has been shown to be a very effective way in improving the performance of natural language processing tasks. In fact almost any natural language tasks that can be thought of has been improved by these pretrained embeddings. These tasks range from sentiment analysis, translation, sequence prediction amongst many others. One of the most successful word embeddings is the Word2vec CBOW model proposed by Mikolov trained by the negative sampling technique. Mai et al. modifies this objective to train CMOW embeddings that are sensitive to word order. We used a modified version of the negative sampling objective for our context words, modelling the context embeddings as a Taylor series of rate matrices. We show that different modes of the Taylor series produce different types of embeddings. We compare these embeddings to their similar counterparts like CBOW and CMOW and show that they achieve comparable performance. We also introduce a novel left-right context split objective that improves performance for tasks sensitive to word order. Our Word2rate model is grounded in a statistical foundation using rate matrices while being competitive in variety of language tasks.


title: Automated manipulation of free space optical beams with integrated silicon photonic meshes

abstract: Free-space optics (FSO) offer promising solutions in wireless systems where many different devices need to communicate and interoperate, exchanging massive amounts of data as in communication and sensor networks, and in technologies for positioning and ranging. In these applications, control and manipulation of the light field is required for properly generating and correctly receiving FSO beams even in the presence of unpredictable objects and turbulence in the light path. In this work, we use a programmable mesh of Mach-Zehnder Interferometers (MZIs) to automatically control the complex field radiated and captured by an array of optical antennas. Several functionalities are demonstrated, including the generation of perfectly shaped beams with non-perfect optical antennas, the imaging of a desired field pattern through an obstacle or a diffusive medium, and the identification of an unknown obstacle inserted in the FSO path. Compared to conventional devices used for the manipulation of FSO beams, such as spatial light modulators (SLMs), our programmable circuit can self-configure through automated control strategies and can be integrated with other functionalities implemented onto the same photonic chip.


title: Altered connectedness of the brain chronnectome during the progression of Alzheimer's disease

abstract: Graph theory has been extensively used to investigate brain network topology and its changes in disease cohorts. However, many graph theoretic analysis-based brain network studies focused on the shortest paths or, more generally, cost-efficiency. In this work, we use two new concepts, connectedness and 2-connectedness, to measure different global properties compared to the previously widely adopted ones.


title: Istances and Br\o ndsted's variational principle

abstract: The manuscript contains elegant extensions of the fundamental variational principles: Br\o ndsted's and Ekeland's. On the other hand we get general and precise version of the Takahashi and the Cariste fixed point theorems. The results are based on the notion of istance for uniform spaces.


title: A derivation of the standard model particles from the Dirac Lagrangian on internal spacetime

abstract: 'Internal spacetime' is a modification of general relativity that was recently introduced as an approximate spacetime geometric model of quantum nonlocality. In an internal spacetime, time is stationary along the worldlines of fundamental (dust) particles. Consequently, the dimensions of tangent spaces at different points of spacetime vary, and spin wavefunction collapse is modeled by the projection from one tangent space to another. In this article we develop spinors on an internal spacetime, and construct a new Dirac-like Lagrangian $\mathcal{L} = \bar{\psi}(i \slashed \partial - \hat{\omega}) \psi$ whose equations of motion describe their couplings and interactions. Furthermore, we show that hidden within $\mathcal{L}$ is the entire standard model: $\mathcal{L}$ contains precisely three generations of quarks and leptons, the electroweak gauge bosons, the Higgs boson, and one new massive spin-$2$ boson; gluons are considered in a companion article. Specifically, we are able to derive the correct spin, electric charge, and color charge of each standard model particle, as well as predict the existence of a new boson.


title: Design of an Efficient, Ease-of-use and Affordable Artificial Intelligence based Nucleic Acid Amplification Diagnosis Technology for Tuberculosis and Multi-drug Resistant Tuberculosis

abstract: Current technologies that facilitate diagnosis for simultaneous detection of Mycobacterium tuberculosis and its resistance to first-line anti-tuberculosis drugs (Isoniazid and Rifampicim) are designed for lab-based settings and are unaffordable for large scale testing implementations. The suitability of a TB diagnosis instrument, generally required in low-resource settings, to be implementable in point-of-care last mile public health centres depends on manufacturing cost, ease-of-use, automation and portability. This paper discusses a portable, low-cost, machine learning automated Nucleic acid amplification testing (NAAT) device that employs the use of a smartphone-based fluorescence detection using novel image processing and chromaticity detection algorithms. To test the instrument, real time polymerase chain reaction (qPCR) experiment on cDNA dilution spanning over two concentrations (40 ng/uL and 200 ng/uL) was performed and sensitive detection of multiplexed positive control assay was verified.

categories: physics.med-ph cs.LG eess.IV physics.bio-ph physics.ins-det q-bio.QM


title: Collective flow in single-hit QCD kinetic theory

abstract: Motivated by recent interest in collectivity in small systems, we calculate the harmonic flow response to initial geometry deformations within weakly coupled QCD kinetic theory using the first correction to the free-streaming background. We derive a parametric scaling formula that relates harmonic flow in systems of different sizes and different generic initial gluon distributions. We comment on similarities and differences between the full QCD effective kinetic theory and the toy models used previously. Finally we calculate the centrality dependence of the integrated elliptic flow $v_2$ in oxygen-oxygen, proton-lead and proton-proton collision systems.


title: Rate-Splitting Multiple Access for Joint Radar-Communications with Low-Resolution DACs

abstract: In this paper, we introduce the design of a multi-antenna Joint Radar-Communication (JRC) system with Rate Splitting Multiple Access (RSMA) and low resolution Digital-to-Analog Converter (DAC) units. Using RSMA, the communication messages are split into private and common parts, then precoded and quantized before transmission. We use a problem formulation to design the JRC system with RSMA and low resolution DACs by maximizing communication sum-rate and the proximity of the resulting JRC waveform to an optimal radar beampattern under an average transmit power constraint. We solve the joint sum-rate maximization and beampattern error minimization problem using Alternating Direction Method of Multipliers (ADMM) method. The numerical results show that RSMA achieves a significantly higher sum-rate compared to Space Division Multiple Access (SDMA) while providing the same Normalized Mean Square Error (NMSE) for the designed radar beampattern.


title: Calculation of generating function in many-body systems with quantum computers: technical challenges and use in hybrid quantum-classical methods

abstract: The generating function of a Hamiltonian $H$ is defined as $F(t)=\langle e^{-itH}\rangle$, where $t$ is the time and where the expectation value is taken on a given initial quantum state. This function gives access to the different moments of the Hamiltonian $\langle H^{K}\rangle$ at various orders $K$. The real and imaginary parts of $F(t)$ can be respectively evaluated on quantum computers using one extra ancillary qubit with a set of measurement for each value of the time $t$. The low cost in terms of qubits renders it very attractive in the near term period where the number of qubits is limited. Assuming that the generating function can be precisely computed using quantum devices, we show how the information content of this function can be used a posteriori on classical computers to solve quantum many-body problems. Several methods of classical post-processing are illustrated with the aim to predict approximate ground or excited state energies and/or approximate long-time evolutions. This post-processing can be achieved using methods based on the Krylov space and/or on the $t$-expansion approach that is closely related to the imaginary time evolution. Hybrid quantum-classical calculations are illustrated in many-body interacting systems using the pairing and Fermi-Hubbard models.


title: Exploratory Data Analysis of Electric Tricycle as Sustainable Public Transport Mode in General Santos City Using Logistic Regression

abstract: General Santos City, as the tuna capital of the Philippines, relies with the presence of tricycles in moving people and goods. Considered as a highly-urbanized city, General Santos City serves as vital link of the entire SOCKSARGEN region's economic activities. With the current thrust of the city in providing a sustainable transport service, several options were identified to adopt in the entire city, that includes cleaner and better transport mode. Electric tricycle is an after sought alternative that offers better choice in terms of identified factors of sustainable transport: reliability, safety, comfort, environment, affordability, and facility. A literature review was conducted to provide a comparison of cost and emission between a motorized tricycle and an e-tricycle. The study identified the existing tricycle industry of the city and reviewed the modal share with the city's travel pattern. The survey revealed a number of hazards were with the current motorized tricycle that needs to address for the welfare of the passengers and drivers. The study favors the shift to adopting E-tricycle. The model derived from binary logistics regression provided a 72.72% model accuracy. Based from the results and findings, electric tricycle can be an alternative mode of public transport in the city that highly support sustainable option that provides local populace to improve their quality of life through mobility and economic activity. Further recommendation to local policy makers in the transport sector of the city include the clustering of barangays for better traffic management and franchise regulation, the inclusion of transport-related infrastructure related to tricycle service with their investment planning and programming, the roll out and implementation of tricycle code of the city, and the piloting activity of introducing e-tricycle in the city.


title: Shadow-Mapping for Unsupervised Neural Causal Discovery

abstract: An important goal across most scientific fields is the discovery of causal structures underling a set of observations. Unfortunately, causal discovery methods which are based on correlation or mutual information can often fail to identify causal links in systems which exhibit dynamic relationships. Such dynamic systems (including the famous coupled logistic map) exhibit `mirage' correlations which appear and disappear depending on the observation window. This means not only that correlation is not causation but, perhaps counter-intuitively, that causation may occur without correlation. In this paper we describe Neural Shadow-Mapping, a neural network based method which embeds high-dimensional video data into a low-dimensional shadow representation, for subsequent estimation of causal links. We demonstrate its performance at discovering causal links from video-representations of dynamic systems.


title: CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework

abstract: Federated learning (FL) is an emerging distributed machine learning paradigm that protects privacy and tackles the problem of isolated data islands. At present, there are two main communication strategies of FL: synchronous FL and asynchronous FL. The advantages of synchronous FL are that the model has high precision and fast convergence speed. However, this synchronous communication strategy has the risk that the central server waits too long for the devices, namely, the straggler effect which has a negative impact on some time-critical applications. Asynchronous FL has a natural advantage in mitigating the straggler effect, but there are threats of model quality degradation and server crash. Therefore, we combine the advantages of these two strategies to propose a clustered semi-asynchronous federated learning (CSAFL) framework. We evaluate CSAFL based on four imbalanced federated datasets in a non-IID setting and compare CSAFL to the baseline methods. The experimental results show that CSAFL significantly improves test accuracy by more than +5% on the four datasets compared to TA-FedAvg. In particular, CSAFL improves absolute test accuracy by +34.4% on non-IID FEMNIST compared to TA-FedAvg.


title: Using Action Space Clustering to Constrain the Accretion History of Milky Way like Galaxies

abstract: In the currently favored cosmological paradigm galaxies form hierarchically through the accretion of numerous satellite galaxies. Since the satellites are much less massive than the host halo, they occupy a small fraction of the volume in action space defined by the potential of the host halo. Since actions are conserved when the potential of the host halo changes adiabatically, stars from an accreted satellite are expected to remain clustered in action space as the host halo evolves. In this paper, we identify accreted satellites in three Milky Way like disk galaxies from the cosmological baryonic FIRE-2 simulations by tracking satellite galaxies through simulation snapshots. We then try to recover these satellites by applying the cluster analysis algorithm Enlink to the orbital actions of accreted star particles in the present-day snapshot. We define several metrics to quantify the success of the clustering algorithm and use these metrics to identify well-recovered and poorly-recovered satellites. We plot these satellites in the infall time-progenitor mass (or stellar mass) space, and determine the boundaries between the well-recovered and poorly-recovered satellites in these two spaces with classification tree method. The groups found by Enlink are more likely to correspond to a real satellite if they have high significance, a quantity assigned by Enlink. Since cosmological simulations predict that most stellar halos have a population of insitu stars, we test the ability of Enlink to recover satellites when the sample is contaminated by 10-50% of insitu star particles, and show that most of the satellites well-recovered by Enlink in the absence of insitu stars, stay well-recovered even with 50% contamination. We thus expect that, in the future, cluster analysis in action space will be useful in upcoming data sets (e.g. Gaia) for identifying accreted satellites in the Milky Way.


title: Flow in an hourglass: particle friction and stiffness matter

abstract: Granular flow out of a silo is studied experimentally and numerically. The time evolution of the discharge rate as well as the normal force (apparent weight) at the bottom of the container is monitored. We show, that particle stiffness has a strong effect on the qualitative features of silo discharge. For deformable grains with a Young's modulus of about $Y_m\approx 40$ kPa in a silo with basal pressure of the order of 4 kPa lowering the friction coefficient leads to a gradual change in the discharge curve: the flow rate becomes filling height dependent, it decreases during the discharge process. For hard grains with a Young's modulus of about $Y_m\approx 500$ MPa the flow rate is much less sensitive to the value of the friction coefficient. Using DEM data combined with a coarse-graining methodology allows us to compute all the relevant macroscopic fields, namely, linear momentum, density and stress tensors. The observed difference in the discharge in the low friction limit is connected to a strong difference in the pressure field: while for hard grains Janssen-screening is effective, leading to high vertical stress near the silo wall and small pressure above the orifice region, for deformable grains the pressure above the orifice is larger and gradually decreases during the discharge process. We have analyzed the momentum balance in the region of the orifice (near the location of the outlet) for the case of soft particles with low friction coefficient, and proposed a phenomenological formulation that predicts the linear decrease of the flow rate with decreasing filling height.


title: The Nielsen realization problem for K3 surfaces

abstract: The smooth (resp. metric and complex) Nielsen Realization Problem for K3 surfaces $M$ asks: when can a finite group $G$ of mapping classes of $M$ be realized by a finite group of diffeomorphisms (resp. isometries of a Ricci-flat metric, or automorphisms of a complex structure)? We solve the metric and complex versions of Nielsen Realization, and we solve the smooth version almost completely for involutions. Unlike the case of $2$-manifolds, some $G$ are realizable and some are not, and the answer depends on the category of structure preserved. In particular, Dehn twists are not realizable by finite order diffeomorphisms. We introduce a computable invariant $L_G$ that determines in many cases whether $G$ is realizable or not, and apply this invariant to construct an $S_4$ action by isometries of some Ricci-flat metric on $M$ that preserves no complex structure. We also show that the subgroups of ${\rm Diff}(M)$ of a given prime order $p$ which fix pointwise some positive-definite $3$-plane in $H_2(M;\mathbb{R})$ and preserve some complex structure on $M$ form a single conjugacy class in ${\rm Diff}(M)$ (it is known that then $p\in \{2,3,5,7\}$).


title: I Find Your Lack of Uncertainty in Computer Vision Disturbing

abstract: Neural networks are used for many real world applications, but often they have problems estimating their own confidence. This is particularly problematic for computer vision applications aimed at making high stakes decisions with humans and their lives. In this paper we make a meta-analysis of the literature, showing that most if not all computer vision applications do not use proper epistemic uncertainty quantification, which means that these models ignore their own limitations. We describe the consequences of using models without proper uncertainty quantification, and motivate the community to adopt versions of the models they use that have proper calibrated epistemic uncertainty, in order to enable out of distribution detection. We close the paper with a summary of challenges on estimating uncertainty for computer vision applications and recommendations.


title: TalkNet 2: Non-Autoregressive Depth-Wise Separable Convolutional Model for Speech Synthesis with Explicit Pitch and Duration Prediction

abstract: We propose TalkNet, a non-autoregressive convolutional neural model for speech synthesis with explicit pitch and duration prediction. The model consists of three feed-forward convolutional networks. The first network predicts grapheme durations. An input text is expanded by repeating each symbol according to the predicted duration. The second network predicts pitch value for every mel frame. The third network generates a mel-spectrogram from the expanded text conditioned on predicted pitch. All networks are based on 1D depth-wise separable convolutional architecture. The explicit duration prediction eliminates word skipping and repeating. The quality of the generated speech nearly matches the best auto-regressive models - TalkNet trained on the LJSpeech dataset got MOS 4.08. The model has only 13.2M parameters, almost 2x less than the present state-of-the-art text-to-speech models. The non-autoregressive architecture allows for fast training and inference. The small model size and fast inference make the TalkNet an attractive candidate for embedded speech synthesis.


title: Autoencoder-Based Unequal Error Protection Codes

abstract: We present a novel autoencoder-based approach for designing codes that provide unequal error protection (UEP) capabilities. The proposed design is based on a generalization of an autoencoder loss function that accommodates both message-wise and bit-wise UEP scenarios. In both scenarios, the generalized loss function can be adjusted using an associated weight vector to trade off error probabilities corresponding to different importance classes. For message-wise UEP, we compare the proposed autoencoder-based UEP codes with a union of random coset codes. For bit-wise UEP, the proposed codes are compared with UEP rateless spinal codes and the superposition of random Gaussian codes. In all cases, the autoencoder-based codes show superior performance while providing design simplicity and flexibility in trading off error protection among different importance classes.