title: Graph Convolution Neural Network For Weakly Supervised Abnormality Localization In Long Capsule Endoscopy Videos

abstract: Temporal activity localization in long videos is an important problem. The cost of obtaining frame level label for long Wireless Capsule Endoscopy (WCE) videos is prohibitive. In this paper, we propose an end-to-end temporal abnormality localization for long WCE videos using only weak video level labels. Physicians use Capsule Endoscopy (CE) as a non-surgical and non-invasive method to examine the entire digestive tract in order to diagnose diseases or abnormalities. While CE has revolutionized traditional endoscopy procedures, a single CE examination could last up to 8 hours generating as much as 100,000 frames. Physicians must review the entire video, frame-by-frame, in order to identify the frames capturing relevant abnormality. This, sometimes could be as few as just a single frame. Given this very high level of redundancy, analyzing long CE videos can be very tedious, time consuming and also error prone. This paper presents a novel multi-step method for an end-to-end localization of target frames capturing abnormalities of interest in the long video using only weak video labels. First we developed an automatic temporal segmentation using change point detection technique to temporally segment the video into uniform, homogeneous and identifiable segments. Then we employed Graph Convolutional Neural Network (GCNN) to learn a representation of each video segment. Using weak video segment labels, we trained our GCNN model to recognize each video segment as abnormal if it contains at least a single abnormal frame. Finally, leveraging the parameters of the trained GCNN model, we replaced the final layer of the network with a temporal pool layer to localize the relevant abnormal frames within each abnormal video segment. Our method achieved an accuracy of 89.9\% on the graph classification task and a specificity of 97.5\% on the abnormal frames localization task.


title: Analyzing Wikipedia Membership Dataset and PredictingUnconnected Nodes in the Signed Networks

abstract: In the age of digital interaction, person-to-person relationships existing on social media may be different from the very same interactions that exist offline. Examining potential or spurious relationships between members in a social network is a fertile area of research for computer scientists -- here we examine how relationships can be predicted between two unconnected people in a social network by using area under Precison-Recall curve and ROC. Modeling the social network as a signed graph, we compare Triadic model,Latent Information model and Sentiment model and use them to predict peer to peer interactions, first using a plain signed network, and second using a signed network with comments as context. We see that our models are much better than random model and could complement each other in different cases.


title: Rational self-affine tiles associated to standard and nonstandard digit systems

abstract: We consider digit systems $(A,\mathcal{D})$, where $ A \in \mathbb{Q}^{n\times n}$ is an expanding matrix and the digit set $\mathcal{D}$ is a suitable subset of $\mathbb{Q}^n$. To such a system, we associate a self-affine set $\mathcal{F} = \mathcal{F}(A,\mathcal{D})$ that lives in a certain representation space $\mathbb{K}$. If $A$ is an integer matrix, then $\mathbb{K} = \mathbb{R}^n$, while in the general rational case $\mathbb{K}$ contains an additional solenoidal factor. We give a criterion for $\mathcal{F}$ to have positive Haar measure, i.e., for being a rational self-affine tile. We study topological properties of $\mathcal{F}$ and prove some tiling theorems. Our setting is very general in the sense that we allow $(A,\mathcal{D})$ to be a nonstandard digit system. A standard digit system $(A,\mathcal{D})$ is one in which we require $\mathcal{D}$ to be a complete system of residue class representatives w.r.t. a certain naturally chosen residue class ring. Our tools comprise the Frobenius normal form and character theory of locally compact abelian groups.


title: Salt and pepper noise removal method based on stationary Framelet transform with non-convex sparsity regularization

abstract: Salt and pepper noise removal is a common inverse problem in image processing. Traditional denoising methods have two limitations. First, noise characteristics are often not described accurately. For example, the noise location information is often ignored and the sparsity of the salt and pepper noise is often described by L1 norm, which cannot illustrate the sparse variables clearly. Second, conventional methods separate the contaminated image into a recovered image and a noise part, thus resulting in recovering an image with unsatisfied smooth parts and detail parts. In this study, we introduce a noise detection strategy to determine the position of the noise, and a non-convex sparsity regularization depicted by Lp quasi-norm is employed to describe the sparsity of the noise, thereby addressing the first limitation. The morphological component analysis framework with stationary Framelet transform is adopted to decompose the processed image into cartoon, texture, and noise parts to resolve the second limitation. Then, the alternating direction method of multipliers (ADMM) is employed to solve the proposed model. Finally, experiments are conducted to verify the proposed method and compare it with some current state-of-the-art denoising methods. The experimental results show that the proposed method can remove salt and pepper noise while preserving the details of the processed image.


title: A Promising Technology for 6G Wireless Networks: Intelligent Reflecting Surface

abstract: The intelligent information society, which is highly digitized, intelligence inspired and globally data driven, will be deployed in the next decade. The next 6G wireless communication networks are the key to achieve this grand blueprint, which is expected to connect everything, provide full dimensional wireless coverage and integrate all functions to support full-vertical applications. Recent research reveals that intelligent reflecting surface (IRS) with wireless environment control capability is a promising technology for 6G networks. Specifically, IRS can intelligently control the wavefront, e.g., the phase, amplitude, frequency, and even polarization by massive tunable elements, thus achieving fine-grained 3-D passive beamforming. In this paper, we first give a blueprint of the next 6G networks including the vision, typical scenarios and key performance indicators (KPIs). Then, we provide an overview of IRS including the new signal model, hardware architecture and competitive advantages in 6G networks. Besides, we discuss the potential application of IRS in the connectivity of 6G networks in detail, including intelligent and controllable wireless environment, ubiquitous connectivity, deep connectivity and holographic connectivity. At last, we summarize the challenges of IRS application and deployment in 6G networks. As a timely review of IRS, our summary will be of interest to both researchers and practitioners engaging in IRS for 6G networks.


title: Optimal designs for experiments for scalar-on-function linear models

abstract: The aim of this work is to extend the usual optimal experimental design paradigm to experiments where the settings of one or more factors are functions. Such factors are known as profile factors, or as dynamic factors. For these new experiments, a design consists of combinations of functions for each run of the experiment. After briefly introducing the class of profile factors, basis functions are described with primary focus given on the B-spline basis system, due to its computational efficiency and useful properties. Basis function expansions are applied to a functional linear model consisting of profile factors, reducing the problem to an optimisation of basis coefficients. The methodology developed comprises special cases, including combinations of profile and non-functional factors, interactions, and polynomial effects. The method is finally applied to an experimental design problem in a Biopharmaceutical study that is performed using the Ambr250 modular bioreactor.


title: Real Additive Margin Softmax for Speaker Verification

abstract: The additive margin softmax (AM-Softmax) loss has delivered remarkable performance in speaker verification. A supposed behavior of AM-Softmax is that it can shrink within-class variation by putting emphasis on target logits, which in turn improves margin between target and non-target classes. In this paper, we conduct a careful analysis on the behavior of AM-Softmax loss, and show that this loss does not implement real max-margin training. Based on this observation, we present a Real AM-Softmax loss which involves a true margin function in the softmax training. Experiments conducted on VoxCeleb1, SITW and CNCeleb demonstrated that the corrected AM-Softmax loss consistently outperforms the original one. The code has been released at https://gitlab.com/csltstu/sunine.


title: Low-temperature acanthite-like phase of Cu$_{2}$S: A first-principles study on electronic and transport properties

abstract: The mobility and disorder in the lattice of Cu atoms as liquid-like behavior is an important characteristic affecting the thermoelectric properties of Cu$_{2}$S. In this study, using a theoretical model called acanthite-like structure for Cu$_{2}$S at a low-temperature range, we systematically investigate the electronic structure, intrinsic defect formation, and transport properties by first-principles calculations. Thereby, previous experimental reports on the indirect bandgap nature of Cu$_{2}$S were confirmed in this work with an energy gap of about 0.9-0.95 eV. As a result, the optical absorption coefficient estimated from this model also gives a potential value of $\alpha > 10^{4}$ cm$^{-1}$ in the visible spectrum range. According to the bonding analysis and formation energy aspect, Cu vacancy is the most preferred defect to form in Cu$_{2}$S, which primarily affects the conductive behavior as a $p$-type, as experimentally observed. Finally, the transport properties of Cu$_{2}$S system were successfully reproduced using an electron-phonon scattering method, highlighting the important role of relaxation time prediction in conductivity estimation instead of regarding it as a constant.


title: Supernova Constraints on Dark Flavored Sectors

abstract: Proto-neutron stars forming a few seconds after core-collapse supernovae are hot and dense environments where hyperons can be efficiently produced by weak processes. By making use of various state-of-the-art supernova simulations combined with the proper extensions of the equations of state including $\Lambda$ hyperons, we calculate the cooling of the star induced by the emission of dark particles $X^0$ through the decay $\Lambda\to n X^0$. Comparing this novel energy-loss process to the neutrino cooling of SN 1987A allows us to set a stringent upper limit on the branching fraction, BR$(\Lambda\to n X^0)\leq 8\times10^{-9}$, that we apply to massless dark photons and axions with flavor-violating couplings to quarks. We find that the new supernova bound can be orders of magnitude stronger than other limits in dark-sector models.


title: The cube axiom and resolutions in homotopy theory

abstract: We show that a version of the cube axiom holds in cosimplicial unstable coalgebras and cosimplicial spaces equipped with a resolution model structure. As an application, classical theorems in unstable homotopy theory are extended to this context.


title: Current shot noise in atomic contacts: Fe and FeH$_2$ between Au electrodes

abstract: Single Fe atoms on Au(111) surfaces were hydrogenated and dehydrogenated with the Au tip of a low-temperature scanning tunneling microscope (STM). Fe and FeH$_2$ were contacted with the tip of the microscope and show distinctly different evolutions of the conductance with the tip-substrate distance. The current shot noise of these contacts has been measured and indicates a single relevant conductance channel with the spin-polarized transmission. For FeH$_2$ the spin polarization reaches values up to 80\% for low conductances and is reduced if the tip-surface distance is decreased. These observations are partially reproduced using density functional theory (DFT) based transport calculations. We suggest that the quantum motion of the hydrogen atoms, which is not taken into account in our DFT modeling, may have a significant effect on the results.


title: KaraTuner: Towards end to end natural pitch correction for singing voice in karaoke

abstract: An automatic pitch correction system typically includes several stages, such as pitch extraction, deviation estimation, pitch shift processing, and cross-fade smoothing. However, designing these components with strategies often requires domain expertise and they are likely to fail on corner cases. In this paper, we present KaraTuner, an end-to-end neural architecture that predicts pitch curve and resynthesizes the singing voice directly from the tuned pitch and vocal spectrum extracted from the original recordings. Several vital technical points have been introduced in KaraTuner to ensure pitch accuracy, pitch naturalness, timbre consistency, and sound quality. A feed-forward Transformer is employed in the pitch predictor to capture longterm dependencies in the vocal spectrum and musical note. We also develop a pitch-controllable vocoder based on a novel source-filter block and the Fre-GAN architecture. KaraTuner obtains a higher preference than the rule-based pitch correction approach through A/B tests, and perceptual experiments show that the proposed vocoder achieves significant advantages in timbre consistency and sound quality compared with the parametric WORLD vocoder, phase vocoder and CLPC vocoder.


title: The homotopy automorphisms of a marked n-stage

abstract: We show nilpotency and completeness results for the homotopy automorphisms of a marked n-stage for an unstable coalgebra. These objects figure in the moduli problem of unstable coalgebras. Our theorems extend classical work of Dror, Zabrodsky, Maruyama and M\o ller.


title: Joint Spatial Division and Coaxial Multiplexing for Downlink Multi-User OAM Wireless Backhaul

abstract: Orbital angular momentum (OAM) at radio frequency (RF) provides a novel approach of multiplexing a set of orthogonal modes on the same frequency channel to achieve high spectral efficiencies (SEs). However, the existing research on OAM wireless communications is mainly focused on pointto-point transmission in the line-of-sight (LoS) scenario. In this paper, we propose an overall scheme of the downlink multi-user OAM (MU-OAM) wireless backhaul based on uniform circular arrays (UCAs) for broadcasting networks, which can achieve the joint spatial division and coaxial multiplexing (JSDCM). A salient feature of the proposed downlink MU-OAM wireless backhaul systems is that the channel matrices are completely characterized by the position of each small base station (SBS), independent of the numbers of subcarriers and antennas, which avoids estimating large channel matrices required by the traditional downlink multi-user multiple-input multiple-output (MU-MIMO) wireless backhaul systems. Thereafter, we propose an OAM-based multiuser distance and angle of arrival (AoA) estimation method, which is able to simultaneously estimate the positions of multiple SBSs with a flexible number of training symbols. With the estimated distances and AoAs, a MU-OAM preprocessing scheme is applied to eliminate the co-mode and inter-mode interferences in the downlink MU-OAM channel. At last, the proposed methods are extended to the downlink MU-OAM-MIMO wireless backhaul system equipped with uniform concentric circular arrays (UCCAs), for which much higher spectral efficiency (SE) and energy efficiency (EE) than traditional MU-MIMO systems can be achieved. Both mathematical analysis and simulation results validate that the proposed scheme can effectively eliminate both interferences of the practical downlink MU-OAM channel and approaches the performance of the ideal MU-OAM channel.


title: An accreting white dwarf displaying fast transitional mode switching

abstract: Accreting white dwarfs are often found in close binary systems with orbital periods ranging from tens of minutes to several hours. In most cases, the accretion process is relatively steady, with significant modulations only occurring on time-scales of ~days or longer. Here, we report the discovery of abrupt drops in the optical luminosity of the accreting white dwarf binary system TW Pictoris by factors up to 3.5 on time-scales as short as 30 minutes. The optical light curve of this binary system obtained by the Transiting Exoplanet Survey Satellite (TESS) clearly displays fast switches between two distinct intensity modes that likely track the changing mass accretion rate onto the white dwarf. In the low mode, the system also displays magnetically-gated accretion bursts, which implies that a weak magnetic field of the white dwarf truncates the inner disk at the co-rotation radius in this mode. The properties of the mode switching observed in TW Pictoris appear analogous to those observed in transitional millisecond pulsars, where similar transitions occur, although on timescales of ~tens of seconds. Our discovery establishes a previously unrecognised phenomenon in accreting white dwarfs and suggests a tight link to the physics governing magnetic accretion onto neutron stars.


title: On generalization of a theorem of Harish-Chandra

abstract: In this paper under some conditions we generalize a theorem of Harish-Chandra concerning representability of Fourier transforms of orbital integrals.


title: Effective comparison of neutrino-mass models

abstract: New physics in the lepton sector may account for neutrino masses, affect electroweak precision observables, induce charged-lepton flavour violation, and shift dipole moments. The low-energy predictions of different models are most conveniently compared within the formalism of effective field theory. To illustrate the benefits of this approach, we derive the Wilson coefficients for a set of representative models: the fermionic seesaw mechanisms (type I and III), the Zee model, and a minimal leptoquark model. In each case, the Weinberg and the dipole operators have qualitatively different origins. In parallel, we present the model-independent constraints on the Wilson coefficients coming from various lepton observables. We then show that it becomes straightforward to understand the allowed parameter space for each model, and to discriminate between them. The Zee and leptoquark models are suitable to address the muon $g-2$ anomaly. We also confront the models with the anomalies in the W-boson mass and semileptonic $B$-meson decays.


title: SpecTNT: a Time-Frequency Transformer for Music Audio

abstract: Transformers have drawn attention in the MIR field for their remarkable performance shown in natural language processing and computer vision. However, prior works in the audio processing domain mostly use Transformer as a temporal feature aggregator that acts similar to RNNs. In this paper, we propose SpecTNT, a Transformer-based architecture to model both spectral and temporal sequences of an input time-frequency representation. Specifically, we introduce a novel variant of the Transformer-in-Transformer (TNT) architecture. In each SpecTNT block, a spectral Transformer extracts frequency-related features into the frequency class token (FCT) for each frame. Later, the FCTs are linearly projected and added to the temporal embeddings (TEs), which aggregate useful information from the FCTs. Then, a temporal Transformer processes the TEs to exchange information across the time axis. By stacking the SpecTNT blocks, we build the SpecTNT model to learn the representation for music signals. In experiments, SpecTNT demonstrates state-of-the-art performance in music tagging and vocal melody extraction, and shows competitive performance for chord recognition. The effectiveness of SpecTNT and other design choices are further examined through ablation studies.


title: Imaging topological torus lattice from an electron crystal in twisted mono-bilayer graphene

abstract: A variety of exotic quantum phases of matter have been created by Van der Waals heterostructures. Moreover, these twisted heterostructures provide a feasible way of braiding correlation effect and nontrivial band topology together. Here, through a comprehensive spectrum study, we report the discovery of topological torus lattice in twisted mono-bilayer graphene. The strong Coulomb correlations give rise to an unusual charge localization behavior within the moir\'e supercell, leading to an electron crystal. The nontrivial band topology is encoded into the electron crystal, which would result in spatial modulated Chern numbers, and is evidenced by an emergent topological torus lattice state. Our result illustrates an efficient strategy for entwining and engineering topological physics with a strong electron correlation.


title: Deep Models with Fusion Strategies for MVP Point Cloud Registration

abstract: The main goal of point cloud registration in Multi-View Partial (MVP) Challenge 2021 is to estimate a rigid transformation to align a point cloud pair. The pairs in this competition have the characteristics of low overlap, non-uniform density, unrestricted rotations and ambiguity, which pose a huge challenge to the registration task. In this report, we introduce our solution to the registration task, which fuses two deep learning models: ROPNet and PREDATOR, with customized ensemble strategies. Finally, we achieved the second place in the registration track with 2.96546, 0.02632 and 0.07808 under the the metrics of Rot\_Error, Trans\_Error and MSE, respectively.


title: Cyclic Prefix (CP) Jamming Against Eavesdropping Relays in OFDM Systems

abstract: Cooperative communication has been widely used to provide spatial diversity benefits for low-end user equipments, especially in ad hoc and wireless sensor networks. However, the lack of strong authentication mechanisms in these networks leaves them prone to eavesdropping relays. In this paper, we propose a secure orthogonal frequency division multiplexing (OFDM) transmission scheme, where the destination node transmits a jamming signal over the cyclic prefix (CP) duration of the received signal. Simulation results verify that as long as at least a part of the jamming signal falls to the actual data portion of the eavesdropping relay, it spreads through all the data symbols due to the fast Fourier transformation (FFT) operation, resulting in degraded interception at the eavesdropper.


title: Ensembling Graph Predictions for AMR Parsing

abstract: In many machine learning tasks, models are trained to predict structure data such as graphs. For example, in natural language processing, it is very common to parse texts into dependency trees or abstract meaning representation (AMR) graphs. On the other hand, ensemble methods combine predictions from multiple models to create a new one that is more robust and accurate than individual predictions. In the literature, there are many ensembling techniques proposed for classification or regression problems, however, ensemble graph prediction has not been studied thoroughly. In this work, we formalize this problem as mining the largest graph that is the most supported by a collection of graph predictions. As the problem is NP-Hard, we propose an efficient heuristic algorithm to approximate the optimal solution. To validate our approach, we carried out experiments in AMR parsing problems. The experimental results demonstrate that the proposed approach can combine the strength of state-of-the-art AMR parsers to create new predictions that are more accurate than any individual models in five standard benchmark datasets.


title: EmbRace: Accelerating Sparse Communication for Distributed Training of NLP Neural Networks

abstract: Distributed data-parallel training has been widely adopted for deep neural network (DNN) models. Although current deep learning (DL) frameworks scale well for dense models like image classification models, we find that these DL frameworks have relatively low scalability for sparse models like natural language processing (NLP) models that have highly sparse embedding tables. Most existing works overlook the sparsity of model parameters thus suffering from significant but unnecessary communication overhead. In this paper, we propose EmbRace, an efficient communication framework to accelerate communications of distributed training for sparse models. EmbRace introduces Sparsity-aware Hybrid Communication, which integrates AlltoAll and model parallelism into data-parallel training, so as to reduce the communication overhead of highly sparse parameters. To effectively overlap sparse communication with both backward and forward computation, EmbRace further designs a 2D Communication Scheduling approach which optimizes the model computation procedure, relaxes the dependency of embeddings, and schedules the sparse communications of each embedding row with a priority queue. We have implemented a prototype of EmbRace based on PyTorch and Horovod, and conducted comprehensive evaluations with four representative NLP models. Experimental results show that EmbRace achieves up to 2.41X speedup compared to the state-of-the-art distributed training baselines.


title: Online Sign Identification: Minimization of the Number of Errors in Thresholding Bandits

abstract: In the fixed budget thresholding bandit problem, an algorithm sequentially allocates a budgeted number of samples to different distributions. It then predicts whether the mean of each distribution is larger or lower than a given threshold. We introduce a large family of algorithms (containing most existing relevant ones), inspired by the Frank-Wolfe algorithm, and provide a thorough yet generic analysis of their performance. This allowed us to construct new explicit algorithms, for a broad class of problems, whose losses are within a small constant factor of the non-adaptive oracle ones. Quite interestingly, we observed that adaptive methods empirically greatly out-perform non-adaptive oracles, an uncommon behavior in standard online learning settings, such as regret minimization. We explain this surprising phenomenon on an insightful toy problem.


title: GAN-based disentanglement learning for chest X-ray rib suppression

abstract: Clinical evidence has shown that rib-suppressed chest X-rays (CXRs) can improve the reliability of pulmonary disease diagnosis. However, previous approaches on generating rib-suppressed CXR face challenges in preserving details and eliminating rib residues. We hereby propose a GAN-based disentanglement learning framework called Rib Suppression GAN, or RSGAN, to perform rib suppression by utilizing the anatomical knowledge embedded in unpaired computed tomography (CT) images. In this approach, we employ a residual map to characterize the intensity difference between CXR and the corresponding rib-suppressed result. To predict the residual map in CXR domain, we disentangle the image into structure- and contrast-specific features and transfer the rib structural priors from digitally reconstructed radiographs (DRRs) computed by CT. Furthermore, we employ additional adaptive loss to suppress rib residue and preserve more details. We conduct extensive experiments based on 1,673 CT volumes, and four benchmarking CXR datasets, totaling over 120K images, to demonstrate that (i) our proposed RSGAN achieves superior image quality compared to the state-of-the-art rib suppression methods; (ii) combining CXR with our rib-suppressed result leads to better performance in lung disease classification and tuberculosis area detection.


title: Wave Functional of the Universe and Time

abstract: A version of the quantum theory of gravity based on the concept of the wave functional of the universe is proposed. To determine the physical wave functional, the quantum principle of least action is formulated as a secular equation for the corresponding action operator. Its solution, the wave functional, is an invariant of general covariant transformations of space-time. In the new formulation, the history of the evolution of the universe is described in terms of coordinate time together with arbitrary lapse and shift functions, which makes this description close to the formulation of the principle of general covariance in the classical theory of Einstein's gravity. In the new formulation of the quantum theory, an invariant parameter of the evolutionary time of the universe is defined, which is a generalization of the classical geodesic time, measured by a standard clock along time-like geodesics.


title: Al$_2$B$_2$ and AlB$_4$ monolayers: emergence of multiple two-dimensional Dirac nodal line semimetals with novel properties

abstract: Topological semimetal phases in two-dimensional (2D) materials have gained widespread interest due to their potential applications in developing nanoscale devices. Despite the prediction of the Dirac/Weyl points in a wide variety of 2D candidates, materials featuring topological nodal lines are still in great scarcity. Herein, we predict two stable thinnest films of aluminum diboride with hyper- and hypo-stoichiometries of Al$_2$B$_2$ and AlB$_4$ as new 2D nonmagnetic Dirac nodal line semimetals (NLSMs) which promise to offer many novel features. Our elaborate electronic structure calculations combined with analytical studies reveal that, in addition to the multiple Dirac points, these 2D configurations host various type-I closed nodal lines (NLs) around the Fermi level, all of which are semimetal states protected by the time-reversal and in-plane mirror symmetries. The most intriguing NL in Al$_2$B$_2$ encloses the K point and crosses the Fermi level with a considerable dispersion, thus providing a fresh playground to explore exotic properties in dispersive Dirac nodal lines. More strikingly, in the case of 2D superconductor AlB$_4$ which exhibits a high transition temperature, we provide the first evidence for a set of 2D nonmagnetic open type-II NLs in weak spin-orbit coupling limit, coinciding with closed type-I NLs near the Fermi level. The coexistence of superconductivity and nontrivial band topology in AlB$_4$ not only makes it a promising material to exhibit novel topological superconducting phases, but also the rather large energy dispersion of type-II nodal lines in this configuration, may offer a distinguished platform for realization of novel topological features in two-dimensional limit.


title: Geodesic path for the minimal energy cost in shortcuts to isothermality

abstract: Shortcut to isothermality is a driving strategy to steer the system to its equilibrium states within finite time, and enables evaluating the impact of a control promptly. Finding optimal scheme to minimize the energy cost is of critical importance in applications of this strategy in pharmaceutical drug test, biological selection, and quantum computation. We prove the equivalence between designing the optimal scheme and finding the geodesic path in the space of control parameters. Such equivalence allows a systematic and universal approach to find the optimal control to reduce the energy cost. We demonstrate the current method with examples of a Brownian particle trapped in controllable harmonic potentials.


title: State-Space Constraints Improve the Generalization of the Differentiable Neural Computer in some Algorithmic Tasks

abstract: Memory-augmented neural networks (MANNs) can solve algorithmic tasks like sorting. However, they often do not generalize to lengths of input sequences not seen in the training phase. Therefore, we introduce two approaches constraining the state-space of the network controller to improve the generalization to out-of-distribution-sized input sequences: state compression and state regularization. We show that both approaches can improve the generalization capability of a particular type of MANN, the differentiable neural computer (DNC), and compare our approaches to a stateful and a stateless controller on a set of algorithmic tasks. Furthermore, we show that especially the combination of both approaches can enable a pre-trained DNC to be extended post hoc with a larger memory. Thus, our introduced approaches allow to train a DNC using shorter input sequences and thus save computational resources. Moreover, we observed that the capability for generalization is often accompanied by loop structures in the state-space, which could correspond to looping constructs in algorithms.


title: Note: Sound velocities of generalized Lennard-Jones ($n-6$) fluids near freezing

abstract: In a recent paper [S. Khrapak, Molecules {\bf 25}, 3498 (2000)] the longitudinal and transverse sound velocities of conventional Lennard-Jones systems at the liquid-solid coexistence were calculated. It was shown that the sound velocities remain almost invariant along the liquid-solid coexistence boundary lines and that their magnitudes are comparable with those of repulsive soft sphere and hard sphere models at the fluid-solid phase transition. This implies that attraction does not affect the magnitude of sound velocities at the fluid-solid phase transition. This paper provides further evidence to this by examining the generalized Lennard-Jones $n$-6 fluids with $n$ ranging from $12$ to $7$ and demonstrating that the steepness of repulsive term has only a minor effect on the magnitude of the sound velocities.

categories: cond-mat.soft cond-mat.mtrl-sci cond-mat.stat-mech physics.flu-dyn


title: Learning Prototype-oriented Set Representations for Meta-Learning

abstract: Learning from set-structured data is a fundamental problem that has recently attracted increasing attention, where a series of summary networks are introduced to deal with the set input. In fact, many meta-learning problems can be treated as set-input tasks. Most existing summary networks aim to design different architectures for the input set in order to enforce permutation invariance. However, scant attention has been paid to the common cases where different sets in a meta-distribution are closely related and share certain statistical properties. Viewing each set as a distribution over a set of global prototypes, this paper provides a novel prototype-oriented optimal transport (POT) framework to improve existing summary networks. To learn the distribution over the global prototypes, we minimize its regularized optimal transport distance to the set empirical distribution over data points, providing a natural unsupervised way to improve the summary network. Since our plug-and-play framework can be applied to many meta-learning problems, we further instantiate it to the cases of few-shot classification and implicit meta generative modeling. Extensive experiments demonstrate that our framework significantly improves the existing summary networks on learning more powerful summary statistics from sets and can be successfully integrated into metric-based few-shot classification and generative modeling applications, providing a promising tool for addressing set-input and meta-learning problems.


title: Long-range neutrinoless double beta decay mechanisms

abstract: Understanding the origin of lepton number violation is one of the fundamental questions in particle physics today. Neutrinoless double beta decay provides a way in which this violation can be tested. In this article, we derive the form of hadronic and leptonic matrix elements for all possible long-range mechanisms of neutrinoless double beta decay. With these, we calculate the numerical values of the nuclear matrix elements (NME) and phase space factors (PSF) by making use of the interacting boson model of the nucleus (IBM-2) for NMEs and of exact Dirac wave functions for the PSFs. We show that:\ (I) lepton number violation can occur even with zero (or very small) neutrino mass and (II) the angular correlations of the emitted electrons can distinguish between different models of non-standard (NS) mechanisms. We set limits on the coupling constants of some NS models, in particular Left-Right models and SUSY models.


title: Adaptive Tikhonov strategies for stochastic ensemble Kalman inversion

abstract: Ensemble Kalman inversion (EKI) is a derivative-free optimizer aimed at solving inverse problems, taking motivation from the celebrated ensemble Kalman filter. The purpose of this article is to consider the introduction of adaptive Tikhonov strategies for EKI. This work builds upon Tikhonov EKI (TEKI) which was proposed for a fixed regularization constant. By adaptively learning the regularization parameter, this procedure is known to improve the recovery of the underlying unknown. For the analysis, we consider a continuous-time setting where we extend known results such as well-posdeness and convergence of various loss functions, but with the addition of noisy observations. Furthermore, we allow a time-varying noise and regularization covariance in our presented convergence result which mimic adaptive regularization schemes. In turn we present three adaptive regularization schemes, which are highlighted from both the deterministic and Bayesian approaches for inverse problems, which include bilevel optimization, the MAP formulation and covariance learning. We numerically test these schemes and the theory on linear and nonlinear partial differential equations, where they outperform the non-adaptive TEKI and EKI.


title: Variance Reduction in Stochastic Reaction Networks using Control Variates

abstract: Monte Carlo estimation in plays a crucial role in stochastic reaction networks. However, reducing the statistical uncertainty of the corresponding estimators requires sampling a large number of trajectories. We propose control variates based on the statistical moments of the process to reduce the estimators' variances. We develop an algorithm that selects an efficient subset of infinitely many control variates. To this end, the algorithm uses resampling and a redundancy-aware greedy selection. We demonstrate the efficiency of our approach in several case studies.


title: SynCoLFinGer: Synthetic Contactless Fingerprint Generator

abstract: We present the first method for synthetic generation of contactless fingerprint images, referred to as SynCoLFinGer. To this end, the constituent components of contactless fingerprint images regarding capturing, subject characteristics, and environmental influences are modeled and applied to a synthetically generated ridge pattern using the SFinGe algorithm. The proposed method is able to generate different synthetic samples corresponding to a single finger and it can be parameterized to generate contactless fingerprint images of various quality levels. The resemblance of the synthetically generated contactless fingerprints to real fingerprints is confirmed by evaluating biometric sample quality using an adapted NFIQ 2.0 algorithm and biometric utility using a state-of-the-art contactless fingerprint recognition system.


title: Deep zoom-in simulation of a fuzzy dark matter galactic halo

abstract: Fuzzy dark matter (FDM) made of ultra-light bosonic particles is a viable alternative to cold dark matter (CDM) with clearly distinguishable small-scale features in collapsed structures. On large scales, it behaves gravitationally like CDM deviating only by a cut-off in the initial power spectrum and can be studied using N-body methods. In contrast, wave interference effects near the de Broglie scale result in new phenomena unique to FDM. Interfering modes in filaments and halos yield a stochastically oscillating granular structure which condenses into solitonic cores during halo formation. Investigating these highly non-linear wave phenomena requires the spatially resolved numerical integration of the Schr\"odinger equation. In previous papers we introduced a hybrid zoom-in scheme that combines N-body methods to model the large-scale gravitational potential around and the mass accretion onto pre-selected halos with simulations of the Schr\"odinger-Poisson equation to capture wave-like effects inside these halos. In this work, we present a new, substantially improved reconstruction method for the wave function inside of previously collapsed structures. We demonstrate its capabilities with a deep zoom-in simulation of a well-studied sub-$L_\ast$-sized galactic halo from cosmological intitial conditions. With a particle mass of $m = 2.5\times 10^{-22}\,$eV and halo mass $M_{\text{vir}}=1.7\times 10^{11}\,M_{\odot}$ in a ($60$h${^{-1}}$ comoving Mpc)${}^{3}$ cosmological box, it reaches an effective resolution of 20 comoving pc. This pushes the values of $m$ and $M$ accessible to simulations significantly closer to those relevant for studying galaxy evolution in the allowed range of FDM masses.


title: Quantifying nanoscale electromagnetic fields in near-field microscopy by Fourier demodulation analysis

abstract: Confining light to sharp metal tips has become a versatile technique to study optical and electronic properties far below the diffraction limit. Particularly near-field microscopy in the mid-infrared spectral range has found a variety of applications in probing nanostructures and their dynamics. Yet, the ongoing quest for ultimately high spatial resolution down to the single-nanometer regime and quantitative three-dimensional nano-tomography depends vitally on a precise knowledge of the spatial distribution of the near fields emerging from the probe. Here, we perform finite element simulations of a tip with realistic geometry oscillating above a dielectric sample. By introducing a novel Fourier demodulation analysis of the electric field at each point in space, we reliably quantify the distribution of the near fields above and within the sample. Besides inferring the lateral field extension, which can be smaller than the tip radius of curvature, we also quantify the probing volume within the sample. Finally, we visualize the scattering process into the far field at a given demodulation order, for the first time, and shed light onto the nanoscale distribution of the near fields and its evolution as the tip-sample distance is varied. Our work represents a crucial step in understanding and tailoring the spatial distribution of evanescent fields in optical nanoscopy.


title: BEAMetrics: A Benchmark for Language Generation Evaluation Evaluation

abstract: Natural language processing (NLP) systems are increasingly trained to generate open-ended text rather than classifying between responses. This makes research on evaluation metrics for generated language -- functions that score system output given the context and/or human reference responses -- of critical importance. However, different metrics have different strengths and biases, and reflect human intuitions better on some tasks than others. There is currently no simple, unified way to compare, analyse or evaluate metrics across a representative set of tasks. Here, we describe the Benchmark to Evaluate Automatic Metrics (BEAMetrics), a resource to make research into new metrics itself easier to evaluate. BEAMetrics users can quickly compare existing and new metrics with human judgements across a diverse set of tasks, quality dimensions (fluency vs. coherence vs. informativeness etc), and languages. As generation experts might predict, BEAMetrics reveals stark task-dependent differences between existing metrics, and consistently poor performance on tasks with complex answer spaces or high reliance on general knowledge. While this analysis highlights a critical issue facing current research practice, BEAMetrics also contribute to its resolution by facilitating research into better metrics -- particularly those that can account for the complex interaction between context and general knowledge inherent to many modern NLP applications. BEAMetrics is available under the MIT License: https://github.com/ThomasScialom/BEAMetrics


title: Body Part Regression for CT Images

abstract: One of the greatest challenges in the medical imaging domain is to successfully transfer deep learning models into clinical practice. Since models are often trained on a specific body region, a robust transfer into the clinic necessitates the selection of images with body regions that fit the algorithm to avoid false-positive predictions in unknown regions. Due to the insufficient and inaccurate nature of manually-defined imaging meta-data, automated body part recognition is a key ingredient towards the broad and reliable adoption of medical deep learning models. While some approaches to this task have been presented in the past, building and evaluating robust algorithms for fine-grained body part recognition remains challenging. So far, no easy-to-use method exists to determine the scanned body range of medical Computed Tomography (CT) volumes. In this thesis, a self-supervised body part regression model for CT volumes is developed and trained on a heterogeneous collection of CT studies. Furthermore, it is demonstrated how the algorithm can contribute to the robust and reliable transfer of medical models into the clinic. Finally, easy application of the developed method is ensured by integrating it into the medical platform toolkit Kaapana and providing it as a python package at https://github.com/MIC-DKFZ/BodyPartRegression .


title: Finding the Right Bricks for Molecular Lego: A Data Mining Approach to Organic Semiconductor Design

abstract: Improving charge carrier mobilities in organic semiconductors is a challenging task that has hitherto primarily been tackled by empirical structural tuning of promising core compounds. Knowledge-based methods can greatly accelerate such local exploration, while a systematic analysis of large chemical databases can point towards promising design strategies. Here, we demonstrate such data mining by clustering an in-house database of >64.000 organic molecular crystals for which two charge-transport descriptors, the electronic coupling and the reorganization energy, have been calculated from first principles. The clustering is performed according to the Bemis-Murcko scaffolds of the constituting molecules and according to the sidegroups with which these molecular backbones are functionalized. In both cases, we obtain statistically significant structure-property relationships with certain scaffolds (sidegroups) consistently leading to favorable charge-transport properties. Functionalizing promising scaffolds with favorable sidegroups results in engineered molecular crystals for which we indeed compute improved charge-transport properties.


title: Tackling the Score Shift in Cross-Lingual Speaker Verification by Exploiting Language Information

abstract: This paper contains a post-challenge performance analysis on cross-lingual speaker verification of the IDLab submission to the VoxCeleb Speaker Recognition Challenge 2021 (VoxSRC-21). We show that current speaker embedding extractors consistently underestimate speaker similarity in within-speaker cross-lingual trials. Consequently, the typical training and scoring protocols do not put enough emphasis on the compensation of intra-speaker language variability. We propose two techniques to increase cross-lingual speaker verification robustness. First, we enhance our previously proposed Large-Margin Fine-Tuning (LM-FT) training stage with a mini-batch sampling strategy which increases the amount of intra-speaker cross-lingual samples within the mini-batch. Second, we incorporate language information in the logistic regression calibration stage. We integrate quality metrics based on soft and hard decisions of a VoxLingua107 language identification model. The proposed techniques result in a 11.7% relative improvement over the baseline model on the VoxSRC-21 test set and contributed to our third place finish in the corresponding challenge.


title: How to Effectively Identify and Communicate Person-Targeting Media Bias in Daily News Consumption?

abstract: Slanted news coverage strongly affects public opinion. This is especially true for coverage on politics and related issues, where studies have shown that bias in the news may influence elections and other collective decisions. Due to its viable importance, news coverage has long been studied in the social sciences, resulting in comprehensive models to describe it and effective yet costly methods to analyze it, such as content analysis. We present an in-progress system for news recommendation that is the first to automate the manual procedure of content analysis to reveal person-targeting biases in news articles reporting on policy issues. In a large-scale user study, we find very promising results regarding this interdisciplinary research direction. Our recommender detects and reveals substantial frames that are actually present in individual news articles. In contrast, prior work rather only facilitates the visibility of biases, e.g., by distinguishing left- and right-wing outlets. Further, our study shows that recommending news articles that differently frame an event significantly improves respondents' awareness of bias.


title: Lifting DecPOMDPs for Nanoscale Systems -- A Work in Progress

abstract: DNA-based nanonetworks have a wide range of promising use cases, especially in the field of medicine. With a large set of agents, a partially observable stochastic environment, and noisy observations, such nanoscale systems can be modelled as a decentralised, partially observable, Markov decision process (DecPOMDP). As the agent set is a dominating factor, this paper presents (i) lifted DecPOMDPs, partitioning the agent set into sets of indistinguishable agents, reducing the worst-case space required, and (ii) a nanoscale medical system as an application. Future work turns to solving and implementing lifted DecPOMDPs.


title: Probabilistic Inference in Planning for Partially Observable Long Horizon Problems

abstract: For autonomous service robots to successfully perform long horizon tasks in the real world, they must act intelligently in partially observable environments. Most Task and Motion Planning approaches assume full observability of their state space, making them ineffective in stochastic and partially observable domains that reflect the uncertainties in the real world. We propose an online planning and execution approach for performing long horizon tasks in partially observable domains. Given the robot's belief and a plan skeleton composed of symbolic actions, our approach grounds each symbolic action by inferring continuous action parameters needed to execute the plan successfully. To achieve this, we formulate the problem of joint inference of action parameters as a Hybrid Constraint Satisfaction Problem (H-CSP) and solve the H-CSP using Belief Propagation. The robot executes the resulting parameterized actions, updates its belief of the world and replans when necessary. Our approach is able to efficiently solve partially observable tasks in a realistic kitchen simulation environment. Our approach outperformed an adaptation of the state-of-the-art method across our experiments.


title: Measuring the influence of beliefs in belief networks

abstract: Influential beliefs are crucial for our understanding of how people reason about political issues and make political decisions. This research proposes a new method for measuring the influence of political beliefs within larger context of belief system networks, based on the advances in psychometric network methods and network influence research. Using the latest round of the European Social Survey data, we demonstrate this approach on a belief network expressing support for the regime in 29 European countries and capturing beliefs related to support for regime performance, principles, institutions, and political actors. Our results show that the average influence of beliefs can be related to the consistency and connectivity of the belief network and that the influence of specific beliefs (e.g. Satisfaction with Democracy) on a country level has a significant negative correlation with external indicators from the same domain (e.g. Liberal Democracy index), which suggests that highly influential beliefs are related to pressing political issues. These findings suggest that network-based belief influence metrics estimated from large-scale survey data can be used a new type of indicator in comparative political research, which opens new avenues for integrating psychometric network analysis methods into political science methodology.


title: A Dynamic Mode Decomposition Extension for the Forecasting of Parametric Dynamical Systems

abstract: Dynamic mode decomposition (DMD) has recently become a popular tool for the non-intrusive analysis of dynamical systems. Exploiting Proper Orthogonal Decomposition (POD) as a dimensionality reduction technique, DMD is able to approximate a dynamical system as a sum of spatial basis evolving linearly in time, thus enabling a better understanding of the physical phenomena and forecasting of future time instants. In this work we propose an extension of DMD to parameterized dynamical systems, focusing on the future forecasting of the output of interest in a parametric context. Initially all the snapshots -- for different parameters and different time instants -- are projected to a reduced space; then DMD, or one of its variants, is employed to approximate reduced snapshots for future time instants. Exploiting the low dimension of the reduced space the predicted reduced snapshots are then combined using regression techniques, thus enabling the possibility to approximate any untested parametric configuration in future. This paper depicts in detail the algorithmic core of this method; we also present and discuss three test cases for our algorithm: a simple dynamical system with a linear parameter dependency, a heat problem with nonlinear parameter dependency and a fluid dynamics problem with nonlinear parameter dependency.


title: Enhancing exploration algorithms for navigation with visual SLAM

abstract: Exploration is an important step in autonomous navigation of robotic systems. In this paper we introduce a series of enhancements for exploration algorithms in order to use them with vision-based simultaneous localization and mapping (vSLAM) methods. We evaluate developed approaches in photo-realistic simulator in two modes: with ground-truth depths and neural network reconstructed depth maps as vSLAM input. We evaluate standard metrics in order to estimate exploration coverage.


title: Disentangled Representation with Dual-stage Feature Learning for Face Anti-spoofing

abstract: As face recognition is widely used in diverse security-critical applications, the study of face anti-spoofing (FAS) has attracted more and more attention. Several FAS methods have achieved promising performances if the attack types in the testing data are the same as training data, while the performance significantly degrades for unseen attack types. It is essential to learn more generalized and discriminative features to prevent overfitting to pre-defined spoof attack types. This paper proposes a novel dual-stage disentangled representation learning method that can efficiently untangle spoof-related features from irrelevant ones. Unlike previous FAS disentanglement works with one-stage architecture, we found that the dual-stage training design can improve the training stability and effectively encode the features to detect unseen attack types. Our experiments show that the proposed method provides superior accuracy than the state-of-the-art methods on several cross-type FAS benchmarks.


title: Newsalyze: Effective Communication of Person-Targeting Biases in News Articles

abstract: Media bias and its extreme form, fake news, can decisively affect public opinion. Especially when reporting on policy issues, slanted news coverage may strongly influence societal decisions, e.g., in democratic elections. Our paper makes three contributions to address this issue. First, we present a system for bias identification, which combines state-of-the-art methods from natural language understanding. Second, we devise bias-sensitive visualizations to communicate bias in news articles to non-expert news consumers. Third, our main contribution is a large-scale user study that measures bias-awareness in a setting that approximates daily news consumption, e.g., we present respondents with a news overview and individual articles. We not only measure the visualizations' effect on respondents' bias-awareness, but we can also pinpoint the effects on individual components of the visualizations by employing a conjoint design. Our bias-sensitive overviews strongly and significantly increase bias-awareness in respondents. Our study further suggests that our content-driven identification method detects groups of similarly slanted news articles due to substantial biases present in individual news articles. In contrast, the reviewed prior work rather only facilitates the visibility of biases, e.g., by distinguishing left- and right-wing outlets.


title: Quantum Fokker-Planck Master Equation for Continuous Feedback Control

abstract: Measurement and feedback control are essential features of quantum science, with applications ranging from quantum technology protocols to information-to-work conversion in quantum thermodynamics. Theoretical descriptions of feedback control are typically given in terms of stochastic equations requiring numerical solutions, or are limited to linear feedback protocols. Here we present a formalism for continuous quantum measurement and feedback, both linear and nonlinear. Our main result is a quantum Fokker-Planck master equation describing the joint dynamics of a quantum system and a detector with finite bandwidth. For fast measurements, we derive a Markovian master equation for the system alone, amenable to analytical treatment. We illustrate our formalism by investigating two basic information engines, one quantum and one classical.


title: DE-RSTC: A rational secure two-party computation protocol based on direction entropy

abstract: Rational secure multi-party computation (RSMC) means two or more rational parties to complete a function on private inputs. In the process, the rational parties choose strategies to maximize utility, which will cause players to maliciously execute the protocol and undermine the fairness and correctness of the protocol. To solve this problem, we leverage game theory to propose the direction entropy-based solution. First, we utilize the direction vector of the direction entropy to examine the player's strategy uncertainty and quantify its strategy from different dimensions. Specifically, when parties choose a cooperation strategy, the direction vector is positive, and the information transmitted is positive, conversely, it is negative information. Then, we provide mutual information to construct new utility functions for the players. What's more, we measure the mutual information of players to appraise their strategies. Finally, we prove in detail the protocol we gave, and the result show that the fairness problem in rational secure two-party computation. We also prove that the proposed protocol reaches the Nash equilibrium. Furthermore, we conduct experiments using mutual information to construct utility, and the results show that the utility obtained when the player is honest will be higher.


title: Machine Covering in the Random-Order Model

abstract: In the Online Machine Covering problem jobs, defined by their sizes, arrive one by one and have to be assigned to $m$ parallel and identical machines, with the goal of maximizing the load of the least-loaded machine. In this work, we study the Machine Covering problem in the recently popular random-order model. Here no extra resources are present, but instead the adversary is weakened in that it can only decide upon the input set while jobs are revealed uniformly at random. It is particularly relevant to Machine Covering where lower bounds are usually associated to highly structured input sequences. We first analyze Graham's Greedy-strategy in this context and establish that its competitive ratio decreases slightly to $\Theta\left(\frac{m}{\log(m)}\right)$ which is asymptotically tight. Then, as our main result, we present an improved $\tilde{O}(\sqrt[4]{m})$-competitive algorithm for the problem. This result is achieved by exploiting the extra information coming from the random order of the jobs, using sampling techniques to devise an improved mechanism to distinguish jobs that are relatively large from small ones. We complement this result with a first lower bound showing that no algorithm can have a competitive ratio of $O\left(\frac{\log(m)}{\log\log(m)}\right)$ in the random-order model. This lower bound is achieved by studying a novel variant of the Secretary problem, which could be of independent interest.


title: Investigating Man-in-the-Middle-based False Data Injection in a Smart Grid Laboratory Environment

abstract: With the increasing use of information and communication technology in electrical power grids, the security of energy supply is increasingly threatened by cyber-attacks. Traditional cyber-security measures, such as firewalls or intrusion detection/prevention systems, can be used as mitigation and prevention measures, but their effective use requires a deep understanding of the potential threat landscape and complex attack processes in energy information systems. Given the complexity and lack of detailed knowledge of coordinated, timed attacks in smart grid applications, we need information and insight into realistic attack scenarios in an appropriate and practical setting. In this paper, we present a man-in-the-middle-based attack scenario that intercepts process communication between control systems and field devices, employs false data injection techniques, and performs data corruption such as sending false commands to field devices. We demonstrate the applicability of the presented attack scenario in a physical smart grid laboratory environment and analyze the generated data under normal and attack conditions to extract domain-specific knowledge for detection mechanisms.


title: A Dimensionality Reduction Approach for Convolutional Neural Networks

abstract: The focus of this paper is the application of classical model order reduction techniques, such as Active Subspaces and Proper Orthogonal Decomposition, to Deep Neural Networks. We propose a generic methodology to reduce the number of layers of a pre-trained network by combining the aforementioned techniques for dimensionality reduction with input-output mappings, such as Polynomial Chaos Expansion and Feedforward Neural Networks. The necessity of compressing the architecture of an existing Convolutional Neural Network is motivated by its application in embedded systems with specific storage constraints. Our experiment shows that the reduced nets obtained can achieve a level of accuracy similar to the original Convolutional Neural Network under examination, while saving in memory allocation.


title: Speeding-Up Back-Propagation in DNN: Approximate Outer Product with Memory

abstract: In this paper, an algorithm for approximate evaluation of back-propagation in DNN training is considered, which we term Approximate Outer Product Gradient Descent with Memory (Mem-AOP-GD). The Mem-AOP-GD algorithm implements an approximation of the stochastic gradient descent by considering only a subset of the outer products involved in the matrix multiplications that encompass backpropagation. In order to correct for the inherent bias in this approximation, the algorithm retains in memory an accumulation of the outer products that are not used in the approximation. We investigate the performance of the proposed algorithm in terms of DNN training loss under two design parameters: (i) the number of outer products used for the approximation, and (ii) the policy used to select such outer products. We experimentally show that significant improvements in computational complexity as well as accuracy can indeed be obtained through Mem-AOPGD.


title: A reservoir of timescales in random neural networks

abstract: The temporal activity of many biological systems, including neural circuits, exhibits fluctuations simultaneously varying over a large range of timescales. The mechanisms leading to this temporal heterogeneity are yet unknown. Here we show that random neural networks endowed with a distribution of self-couplings, representing functional neural clusters of different sizes, generate multiple timescales activity spanning several orders of magnitude. When driven by a time-dependent broadband input, slow and fast neural clusters preferentially entrain slow and fast spectral components of the input, respectively, suggesting a potential mechanism for spectral demixing in cortical circuits.


title: Branch Predicting with Sparse Distributed Memories

abstract: Modern processors rely heavily on speculation to keep the pipeline filled and consequently execute and commit instructions as close to maximum capacity as possible. To improve instruction-level parallelism, the processor core needs to fetch and decode multiple instructions per cycle and has come to rely on incredibly accurate branch prediction. However, this comes at cost of the increased area and complexity which is needed for modern high accuracy branch predictors. The key idea described in this work is to use hyperdimensional computing and sparse distributed memory principles to create a novel branch predictor that can deliver complex predictions for a fraction of the current area. Sparse distributed memories can store vast amounts of data in a compressed manner, theoretically enabling branch histories larger and more precise than the branch predictors used today to be stored with equal or smaller area footprint. Furthermore, as all the data is in a hashed format and due to the nature of the hashing scheme used, it is inherently harder to manipulate with known side-channel attacks. We describe our proof-of-concept and evaluate it against a state-of-the-art academic TAGE predictor. Our experiments are conducted on realistic synthetic branch predictor patterns and the Championship Branch Prediction traces and show competitive accuracy. Finally, we describe techniques that can be used to solve some of the challenges of processing with hyperdimensional vectors in order to deliver timely predictions.


title: RKHS-SHAP: Shapley Values for Kernel Methods

abstract: Feature attribution for kernel methods is often heuristic and not individualised for each prediction. To address this, we turn to the concept of Shapley values~(SV), a coalition game theoretical framework that has previously been applied to different machine learning model interpretation tasks, such as linear models, tree ensembles and deep networks. By analysing SVs from a functional perspective, we propose \textsc{RKHS-SHAP}, an attribution method for kernel machines that can efficiently compute both \emph{Interventional} and \emph{Observational Shapley values} using kernel mean embeddings of distributions. We show theoretically that our method is robust with respect to local perturbations - a key yet often overlooked desideratum for consistent model interpretation. Further, we propose \emph{Shapley regulariser}, applicable to a general empirical risk minimisation framework, allowing learning while controlling the level of specific feature's contributions to the model. We demonstrate that the Shapley regulariser enables learning which is robust to covariate shift of a given feature and fair learning which controls the SVs of sensitive features.


title: Domain Generalisation for Apparent Emotional Facial Expression Recognition across Age-Groups

abstract: Apparent emotional facial expression recognition has attracted a lot of research attention recently. However, the majority of approaches ignore age differences and train a generic model for all ages. In this work, we study the effect of using different age-groups for training apparent emotional facial expression recognition models. To this end, we study Domain Generalisation in the context of apparent emotional facial expression recognition from facial imagery across different age groups. We first compare several domain generalisation algorithms on the basis of out-of-domain-generalisation, and observe that the Class-Conditional Domain-Adversarial Neural Networks (CDANN) algorithm has the best performance. We then study the effect of variety and number of age-groups used during training on generalisation to unseen age-groups and observe that an increase in the number of training age-groups tends to increase the apparent emotional facial expression recognition performance on unseen age-groups. We also show that exclusion of an age-group during training tends to affect more the performance of the neighbouring age groups.


title: Prosecutor Politics: The Impact of Election Cycles on Criminal Sentencing in the Era of Rising Incarceration

abstract: I investigate how political incentives affect the behavior of district attorneys (DAs). I develop a theoretical model that predicts DAs will increase sentencing intensity in an election period compared to the period prior. To empirically test this prediction, I compile one of the most comprehensive datasets to date on the political careers of all district attorneys in office during the steepest rise in incarceration in U.S. history (roughly 1986-2006). Using quasi-experimental methods, I find causal evidence that being in a DA election year increases total admissions per capita and total months sentenced per capita. I estimate that the election year effects on admissions are akin to moving 0.85 standard deviations along the distribution of DA behavior within state (e.g., going from the 50th to 80th percentile in sentencing intensity). I find evidence that election effects are larger (1) when DA elections are contested, (2) in Republican counties, and (3) in the southern United States--all these factors are consistent with the perspective that election effects arise from political incentives influencing DAs. Further, I find that district attorney election effects decline over the period 1986-2006, in tandem with U.S. public opinion softening regarding criminal punishment. These findings suggest DA behavior may respond to voter preferences--in particular to public sentiment regarding the harshness of the court system.


title: Continuation of Famous Art with AI: A Conditional Adversarial Network Inpainting Approach

abstract: Much of the state-of-the-art in image synthesis inspired by real artwork are either entirely generative by filtered random noise or inspired by the transfer of style. This work explores the application of image inpainting to continue famous artworks and produce generative art with a Conditional GAN. During the training stage of the process, the borders of images are cropped, leaving only the centre. An inpainting GAN is then tasked with learning to reconstruct the original image from the centre crop by way of minimising both adversarial and absolute difference losses, which are analysed by both their Fr\'echet Inception Distances and manual observations which are presented. Once the network is trained, images are then resized rather than cropped and presented as input to the generator. Following the learning process, the generator then creates new images by continuing from the edges of the original piece. Three experiments are performed with datasets of 4766 landscape paintings (impressionism and romanticism), 1167 Ukiyo-e works from the Japanese Edo period, and 4968 abstract artworks. Results show that geometry and texture (including canvas and paint) as well as scenery such as sky, clouds, water, land (including hills and mountains), grass, and flowers are implemented by the generator when extending real artworks. In the Ukiyo-e experiments, it was observed that features such as written text were generated even in cases where the original image did not have any, due to the presence of an unpainted border within the input image.


title: Projected Model Counting: Beyond Independent Support

abstract: The past decade has witnessed a surge of interest in practical techniques for projected model counting. Despite significant advancements, however, performance scaling remains the Achilles' heel of this field. A key idea used in modern counters is to count models projected on an \emph{independent support} that is often a small subset of the projection set, i.e. original set of variables on which we wanted to project. While this idea has been effective in scaling performance, the question of whether it can benefit to count models projected on variables beyond the projection set, has not been explored. In this paper, we study this question and show that contrary to intuition, it can be beneficial to project on variables beyond the projection set. In applications such as verification of binarized neural networks, quantification of information flow, reliability of power grids etc., a good upper bound of the projected model count often suffices. We show that in several such cases, we can identify a set of variables, called upper bound support (UBS), that is not necessarily a subset of the projection set, and yet counting models projected on UBS guarantees an upper bound of the true projected model count. Theoretically, a UBS can be exponentially smaller than the smallest independent support. Our experiments show that even otherwise, UBS-based projected counting can be more efficient than independent support-based projected counting, while yielding bounds of very high quality. Based on extensive experiments, we find that UBS-based projected counting can solve many problem instances that are beyond the reach of a state-of-the-art independent support-based projected model counter.


title: A unified framework for walking and running of bipedal robots

abstract: In this paper, we propose a novel framework capable of generating various walking and running gaits for bipedal robots. The main goal is to relax the fixed center of mass (CoM) height assumption of the linear inverted pendulum model (LIPM) and generate a wider range of walking and running motions, without a considerable increase in complexity. To do so, we use the concept of virtual constraints in the centroidal space which enables generating motions beyond walking while keeping the complexity at a minimum. By a proper choice of these virtual constraints, we show that we can generate different types of walking and running motions. More importantly, enforcing the virtual constraints through feedback renders the dynamics linear and enables us to design a feedback control mechanism which adapts the next step location and timing in face of disturbances, through a simple quadratic program (QP). To show the effectiveness of this framework, we showcase different walking and running simulations of the biped robot Bolt in the presence of both environmental uncertainties and external disturbances.


title: Euler characteristic and signature of real semi-stable degenerations

abstract: We give a motivic proof of the fact that for non-singular real tropical complete intersections, the Euler characteristic of the real part is equal to the signature of the complex part. This has originally been proved by Itenberg in the case of surfaces in $\mathbb CP^3$, and has been successively generalized by Bertrand, and by Bihan and ertrand. Our proof, different from the previous approaches, is an application of the motivic nearby fiber of semi-stable degenerations. In particular it extends the original result by Itenberg-Bertrand-Bihan to real analytic families admitting a $\mathbb Q$-non-singular tropical limit.


title: A Formalisation of Abstract Argumentation in Higher-Order Logic

abstract: We present an approach for representing abstract argumentation frameworks based on an encoding into classical higher-order logic. This provides a uniform framework for computer-assisted assessment of abstract argumentation frameworks using interactive and automated reasoning tools. This enables the formal analysis and verification of meta-theoretical properties as well as the flexible generation of extensions and labellings with respect to well-known argumentation semantics.


title: Characterization of groups $E_6(3)$ and ${^2}E_6(3)$ by Gruenberg--Kegel graph

abstract: The Gruenberg--Kegel graph (or the prime graph) $\Gamma(G)$ of a finite group $G$ is defined as follows. The vertex set of $\Gamma(G)$ is the set of all prime divisors of the order of $G$. Two distinct primes $r$ and $s$ regarded as vertices are adjacent in $\Gamma(G)$ if and only if there exists an element of order $rs$ in $G$. Suppose that $L\cong E_6(3)$ or $L\cong{}^2E_6(3)$. We prove that if $G$ is a finite group such that $\Gamma(G)=\Gamma(L)$, then $G\cong L$.


title: The Hawking-Penrose singularity theorem for $C^1$-Lorentzian metrics

abstract: We extend both the Hawking-Penrose Theorem and its generalisation due to Galloway and Senovilla to Lorentzian metrics of regularity $C^1$. For metrics of such low regularity, two main obstacles have to be addressed. On the one hand, the Ricci tensor now is distributional, and on the other hand, unique solvability of the geodesic equation is lost. To deal with the first issue in a consistent way, we develop a theory of tensor distributions of finite order, which also provides a framework for the recent proofs of the theorems of Hawking and of Penrose for $C^1$-metrics [7]. For the second issue, we study geodesic branching and add a further alternative to causal geodesic incompleteness to the theorem, namely a condition of maximal causal non-branching. The genericity condition is re-cast in a distributional form that applies to the current reduced regularity while still being fully compatible with the smooth and $C^{1,1}$-settings. In addition, we develop refinements of the comparison techniques used in the proof of the $C^{1,1}$-version of the theorem [8]. The necessary results from low regularity causality theory are collected in an appendix.


title: Robust non-integer conductance in disordered 2D Dirac semimetals

abstract: We study the conductance $G$ of 2D Dirac semimetal nanowires at the presence of disorder. For an even nanowire length $L$ determined by the number of unit cells, we find non-integer values for $G$ that are independent of $L$ and persist with weak disorder, indicated by the vanishing fluctuations of $G$. The effect is created by a combination of the scattering effects at the contacts(interface) between the leads and the nanowire, an energy gap present in the nanowire for even $L$ and the topological properties of the 2D Dirac semimetals. Unlike conventional materials the reduced $G$ due to the scattering at the interface, is stabilized at non-integer values inside the nanowire, leading to a topological phase for weak disorder. For strong disorder the system leaves the topological phase and the fluctuations of $G$ are increased as the system undergoes a transition/crossover toward the Anderson localized(insulating) phase, via a non-standard disordered phase. We study the scaling and the statistics of $G$ at these phases. In addition we have found that the effect of robust non-integer $G$ disappears for odd $L$, which results in integer $G$, determined by the number of open channels in the nanowire, due to resonant scattering.


title: Room-temperature silicon platform for GHz-frequency nano-electro-opto-mechanical systems

abstract: Nano-electro-opto-mechanical systems enable the synergistic coexistence of electrical, mechanical, and optical signals on a chip to realize new functions. Most of the technology platforms proposed for the fabrication of these systems so far are not fully compatible with the mainstream CMOS technology, thus hindering mass-scale utilization. We have developed a CMOS technology platform for nano-electro-opto-mechanical systems that includes piezoelectric interdigitated transducers for electronic driving of mechanical signals and nanocrystalline silicon nanobeams for enhanced optomechanical interaction. Room temperature operation of devices at 2 GHz and with peak sensitivity down to 2.6 cavity phonons is demonstrated. Our proof-of-principle technology platform can be integrated and interfaced with silicon photonics, electronics, and MEMS devices and may enable multiple functions for coherent signal processing in the classical and quantum domains.


title: Analysis of French Phonetic Idiosyncrasies for Accent Recognition

abstract: Speech recognition systems have made tremendous progress since the last few decades. They have developed significantly in identifying the speech of the speaker. However, there is a scope of improvement in speech recognition systems in identifying the nuances and accents of a speaker. It is known that any specific natural language may possess at least one accent. Despite the identical word phonemic composition, if it is pronounced in different accents, we will have sound waves, which are different from each other. Differences in pronunciation, in accent and intonation of speech in general, create one of the most common problems of speech recognition. If there are a lot of accents in language we should create the acoustic model for each separately. We carry out a systematic analysis of the problem in the accurate classification of accents. We use traditional machine learning techniques and convolutional neural networks, and show that the classical techniques are not sufficiently efficient to solve this problem. Using spectrograms of speech signals, we propose a multi-class classification framework for accent recognition. In this paper, we focus our attention on the French accent. We also identify its limitation by understanding the impact of French idiosyncrasies on its spectrograms.


title: Higher spin glueballs from functional methods

abstract: We calculate the glueball spectrum for spin up to J=4 and positive charge parity in pure Yang-Mills theory. We construct the full bases for J=0,1,2,3,4 and discuss the relation to gauge invariant operators. Using a fully self-contained truncation of Dyson-Schwinger equations as input, we obtain ground states and first and second excited states from extrapolations of the eigenvalue curves. Where available, we find good quantitative agreement with lattice results.


title: Derived terms without derivation a shifted perspective on the derived-term automaton

abstract: We present here a construction for the derived term automaton (aka partial derivative, or Antimirov, automaton) of a rational (or regular) expression based on a sole induction on the depth of the expression and without making reference to an operation of derivation of the expression. It is particularly well-suited to the case of weighted rational expressions.


title: Graph Partner Neural Networks for Semi-Supervised Learning on Graphs

abstract: Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is inevitable for deep GCNs to suffer from an over-smoothing issue that the representations of nodes will tend to be indistinguishable after repeated graph convolution operations. To address this problem, we propose the Graph Partner Neural Network (GPNN) which incorporates a de-parameterized GCN and a parameter-sharing MLP. We provide empirical and theoretical evidence to demonstrate the effectiveness of the proposed MLP partner on tackling over-smoothing while benefiting from appropriate smoothness. To further tackle over-smoothing and regulate the learning process, we introduce a well-designed consistency contrastive loss and KL divergence loss. Besides, we present a graph enhancement technique to improve the overall quality of edges in graphs. While most GCNs can work with shallow architecture only, GPNN can obtain better results through increasing model depth. Experiments on various node classification tasks have demonstrated the state-of-the-art performance of GPNN. Meanwhile, extensive ablation studies are conducted to investigate the contributions of each component in tackling over-smoothing and improving performance.


title: Building a Smart EM Environment -- AI-Enhanced Aperiodic Micro-Scale Design of Passive EM Skins

abstract: An innovative process for the design of static passive smart skins (SPSSs) is proposed to take into account, within the synthesis, the electromagnetic (EM) interactions due to their finite (macro-level) size and aperiodic (micro-scale) layouts. Such an approach leverages on the combination of an inverse source (IS) formulation, to define the SPSS surface currents, and of an instance of the System-by-Design paradigm, to synthesize the unit cell (UC) descriptors suitable for supporting these currents. As for this latter step, an enhanced Artificial Intelligence (IA)-based digital twin (DT) is built to efficiently and reliably predict the relationships among the UCs and the non-uniform coupling effects arising when the UCs are irregularly assembled to build the corresponding SPSS. Towards this end and unlike state-of-the-art approaches, an aperiodic finite small-scale model of the SPSS is derived to generate the training database for the DT implementation. A set of representative numerical experiments, dealing with different radiation objectives and smart skin apertures, is reported to assess the reliability of the conceived design process and to illustrate the radiation features of the resulting layouts, validated with accurate full-wave simulations, as well.


title: Quantum gravity phenomenology induced in the propagation of UHECR, a kinematical solution in Finsler and generalized Finsler spacetime

abstract: It is well-known that the Universe is opaque to the propagation of Ultra-High-Energy Cosmic Rays (UHECRs) since these particles dissipate energy during their propagation interacting with the Cosmic Microwave Background (CMB) mainly in the so-called GZK cut-off phenomenon. Some experimental evidence seems to hint at the possibility of a dilation of the GZK predicted opacity sphere. It is well-known that kinematical perturbations caused by supposed quantum gravity (QG) effects can modify the foreseen GZK opacity horizon. The introduction of Lorentz Invariance Violation (LIV) can indeed reduce, in some cases making negligible, the CMB-UHECRs interaction probability. In this work we explore the effects induced by modified kinematics in the UHECRs phenomenology from the QG perspective. We explore the possibility of a geometrical description of the massive fermions interaction with the supposed quantum structure of spacetime in order to introduce a Lorentz covariance modifification. The kinematics is amended modifying the Dispersion Relations (DRs) of free particles in the context of a covariance-preserving framework. This spacetime description requires a more general geometry than the usual Riemannian one, indicating for instance the Finsler construction and the related generalized Finsler spacetime as ideal candidates. Finally we investigate the correlation between the magnitude of Lorentz covariance modification and the attenuation length of the photopion production process related to the GZK cut-off, demonstrating that the predicted opacity horizon can be dilated even in the context of a theory that does not require any privileged reference frame.


title: Phenomenological Effects of CPT and Lorentz Invariance Violation in Particle and Astroparticle Physics

abstract: It is well known that a fundamental theorem of Quantum Field Theory (QFT) set in at spacetime ensures the CPT invariance of the theory. This symmetry is strictly connected to the Lorentz covariance, and consequently to the fundamental structure of spacetime. Therefore it may be interesting to investigate the possibility of departure from this fundamental symmetry, since it can furnish a window to observe possible effects of a more fundamental quantum gravity theory in a "lower energy limit". Moreover, in the past, the inquiry of symmetry violations provided a starting point for new physics discoveries. A useful physical framework for this kind of search is provided by astroparticle physics, thanks to the high energy involved and to the long path travelled by particles accelerated by an astrophysical object and then revealed on Earth. Astrophysical messengers are therefore very important probes for investigating this sector, involving high energy photons, charged particles, and neutrinos of cosmic origin. In addition, one can also study artificial neutrino beams, investigated at accelerator experiments. Here we discuss the state of art for all these topics and some interesting new proposals, both from a theoretical and phenomenological point of view.


title: Neutrino Oscillations and Lorentz Invariance Violation

abstract: This work explores the possibility of resorting to neutrino phenomenology to detect evidence of new physics, caused by the residual signals of the supposed quantum structure of spacetime. In particular, this work investigates the effects on neutrino oscillations and mass hierarchy detection, predicted by models that violate Lorentz invariance, preserving the spacetime isotropy and homogeneity. Neutrino physics is the ideal environment where conducting the search for new "exotic" physics, since the oscillation phenomenon is not included in the original formulation of the minimal Standard Model (SM) of particles. The confirmed observation of the neutrino oscillation phenomenon is, therefore, the first example of physics beyond the SM and can indicate the necessity to resort to new theoretical models. In this work, the hypothesis that the supposed Lorentz Invariance Violation (LIV) perturbations can influence the oscillation pattern is investigated. LIV theories are indeed constructed assuming modified kinematics, caused by the interaction of massive particles with the spacetime background. This means that the dispersion relations are modified, so it appears natural to search for effects caused by LIV in physical phenomena governed by masses, as in the case of neutrino oscillations. In addition, the neutrino oscillation phenomenon is interesting since there are three different mass eigenstates and in a LIV scenario, which preserves isotropy, at least two different species of particle must interact.


title: Strange quark matter and proto-strange stars in an equivaparticle model

abstract: The properties of strange quark matter and the structures of (proto-)strange stars are studied within the framework of an equivparticle model, where a new quark mass scaling and self-consistent thermodynamic treatment are adopted. Our results show that the perturbative interaction has a strong impact on the properties of strange quark matter. It is found that the energy per baryon increases with temperature, while the free energy decreases and eventually becomes negative. At fixed temperatures, the pressure at the minimum free energy per baryon is zero, suggesting that the thermodynamic self-consistency is preserved. Additionally, the sound velocity v in quark matter approaches to the extreme relativistic limit (c/sqrt(3)) as the density increases. By increasing the strengths of confinement parameter D and perturbation parameter C, the tendency for v to approach the extreme relativistic limit at high density is slightly weakened. For (proto-)strange stars, in contrast to the quark mass scalings adopted in previous publications, the new quark mass scaling can accommodate massive proto-strange stars with their maximum mass surpassing twice the solar mass at T = 50 MeV.


title: Ride Sharing & Data Privacy: An Analysis of the State of Practice

abstract: Digital services like ride sharing rely heavily on personal data as individuals have to disclose personal information in order to gain access to the market and exchange their information with other participants; yet, the service provider usually gives little to no information regarding the privacy status of the disclosed information though privacy concerns are a decisive factor for individuals to (not) use these services. We analyzed how popular ride sharing services handle user privacy to assess the current state of practice. The results show that services include a varying set of personal data and offer limited privacy-related features.


title: A snapshot of the oldest AGN feedback phases

abstract: Active Galactic Nuclei (AGN) inject large amounts of energy into their host galaxies and surrounding environment, shaping their properties and evolution. In particular, AGN jets inflate cosmic-ray lobes, which can rise buoyantly as light `bubbles' in the surrounding medium, displacing and heating the encountered thermal gas and thus halting its spontaneous cooling. These bubbles have been identified in a wide range of systems. However, due to the short synchrotron lifetime of electrons, the most advanced phases of their evolution have remained observationally unconstrained, preventing us to fully understand their coupling with the external medium, and thus AGN feedback. Simple subsonic hydrodynamic models predict that the pressure gradients, naturally present around the buoyantly rising bubbles, transform them into toroidal structures, resembling mushroom clouds in a stratified atmosphere. The way and timescales on which these tori will eventually disrupt depend on various factors including magnetic fields and plasma viscosity. Here we report LOFAR observations below 200 MHz, sensitive to the oldest radio-emitting particles, showing the late evolution of multiple generations of cosmic-ray AGN bubbles in a galaxy group with unprecedented level of detail. The bubbles' buoyancy power can efficiently offset the radiative cooling of the intragroup medium. However, the bubbles have still not thoroughly mixed with the thermal gas, after hundreds of million years, likely under the action of magnetic fields.


title: Secure domination number of $k$-subdivision of graphs

abstract: Let $G=(V,E)$ be a simple graph. A dominating set of $G$ is a subset $D\subseteq V$ such that every vertex not in $D$ is adjacent to at least one vertex in $D$. The cardinality of a smallest dominating set of $G$, denoted by $\gamma(G)$, is the domination number of $G$. A dominating set $D$ is called a secure dominating set of $G$, if for every $u\in V-D$, there exists a vertex $v\in D$ such that $uv \in E$ and $D-\{v\}\cup\{u\}$ is a dominating set of $G$. The cardinality of a smallest secure dominating set of $G$, denoted by $\gamma_s(G)$, is the secure domination number of $G$. For any $k \in \mathbb{N}$, the $k$-subdivision of $G$ is a simple graph $G^{\frac{1}{k}}$ which is constructed by replacing each edge of $G$ with a path of length $k$. In this paper, we study the secure domination number of $k$-subdivision of $G$.


title: Electric Vehicle Automatic Charging System Based on Vision-force Fusion

abstract: Electric vehicles are an emerging means of transportation with environmental friendliness. The automatic charging is a hot topic in this field that is full of challenges. We introduce a complete automatic charging system based on vision-force fusion, which includes perception, planning and control for robot manipulations of the system. We design the whole system in simulation and transfer it to the real world. The experimental results prove the effectiveness of our system.


title: Learning Optimal Conformal Classifiers

abstract: Modern deep learning based classifiers show very high accuracy on test data but this does not provide sufficient guarantees for safe deployment, especially in high-stake AI applications such as medical diagnosis. Usually, predictions are obtained without a reliable uncertainty estimate or a formal guarantee. Conformal prediction (CP) addresses these issues by using the classifier's predictions, e.g., its probability estimates, to predict confidence sets containing the true class with a user-specified probability. However, using CP as a separate processing step after training prevents the underlying model from adapting to the prediction of confidence sets. Thus, this paper explores strategies to differentiate through CP during training with the goal of training model with the conformal wrapper end-to-end. In our approach, conformal training (ConfTr), we specifically "simulate" conformalization on mini-batches during training. Compared to standard training, ConfTr reduces the average confidence set size (inefficiency) of state-of-the-art CP methods applied after training. Moreover, it allows to "shape" the confidence sets predicted at test time, which is difficult for standard CP. On experiments with several datasets, we show ConfTr can influence how inefficiency is distributed across classes, or guide the composition of confidence sets in terms of the included classes, while retaining the guarantees offered by CP.


title: Topologically Regularized Data Embeddings

abstract: Unsupervised feature learning often finds low-dimensional embeddings that capture the structure of complex data. For tasks for which prior expert topological knowledge is available, incorporating this into the learned representation may lead to higher quality embeddings. For example, this may help one to embed the data into a given number of clusters, or to accommodate for noise that prevents one from deriving the distribution of the data over the model directly, which can then be learned more effectively. However, a general tool for integrating different prior topological knowledge into embeddings is lacking. Although differentiable topology layers have been recently developed that can (re)shape embeddings into prespecified topological models, they have two important limitations for representation learning, which we address in this paper. First, the currently suggested topological losses fail to represent simple models such as clusters and flares in a natural manner. Second, these losses neglect all original structural (such as neighborhood) information in the data that is useful for learning. We overcome these limitations by introducing a new set of topological losses, and proposing their usage as a way for topologically regularizing data embeddings to naturally represent a prespecified model. We include thorough experiments on synthetic and real data that highlight the usefulness and versatility of this approach, with applications ranging from modeling high-dimensional single-cell data, to graph embedding.