title: Fluid-fluid phase behaviour in the explicit solvent ionic model: hard spherocylinder solvent molecules

abstract: We study a fluid-fluid phase transition of the explicit solvent model represented as a mixture of the restricted primitive model (RPM) of ionic fluid and neutral hard spherocylinders (HSC). To this end, we combine two theoretical approaches, i.e., the scale particle theory (SPT) and the associative mean spherical approximation (AMSA). Whereas the SPT is sufficient to provide a rather good description of a reference system taking into account hard-core interactions, the AMSA is known to be efficient in treating the Coulomb interactions between the ions. Alternatively, we also use the mean spherical approximation (MSA) for comparison. In general, both approximations lead to similar qualitative results for the phase diagrams: the region of coexisting envelope becomes broader and shifts towards larger densities and higher temperatures when the pressure increases. However, the AMSA and the MSA produce different concentration dependences, i.e., contrary to the MSA, the AMSA phase diagrams show that the high-density phase mostly consists of the ions for all pressures considered. To demonstrate the effect of asphericity of solvent molecules on the fluid-fluid phase transition, we consider an "equivalent" mixture in which the HSC particles are replaced by hard spheres (HS) of the same volume. It is observed that in the case of HSC solvent (RPM-HSC model), the region of phase coexistence is wider than for the case of the solvent molecules being of spherical shape (RPM-HS model). It is also found that the critical temperature is higher in the RPM-HSC model than in the RPM-HS model, though it becomes the same at higher pressures in the MSA, while in the AMSA this difference remains essential.


title: Underlying Flag Polymatroids

abstract: We describe a natural geometric relationship between matroids and underlying flag matroids by relating the geometry of the greedy algorithm to monotone path polytopes. This perspective allows us to generalize the construction of underlying flag matroids to polymatroids. We show that the polytopes associated to underlying flag polymatroid are simple by proving that they are normally equivalent to certain nestohedra. We use this to show that polymatroids realized by subspace arrangements give rise to smooth toric varieties in flag varieties and we interpret our construction in terms of toric quotients. We give various examples that illustrate the rich combinatorial structure of flag polymatroids. Finally, we study general monotone paths on polymatroid polytopes, that relate to the enumeration of certain Young tableaux.


title: Inviscid limit for the compressible Navier-Stokes equations with density dependent viscosity

abstract: We consider the compressible Navier-Stokes system describing the motion of a barotropic fluid with density dependent viscosity confined in a three-dimensional bounded domain $\Omega$. We show the convergence of the weak solution to the compressible Navier-Stokes system to the strong solution to the compressible Euler system when the viscosity and the damping coefficients tend to zero.


title: Compound Poisson Processes: Potentials, Green Measures and Random Times

abstract: In this paper we study the existence of Green measures for Markov processes with a nonlocal jump generator. The jump generator has no second moment and satisfies a suitable condition on its Fourier transform. We also study the same problem for certain classes of random time changes Markov processes with jump generator.


title: Learning Human Body Motions from Skeleton-Based Observations for Robot-Assisted Therapy

abstract: Robots applied in therapeutic scenarios, for instance in the therapy of individuals with Autism Spectrum Disorder, are sometimes used for imitation learning activities in which a person needs to repeat motions by the robot. To simplify the task of incorporating new types of motions that a robot can perform, it is desirable that the robot has the ability to learn motions by observing demonstrations from a human, such as a therapist. In this paper, we investigate an approach for acquiring motions from skeleton observations of a human, which are collected by a robot-centric RGB-D camera. Given a sequence of observations of various joints, the joint positions are mapped to match the configuration of a robot before being executed by a PID position controller. We evaluate the method, in particular the reproduction error, by performing a study with QTrobot in which the robot acquired different upper-body dance moves from multiple participants. The results indicate the method's overall feasibility, but also indicate that the reproduction quality is affected by noise in the skeleton observations.


title: Forecasting euro area inflation using a huge panel of survey expectations

abstract: In this paper, we forecast euro area inflation and its main components using an econometric model which exploits a massive number of time series on survey expectations for the European Commission's Business and Consumer Survey. To make estimation of such a huge model tractable, we use recent advances in computational statistics to carry out posterior simulation and inference. Our findings suggest that the inclusion of a wide range of firms and consumers' opinions about future economic developments offers useful information to forecast prices and assess tail risks to inflation. These predictive improvements do not only arise from surveys related to expected inflation but also from other questions related to the general economic environment. Finally, we find that firms' expectations about the future seem to have more predictive content than consumer expectations.


title: Fisher Information of a Black Hole Spacetime

abstract: Relativistic quantum metrology is the study of optimal measurement procedures within systems that have both quantum and relativistic components. Here we use Unruh-DeWitt detectors coupled to a massless scalar field as probes of thermal parameters in different spacetimes via a relativistic quantum metrology analysis. We consider both (2+1)-dimensional anti-de Sitter and BTZ black hole spacetimes. We compute the Fisher information to identify characteristics of the black hole spacetime and to compare it to a uniformly accelerating detector in anti-de Sitter space. We find the dependence of the Fisher information on temperature, detector energy gap, black hole mass, interaction time, and the initial state of the detector. We identify strategies that maximize the Fisher information and therefore the precision of estimation.


title: Intermittency, fluctuations and maximal chaos in an emergent universal state of active turbulence

abstract: A hydrodynamic model of active, low Reynolds number suspensions, shows the emergence of an asymptotic state with a universal spectral scaling and non-Gaussian (intermittent) fluctuations in the velocity field. Such states arise when these systems are pushed beyond a critical level of activity and show features akin to high Reynolds number, inertial turbulence. We provide compelling numerical and analytical evidence for the existence of such a transition at a critical value of activity and further show that the maximally chaotic states are tied to this transition.

categories: physics.flu-dyn cond-mat.stat-mech nlin.CD physics.bio-ph


title: A T-matrix Based Approach to Homogenize Artificial Materials

abstract: The accurate and efficient computation of the electromagnetic response of objects made from artificial materials is crucial for designing photonic functionalities and interpreting experiments. Advanced fabrication techniques can nowadays produce new materials as three-dimensional lattices of scattering unit cells. Computing the response of objects of arbitrary shape made from such materials is typically computationally prohibitive unless an effective homogeneous medium approximates the discrete material. In here, we introduce a homogenization method based on the effective T-matrix. Such a matrix captures the exact response of the discrete material, is determined by the T-matrix of the isolated unit cell and the material lattice vectors, and is free of spatial dispersion. The truncation of the effective T-matrix to dipolar order determines the common bi-anisotropic constitutive relations. When combined with quantum-chemical and Maxwell solvers, the method allows one to compute the response of arbitrarily-shaped volumetric patchworks of structured molecular materials and metamaterials.


title: Towards Systems Education for Artificial Intelligence: A Course Practice in Intelligent Computing Architectures

abstract: With the rapid development of artificial intelligence (AI) community, education in AI is receiving more and more attentions. There have been many AI related courses in the respects of algorithms and applications, while not many courses in system level are seriously taken into considerations. In order to bridge the gap between AI and computing systems, we are trying to explore how to conduct AI education from the perspective of computing systems. In this paper, a course practice in intelligent computing architectures are provided to demonstrate the system education in AI era. The motivation for this course practice is first introduced as well as the learning orientations. The main goal of this course aims to teach students for designing AI accelerators on FPGA platforms. The elaborated course contents include lecture notes and related technical materials. Especially several practical labs and projects are detailed illustrated. Finally, some teaching experiences and effects are discussed as well as some potential improvements in the future.


title: Mind the hubris: complexity can misfire

abstract: Here we briefly reflect on the philosophical foundations that ground the quest towards ever-detailed models and identify four practical dangers derived from this pursuit: explosion of the model's uncertainty space, model black-boxing, computational exhaustion and model attachment. We argue that the growth of a mathematical model should be carefully and continuously pondered lest models become extraneous constructs chasing the Cartesian dream.


title: FAT-PIM: Low-Cost Error Detection for Processing-In-Memory

abstract: Processing In Memory (PIM) accelerators are promising architecture that can provide massive parallelization and high efficiency in various applications. Such architectures can instantaneously provide ultra-fast operation over extensive data, allowing real-time performance in data-intensive workloads. For instance, Resistive Memory (ReRAM) based PIM architectures are widely known for their inherent dot-product computation capability. While the performance of such architecture is essential, reliability and accuracy are also important, especially in mission-critical real-time systems. Unfortunately, the PIM architectures have a fundamental limitation in guaranteeing error-free operation. As a result, current methods must pay high implementation costs or performance penalties to achieve reliable execution in the PIM accelerator. In this paper, we make a fundamental observation of this reliability limitation of ReRAM based PIM architecture. Accordingly, we propose a novel solution--Falut Tolerant PIM or FAT-PIM, that can improve reliability for such systems significantly at a low cost. Our evaluation shows that we can improve the error tolerance significantly with only 4.9% performance cost and 3.9% storage overhead.


title: A Resilient Navigation and Path Planning System for High-speed Autonomous Race Car

abstract: This paper describes a resilient navigation and planning system used in the Indy Autonomous Challenge (IAC) competition. The IAC is a competition where full-scale race cars run autonomously on Indianapolis Motor Speedway(IMS) up to 290 km/h (180 mph). Race cars will experience severe vibrations. Especially at high speeds. These vibrations can degrade standard localization algorithms based on precision GPS-aided inertial measurement units. Degraded localization can lead to serious problems, including collisions. Therefore, we propose a resilient navigation system that enables a race car to stay within the track in the event of localization failures. Our navigation system uses a multi-sensor fusion-based Kalman filter. We detect degradation of the navigation solution using probabilistic approaches to computing optimal measurement values for the correction step of our Kalman filter. In addition, an optimal path planning algorithm for obstacle avoidance is proposed. In this challenge, the track has static obstacles on the track. The vehicle is required to avoid them with minimal time loss. By taking the original optimal racing line, obstacles, and vehicle dynamics into account, we propose a road-graph-based path planning algorithm to ensure that our race car can perform efficient obstacle avoidance. The proposed localization system was successfully validated to show its capability to prevent localization failures in the event of faulty GPS measurements during the historic world's first autonomous racing at IMS. Owing to our robust navigation and planning algorithm, we were able to finish the race as one of the top four teams while the remaining five teams failed to finish due to collisions or out-of-track violations.


title: SMILE: A novel way to explore solar-terrestrial interactions

abstract: This chapter describes the scientific motivations that led to the development of the SMILE (Solar wind Magnetosphere Ionosphere Link Explorer) mission. The solar wind coupling with the terrestrial magnetosphere is a key link in Sun-Earth interactions. In-situ missions can provide detailed observations of plasma and magnetic field conditions in the solar wind and the magnetosphere, but leave us still unable to fully quantify the global effects of the drivers of Sun-Earth connections, and to monitor their evolution. This information is essential to develop a comprehensive understanding of how the Sun controls the Earth's plasma environment and space weather. SMILE offers a new approach to global monitoring of geospace by imaging the magnetosheath and cusps in X-rays emitted when high charge-state solar wind ions exchange charges with exospheric neutrals. SMILE combines this with simultaneous UV imaging of the northern aurora and in-situ plasma and magnetic field measurements in the magnetosheath and solar wind from a highly elliptical northern polar orbit. In this chapter the science that SMILE will explore and the scientific preparations that will ensure the optimal exploitation of SMILE measurements are presented.


title: Demonstration of optimal non-projective measurement of binary coherent states with photon counting

abstract: Quantum state discrimination is a central problem in quantum measurement theory, with applications spanning from quantum communication to computation. Typical measurement paradigms for state discrimination involve a minimum probability of error or unambiguous discrimination with a minimum probability of inconclusive results. Alternatively, an optimal inconclusive measurement, a non-projective measurement, achieves minimal error for a given inconclusive probability. This more general measurement encompasses the standard measurement paradigms for state discrimination and provides a much more powerful tool for quantum information and communication. Here, we experimentally demonstrate the optimal inconclusive measurement for the discrimination of binary coherent states using linear optics and single-photon detection. Our demonstration uses coherent displacement operations based on interference, single-photon detection, and fast feedback to prepare the optimal feedback policy for the optimal non-projective quantum measurement with high fidelity. This generalized measurement allows us to transition among standard measurement paradigms in an optimal way from minimum error to unambiguous measurements for binary coherent states. As a particular case, we use this general measurement to implement the optimal minimum error measurement for phase-coherent states, which is the optimal modulation for communications under the average power constraint. Moreover, we propose a hybrid measurement that leverages the binary optimal inconclusive measurement in conjunction with sequential, unambiguous state elimination to realize higher dimensional inconclusive measurements of coherent states.


title: Advancing Semi-Supervised Task Oriented Dialog Systems by JSA Learning of Discrete Latent Variable Models

abstract: Developing semi-supervised task-oriented dialog (TOD) systems by leveraging unlabeled dialog data has attracted increasing interests. For semi-supervised learning of latent state TOD models, variational learning is often used, but suffers from the annoying high-variance of the gradients propagated through discrete latent variables and the drawback of indirectly optimizing the target log-likelihood. Recently, an alternative algorithm, called joint stochastic approximation (JSA), has emerged for learning discrete latent variable models with impressive performances. In this paper, we propose to apply JSA to semi-supervised learning of the latent state TOD models, which is referred to as JSA-TOD. To our knowledge, JSA-TOD represents the first work in developing JSA based semi-supervised learning of discrete latent variable conditional models for such long sequential generation problems like in TOD systems. Extensive experiments show that JSA-TOD significantly outperforms its variational learning counterpart. Remarkably, semi-supervised JSA-TOD using 20% labels performs close to the full-supervised baseline on MultiWOZ2.1.


title: Personality-Driven Social Multimedia Content Recommendation

abstract: Social media marketing plays a vital role in promoting brand and product values to wide audiences. In order to boost their advertising revenues, global media buying platforms such as Facebook Ads constantly reduce the reach of branded organic posts, pushing brands to spend more on paid media ads. In order to run organic and paid social media marketing efficiently, it is necessary to understand the audience, tailoring the content to fit their interests and online behaviours, which is impossible to do manually at a large scale. At the same time, various personality type categorization schemes such as the Myers-Briggs Personality Type indicator make it possible to reveal the dependencies between personality traits and user content preferences on a wider scale by categorizing audience behaviours in a unified and structured manner. This problem is yet to be studied in depth by the research community, while the level of impact of different personality traits on content recommendation accuracy has not been widely utilised and comprehensively evaluated so far. Specifically, in this work we investigate the impact of human personality traits on the content recommendation model by applying a novel personality-driven multi-view content recommender system called Personality Content Marketing Recommender Engine, or PersiC. Our experimental results and real-world case study demonstrate not just PersiC's ability to perform efficient human personality-driven multi-view content recommendation, but also allow for actionable digital ad strategy recommendations, which when deployed are able to improve digital advertising efficiency by over 420% as compared to the original human-guided approach.


title: Evaluating the prevalence of spurious correlations in pulsar timing array datasets

abstract: Pulsar timing array collaborations have recently reported evidence for a noise process with a common spectrum among the millisecond pulsars in the arrays. The spectral properties of this common-noise process are consistent with expectations for an isotropic gravitational-wave background (GWB) from inspiralling supermassive black-hole binaries. However, recent simulation analyses based on Parkes Pulsar Timing Array data indicate that such a detection may arise spuriously. In this paper, we use simulated pulsar timing array datasets to further test the robustness of the inference methods for spectral and spatial correlations from a GWB. Expanding on our previous results, we find strong support (Bayes factors exceeding $10^5$) for the presence of a common-spectrum noise process in datasets where no common process is present, under a wide range of timing noise prescriptions per pulsar. We show that these results are highly sensitive to the choice of Bayesian priors on timing noise parameters, with priors that more closely match the injected distributions of timing noise parameters resulting in diminished support for a common-spectrum noise process. These results emphasize shortcomings in current methods for inferring the presence of a common-spectrum process, and imply that the detection of a common process is not a reliable precursor to detection of the GWB. Future searches for the nanohertz GWB should remain focussed on detecting spatial correlations, and make use of more tailored specifications for a common-spectrum noise process.


title: OCTAve: 2D en face Optical Coherence Tomography Angiography Vessel Segmentation in Weakly-Supervised Learning with Locality Augmentation

abstract: While there have been increased researches using deep learning techniques for the extraction of vascular structure from the 2D en face OCTA, for such approach, it is known that the data annotation process on the curvilinear structure like the retinal vasculature is very costly and time consuming, albeit few tried to address the annotation problem. In this work, we propose the application of the scribble-base weakly-supervised learning method to automate the pixel-level annotation. The proposed method, called OCTAve, combines the weakly-supervised learning using scribble-annotated ground truth augmented with an adversarial and a novel self-supervised deep supervision. Our novel mechanism is designed to utilize the discriminative outputs from the discrimination layer of a UNet-like architecture where the Kullback-Liebler Divergence between the aggregate discriminative outputs and the segmentation map predicate is minimized during the training. This combined method leads to the better localization of the vascular structure as shown in our experiments. We validate our proposed method on the large public datasets i.e., ROSE, OCTA-500. The segmentation performance is compared against both state-of-the-art fully-supervised and scribble-based weakly-supervised approaches. The implementation of our work used in the experiments is located at [LINK].


title: Continued PSP/WISPR Observations of a Phaethon-related Dust Trail

abstract: We present an update to the first white-light detections of a dust trail observed closely following the orbit of asteroid (3200) Phaethon, as seen by the Wide-field Imager for Parker Solar Probe (WISPR) instrument on the NASA Parker Solar Probe (PSP) mission. Here we provide a summary and analysis of observations of the dust trail over nine separate mission encounters between October 2018 and August 2021 that saw the spacecraft approach to within 0.0277 au of the orbit of Phaethon. We find the photometric and estimated dust mass properties to be inline with those in the initial publication, with a visual (V) magnitude of approximately 16.1$\pm$0.3 per pixel, corresponding to a surface brightness of 26.1 mag arcsec$^{-2}$, and an estimated mass of dust within the range $10^{10}$ kg - $10^{12}$ kg depending on the assumed dust properties. However, the key finding of this survey is the discovery that the dust trail does not perfectly follow the orbit of Phaethon, with a clear separation noted between them that increases as a function of true anomaly, though the trail may differ from Phaethon's orbit by as little as 1-degree in periapsis.


title: Characterizations of directional openness for set-valued mappings

abstract: We provide necessary and sufficient conditions for a set-valued mapping between finite dimensional spaces to be directionally open by relating this property with directional regularity, H\"older continuity of the inverse mapping, coderivatives and variations. These generalize and refine some previously known results.


title: L\'evy Models for Collapse of the Wave Function

abstract: Recently there has been much progress in the development of stochastic models for state reduction in quantum mechanics. In such models, the collapse of the wave function is a physical process, governed by a nonlinear stochastic differential equation that generalizes the Schr\"odinger equation. The present paper considers energy-based stochastic extensions of the Schr\"odinger equation. Most of the work carried out hitherto in this area has been concerned with models where the process driving the stochastic dynamics of the quantum state is Brownian motion. Here, the Brownian framework is broadened to a wider class of models where the noise process is of the L\'evy type, admitting stationary and independent increments. The properties of such models are different from those of Brownian reduction models. In particular, for L\'evy models the decoherence rate depends on the overall scale of the energy. Thus, in L\'evy reduction models, a macroscopic quantum system will spontaneously collapse to an eigenstate even if the energy level gaps are small.


title: Multisymplectic Formulation of Deep Learning Using Mean--Field Type Control and Nonlinear Stability of Training Algorithm

abstract: As it stands, a robust mathematical framework to analyse and study various topics in deep learning is yet to come to the fore. Nonetheless, viewing deep learning as a dynamical system allows the use of established theories to investigate the behaviour of deep neural networks. In order to study the stability of the training process, in this article, we formulate training of deep neural networks as a hydrodynamics system, which has a multisymplectic structure. For that, the deep neural network is modelled using a stochastic differential equation and, thereby, mean-field type control is used to train it. The necessary conditions for optimality of the mean--field type control reduce to a system of Euler-Poincare equations, which has the a similar geometric structure to that of compressible fluids. The mean-field type control is solved numerically using a multisymplectic numerical scheme that takes advantage of the underlying geometry. Moreover, the numerical scheme, yields an approximated solution which is also an exact solution of a hydrodynamics system with a multisymplectic structure and it can be analysed using backward error analysis. Further, nonlinear stability yields the condition for selecting the number of hidden layers and the number of nodes per layer, that makes the training stable while approximating the solution of a residual neural network with a number of hidden layers approaching infinity.


title: On $k$-Mersenne and k-Mersenne-Lucas Octonions

abstract: This paper aims to introduce the $k$-Mersenne and $k$-Mersenne-Lucas octonions. We give the closed form formulae for these octonions and obtain some well-known identities like Cassini's identity, d'Ocagne's identity, Catalan identity, Vajda's identity and generating functions of them. As a consequence k=1 yields all the above properties for Mersenne and Mersenne-Lucas octonions.


title: DeepFusion: Real-Time Dense 3D Reconstruction for Monocular SLAM using Single-View Depth and Gradient Predictions

abstract: While the keypoint-based maps created by sparse monocular simultaneous localisation and mapping (SLAM) systems are useful for camera tracking, dense 3D reconstructions may be desired for many robotic tasks. Solutions involving depth cameras are limited in range and to indoor spaces, and dense reconstruction systems based on minimising the photometric error between frames are typically poorly constrained and suffer from scale ambiguity. To address these issues, we propose a 3D reconstruction system that leverages the output of a convolutional neural network (CNN) to produce fully dense depth maps for keyframes that include metric scale. Our system, DeepFusion, is capable of producing real-time dense reconstructions on a GPU. It fuses the output of a semi-dense multiview stereo algorithm with the depth and gradient predictions of a CNN in a probabilistic fashion, using learned uncertainties produced by the network. While the network only needs to be run once per keyframe, we are able to optimise for the depth map with each new frame so as to constantly make use of new geometric constraints. Based on its performance on synthetic and real-world datasets, we demonstrate that DeepFusion is capable of performing at least as well as other comparable systems.


title: Decentralized digital twins of complex dynamical systems

abstract: In this paper, we introduce a decentralized digital twin (DDT) framework for dynamical systems and discuss the prospects of the DDT modeling paradigm in computational science and engineering applications. The DDT approach is built on a federated learning concept, a branch of machine learning that encourages knowledge sharing without sharing the actual data. This approach enables clients to collaboratively learn an aggregated model while keeping all the training data on each client. We demonstrate the feasibility of the DDT framework with various dynamical systems, which are often considered prototypes for modeling complex transport phenomena in spatiotemporally extended systems. Our results indicate that federated machine learning might be a key enabler for designing highly accurate decentralized digital twins in complex nonlinear spatiotemporal systems.


title: Measurement of the total cross section and $\rho$-parameter from elastic scattering in $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector

abstract: In a special run of the LHC with $\beta^\star = 2.5~$km, proton-proton elastic-scattering events were recorded at $\sqrt{s} = 13~$TeV with an integrated luminosity of $340~\mu \textrm{b}^{-1}$ using the ALFA subdetector of ATLAS in 2016. The elastic cross section was measured differentially in the Mandelstam $t$ variable in the range from $-t = 2.5 \cdot 10^{-4}~$GeV$^{2}$ to $-t = 0.46~$GeV$^{2}$ using 6.9 million elastic-scattering candidates. This paper presents measurements of the total cross section $\sigma_{\textrm{tot}}$, parameters of the nuclear slope, and the $\rho$-parameter defined as the ratio of the real part to the imaginary part of the elastic-scattering amplitude in the limit $t \rightarrow 0$. These parameters are determined from a fit to the differential elastic cross section using the optical theorem and different parameterizations of the $t$-dependence. The results for $\sigma_{\textrm{tot}}$ and $\rho$ are \begin{equation*} \sigma_{\textrm{tot}}(pp\rightarrow X) = \mbox{104.7} \pm 1.1 \; \mbox{mb} , \; \; \; \rho = \mbox{0.098} \pm 0.011 . \end{equation*} The uncertainty in $\sigma_{\textrm{tot}}$ is dominated by the luminosity measurement, and in $\rho$ by imperfect knowledge of the detector alignment and by modelling of the nuclear amplitude.


title: Monotonicity of Ursell functions in the Ising model

abstract: In this paper, we consider Ising models with ferromagnetic pair interactions. We prove that the Ursell functions $u_{2k}$ satisfy: $(-1)^{k-1}u_{2k}$ is increasing in each interaction. As an application, we prove a 1983 conjecture by Nishimori and Griffiths about the partition function of the Ising model with complex external field $h$: its closest zero to the origin (in the variable $h$) moves towards the origin as an arbitrary interaction increases.


title: Domain Adapting Deep Reinforcement Learning for Real-world Speech Emotion Recognition

abstract: Computers can understand and then engage with people in an emotionally intelligent way thanks to speech-emotion recognition (SER). However, the performance of SER in cross-corpus and real-world live data feed scenarios can be significantly improved. The inability to adapt an existing model to a new domain is one of the shortcomings of SER methods. To address this challenge, researchers have developed domain adaptation techniques that transfer knowledge learnt by a model across the domain. Although existing domain adaptation techniques have improved performances across domains, they can be improved to adapt to a real-world live data feed situation where a model can self-tune while deployed. In this paper, we present a deep reinforcement learning-based strategy (RL-DA) for adapting a pre-trained model to a real-world live data feed setting while interacting with the environment and collecting continual feedback. RL-DA is evaluated on SER tasks, including cross-corpus and cross-language domain adaption schema. Evaluation results show that in a live data feed setting, RL-DA outperforms a baseline strategy by 11% and 14% in cross-corpus and cross-language scenarios, respectively.


title: Anomalous Ward identities for on-shell amplitudes at the conformal fixed point

abstract: Conformal symmetry underlies many massless quantum field theories, but little is known about the consequences of this powerful symmetry for on-shell scattering amplitudes. Working in a dimensionally-regularised $\phi^3$ model at the conformal fixed point, we show that the on-shell renormalised amplitudes satisfy anomalous conformal Ward identities. Each external on-shell state contributes two terms to the anomaly. The first term is proportional to the elementary field anomalous dimension, and thus involves only lower-loop information. We show that the second term can be given as the convolution of a universal collinear function and lower-order amplitudes. The computation of the conformal anomaly is therefore simpler than that of the amplitude at the same perturbative order, which gives our anomalous conformal Ward identities a strong predictive power in perturbation theory. Finally, we show that our result is also of practical importance for dimensionally-regularised amplitudes away from the conformal fixed point.


title: Four point functions in momentum space and topological terms in gravity

abstract: In the first part, we concentrate on CFTs in coordinate space. We lay the foundations of Conformal Field Theory and we also demonstrate a method where by using the embedding formalism we can derive up to n-point scalar conformal correlators. We proceed with our analysis in momentum space and we illustrate the theory of the conformal anomalies. We move on to analyse the renormalization of the correlators through counterterms followed by a discussion of the anomaly action. In the second part of the thesis. we derive and analyze the conformal Ward identities (CWIs) of a tensorial 4-point function of a generic CFT in momentum space. The correlator involves the stress-energy tensor $T$ and three scalar operators $O$ ($TOOO$). We derive the structure of the corresponding CWIs in two different sets of variables, relevant for the analysis of the 1-to-3 (1 graviton $\to$ 3 scalars) and 2-to-2 (graviton + scalar $\to$ two scalars) scattering processes. Then, we move on to another conformal correlator, the one made of four stress-energy tensors. We elaborate on the structure of the conformal anomaly effective action up to 4-th order, in an expansion in the gravitational fluctuations $(h)$ of the background metric, in the flat spacetime limit. We discuss the renormalization of 4-point functions containing insertions of stress-energy tensors (4T), in conformal field theories in four spacetime dimensions. Finally, we include an analysis on the topological terms that are involved in the renormalization and consequently corrections of gravitational theories.


title: Low complexity, low probability patterns and consequences for algorithmic probability applications

abstract: Developing new ways to estimate probabilities can be valuable for science, statistics, and engineering. By considering the information content of different output patterns, recent work invoking algorithmic information theory has shown that a priori probability predictions based on pattern complexities can be made in a broad class of input-output maps. These algorithmic probability predictions do not depend on a detailed knowledge of how output patterns were produced, or historical statistical data. Although quantitatively fairly accurate, a main weakness of these predictions is that they are given as an upper bound on the probability of a pattern, but many low complexity, low probability patterns occur, for which the upper bound has little predictive value. Here we study this low complexity, low probability phenomenon by looking at example maps, namely a finite state transducer, natural time series data, RNA molecule structures, and polynomial curves. Some mechanisms causing low complexity, low probability behaviour are identified, and we argue this behaviour should be assumed as a default in the real world algorithmic probability studies. Additionally, we examine some applications of algorithmic probability and discuss some implications of low complexity, low probability patterns for several research areas including simplicity in physics and biology, a priori probability predictions, Solomonoff induction and Occam's razor, machine learning, and password guessing.


title: Accessing and Interpreting OPC UA Event Traces based on Semantic Process Descriptions

abstract: The analysis of event data from production systems is the basis for many applications associated with Industry 4.0. However, heterogeneous and disjoint data is common in this domain. As a consequence, contextual information of an event might be incomplete or improperly interpreted which results in suboptimal analysis results. This paper proposes an approach to access a production systems' event data based on the event data's context (such as the product type, process type or process parameters). The approach extracts filtered event logs from a database system by combining: 1) a semantic model of a production system's hierarchical structure, 2) a formalized process description and 3) an OPC UA information model. As a proof of concept we demonstrate our approach using a sample server based on OPC UA for Machinery Companion Specifications.


title: Scaling limit of graph classes through split decomposition

abstract: We prove that Aldous' Brownian CRT is the scaling limit, with respect to the Gromov--Prokhorov topology, of uniform random graphs in each of the three following families of graphs: distance-hereditary graphs, $2$-connected distance-hereditary graphs and $3$-leaf power graphs. Our approach is based on the split decomposition and on analytic combinatorics.


title: A Letter on Progress Made on Husky Carbon: A Legged-Aerial, Multi-modal Platform

abstract: Animals, such as birds, widely use multi-modal locomotion by combining legged and aerial mobility with dominant inertial effects. The robotic biomimicry of this multi-modal locomotion feat can yield ultra-flexible systems in terms of their ability to negotiate their task spaces. The main objective of this paper is to discuss the challenges in achieving multi-modal locomotion, and to report our progress in developing our quadrupedal robot capable of multi-modal locomotion (legged and aerial locomotion), the Husky Carbon. We report the mechanical and electrical components utilized in our robot, in addition to the simulation and experimentation done to achieve our goal in developing a versatile multi-modal robotic platform.


title: Implementing a Hierarchical Deep Learning Approach for Simulating Multi-Level Auction Data

abstract: We present a deep learning solution to address the challenges of simulating realistic synthetic first-price sealed-bid auction data. The complexities encountered in this type of auction data include high-cardinality discrete feature spaces and a multilevel structure arising from multiple bids associated with a single auction instance. Our methodology combines deep generative modeling (DGM) with an artificial learner that predicts the conditional bid distribution based on auction characteristics, contributing to advancements in simulation-based research. This approach lays the groundwork for creating realistic auction environments suitable for agent-based learning and modeling applications. Our contribution is twofold: we introduce a comprehensive methodology for simulating multilevel discrete auction data, and we underscore the potential of DGM as a powerful instrument for refining simulation techniques and fostering the development of economic models grounded in generative AI.


title: Lifelong Machine Learning of Functionally Compositional Structures

abstract: A hallmark of human intelligence is the ability to construct self-contained chunks of knowledge and reuse them in novel combinations for solving different problems. Learning such compositional structures has been a challenge for artificial systems, due to the underlying combinatorial search. To date, research into compositional learning has largely proceeded separately from work on lifelong or continual learning. This dissertation integrated these two lines of work to present a general-purpose framework for lifelong learning of functionally compositional structures. The framework separates the learning into two stages: learning how to combine existing components to assimilate a novel problem, and learning how to adapt the existing components to accommodate the new problem. This separation explicitly handles the trade-off between stability and flexibility. This dissertation instantiated the framework into various supervised and reinforcement learning (RL) algorithms. Supervised learning evaluations found that 1) compositional models improve lifelong learning of diverse tasks, 2) the multi-stage process permits lifelong learning of compositional knowledge, and 3) the components learned by the framework represent self-contained and reusable functions. Similar RL evaluations demonstrated that 1) algorithms under the framework accelerate the discovery of high-performing policies, and 2) these algorithms retain or improve performance on previously learned tasks. The dissertation extended one lifelong compositional RL algorithm to the nonstationary setting, where the task distribution varies over time, and found that modularity permits individually tracking changes to different elements in the environment. The final contribution of this dissertation was a new benchmark for compositional RL, which exposed that existing methods struggle to discover the compositional properties of the environment.


title: Trigonometric Lie algebras, affine Kac-Moody Lie algebras, and equivariant quasi modules for vertex algebras

abstract: In this paper, we study a family of infinite-dimensional Lie algebras $\widehat{X}_{S}$, where $X$ stands for the type: $A,B,C,D$, and $S$ is an abelian group, which generalize the $A,B,C,D$ series of trigonometric Lie algebras. Among the main results, we identify $\widehat{X}_{S}$ with what are called the covariant algebras of the affine Lie algebra $\widehat{\mathcal{L}_{S}}$ with respect to some automorphism groups, where $\mathcal{L}_{S}$ is an explicitly defined associative algebra viewed as a Lie algebra. We then show that restricted $\widehat{X}_{S}$-modules of level $\ell$ naturally correspond to equivariant quasi modules for affine vertex algebras related to $\mathcal{L}_{S}$. Furthermore, for any finite cyclic group $S$, we completely determine the structures of these four families of Lie algebras, showing that they are essentially affine Kac-Moody Lie algebras of certain types.


title: Equivariance and Invariance Inductive Bias for Learning from Insufficient Data

abstract: We are interested in learning robust models from insufficient data, without the need for any externally pre-trained checkpoints. First, compared to sufficient data, we show why insufficient data renders the model more easily biased to the limited training environments that are usually different from testing. For example, if all the training swan samples are "white", the model may wrongly use the "white" environment to represent the intrinsic class swan. Then, we justify that equivariance inductive bias can retain the class feature while invariance inductive bias can remove the environmental feature, leaving the class feature that generalizes to any environmental changes in testing. To impose them on learning, for equivariance, we demonstrate that any off-the-shelf contrastive-based self-supervised feature learning method can be deployed; for invariance, we propose a class-wise invariant risk minimization (IRM) that efficiently tackles the challenge of missing environmental annotation in conventional IRM. State-of-the-art experimental results on real-world benchmarks (VIPriors, ImageNet100 and NICO) validate the great potential of equivariance and invariance in data-efficient learning. The code is available at https://github.com/Wangt-CN/EqInv


title: Surrogate Modeling of Melt Pool Thermal Field using Deep Learning

abstract: Powder-based additive manufacturing has transformed the manufacturing industry over the last decade. In Laser Powder Bed Fusion, a specific part is built in an iterative manner in which two-dimensional cross-sections are formed on top of each other by melting and fusing the proper areas of the powder bed. In this process, the behavior of the melt pool and its thermal field has a very important role in predicting the quality of the manufactured part and its possible defects. However, the simulation of such a complex phenomenon is usually very time-consuming and requires huge computational resources. Flow-3D is one of the software packages capable of executing such simulations using iterative numerical solvers. In this work, we create three datasets of single-trail processes using Flow-3D and use them to train a convolutional neural network capable of predicting the behavior of the three-dimensional thermal field of the melt pool solely by taking three parameters as input: laser power, laser velocity, and time step. The CNN achieves a relative Root Mean Squared Error of 2% to 3% for the temperature field and an average Intersection over Union score of 80% to 90% in predicting the melt pool area. Moreover, since time is included as one of the inputs of the model, the thermal field can be instantly obtained for any arbitrary time step without the need to iterate and compute all the steps


title: Generation and annihilation of skyrmions and antiskyrmions in magnetic heterostructures

abstract: We demonstrate the controlled generation and annihilation of (anti)skyrmions with tunable chirality in magnetic heterostructures by means of micromagnetic simulations. By making use of magnetic (anti)vortices in patterned ferromagnetic layer, we stabilize full lattices of (anti)skyrmions in an underlying skyrmionic thin film in a reproducible manner. The stability of the (anti)skyrmion depends on the polarization of the (anti)vortex, whereas their chirality is given by those of the (anti)vortices. Furthermore, we demonstrate that the core coupling between the (anti)vortices and (anti)skyrmions allows to annihilate the spin-objects in a controlled fashion by applying short pulses of in-plane external magnetic fields, representing a new key paradigm in skyrmionic devices.


title: GraphCFC: A Directed Graph Based Cross-Modal Feature Complementation Approach for Multimodal Conversational Emotion Recognition

abstract: Emotion Recognition in Conversation (ERC) plays a significant part in Human-Computer Interaction (HCI) systems since it can provide empathetic services. Multimodal ERC can mitigate the drawbacks of uni-modal approaches. Recently, Graph Neural Networks (GNNs) have been widely used in a variety of fields due to their superior performance in relation modeling. In multimodal ERC, GNNs are capable of extracting both long-distance contextual information and inter-modal interactive information. Unfortunately, since existing methods such as MMGCN directly fuse multiple modalities, redundant information may be generated and diverse information may be lost. In this work, we present a directed Graph based Cross-modal Feature Complementation (GraphCFC) module that can efficiently model contextual and interactive information. GraphCFC alleviates the problem of heterogeneity gap in multimodal fusion by utilizing multiple subspace extractors and Pair-wise Cross-modal Complementary (PairCC) strategy. We extract various types of edges from the constructed graph for encoding, thus enabling GNNs to extract crucial contextual and interactive information more accurately when performing message passing. Furthermore, we design a GNN structure called GAT-MLP, which can provide a new unified network framework for multimodal learning. The experimental results on two benchmark datasets show that our GraphCFC outperforms the state-of-the-art (SOTA) approaches.


title: Transplantation of Conversational Speaking Style with Interjections in Sequence-to-Sequence Speech Synthesis

abstract: Sequence-to-Sequence Text-to-Speech architectures that directly generate low level acoustic features from phonetic sequences are known to produce natural and expressive speech when provided with adequate amounts of training data. Such systems can learn and transfer desired speaking styles from one seen speaker to another (in multi-style multi-speaker settings), which is highly desirable for creating scalable and customizable Human-Computer Interaction systems. In this work we explore one-to-many style transfer from a dedicated single-speaker conversational corpus with style nuances and interjections. We elaborate on the corpus design and explore the feasibility of such style transfer when assisted with Voice-Conversion-based data augmentation. In a set of subjective listening experiments, this approach resulted in high-fidelity style transfer with no quality degradation. However, a certain voice persona shift was observed, requiring further improvements in voice conversion.


title: SecretGen: Privacy Recovery on Pre-Trained Models via Distribution Discrimination

abstract: Transfer learning through the use of pre-trained models has become a growing trend for the machine learning community. Consequently, numerous pre-trained models are released online to facilitate further research. However, it raises extensive concerns on whether these pre-trained models would leak privacy-sensitive information of their training data. Thus, in this work, we aim to answer the following questions: "Can we effectively recover private information from these pre-trained models? What are the sufficient conditions to retrieve such sensitive information?" We first explore different statistical information which can discriminate the private training distribution from other distributions. Based on our observations, we propose a novel private data reconstruction framework, SecretGen, to effectively recover private information. Compared with previous methods which can recover private data with the ground true prediction of the targeted recovery instance, SecretGen does not require such prior knowledge, making it more practical. We conduct extensive experiments on different datasets under diverse scenarios to compare SecretGen with other baselines and provide a systematic benchmark to better understand the impact of different auxiliary information and optimization operations. We show that without prior knowledge about true class prediction, SecretGen is able to recover private data with similar performance compared with the ones that leverage such prior knowledge. If the prior knowledge is given, SecretGen will significantly outperform baseline methods. We also propose several quantitative metrics to further quantify the privacy vulnerability of pre-trained models, which will help the model selection for privacy-sensitive applications. Our code is available at: https://github.com/AI-secure/SecretGen.


title: Dynamics and triggers of misinformation on vaccines

abstract: The Covid-19 pandemic has sparked renewed attention on the prevalence of misinformation online, whether intentional or not, underscoring the potential risks posed to individuals' quality of life associated with the dissemination of misconceptions and enduring myths on health-related subjects. In this study, we analyze 6 years (2016-2021) of Italian vaccine debate across diverse social media platforms (Facebook, Instagram, Twitter, YouTube), encompassing all major news sources - both questionable and reliable. We first use the symbolic transfer entropy analysis of news production time-series to dynamically determine which category of sources, questionable or reliable, causally drives the agenda on vaccines. Then, leveraging deep learning models capable to accurately classify vaccine-related content based on the conveyed stance and discussed topic, respectively, we evaluate the focus on various topics by news sources promoting opposing views and compare the resulting user engagement. Aside from providing valuable resources for further investigation of vaccine-related misinformation, particularly in a language (Italian) that receives less attention in scientific research compared to languages like English, our study uncovers misinformation not as a parasite of the news ecosystem that merely opposes the perspectives offered by mainstream media, but as an autonomous force capable of even overwhelming the production of vaccine-related content from the latter. While the pervasiveness of misinformation is evident in the significantly higher engagement of questionable sources compared to reliable ones, our findings underscore the importance of consistent and thorough pro-vax coverage. This is especially crucial in addressing the most sensitive topics where the risk of misinformation spreading and potentially exacerbating negative attitudes toward vaccines among the users involved is higher.


title: Approximating missing higher-orders in transverse momentum distributions using resummations

abstract: We present a more reliable approach to approximate the unknown next-to-next-to-next-to-leading order (N3LO) transverse momentum distribution of colourless final states, namely the Higgs boson produced via gluon fusion and the lepton pair produced via Drell--Yan (DY) mechanism. The approximation we construct relies on the combination of various resummation formalisms -- namely threshold, small-pt and high energy resummations -- by exploiting the singularity structure of the large logarithms in Mellin space. We show that for the case of Higgs boson production, the approximate N3LO transverse momentum distribution amounts to a correction of a few percent with respect to the NNLO result with a reduction in the scale dependence.


title: Local Discontinuous Galerkin for the Functional Renormalisation Group

abstract: We apply the Local Discontinuous Galerkin discretisation to flow equations of the O(N)-model in the Local Potential Approximation. The improved stability is directly observed by solving the flow equation for various $N$ and space-time dimensions $d$. A particular focus of this work is the numerical discretisation and its implementation. The code is publicly available, and is explained in detail here. It is realised as a module within the high performance PDE framework DUNE.


title: Continuous ErrP detections during multimodal human-robot interaction

abstract: Human-in-the-loop approaches are of great importance for robot applications. In the presented study, we implemented a multimodal human-robot interaction (HRI) scenario, in which a simulated robot communicates with its human partner through speech and gestures. The robot announces its intention verbally and selects the appropriate action using pointing gestures. The human partner, in turn, evaluates whether the robot's verbal announcement (intention) matches the action (pointing gesture) chosen by the robot. For cases where the verbal announcement of the robot does not match the corresponding action choice of the robot, we expect error-related potentials (ErrPs) in the human electroencephalogram (EEG). These intrinsic evaluations of robot actions by humans, evident in the EEG, were recorded in real time, continuously segmented online and classified asynchronously. For feature selection, we propose an approach that allows the combinations of forward and backward sliding windows to train a classifier. We achieved an average classification performance of 91% across 9 subjects. As expected, we also observed a relatively high variability between the subjects. In the future, the proposed feature selection approach will be extended to allow for customization of feature selection. To this end, the best combinations of forward and backward sliding windows will be automatically selected to account for inter-subject variability in classification performance. In addition, we plan to use the intrinsic human error evaluation evident in the error case by the ErrP in interactive reinforcement learning to improve multimodal human-robot interaction.


title: What is Healthy? Generative Counterfactual Diffusion for Lesion Localization

abstract: Reducing the requirement for densely annotated masks in medical image segmentation is important due to cost constraints. In this paper, we consider the problem of inferring pixel-level predictions of brain lesions by only using image-level labels for training. By leveraging recent advances in generative diffusion probabilistic models (DPM), we synthesize counterfactuals of "How would a patient appear if X pathology was not present?". The difference image between the observed patient state and the healthy counterfactual can be used for inferring the location of pathology. We generate counterfactuals that correspond to the minimal change of the input such that it is transformed to healthy domain. This requires training with healthy and unhealthy data in DPMs. We improve on previous counterfactual DPMs by manipulating the generation process with implicit guidance along with attention conditioning instead of using classifiers. Code is available at https://github.com/vios-s/Diff-SCM.


title: Next-generation HPC models for future rotorcraft applications

abstract: Rotorcraft technologies pose great scientific and industrial challenges for numerical computing. As available computational resources approach the exascale, finer scales and therefore more accurate simulations of engineering test cases become accessible. However, shifting legacy workflows and optimizing parallel efficiency and scalability of existing software on new hardware is often demanding. This paper reports preliminary results in CFD and structural dynamics simulations using the T106A Low Pressure Turbine (LPT) blade geometry on Leonardo S.p.A.'s davinci-1 high-performance computing (HPC) facility. Time to solution and scalability are assessed for commercial packages Ansys Fluent, STAR-CCM+, and ABAQUS, and the open-source scientific computing framework PyFR. In direct numerical simulations of compressible fluid flow, normalized time to solution values obtained using PyFR are found to be up to 8 times smaller than those obtained using Fluent and STAR-CCM+. The findings extend to the incompressible case. All models offer weak and strong scaling in tests performed on up to 48 compute nodes, each with 4 Nvidia A100 GPUs. In linear elasticity simulations with ABAQUS, both the iterative solver and the direct solver provide speedup in preliminary scaling tests, with the iterative solver outperforming the direct solver in terms of time-to-solution and memory usage. The results provide a first indication of the potential of HPC architectures in scaling engineering applications towards certification by simulation, and the first step for the Company towards the use of cutting-edge HPC toolkits in the field of Rotorcraft technologies.


title: How criticality meets bifurcation in compressive failure of disordered solids

abstract: Continuum mechanics describes compressive failure as a standard bifurcation in the response of a material to an increasing load: damage, which initially grows uniformly in the material, localizes within a thin band at failure. Yet, experiments recording the acoustic activity preceding localization evidence power-law distributed failure precursors of increasing size, suggesting that compressive failure is a critical phenomenon. We examine here this apparent contradiction by probing the spatial organization of the damage activity and its evolution until localization during compression experiments of 2D cellular solids. The intermittent damage evolution measured in our experiments is adequately described by a non-stationary depinning equation derived from damage mechanics and reminiscent of critical phenomena. In this description, precursors are damage cascades emerging from the interplay between the material's disorder and the long-range stress redistributions following individual damage events. Yet, the divergence of their characteristic size close to failure, which we observe in our experiments, is not the signature of a transition towards criticality. Instead, the system remains at a fixed distance to the critical point at all stages of the damage evolution. The divergence results from the progressive loss of stability of the material as it is driven towards localization. Thus, our study shows that compressive failure is a standard bifurcation for which the material disorder plays a marginal role. It also shows that precursory activity constitute by-products of the evolution towards localization and can serve to build a predictive method to assess the residual lifetime of structures.

categories: cond-mat.stat-mech cond-mat.soft physics.data-an physics.geo-ph


title: NN2Rules: Extracting Rule List from Neural Networks

abstract: We present an algorithm, NN2Rules, to convert a trained neural network into a rule list. Rule lists are more interpretable since they align better with the way humans make decisions. NN2Rules is a decompositional approach to rule extraction, i.e., it extracts a set of decision rules from the parameters of the trained neural network model. We show that the decision rules extracted have the same prediction as the neural network on any input presented to it, and hence the same accuracy. A key contribution of NN2Rules is that it allows hidden neuron behavior to be either soft-binary (eg. sigmoid activation) or rectified linear (ReLU) as opposed to existing decompositional approaches that were developed with the assumption of soft-binary activation.


title: Online Adaptive Personalization for Face Anti-spoofing

abstract: Face authentication systems require a robust anti-spoofing module as they can be deceived by fabricating spoof images of authorized users. Most recent face anti-spoofing methods rely on optimized architectures and training objectives to alleviate the distribution shift between train and test users. However, in real online scenarios, past data from a user contains valuable information that could be used to alleviate the distribution shift. We thus introduce OAP (Online Adaptive Personalization): a lightweight solution which can adapt the model online using unlabeled data. OAP can be applied on top of most anti-spoofing methods without the need to store original biometric images. Through experimental evaluation on the SiW dataset, we show that OAP improves recognition performance of existing methods on both single video setting and continual setting, where spoof videos are interleaved with live ones to simulate spoofing attacks. We also conduct ablation studies to confirm the design choices for our solution.


title: Analytic representations of two-loop scattering amplitudes with internal masses

abstract: We highlight the latest developments in computing higher-order scattering amplitudes with massive internal propagators. The contributing Feynman integrals often lead to special classes of functions, for example, functions associated with elliptic curves. With the presence of more scales in the amplitudes, it becomes imperative to have a better understanding of the contributing Feynman integrals and using current cutting-edge technologies to tackle the growth in analytic and algebraic complexities. In particular, we start with discussing two-loop scattering amplitudes for top-quark pair production and conclude with motivating important steps towards obtaining next-to-next-to leading-order corrections for five-point processes.


title: MAPIE: an open-source library for distribution-free uncertainty quantification

abstract: Estimating uncertainties associated with the predictions of Machine Learning (ML) models is of crucial importance to assess their robustness and predictive power. In this submission, we introduce MAPIE (Model Agnostic Prediction Interval Estimator), an open-source Python library that quantifies the uncertainties of ML models for single-output regression and multi-class classification tasks. MAPIE implements conformal prediction methods, allowing the user to easily compute uncertainties with strong theoretical guarantees on the marginal coverages and with mild assumptions on the model or on the underlying data distribution. MAPIE is hosted on scikit-learn-contrib and is fully "scikit-learn-compatible". As such, it accepts any type of regressor or classifier coming with a scikit-learn API. The library is available at: https://github.com/scikit-learn-contrib/MAPIE/.


title: Superconductivity enhanced by pair fluctuations between wide and narrow bands

abstract: Full or empty narrow bands near the Fermi level are known to enhance superconductivity by promoting scattering processes and spin fluctuations. Here, we demonstrate that doublon-holon fluctuations in systems with half-filled narrow bands can similarly boost the superconducting $T_c$. We study the half-filled attractive bilayer Hubbard model on the square lattice using dynamical mean-field theory. The band structure of the noninteracting system contains a wide band formed by bonding orbitals and a narrow band formed by antibonding orbitals, with bandwidths tunable by the inter-layer hopping. The shrinking of the narrow band can lead to a substantial increase in the superconducting order parameter and phase stiffness in the wide band. At the same time, the coupling to the wide band allows the narrow band to remain superconducting -- and to reach the largest order parameter -- in the flat band limit. We develop an anomalous worm sampling method to study superconductivity in the limit of vanishing effective hopping. By analyzing the histogram of the local eigenstates, we clarify how the interplay between different interaction terms in the bonding/antibonding basis promotes pair fluctuations and superconductivity.


title: Cohomology of SL(3,Z) with coefficients in the standard representation

abstract: This paper is a natural continuation of a joint paper with Bajpai, Harder and Moya Giusti \cite{BHHM}, even though it began as an answer to Goncharov's question. It that paper, we had complete description for all representations except for odd symmetric powers and their dual ones. For those representations we were left with two options: certain one dimensional module is a ghost space or not. Here we find the $H^2(SL_3(\Z),V_3)$ has ghost classes. It means that it is generated by a class from the cohomology of the Borel subgroup. With the techniques developed here, we show that the $d_2$ map of the spectral sequence for the boundary cohomology of $GL_4(\Z)$ is non-trivial if and only if there is a ghost class in $GL_3(\Z)$ (see Propositions 11 and 12.) We use a result of Elbaz-Vincent, Gangl and Soule to show that a spectral sequence related to $GL_4(\Z)$ does not degenerate at $E_2$-level. Then $d_2$ is non-trivial. Therefore, we obtain that $H^2(SL_3(\Z),V_3))$ is a ghost space, where $V_3$ is the standard representation.


title: Asymptotic regimes of an integro-difference equation with discontinuous kernel

abstract: This paper is concerned with an integral equation that models discrete time dynamics of a population in a patchy landscape. The patches in the domain are reflected through the discontinuity of the kernel of the integral operator at a finite number of points in the whole domain. We prove the existence and uniqueness of a stationary state under certain assumptions on the principal eigenvalue of the linearized integral operator and the growth term as well. We also derive criteria under which the population undergoes extinction (in which case the stationary solution is 0 everywhere).


title: A Survey on Graph Problems Parameterized Above and Below Guaranteed Values

abstract: We survey the field of algorithms and complexity for graph problems parameterized above or below guaranteed values, a research area which was pioneered by Venkatesh Raman. Those problems seek, for a given graph $G$, a solution whose value is at least $g(G)+k$ or at most $g(G)-k$, where $g(G)$ is a guarantee on the value that any solution on $G$ takes. The goal is to design algorithms which find such solution in time whose complexity in $k$ is decoupled from that in the guarantee, or to rule out the existence of such algorithms by means of intractability results. We discuss a large number of algorithms and intractability results, and complement them by several open problems.


title: Orthogonalization of data via Gromov-Wasserstein type feedback for clustering and visualization

abstract: In this paper we propose an adaptive approach for clustering and visualization of data by an orthogonalization process. Starting with the data points being represented by a Markov process using the diffusion map framework, the method adaptively increase the orthogonality of the clusters by applying a feedback mechanism inspired by the Gromov-Wasserstein distance. This mechanism iteratively increases the spectral gap and refines the orthogonality of the data to achieve a clustering with high specificity. By using the diffusion map framework and representing the relation between data points using transition probabilities, the method is robust with respect to both the underlying distance, noise in the data and random initialization. We prove that the method converges globally to a unique fixpoint for certain parameter values. We also propose a related approach where the transition probabilities in the Markov process are required to be doubly stochastic, in which case the method generates a minimizer to a nonconvex optimization problem. We apply the method on cryo-electron microscopy image data from biopharmaceutical manufacturing where we can confirm biologically relevant insights related to therapeutic efficacy. We consider an example with morphological variations of gene packaging and confirm that the method produces biologically meaningful clustering results consistent with human expert classification.


title: ArtFID: Quantitative Evaluation of Neural Style Transfer

abstract: The field of neural style transfer has experienced a surge of research exploring different avenues ranging from optimization-based approaches and feed-forward models to meta-learning methods. The developed techniques have not just progressed the field of style transfer, but also led to breakthroughs in other areas of computer vision, such as all of visual synthesis. However, whereas quantitative evaluation and benchmarking have become pillars of computer vision research, the reproducible, quantitative assessment of style transfer models is still lacking. Even in comparison to other fields of visual synthesis, where widely used metrics exist, the quantitative evaluation of style transfer is still lagging behind. To support the automatic comparison of different style transfer approaches and to study their respective strengths and weaknesses, the field would greatly benefit from a quantitative measurement of stylization performance. Therefore, we propose a method to complement the currently mostly qualitative evaluation schemes. We provide extensive evaluations and a large-scale user study to show that the proposed metric strongly coincides with human judgment.


title: Stochastic data-driven parameterization of unresolved mesoscale eddies

abstract: In this work, a stochastic representation based on a physical transport principle is proposed to account for mesoscale eddy effects on the large-scale oceanic circulation. This stochastic framework arises from a decomposition of the Lagrangian velocity into a smooth-in-time component and a highly oscillating noise term. One important characteristic of this random model is that it conserves the total energy of the resolved flow for any realization. Such an energy-preserving representation is successfully implemented in a well established multi-layered quasi-geostrophic dynamical core. The empirical spatial correlation of the unresolved noise is calibrated from the eddy-resolving simulation data. In particular, a stationary correction drift can be introduced in the noise through Girsanov transformation. This non intuitive term appears to be important in reproducing on a coarse mesh the eastwards jet of the wind-driven double-gyre circulation. In addition, a projection method has been proposed to constrain the noise living along the iso-surfaces of the vertical stratification. The resulting noise enables us to improve the intrinsic low-frequency variability of the large-scale current.


title: The Infrared Medium-deep Survey. IX. Discovery of Two New $z\sim6$ Quasars and Space Density down to $M_{1450}\sim-23.5$ mag

abstract: We present the result of the Infrared Medium-deep Survey (IMS) $z\sim6$ quasar survey, using the combination of the IMS near-infrared images and the Canada-France-Hawaii Telescope Legacy Survey (CFHTLS) optical images. The traditional color-selection method results in 25 quasar candidates over $86$ deg$^{2}$. We introduce the corrected Akaike Information Criterion (AICc) with the high-redshift quasar and late-type star models to prioritize the candidates efficiently. Among the color-selected candidates, seven plausible candidates finally passed the AICc selection of which three are known quasars at $z\sim6$. The follow-up spectroscopic observations for the remaining four candidates were carried out, and we confirmed that two out of four are $z\sim6$ quasars. With this complete sample, we revisited the quasar space density at $z\sim6$ down to $M_{1450}\sim-23.5$ mag. Our result supports the low quasar space density at the luminosity where the quasar's ultraviolet ionizing emissivity peaks, favoring a minor contribution of quasars to the cosmic reionization.


title: MedML: Fusing Medical Knowledge and Machine Learning Models for Early Pediatric COVID-19 Hospitalization and Severity Prediction

abstract: The COVID-19 pandemic has caused devastating economic and social disruption, straining the resources of healthcare institutions worldwide. This has led to a nationwide call for models to predict hospitalization and severe illness in patients with COVID-19 to inform distribution of limited healthcare resources. We respond to one of these calls specific to the pediatric population. To address this challenge, we study two prediction tasks for the pediatric population using electronic health records: 1) predicting which children are more likely to be hospitalized, and 2) among hospitalized children, which individuals are more likely to develop severe symptoms. We respond to the national Pediatric COVID-19 data challenge with a novel machine learning model, MedML. MedML extracts the most predictive features based on medical knowledge and propensity scores from over 6 million medical concepts and incorporates the inter-feature relationships between heterogeneous medical features via graph neural networks (GNN). We evaluate MedML across 143,605 patients for the hospitalization prediction task and 11,465 patients for the severity prediction task using data from the National Cohort Collaborative (N3C) dataset. We also report detailed group-level and individual-level feature importance analyses to evaluate the model interpretability. MedML achieves up to a 7% higher AUROC score and up to a 14% higher AUPRC score compared to the best baseline machine learning models and performs well across all nine national geographic regions and over all three-month spans since the start of the pandemic. Our cross-disciplinary research team has developed a method of incorporating clinical domain knowledge as the framework for a new type of machine learning model that is more predictive and explainable than current state-of-the-art data-driven feature selection methods.


title: Well-posedness of evolutionary differential variational-hemivariational inequalities and applications to frictional contact mechanics

abstract: In this paper, we study the well-posedness of a class of evolutionary variational-hemivariational inequalities coupled with a nonlinear ordinary differential equation in Banach spaces. The proof is based on an iterative approximation scheme showing that the problem has a unique mild solution. In addition, we established the continuity of the flow map with respect to the initial data. Under the general framework, we consider two new applications for modelling of frictional contact for viscoelastic materials. In the first application, we consider Coulomb friction with normal compliance, and in the second, normal damped response. The structure of the friction coefficient $\mu$ is new with motivation from geophysical applications in earth sciences with dependence on an external state variable $\alpha$ and the slip rate $|\dot{u}_\tau|$.


title: Three-flavour neutrino oscillations in a magnetic field

abstract: In this paper we study Dirac neutrino oscillations in a magnetic field in the three-flavour case. A theoretical framework developed in [1] is extended to the case of three neutrino species. The closed expression for neutrino flavour and spin oscillations are given. We show that the probabilities exhibit a complicated interplay of oscillation on magnetic $\mu_\nu B$ and vacuum $\Delta m^2_{ij}/2p$ frequencies. It is also shown that neutrino oscillations in an interstellar magnetic field can modify neutrino fluxes observed in neutrino telescopes.


title: Higher-order topological states in photonic Thue-Morse quasicrystals: quadrupole insulator and a new origin of corner states

abstract: Corner states (CSs) in higher-order topological insulators (HOTIs) have recently been of great interest in both crystals and quasicrystals. In contrast to electronic systems, HOTIs have not been found in photonic quasicrystals (PQCs). Here, we systemically study the higher-order topology in the two-dimensional Thue-Morse photonic quasicrystals (TM-PQCs). Not only the topological phase transition and the non-trivial CSs with fractional charge induced by multipole moments, but also a new type of CSs are found due to the complex structure of TM-PQCs near corners. The different origins of these CSs are also analyzed based on the tight-binding model. Our work opens the door to explore richer HOT physics beyond photonic crystals and the robustness of CSs in PQC shows the potential for applications.


title: Modeling interspur interactions as a potential mechanism of the FLASH effect

abstract: The mechanism responsible for the FLASH effect, normal tissue sparing by ultra-high dose rate (UHDR) irradiation with isoeffective tumor control compared to conventional dose rate (CDR) irradiation, remains undetermined. Here we investigate the contribution of interspur interactions (interactions between radiolytic species of individual particle tracks) to overall radiochemical interactions as a function of irradiation parameters, and suggest an increase in interspur interaction as a potential mechanism for tissue sparing in FLASH radiation therapy. We construct a model that analytically represents the spatiotemporal distribution of spurs in a target volume as a function of irradiation parameters (e.g. dose, dose rate, linear energy transfer), and quantifies the effect of interspur interactions on the ongoing radiochemistry. Spurs evolve under a simplified reaction-diffusion equation with parameters based on Monte Carlo simulations, and interspur interaction is quantified by calculating the expected values of interspur overlap in the target. The model demonstrates that for any set of irradiation parameters, a minimum critical dose and dose rate are necessary to induce significant interspur interaction, and that interspur interactions correlate negatively with beam linear energy transfer at a fixed dose. The model suggests optimal beam parameters, including dose, dose rate, linear energy transfer, and pulse structure, to maximize interspur interactions. Depending on the rate of radical scavenging in the target, which limits interspur interaction, this model predicts that the irradiation parameters necessary to elicit the FLASH effect may coincide with an onset of significant interspur interactions, suggesting that interspur interaction may be the underlying mechanism of the FLASH effect.


title: Joint ergodicity for commuting transformations and applications to polynomial sequences

abstract: We give necessary and sufficient conditions for joint ergodicity results of collections of sequences with respect to systems of commuting measure preserving transformations. Combining these results with a new technique that we call "seminorm smoothening", we settle several conjectures related to multiple ergodic averages of commuting transformations with polynomial iterates. We show that the Host-Kra factor is characteristic for pairwise independent polynomials, and that under certain ergodicity conditions the associated ergodic averages converge to the product of integrals. Moreover, when the polynomials are linearly independent, we show that the rational Kronecker factor is characteristic and deduce Khintchine-type lower bounds for the related multiple recurrence problem. Finally, we prove a nil plus null decomposition result for multiple correlation sequences of commuting transformations in the case where the iterates are given by families of pairwise independent polynomials.


title: Large scale regularity of almost minimizers of the one-phase problem in periodic media

abstract: We prove that minimizers and almost minimizers of one-phase free boundary energy functionals in periodic media satisfy large scale (1) Lipschitz estimates (2) free boundary flat implies Lipschitz estimates. The proofs are based on techniques introduced by De Silva and Savin for almost minimizers in homogeneous media.


title: Finite and infinite hypergeometric sums involving the digamma function

abstract: We calculate some finite and infinite sums containing the digamma function in closed-form. For this purpose, we differentiate selected reduction formulas of the hypergeometric function with respect to the parameters applying some derivative formulas of the Pochhammer symbol. Also, we compare two different differentiation formulas of the generalized hypergeometric function with respect to the parameters. For some particular cases, we recover some results found in the literature. Finally, all the results have been numerically checked.


title: On the convergence and sampling of randomized primal-dual algorithms and their application to parallel MRI reconstruction

abstract: Stochastic Primal-Dual Hybrid Gradient (SPDHG) is an algorithm proposed by Chambolle et al. (2018) to efficiently solve a wide class of nonsmooth large-scale optimization problems. In this paper we contribute to its theoretical foundations and prove its almost sure convergence for convex but neither necessarily strongly convex nor smooth functionals, as well as for any random sampling. In addition, we study SPDHG for parallel Magnetic Resonance Imaging reconstruction, where data from different coils are randomly selected at each iteration. We apply SPDHG using a wide range of random sampling methods and compare its performance across a range of settings, including mini-batch size and step size parameters. We show that the sampling can significantly affect the convergence speed of SPDHG and for many cases an optimal sampling can be identified.


title: Reimagining Near-Earth Space Policy in a Post-COVID World

abstract: Our planet and our species are at an existential crossroads. In the long term, climate change threatens to upend life as we know it, while the ongoing COVID-19 pandemic revealed that the world is unprepared and ill-equipped to handle acute shocks to its many systems. These shocks exacerbate the inequities and challenges already present prior to COVID in ways that are still evolving in unpredictable directions. As weary nations look toward a post-COVID world, we draw attention to both the injustice and many impacts of the quiet occupation of near-Earth space, which has rapidly escalated during this time of global crisis. The communities most impacted by climate change, the ongoing pandemic, and systemic racism are those whose voices are missing as stakeholders both on the ground and in space. We argue that significant domestic and international changes to the use of near-Earth space are urgently needed to preserve access to - and the future utility of - the valuable natural resources of space and our shared skies. After examining the failure of the U.S. and international space policy status quo to address these issues, we make specific recommendations in support of safer and more equitable uses of near-Earth space.

categories: physics.soc-ph astro-ph.EP astro-ph.IM physics.space-ph


title: Pure dephasing induced single-photon parametric down-conversion in an ultrastrong coupled plasmon-exciton system

abstract: In coupled quantum systems pure dephasing mechanisms acting on one constituent of the hybrid system break symmetry and enable optical transitions which are forbidden in the non-coupled system, i.e., the pure dephasing bath opens a cascaded dissipation pathway. Here we show that this mechanism enables single-photon induced parametric down-conversion in an ultrastrongly coupled plasmon-exciton system. Fast pure dephasing of the exciton is shown to support photon pair generation as the dominant energy relaxation pathway.


title: Properties of fermionic systems with the Path-integral ground state method

abstract: We investigate strongly correlated many-body systems composed of bosons and fermions with a fully quantum treatment using the path-integral ground state method, PIGS. To account for the Fermi-Dirac statistics, we implement the fixed-node approximation into PIGS, which we then call FN-PIGS. In great detail, we discuss the pair density matrices we use to construct the full density operator in coordinate representation, a vital ingredient of the method. We consider the harmonic oscillator as a proof-of-concept and, as a platform representing quantum many-body systems, we explore helium atoms. Pure $^4$He systems demonstrate most of the features of the method. Complementarily, for pure $^3$He, the fixed-node approximation resolves the ubiquitous sign problem stemming from anti-symmetric wave functions. Finally, we investigate $^3$He-$^4$He mixtures, demonstrating the method's robustness. One of the main features of FN-PIGS is its ability to estimate any property at temperature $T=0$ without any additional bias apart from the FN approximation; biases from long simulations are also excluded. In particular, we calculate the correlation function of pairs of equal and opposite spins and precise values of the $^3$He kinetic energy in the mixture.


title: Status of double virtual NNLO QCD corrections for high multiplicity processes

abstract: Pushing the reach of NNLO QCD predictions to $2\to3$ production processes is one of the pillars of precision phenomenology program at the LHC. In this talk we will overview recent results and developments in the calculation of two-loop five-point amplitudes contributing towards achieving this goal. We will discuss challenges encountered in advancing the state-of-the-art beyond the class of massless five-point scattering. We will then present a basis set of transcendental functions sufficient to express any planar two-loop five-particle scattering amplitude with one external massive leg. This basis greatly facilitates derivation of compact analytic form of scattering amplitudes, and opens a possibility of their fast and reliable numerical evaluation. Applications for phenomenology of electroweak boson production can be reasonably anticipated in the near future.


title: Stellar evolution models with overshooting based on 3-equation non-local theories I. Physical basis and the computation of the dissipation rate

abstract: Context. Mixing by convective overshooting has long been suggested to play an important role for the amount of hydrogen available to nuclear burning in convective cores of stars. The best way to model this effect is still debated. Aims. We suggest an improved model for the computation of the dissipation rate of turbulent kinetic energy which can be used in non-local models of stellar convection and can readily be implemented and self-consistently used in 1D stellar evolution calculations. Methods. We review the physics underlying various models to compute the dissipation rate of turbulent kinetic energy, {\epsilon}, in local and particularly in non-local models of convection in stellar astrophysics. The different contributions to the dissipation rate and their dependence on local stratification and on non-local transport are analysed and a new method to account for at least some of these physical mechanisms is suggested. Results. We show how the new approach influences predictions of stellar models of intermediate-mass main-sequence stars and how these changes differ from other modifications of the non-local convection model that focus on the ratio of horizontal to vertical (turbulent) kinetic energy. Conclusions. The new model is shown to allow for a physically more complete description of convective overshooting and mixing in massive stars. Dissipation by buoyancy waves is found to be a key ingredient which has to be accounted for in non-local models of turbulent convection.


title: TreeSketchNet: From Sketch To 3D Tree Parameters Generation

abstract: 3D modeling of non-linear objects from stylized sketches is a challenge even for experts in Computer Graphics (CG). The extrapolation of objects parameters from a stylized sketch is a very complex and cumbersome task. In the present study, we propose a broker system that mediates between the modeler and the 3D modelling software and can transform a stylized sketch of a tree into a complete 3D model. The input sketches do not need to be accurate or detailed, and only need to represent a rudimentary outline of the tree that the modeler wishes to 3D-model. Our approach is based on a well-defined Deep Neural Network (DNN) architecture, we called TreeSketchNet (TSN), based on convolutions and able to generate Weber and Penn parameters that can be interpreted by the modelling software to generate a 3D model of a tree starting from a simple sketch. The training dataset consists of Synthetically-Generated \revision{(SG)} sketches that are associated with Weber-Penn parameters generated by a dedicated Blender modelling software add-on. The accuracy of the proposed method is demonstrated by testing the TSN with both synthetic and hand-made sketches. Finally, we provide a qualitative analysis of our results, by evaluating the coherence of the predicted parameters with several distinguishing features.


title: Deforming Radiance Fields with Cages

abstract: Recent advances in radiance fields enable photorealistic rendering of static or dynamic 3D scenes, but still do not support explicit deformation that is used for scene manipulation or animation. In this paper, we propose a method that enables a new type of deformation of the radiance field: free-form radiance field deformation. We use a triangular mesh that encloses the foreground object called cage as an interface, and by manipulating the cage vertices, our approach enables the free-form deformation of the radiance field. The core of our approach is cage-based deformation which is commonly used in mesh deformation. We propose a novel formulation to extend it to the radiance field, which maps the position and the view direction of the sampling points from the deformed space to the canonical space, thus enabling the rendering of the deformed scene. The deformation results of the synthetic datasets and the real-world datasets demonstrate the effectiveness of our approach.


title: Polyharmonic Green Functions and Nonlocal BMS Transformations of a Free Scalar Field

abstract: We express the nonlocal BMS charges of a free massless Klein-Gordon scalar field in 2+1 in terms of the Green functions of the polyharmonic operators. Using the properties of these Green functions, we are able to discuss the asymptotic behaviour of the fields that ensures the existence of the charges, and prove that one obtains a realization of the 2+1 BMS algebra in canonical phase space. We also discuss the transformations in configuration space, and show that in this case the algebra closes only up to skew-symmetric combinations of the equations of motion. The formulation of the charges, in terms of Green functions, opens the way to the generalization of the formalism to other dimensions and systems.


title: The multi-variable Affine Index Polynomial for tangles

abstract: The multi-variable affine index polynomial was defined by the author in previous work. The aim of this short note is to update the definition so it is generalizable to virtual tangles and to show it is compatible with tangle decomposition. We also introduce the Turaev moves for virtual tangles, and discuss how to recover the weight of each crossing as an intersection pairing of homology classes.


title: The VMC Survey -- XLIX. Discovery of a population of quasars dominated by nuclear dust emission behind the Magellanic Clouds

abstract: Following the discovery of SAGE0536AGN ($z \sim$ 0.14), with the strongest 10-$\mu$m silicate emission ever observed for an Active Galactic Nucleus (AGN), we discovered SAGE0534AGN ($z \sim$ 1.01), a similar AGN but with less extreme silicate emission. Both were originally mistaken as evolved stars in the Magellanic Clouds. Lack of far-infrared emission, and therefore star-formation, implies we are seeing the central engine of the AGN without contribution from the host galaxy. They could be a key link in galaxy evolution. We used a dimensionality reduction algorithm, t-SNE (t-distributed Stochastic Neighbourhood Embedding) with multi-wavelength data from Gaia EDR3, VISTA survey of the Magellanic Clouds, AllWISE and the Australian SKA Pathfinder to find these two unusual AGN are grouped with 16 other objects separated from the rest, suggesting a rare class. Our spectroscopy at SAAO/SALT and literature data confirm at least 14 of these objects are extragalactic ($0.13 < z < 1.23$), all hosting AGN. Using spectral energy distribution fitter CIGALE we find that the majority of dust emission ($> 70 \%$) in these sources is due to the AGN. Host galaxies appear to be either in or transitioning into the green valley. There is a trend of a thinning torus, increasing X-ray luminosity and decreasing Eddington ratio as the AGN transition through the green valley, implying that as the accretion supply depletes, the torus depletes and the column density reduces. Also, the near-infrared variability amplitude of these sources correlates with attenuation by the torus, implying the torus plays a role in the variability.


title: Exploiting Diversity of Unlabeled Data for Label-Efficient Semi-Supervised Active Learning

abstract: The availability of large labeled datasets is the key component for the success of deep learning. However, annotating labels on large datasets is generally time-consuming and expensive. Active learning is a research area that addresses the issues of expensive labeling by selecting the most important samples for labeling. Diversity-based sampling algorithms are known as integral components of representation-based approaches for active learning. In this paper, we introduce a new diversity-based initial dataset selection algorithm to select the most informative set of samples for initial labeling in the active learning setting. Self-supervised representation learning is used to consider the diversity of samples in the initial dataset selection algorithm. Also, we propose a novel active learning query strategy, which uses diversity-based sampling on consistency-based embeddings. By considering the consistency information with the diversity in the consistency-based embedding scheme, the proposed method could select more informative samples for labeling in the semi-supervised learning setting. Comparative experiments show that the proposed method achieves compelling results on CIFAR-10 and Caltech-101 datasets compared with previous active learning approaches by utilizing the diversity of unlabeled data.


title: Continual Few-Shot Learning with Adversarial Class Storage

abstract: Humans have a remarkable ability to quickly and effectively learn new concepts in a continuous manner without forgetting old knowledge. Though deep learning has made tremendous successes on various computer vision tasks, it faces challenges for achieving such human-level intelligence. In this paper, we define a new problem called continual few-shot learning, in which tasks arrive sequentially and each task is associated with a few training samples. We propose Continual Meta-Learner (CML) to solve this problem. CML integrates metric-based classification and a memory-based mechanism along with adversarial learning into a meta-learning framework, which leads to the desirable properties: 1) it can quickly and effectively learn to handle a new task; 2) it overcomes catastrophic forgetting; 3) it is model-agnostic. We conduct extensive experiments on two image datasets, MiniImageNet and CIFAR100. Experimental results show that CML delivers state-of-the-art performance in terms of classification accuracy on few-shot learning tasks without catastrophic forgetting.