title: On the potential benefits of entropic regularization for smoothing Wasserstein estimators

abstract: This paper is focused on the study of entropic regularization in optimal transport as a smoothing method for Wasserstein estimators, through the prism of the classical tradeoff between approximation and estimation errors in statistics. Wasserstein estimators are defined as solutions of variational problems whose objective function involves the use of an optimal transport cost between probability measures. Such estimators can be regularized by replacing the optimal transport cost by its regularized version using an entropy penalty on the transport plan. The use of such a regularization has a potentially significant smoothing effect on the resulting estimators. In this work, we investigate its potential benefits on the approximation and estimation properties of regularized Wasserstein estimators. Our main contribution is to discuss how entropic regularization may reach, at a lower computational cost, statistical performances that are comparable to those of un-regularized Wasserstein estimators in statistical learning problems involving distributional data analysis. To this end, we present new theoretical results on the convergence of regularized Wasserstein estimators. We also study their numerical performances using simulated and real data in the supervised learning problem of proportions estimation in mixture models using optimal transport.


title: Smart windows passively driven by greenhouse effect

abstract: The rational thermal management of buildings is of major importance for the reduction of the overall primary energy consumption. Smart windows are promising systems which could save a significant part of this energy. Here we introduce a double glazing system made with a thermochromic metal-insulator transition material and a glass layer separated by an air gap which is able to switch from its insulating to its conducting phase thanks to the greenhouse effect occuring in the separation gap. We also show that this passive system can reduce the incoming heat flux by 30% in comparison with a traditional double glazing while maintaining the transmittance around 0.35 over 75% of visible spectrum.


title: Multilingual Zero Resource Speech Recognition Base on Self-Supervise Pre-Trained Acoustic Models

abstract: Labeled audio data is insufficient to build satisfying speech recognition systems for most of the languages in the world. There have been some zero-resource methods trying to perform phoneme or word-level speech recognition without labeled audio data of the target language, but the error rate of these methods is usually too high to be applied in real-world scenarios. Recently, the representation ability of self-supervise pre-trained models has been found to be extremely beneficial in zero-resource phoneme recognition. As far as we are concerned, this paper is the first attempt to extend the use of pre-trained models into word-level zero-resource speech recognition. This is done by fine-tuning the pre-trained models on IPA phoneme transcriptions and decoding with a language model trained on extra texts. Experiments on Wav2vec 2.0 and HuBERT models show that this method can achieve less than 20% word error rate on some languages, and the average error rate on 8 languages is 33.77%.


title: A hybridizable discontinuous Galerkin method for the coupled Navier-Stokes and Darcy problem

abstract: We present and analyze a strongly conservative hybridizable discontinuous Galerkin finite element method for the coupled incompressible Navier-Stokes and Darcy problem with Beavers-Joseph-Saffman interface condition. An a priori error analysis shows that the velocity error does not depend on the pressure, and that velocity and pressure converge with optimal rates. These results are confirmed by numerical examples.


title: A Collisional-Energy-Cascade Model for Nonthermal Velocity Distributions of Neutral Atoms in Plasmas

abstract: Nonthermal velocity distributions with much greater tails than the Maxwellian have been observed for radical atoms in plasmas for a long time. Historically, such velocity distributions have been modeled by a two-temperature Maxwell distribution. In this paper, I propose a model based on collisional energy cascade, which has been studied in the field of granular materials. In the collisional energy cascade, a particle ensemble undergoes energy input at the high-energy region, entropy production by elastic collisions among particles, and energy dissipation. For radical atoms, energy input may be caused by the Franck-Condon energy of molecular dissociation or charge-exchange collision with hot ions, and the input energy is eventually dissipated by collisions with the walls. I show that the steady-state velocity distribution in the collisional energy cascade is approximated by the generalized Mittag-Leffler distribution, which is a one-parameter extension of the Maxwell distribution. This parameter indicates the degree of the nonthermality and is related to the relative importance of energy dissipation over entropy production. This model is compared with a direct molecular dynamics simulation for a simplified gaseous system with energy input and dissipative wall collisions, as well as some experimentally observed velocity distributions of light radicals in plasmas.


title: Measurement of the $\Lambda_c^+$ to $D^0$ production cross-section ratio in peripheral PbPb collisions

abstract: We report on a measurement of the $\Lambda_c^+$ to $D^0$ production ratio in PbPb collisions at $\sqrt{s_{\rm NN}}$= 5.02 TeV with the LHCb detector in the forward rapidity region $2 <y< 4.5$. The $\Lambda_c^+$ ($D^0$) hadrons are reconstructed via the decay channel $\Lambda_c^+\rightarrow pK^+\pi^-$ ($D^0 \rightarrow K^-\pi^+$) for $2<p_{\rm T}<8$ GeV$/c$ and in the centrality range of about 65-90%. The results show no significant dependence on $p_{T}$, $y$ or the mean number of participating nucleons. They are also consistent with similar measurements obtained by the LHCb collaboration in pPb and Pbp collisions at $\sqrt{s_{\rm NN}}$ = 5.02 TeV. The data agree well with predictions from PYTHIA in pp collisions at $\sqrt{s}$ = 5 TeV but are in tension with predictions of the Statistical Hadronization model.


title: Suppressed-scattering windows for radiative cooling applications

abstract: The scattering of light by resonant nanoparticles is a key process for enhancing the solar reflectance in daylight radiative cooling. Here, we investigate the impact of material dispersion on the scattering performance of popular nanoparticles for radiative cooling applications. We show that, due to material dispersion, nanoparticles with a qualitatively similar response at visible frequencies exhibit fundamentally different scattering properties at infrared frequencies. It is found that dispersive nanoparticles exhibit suppressed-scattering windows, allowing for selective thermal emission within an highly reflective sample. The existence of suppressed-scattering windows solely depends on material dispersion, and they appear pinned to the same wavelength even in random composite materials and periodic metasurfaces. Finally, we investigate calcium-silicate-hydrate (CSH), the main phase of concrete, as an example of a dispersive host, illustrating that the co-design of nanoparticles and host allows for tuning of the suppressed-scattering windows. Our results indicate that controlled nanoporosities would enable concrete with daylight passive radiative cooling capabilities.


title: Generation of superhelical time-varying OAM beam with space-time-coding digital metasurface

abstract: The recently proposed extreme-ultraviolet (EUV) beams with time-varying orbital angular momentum (OAM) realized by high-harmonic generation (HHG) provides extraordinary tools for quantum excitation control and particle manipulation. However, such an approach is not easily scalable to other frequency regimes. Here, we design a space-time-coding digital metasurface operating in microwave frequencies to experimentally generate different modes of time-varying OAM. We also introduce a concept of superhelicity of time-varying OAM with a higher-order twist of the wavefront structure, which can be further realized by reflection phase profiles nonlinear in time through the metasurface. By developing a two-probe measurement technique, we dynamically map the OAM field pattern varying in time. The proposed superhelical time-varying OAM beam paves a way for particle manipulations and OAM multiplexing communications.


title: Harvesting Planck radiation for free-space optical communications in the LWIR band

abstract: We demonstrate a free-space optical communication link with an optical transmitter that harvests naturally occurring Planck radiation from a warm body and modulates the emitted intensity. The transmitter exploits an electro-thermo-optic effect in a multilayer graphene device that electrically controls the surface emissivity of the device resulting in control of the intensity of the emitted Planck radiation. We design an amplitude-modulated optical communication scheme and provide a link budget for communications data rate and range based on our experimental electro-optic characterization of the transmitter. Finally, we present an experimental demonstration achieving error-free communications at 100 bits per second over laboratory scales.


title: Understand-Before-Talk (UBT): A Semantic Communication Approach to 6G Networks

abstract: In Shannon theory, semantic aspects of communication were identified but considered irrelevant to the technical communication problems. Semantic communication (SC) techniques have recently attracted renewed research interests in (6G) wireless because they have the capability to support an efficient interpretation of the significance and meaning intended by a sender (or accomplishment of the goal) when dealing with multi-modal data such as videos, images, audio, text messages, and so on, which would be the case for various applications such as intelligent transportation systems where each autonomous vehicle needs to deal with real-time videos and data from a number of sensors including radars. A notable difficulty of existing SC frameworks lies in handling the discrete constraints imposed on the pursued semantic coding and its interaction with the independent knowledge base, which makes reliable semantic extraction extremely challenging. Therefore, we develop a new lightweight hashing-based semantic extraction approach to the SC framework, where our learning objective is to generate one-time signatures (hash codes) using supervised learning for low latency, secure and efficient management of the SC dynamics. We first evaluate the proposed semantic extraction framework over large image data sets, extend it with domain adaptive hashing and then demonstrate the effectiveness of "semantics signature" in bulk transmission and multi-modal data.


title: SageMix: Saliency-Guided Mixup for Point Clouds

abstract: Data augmentation is key to improving the generalization ability of deep learning models. Mixup is a simple and widely-used data augmentation technique that has proven effective in alleviating the problems of overfitting and data scarcity. Also, recent studies of saliency-aware Mixup in the image domain show that preserving discriminative parts is beneficial to improving the generalization performance. However, these Mixup-based data augmentations are underexplored in 3D vision, especially in point clouds. In this paper, we propose SageMix, a saliency-guided Mixup for point clouds to preserve salient local structures. Specifically, we extract salient regions from two point clouds and smoothly combine them into one continuous shape. With a simple sequential sampling by re-weighted saliency scores, SageMix preserves the local structure of salient regions. Extensive experiments demonstrate that the proposed method consistently outperforms existing Mixup methods in various benchmark point cloud datasets. With PointNet++, our method achieves an accuracy gain of 2.6% and 4.0% over standard training in 3D Warehouse dataset (MN40) and ScanObjectNN, respectively. In addition to generalization performance, SageMix improves robustness and uncertainty calibration. Moreover, when adopting our method to various tasks including part segmentation and standard 2D image classification, our method achieves competitive performance.


title: Design and characterization of cochlea-inspired tonotopic resonators

abstract: The cochlea has long been the subject of investigation in various research fields due to its intriguing spiral architecture and unique sensing characteristics. One of its most interesting features is the ability to sense acoustic waves at different spatial locations, based on their frequency content. In this work, we propose a novel design for a tonotopic resonator, based on a cochlea-inspired spiral. The resulting structure was subjected to an optimization process to exhibit out-of-plane vibration modes with mean out-of-plane displacement maxima distributed along its centerline spanning nearly a two-decade frequency range. Numerical simulations are performed to demonstrate the concept, which is also confirmed experimentally on a 3D printed structure. The obtained frequency-dependent distribution is shown to be a viable source of information for the discrimination of signals with various frequency components. The harnessed tonotopic features can be used as a fundamental principle to design structures with applications in areas such as non-destructive testing and vibration attenuation.


title: Industrial graphene coating of low-voltage copper wires for power distribution

abstract: Copper (Cu) is the electrical conductor of choice in many categories of electrical wiring, with household and building installations being the major market of this metal. This work demonstrates the coating of Cu wires - with diameters relevant for low voltage (LV) applications - with graphene. The chemical vapor deposition (CVD) coating process is rapid, safe, scalable and industrially compatible. Graphene-coated Cu wires display oxidation resistance and increased electrical conductivity (up to 1% immediately after coating and up to 3% after 24 months), allowing for wire diameter reduction and thus significant savings in wire production costs. Combined spectroscopic and diffraction analysis indicate that the conductivity increase is due to a change in Cu crystallinity, induced by the coating process conditions, while electrical testing of aged wires shows that graphene plays a major role in maintaining improved electrical performances over long periods of time. Finally, graphene coating of Cu wires using an ambient pressure roll-to-roll (R2R) CVD reactor is demonstrated. This enables the in-line production of graphene-coated metallic wires as required for industrial scale-up.


title: Decentralized State Estimation In A Dimension-Reduced Linear Regression

abstract: Decentralized state estimation in a communication-constrained sensor network is considered. The exchanged estimates are dimension-reduced to reduce the communication load using a linear mapping to a lower-dimensional space. The mean squared error optimal linear mapping depends on the particular estimation method used. Several dimension-reducing algorithms are proposed, where each algorithm corresponds to a commonly applied decentralized estimation method. All except one of the algorithms are shown to be optimal. For the remaining algorithm, we provide a convergence analysis where it is theoretically shown that this algorithm converges to a stationary point and numerically shown that the convergence rate is fast. A message-encoding solution is proposed that allows for efficient communication when using the proposed dimension reduction techniques. We also derive different properties from the proposed framework and show its superiority in relation to baseline methods. The applicability of the different algorithms is demonstrated using a simple fusion example and a more realistic target tracking scenario.


title: 3D printing of nanoceramics: Present status and future perspectives

abstract: In materials research involving additive manufacturing (AM)-based techniques for fabrication of a wide variety of materials, the latest trend at present is to focus largely on 3D printing (3DP) of nanoceramics, which at present is highly challenging, from both fundamental and industrial viewpoints inspite of the tremendous versatility offered by these techniques in terms of addressing design complexities. The two main reasons for the same are: low density and poor mechanical properties of nanoceramic parts fabricated using 3DP techniques. The fundamental reason behind the two aforementioned features of 3DP-fabricated nanoceramic parts is the huge extent of microstructural inhomogeneity arising primarily due to variation in cooling rates during point by point, line by line or layer by layer deposition methodology followed in 3DP techniques, leading to a number of defects in the microstructure. Moreover, the industrial application of nanoceramic parts manufactured using 3DP techniques, is rather limited, primarily owing to the high manufacturing cost associated with these nanoceramic parts. Although, in the last ten years, there has been a considerable volume of work on 3DP-based techniques for manufacturing ceramic parts with enhanced densities and improved mechanical properties, however, there is limited understanding on the correlation of microstructure of 3DP-fabricated nanoceramic components with the mechanical properties. The present review is aimed to review some of the most commonly used 3DP techniques for the fabrication of nanoceramics and provide an overview of the future perspectives, associated with the necessity towards developing a systematic structure-property correlation through correlative characterisation methodology in these materials.


title: Sum Rule Bounds Beyond Rozanov Criterion in Linear and Time-Invariant Thin Absorbers

abstract: Dallenbach layer is composed of an absorbing magnetic-dielectric layer attached to a perfect electric conductor (PEC) sheet. Under linearity and time invariance (LTI) assumptions Rozanov has established analytically a sum-rule trade-off between the absorption efficacy over a predefined bandwidth and the thickness of the layer, that is the so-called Rozanov bound. In recent years several proposals have been introduced to bypass this bound by using non-LTI absorbers. However, in practice, their implementation may be challenging. Here, we expose additional hidden assumptions in Rozanov's derivation, and thus we introduce several new sum rules for LTI layer absorbers that are not covered by the original Rozanov's criterion, and give rise to more relaxed constraints on the absorption limit. We then, demonstrate practical LTI designs of absorbing thin layers that provide absorption beyond the Rozanov's bound. These designs are based on the replacement of the original PEC boundary by various types of penetrable impedance sheet.


title: Interference-Managed Local Service Insertion for 5G Broadcast

abstract: Broadcast of localized TV content enables tailored content delivery catering to the requirements of regional user base. 5G multicast-broadcast service (MBS) requires a spectrally efficient broadcast solution that enables the change of content from one local service area (LSA) to another. A frequency reuse factor of unity between two adjacent LSAs causes their boundary region to become saturated with co-channel interference (CCI). Increasing the reuse factor will reduce the CCI at the cost of degrading the spectral efficiency. This paper addresses the frequency and transmit power planning which manages the CCI at the LSA boundary to achieve a satisfactory trade-off between spectral efficiency and broadcast coverage.


title: Performance Optimization and Parameters Estimation for MIMO-OFDM Dual-functional Communication-radar Systems

abstract: In dual-functional communication-radar systems, common radio frequency (RF) signals are used for both communication and detection. For better compatibility with existing communication systems, we adopt multiple-input multiple-output (MIMO) orthogonal frequency division multiplexing (OFDM) signals as integrated signals and investigate the estimation performance of MIMO-OFDM signals. We first analyze the Cramer-Rao lower bound (CRLB) of parameters estimation. Then, transmit powers over different subcarriers are optimized to achieve the best tradeoff between transmission rate and estimation performance. Finally, we propose a more accurate estimation method which utilizes canonical polyadic decomposition (CPD) of three-order tensor to obtain the parameter matrices. Due to the characteristic of the column structure of the parameter matrices, we just need to use DFT / IDFT to recover the parameters of multiple targets. The simulation results show that the estimation method based on tensor can achieve performance close to CRLB and the estimation performance can be improved by optimizing the transmit powers.


title: Ubiquity of oriented rays

abstract: Call a digraph $H$ \emph{ubiquitous} if every digraph $D$ that contains $k$ vertex-disjoint copies of $H$ for every $k \in \mathbb{N}$ also contains infinitely many vertex-disjoint copies of $H$. We characterise which digraphs whose underlying undirected graph is a ray are ubiquitous.


title: Mechanism of Cold-spot Autoignition in a Hydrogen/Air Mixture

abstract: When designing high-efficiency spark-ignition (SI) engines to operate at high compression ratios, one of the main issues that have to be addressed is detonation development from a pre-ignition front. In order to control this phenomenon, it is necessary to understand the mechanism by which the detonation is initiated. The development of a detonation from a pre-ignition front was analyzed by considering a one-dimensional constant-volume stoichiometric hydrogen/air reactor with detailed chemistry. A spatially linear initial temperature profile near the end-wall was employed, in order to account for the thermal stratification of the bulk mixture. A flame was initiated near the left wall and the effects of its propagation towards the cold end-wall were analyzed. Attention was given on the autoignition that is manifested within the cold-spot ahead of the flame and far from the end-wall, which is followed by detonation. Using CSP tools, the mechanism by which the generated pressure waves influence the autoignition within the cold-spot was investigated. It is found that the pressure oscillations induced by the reflected pressure waves and the pressure waves generated by the pre-ignition front tend to synchronize in the chamber, increasing the reactivity of the system in a periodic manner. The average of the oscillating temperature is greater in the cold-spot, compared to all other points ahead of the flame. As a result, the rate constants of the most important reactions are larger there, leading to a more reactive state that accelerates the dynamics of the cold-spot and to its autoignition.


title: Darwinian Model Upgrades: Model Evolving with Selective Compatibility

abstract: The traditional model upgrading paradigm for retrieval requires recomputing all gallery embeddings before deploying the new model (dubbed as "backfilling"), which is quite expensive and time-consuming considering billions of instances in industrial applications. BCT presents the first step towards backward-compatible model upgrades to get rid of backfilling. It is workable but leaves the new model in a dilemma between new feature discriminativeness and new-to-old compatibility due to the undifferentiated compatibility constraints. In this work, we propose Darwinian Model Upgrades (DMU), which disentangle the inheritance and variation in the model evolving with selective backward compatibility and forward adaptation, respectively. The old-to-new heritable knowledge is measured by old feature discriminativeness, and the gallery features, especially those of poor quality, are evolved in a lightweight manner to become more adaptive in the new latent space. We demonstrate the superiority of DMU through comprehensive experiments on large-scale landmark retrieval and face recognition benchmarks. DMU effectively alleviates the new-to-new degradation and improves new-to-old compatibility, rendering a more proper model upgrading paradigm in large-scale retrieval systems.


title: Agent-Based Modelling for Urban Analytics: State of the Art and Challenges

abstract: Agent-based modelling (ABM) is a facet of wider Multi-Agent Systems (MAS) research that explores the collective behaviour of individual `agents', and the implications that their behaviour and interactions have for wider systemic behaviour. The method has been shown to hold considerable value in exploring and understanding human societies, but is still largely confined to use in academia. This is particularly evident in the field of Urban Analytics; one that is characterised by the use of new forms of data in combination with computational approaches to gain insight into urban processes. In Urban Analytics, ABM is gaining popularity as a valuable method for understanding the low-level interactions that ultimately drive cities, but as yet is rarely used by stakeholders (planners, governments, etc.) to address real policy problems. This paper presents the state-of-the-art in the application of ABM at the interface of MAS and Urban Analytics by a group of ABM researchers who are affiliated with the Urban Analytics programme of the Alan Turing Institute in London (UK). It addresses issues around modelling behaviour, the use of new forms of data, the calibration of models under high uncertainty, real-time modelling, the use of AI techniques, large-scale models, and the implications for modelling policy. The discussion also contextualises current research in wider debates around Data Science, Artificial Intelligence, and MAS more broadly.


title: On-Premise Artificial Intelligence as a Service for Small and Medium Size Setups

abstract: Artificial Intelligence (AI) technologies are moving from customized deployments in specific domains towards generic solutions horizontally permeating vertical domains and industries. For instance, decisions on when to perform maintenance of roads or bridges or how to optimize public lighting in view of costs and safety in smart cities are increasingly informed by AI models. While various commercial solutions offer user friendly and easy to use AI as a Service (AIaaS), functionality-wise enabling the democratization of such ecosystems, open-source equivalent ecosystems are lagging behind. In this chapter, we discuss AIaaS functionality and corresponding technology stack and analyze possible realizations using open source user friendly technologies that are suitable for on-premise set-ups of small and medium sized users allowing full control over the data and technological platform without any third-party dependence or vendor lock-in.


title: Noether supercurrent operator mixing from lattice perturbation theory

abstract: In this work we present perturbative results for the renormalization of the supercurrent operator, $S_\mu$, in ${\cal N} =1$ Supersymmetric Yang-Mills theory. At the quantum level, this operator mixes with both gauge invariant and noninvariant operators, which have the same global transformation properties. In total, there are 13 linearly independent mixing operators of the same and lower dimensionality. We determine, via lattice perturbation theory, the first two rows of the mixing matrix, which refer to the renormalization of $S_\mu$, and of the gauge invariant mixing operator, $T_\mu$. To extract these mixing coefficients in the ${\overline{\rm MS}}$ renormalization scheme and at one-loop order, we compute the relevant two-point and three-point Green's functions of $S_\mu$ and $T_\mu$ in two regularizations: dimensional and lattice. On the lattice, we employ the plaquette gluonic action and for the gluinos we use the fermionic Wilson action with clover improvement.


title: Holistic nanowire laser characterization as a route to optimal design

abstract: Nanowire lasers are sought for near-field and on-chip photonic applications as they provide integrable, coherent and monochromatic radiation. A wavelength-scale nanowire acts as both the gain medium and the cavity for the lasing action: the functional performance (threshold and wavelength) is therefore dependent on both the opto-electronic and crystallographic properties of each nanowire. However, scalable bottom-up manufacturing techniques often suffer from inter-nanowire variation, leading to, often dramatic, differences in yield and performance between individual nanowires. Establishing the relationship between manufacturing controls, geometric and material properties and the lasing performance is a crucial step towards optimisation, however, this is challenging to achieve experimentally due to the complex interdependance of such properties. Here, we present a high-throughput correlative approach to characterise over 5000 individual GaAsP/GaAs multiple quantum well nanowire lasers. Fitting the spontaneous emission provides the threshold carrier density, while coherence length measurements measures end-facet reflectivity. We show that the lasing wavelength and threshold are intrinsically related to the width of a single quantum well due to quantum confinement and bandfilling effects. Unexpectedly, there is no strong relationship between the properties of the lasing cavity (facet reflectivity and distributed losses) and the threshold: instead the threshold is negatively correlated with the non-radiative recombination lifetime of the carriers. This approach therefore provides an optimisation strategy that is not accessible through small-scale studies. The quality and width of the quantum wells limit the threshold of these nanowire lasers, rather than the cavity quality.


title: A Survey on Explainable Anomaly Detection

abstract: In the past two decades, most research on anomaly detection has focused on improving the accuracy of the detection, while largely ignoring the explainability of the corresponding methods and thus leaving the explanation of outcomes to practitioners. As anomaly detection algorithms are increasingly used in safety-critical domains, providing explanations for the high-stakes decisions made in those domains has become an ethical and regulatory requirement. Therefore, this work provides a comprehensive and structured survey on state-of-the-art explainable anomaly detection techniques. We propose a taxonomy based on the main aspects that characterize each explainable anomaly detection technique, aiming to help practitioners and researchers find the explainable anomaly detection method that best suits their needs.


title: Propagating charge carrier plasmon in Sr2RuO4

abstract: We report on studies of charge carrier plasmon excitations in Sr2RuO4 by transmission Electron Energy-Loss Spectroscopy. In particular, we present results on the plasmon dispersion and its width as a function of momentum transfer. The dispersion can be qualitatively explained in the framework of RPA calculations, using an unrenormalized tight-binding band structure. The constant long-wavelength width of the plasmon indicates, that it is caused by a decay into inter-band transition and not by quantum critical fluctuations. The results from these studies on a prototypical bad metal system show that the long-wavelength plasmon excitations near 1 eV are caused by resilient quasiparticles and are not influenced by correlation effects.


title: Feature-Adaptive Interactive Thresholding of Large 3D Volumes

abstract: Thresholding is the most widely used segmentation method in volumetric image processing, and its pointwise nature makes it attractive for the fast handling of large three-dimensional samples. However, global thresholds often do not properly extract components in the presence of artifacts, measurement noise or grayscale value fluctuations. This paper introduces Feature-Adaptive Interactive Thresholding (FAITH), a thresholding technique that incorporates (geometric) features, local processing and interactive user input to overcome these limitations. Given a global threshold suitable for most regions, FAITH uses interactively selected seed voxels to identify critical regions in which that threshold will be adapted locally on the basis of features computed from local environments around these voxels. The combination of domain expert knowledge and a rigorous mathematical model thus enables a very exible way of local thresholding with intuitive user interaction. A qualitative analysis shows that the proposed model is able to overcome limitations typically occuring in plain thresholding while staying efficient enough to also allow the segmentation of big volumes.


title: Squares of conjugacy classes and a variant on the Baer-Suzuki Theorem

abstract: For $p$ a prime, $G$ a finite group and $A$ a normal subset of elements of order $p$, we prove that if $A^2 = \{ab \mid a, b \in A\}$ consists of $p$-elements then $Q = \langle A \rangle$ is soluble. Further, if $O_p(G) = 1$, we show that $p$ is odd, $F(Q)$ is a non-trivial $p'$-group and $Q/F(Q)$ is an elementary abelian $p$-group. We also provide examples which show this conclusion is best possible.


title: Markov Chain Monte Carlo for generating ranked textual data

abstract: This paper faces a central theme in applied statistics and information science, which is the assessment of the stochastic structure of rank-size laws in text analysis. We consider the words in a corpus by ranking them on the basis of their frequencies in descending order. The starting point is that the ranked data generated in linguistic contexts can be viewed as the realisations of a discrete states Markov chain, whose stationary distribution behaves according to a discretisation of the best fitted rank-size law. The employed methodological toolkit is Markov Chain Monte Carlo, specifically referring to the Metropolis-Hastings algorithm. The theoretical framework is applied to the rank-size analysis of the hapax legomena occurring in the speeches of the US Presidents. We offer a large number of statistical tests leading to the consistency of our methodological proposal. To pursue our scopes, we also offer arguments supporting that hapaxes are rare (``extreme") events resulting from memory-less-like processes. Moreover, we show that the considered sample has the stochastic structure of a Markov chain of order one. Importantly, we discuss the versatility of the method, which is considered suitable for deducing similar outcomes for other applied science contexts.


title: Causality-driven Hierarchical Structure Discovery for Reinforcement Learning

abstract: Hierarchical reinforcement learning (HRL) effectively improves agents' exploration efficiency on tasks with sparse reward, with the guide of high-quality hierarchical structures (e.g., subgoals or options). However, how to automatically discover high-quality hierarchical structures is still a great challenge. Previous HRL methods can hardly discover the hierarchical structures in complex environments due to the low exploration efficiency by exploiting the randomness-driven exploration paradigm. To address this issue, we propose CDHRL, a causality-driven hierarchical reinforcement learning framework, leveraging a causality-driven discovery instead of a randomness-driven exploration to effectively build high-quality hierarchical structures in complicated environments. The key insight is that the causalities among environment variables are naturally fit for modeling reachable subgoals and their dependencies and can perfectly guide to build high-quality hierarchical structures. The results in two complex environments, 2D-Minecraft and Eden, show that CDHRL significantly boosts exploration efficiency with the causality-driven paradigm.


title: CUF: Continuous Upsampling Filters

abstract: Neural fields have rapidly been adopted for representing 3D signals, but their application to more classical 2D image-processing has been relatively limited. In this paper, we consider one of the most important operations in image processing: upsampling. In deep learning, learnable upsampling layers have extensively been used for single image super-resolution. We propose to parameterize upsampling kernels as neural fields. This parameterization leads to a compact architecture that obtains a 40-fold reduction in the number of parameters when compared with competing arbitrary-scale super-resolution architectures. When upsampling images of size 256x256 we show that our architecture is 2x-10x more efficient than competing arbitrary-scale super-resolution architectures, and more efficient than sub-pixel convolutions when instantiated to a single-scale model. In the general setting, these gains grow polynomially with the square of the target scale. We validate our method on standard benchmarks showing such efficiency gains can be achieved without sacrifices in super-resolution performance.


title: Conics on Barth--Bauer octics

abstract: We analyze the configurations of conics and lines on a special class of Kummer octic surfaces. In particular, we bound the number of conics by $176$ and show that there is a unique surface with $176$ conics, all irreducible: it admits a faithful action of one of the Mukai groups. Therefore, we also discuss conics and lines on Mukai surfaces: we discover a double plane (ramified at a smooth sextic curve) that contains $8910$ smooth conics.


title: Unified results of compactness and existence for prescribing fractional $Q$-curvatures problem

abstract: In this paper we study the problem of prescribing fractional $Q$-curvature of order $2\sigma$ for a conformal metric on the standard sphere $\Sn$ with $\sigma\in (0,n/2)$ and $n\geq2$. Compactness and existence results are obtained in terms of the flatness order $\beta$ of the prescribed curvature function $K$. Making use of integral representations and perturbation result, we develop a unified approach to obtain these results when $\beta\in [n-2\sigma,n)$ for all $\sigma\in (0,n/2)$. This work generalizes the corresponding results of Jin-Li-Xiong [Math. Ann. 369: 109--151, 2017] for $\beta\in (n-2\sigma,n)$.


title: Behavioral graph fraud detection in E-commerce

abstract: In e-commerce industry, graph neural network methods are the new trends for transaction risk modeling.The power of graph algorithms lie in the capability to catch transaction linking network information, which is very hard to be captured by other algorithms.However, in most existing approaches, transaction or user connections are defined by hard link strategies on shared properties, such as same credit card, same device, same ip address, same shipping address, etc. Those types of strategies will result in sparse linkages by entities with strong identification characteristics (ie. device) and over-linkages by entities that could be widely shared (ie. ip address), making it more difficult to learn useful information from graph. To address aforementioned problems, we present a novel behavioral biometric based method to establish transaction linkings based on user behavioral similarities, then train an unsupervised GNN to extract embedding features for downstream fraud prediction tasks. To our knowledge, this is the first time similarity based soft link has been used in graph embedding applications. To speed up similarity calculation, we apply an in-house GPU based HDBSCAN clustering method to remove highly concentrated and isolated nodes before graph construction. Our experiments show that embedding features learned from similarity based behavioral graph have achieved significant performance increase to the baseline fraud detection model in various business scenarios. In new guest buyer transaction scenario, this segment is a challenge for traditional method, we can make precision increase from 0.82 to 0.86 at the same recall of 0.27, which means we can decrease false positive rate using this method.


title: Fabrication of Metasurfaces on Building Construction Materials for Potential Electromagnetic Applications in the Microwave Band

abstract: Energy self sufficiency, as well as optimal management of power in buildings is gaining importance, while obtaining power from traditional fossil energy sources is becoming more and more expensive. In this context, millimeter scale metasurfaces can be employed to harvest energy from microwave sources. They can also be used as sensors in the microwave regime for efficient power management solutions. In the current study, a simple spray printing method is proposed to develop metasurfaces in construction materials, i.e., plasterboard and wood. Such materials are used in the interior design of buildings; therefore, the implementation of metasurfaces in large areas, such as walls, doors and floors, is realized. The fabricated metasurfaces were characterized regarding their electromagnetic performance. It is hereby shown that the investigated metasurfaces exhibit an efficient electromagnetic response in the frequency range 4 to 7 GHz, depending on the MS. Thus, spray printed metasurfaces integrated on construction materials can potentially be used for electromagnetic applications, for buildings power self efficiency and management.


title: Differential Bias: On the Perceptibility of Stance Imbalance in Argumentation

abstract: Most research on natural language processing treats bias as an absolute concept: Based on a (probably complex) algorithmic analysis, a sentence, an article, or a text is classified as biased or not. Given the fact that for humans the question of whether a text is biased can be difficult to answer or is answered contradictory, we ask whether an "absolute bias classification" is a promising goal at all. We see the problem not in the complexity of interpreting language phenomena but in the diversity of sociocultural backgrounds of the readers, which cannot be handled uniformly: To decide whether a text has crossed the proverbial line between non-biased and biased is subjective. By asking "Is text X more [less, equally] biased than text Y?" we propose to analyze a simpler problem, which, by its construction, is rather independent of standpoints, views, or sociocultural aspects. In such a model, bias becomes a preference relation that induces a partial ordering from least biased to most biased texts without requiring a decision on where to draw the line. A prerequisite for this kind of bias model is the ability of humans to perceive relative bias differences in the first place. In our research, we selected a specific type of bias in argumentation, the stance bias, and designed a crowdsourcing study showing that differences in stance bias are perceptible when (light) support is provided through training or visual aid.


title: Shot-frugal and Robust quantum kernel classifiers

abstract: Quantum kernel methods are a candidate for quantum speed-ups in supervised machine learning. The number of quantum measurements N required for a reasonable kernel estimate is a critical resource, both from complexity considerations and because of the constraints of near-term quantum hardware. We emphasize that for classification tasks, the aim is reliable classification and not precise kernel evaluation, and demonstrate that the former is far more resource efficient. Furthermore, it is shown that the accuracy of classification is not a suitable performance metric in the presence of noise and we motivate a new metric that characterizes the reliability of classification. We then obtain a bound for N which ensures, with high probability, that classification errors over a dataset are bounded by the margin errors of an idealized quantum kernel classifier. Using chance constraint programming and the subgaussian bounds of quantum kernel distributions, we derive several Shot-frugal and Robust (ShofaR) programs starting from the primal formulation of the Support Vector Machine. This significantly reduces the number of quantum measurements needed and is robust to noise by construction. Our strategy is applicable to uncertainty in quantum kernels arising from any source of unbiased noise.


title: Simulating Ride-Pooling Services with Pre-Booking and On-Demand Customers

abstract: If private vehicle trips can be replaced, ride-pooling services can decrease parking space needed by higher vehicle utilization and increase traffic efficiency by increasing vehicle occupancy. Nevertheless, substantial benefits can only be achieved if a certain market penetration is passed to find enough shareable rides for pooling to take place. Additionally, because of their highly dynamic and stochastic nature on-demand ride-pooling services cannot always guarantee that a request is served. Allowing customers to pre-book their trip in advance could provide benefits for both aspects. Additional knowledge helps an operator to better plan vehicle schedules to improve service efficiency while an accepted trip or a rejection can be communicated early on to the customer. This study presents a simulation framework where a ride-pooling provider offers a service in mixed operation: Customers can either use the service on-demand or pre-book trips. A graph-based batch optimization formulation is proposed to create offline schedules for pre-booking customers. Using two rolling horizons, this offline solution is forwarded to an online optimization for on-demand and pre-booking customers simultaneously. The framework is tested in a case study for Manhattan, NYC. That the graph-based batch optimization is superior to a basic insertion method in terms of solution quality and run-time. Due to additional knowledge, the ride-pooling operator can improve the solution quality significantly by serving more customers while pooling efficiency can be increased. Additionally, customers have shorter waiting and detour times the more customers book a trip in advance.


title: Contrastive Psudo-supervised Classification for Intra-Pulse Modulation of Radar Emitter Signals Using data augmentation

abstract: The automatic classification of radar waveform is a fundamental technique in electronic countermeasures (ECM).Recent supervised deep learning-based methods have achieved great success in a such classification task.However, those methods require enough labeled samples to work properly and in many circumstances, it is not available.To tackle this problem, in this paper, we propose a three-stages deep radar waveform clustering(DRSC) technique to automatically group the received signal samples without labels.Firstly, a pretext model is trained in a self-supervised way with the help of several data augmentation techniques to extract the class-dependent features.Next,the pseudo-supervised contrastive training is involved to further promote the separation between the extracted class-dependent features.And finally, the unsupervised problem is converted to a semi-supervised classification problem via pseudo label generation. The simulation results show that the proposed algorithm can effectively extract class-dependent features, outperforming several unsupervised clustering methods, even reaching performance on par with the supervised deep learning-based methods.


title: Evaluating Data-Driven Co-Speech Gestures of Embodied Conversational Agents through Real-Time Interaction

abstract: Embodied Conversational Agents that make use of co-speech gestures can enhance human-machine interactions in many ways. In recent years, data-driven gesture generation approaches for ECAs have attracted considerable research attention, and related methods have continuously improved. Real-time interaction is typically used when researchers evaluate ECA systems that generate rule-based gestures. However, when evaluating the performance of ECAs based on data-driven methods, participants are often required only to watch pre-recorded videos, which cannot provide adequate information about what a person perceives during the interaction. To address this limitation, we explored use of real-time interaction to assess data-driven gesturing ECAs. We provided a testbed framework, and investigated whether gestures could affect human perception of ECAs in the dimensions of human-likeness, animacy, perceived intelligence, and focused attention. Our user study required participants to interact with two ECAs - one with and one without hand gestures. We collected subjective data from the participants' self-report questionnaires and objective data from a gaze tracker. To our knowledge, the current study represents the first attempt to evaluate data-driven gesturing ECAs through real-time interaction and the first experiment using gaze-tracking to examine the effect of ECAs' gestures.


title: Process Yield and Device Stability Improvement for Sol-gel Alumina Passivation layer based GFETs

abstract: The stability of GFET devices is a major problem and needs a good passivation layer for the same. Low cost and low-temperature sol-gel alumina passivation layer-based GFETs is studied here with the goals to improve stability of the device and achieve high process yield. The process yield and device stability are explored for two different molarities of 0.1 M and 0.05 M. The parameters like mobility, trap charge density, minimum conductivity plateau width and minimum conductivity are extracted to compare the stability of devices. The results indicate that GFETs with 0.1 M have problems of process yield due to crack formation in the channel region post-annealing, where close to half of the devices are working, and also working devices are are not stable and degrading very fast within a week's time. On the other hand, 0.05 M sol-gel Alumina-based sample exhibits 100$\%$ process yield with all working devices and observed stable behavior for more than two months. Hence we propose an optimized process recipe for a sol-gel Alumina-based passivation layer to achieve the best possible process yield and device stability for GFETs.


title: Parallel photonic accelerator for decision making using optical spatiotemporal chaos

abstract: Photonic accelerators have attracted increasing attention in artificial intelligence applications. The multi-armed bandit problem is a fundamental problem of decision making using reinforcement learning. However, the scalability of photonic decision making has not yet been demonstrated in experiments, owing to technical difficulties in physical realization. We propose a parallel photonic decision-making system for solving large-scale multi-armed bandit problems using optical spatiotemporal chaos. We solve a 512-armed bandit problem online, which is much larger than previous experiments by two orders of magnitude. The scaling property for correct decision making is examined as a function of the number of slot machines, evaluated as an exponent of 0.86. This exponent is smaller than that in previous work, indicating the superiority of the proposed parallel principle. This experimental demonstration facilitates photonic decision making to solve large-scale multi-armed bandit problems for future photonic accelerators.


title: LLRF for PolFEL Accelerator

abstract: PolFEL stands for Polish Free Electron Laser, the first FEL research infrastructure in Poland. This facility is under development, and it will operate in three wavelength ranges: IR, THz and VUV, using different types of undulators. Machine will be driven by 200 MeV linear superconducting accelerator, which will operate in both, pulsed wave (PW) and continuous wave (CW) modes. This paper will describe the concept, current status and the first results of the LLRF systems development.


title: LION: Latent Point Diffusion Models for 3D Shape Generation

abstract: Denoising diffusion models (DDMs) have shown promising results in 3D point cloud synthesis. To advance 3D DDMs and make them useful for digital artists, we require (i) high generation quality, (ii) flexibility for manipulation and applications such as conditional synthesis and shape interpolation, and (iii) the ability to output smooth surfaces or meshes. To this end, we introduce the hierarchical Latent Point Diffusion Model (LION) for 3D shape generation. LION is set up as a variational autoencoder (VAE) with a hierarchical latent space that combines a global shape latent representation with a point-structured latent space. For generation, we train two hierarchical DDMs in these latent spaces. The hierarchical VAE approach boosts performance compared to DDMs that operate on point clouds directly, while the point-structured latents are still ideally suited for DDM-based modeling. Experimentally, LION achieves state-of-the-art generation performance on multiple ShapeNet benchmarks. Furthermore, our VAE framework allows us to easily use LION for different relevant tasks: LION excels at multimodal shape denoising and voxel-conditioned synthesis, and it can be adapted for text- and image-driven 3D generation. We also demonstrate shape autoencoding and latent shape interpolation, and we augment LION with modern surface reconstruction techniques to generate smooth 3D meshes. We hope that LION provides a powerful tool for artists working with 3D shapes due to its high-quality generation, flexibility, and surface reconstruction. Project page and code: https://nv-tlabs.github.io/LION.


title: Non-volatile hybrid optical phase shifter driven by a ferroelectric transistor

abstract: Optical phase shifters are essential elements in photonic integrated circuits (PICs) and function as a direct interface to program the PIC. Non-volatile phase shifters, which can retain information without a power supply, are highly desirable for low-power static operations. Here a non-volatile optical phase shifter is demonstrated by driving a III-V/Si hybrid metal-oxide-semiconductor (MOS) phase shifter with a ferroelectric field-effect transistor (FeFET) operating in the source follower mode. Owing to the various polarization states in the FeFET, multistate non-volatile phase shifts up to 1.25{\pi} are obtained with CMOS-compatible operation voltages and low switching energy up to 3.3 nJ. Furthermore, a crossbar array architecture is proposed to simplify the control of non-volatile phase shifters in large-scale PICs and its feasibility is verified by confirming the selective write-in operation of a targeted FeFET with a negligible disturbance to the others. This work paves the way for realizing large-scale non-volatile programmable PICs for emerging computing applications such as deep learning and quantum computing.


title: Probabilistic Integration of Object Level Annotations in Chest X-ray Classification

abstract: Medical image datasets and their annotations are not growing as fast as their equivalents in the general domain. This makes translation from the newest, more data-intensive methods that have made a large impact on the vision field increasingly more difficult and less efficient. In this paper, we propose a new probabilistic latent variable model for disease classification in chest X-ray images. Specifically we consider chest X-ray datasets that contain global disease labels, and for a smaller subset contain object level expert annotations in the form of eye gaze patterns and disease bounding boxes. We propose a two-stage optimization algorithm which is able to handle these different label granularities through a single training pipeline in a two-stage manner. In our pipeline global dataset features are learned in the lower level layers of the model. The specific details and nuances in the fine-grained expert object-level annotations are learned in the final layers of the model using a knowledge distillation method inspired by conditional variational inference. Subsequently, model weights are frozen to guide this learning process and prevent overfitting on the smaller richly annotated data subsets. The proposed method yields consistent classification improvement across different backbones on the common benchmark datasets Chest X-ray14 and MIMIC-CXR. This shows how two-stage learning of labels from coarse to fine-grained, in particular with object level annotations, is an effective method for more optimal annotation usage.


title: Approaches To Quantum Cosmology: A Review

abstract: A review of the path integral approach to quantum cosmology and its relation to canonical quantisation. The initial derivation of the Hartle-Hawking and Vilenkin wavefunctions from the Euclidean Einstein-Hilbert action, and later, from the Lorentzian path integral using Picard-Lefshets Theory is discussed. Path integral quantisation of the Einstein-Cartan action is then employed to obtain the wavefunctions for minisuperspace closed FRW universes dominated by matter and radiation. These calculations are complimentary to those recently carried out by Magueijo using canonical quantisation of the same action.


title: Ultra-tuning of nonlinear drumhead MEMS resonators by electro-thermoelastic buckling

abstract: Nonlinear micro-electro-mechanical systems (MEMS) resonators open new opportunities in sensing and signal manipulation compared to their linear counterparts by enabling frequency tuning and increased bandwidth. Here, we design, fabricate and study drumhead resonators exhibiting strongly nonlinear dynamics and develop a reduced order model (ROM) to capture their response accurately. The resonators undergo electrostatically-mediated thermoelastic buckling which tunes their natural frequency from 4.7 to 11.3 MHz, a factor of 2.4x tunability. Moreover, the imposed buckling switches the nonlinearity of the resonators between purely stiffening, purely softening, and even softening-to-stiffening. Accessing these exotic dynamics requires precise control of the temperature and the DC electrostatic forces near the resonator's critical-buckling point. To explain the observed tunability, we develop a one-dimensional physics-based ROM that predicts the linear and nonlinear response of the fundamental bending mode of these drumhead resonators. The ROM captures the dynamic effects of the internal stresses resulting from three sources: The residual stresses from the fabrication process, the mismatch in thermal expansion between the constituent layers, and lastly, the applied electrostatic forces. The ROM replicates the observed tunability of linear (within 5.5% error) and nonlinear responses even near the states of critical buckling. These remarkable nonlinear and large tunability of the natural frequency are valuable features for on-chip acoustic devices in broad applications such as signal manipulation, filtering, and MEMS waveguides.


title: Denoising Masked AutoEncoders Help Robust Classification

abstract: In this paper, we propose a new self-supervised method, which is called Denoising Masked AutoEncoders (DMAE), for learning certified robust classifiers of images. In DMAE, we corrupt each image by adding Gaussian noises to each pixel value and randomly masking several patches. A Transformer-based encoder-decoder model is then trained to reconstruct the original image from the corrupted one. In this learning paradigm, the encoder will learn to capture relevant semantics for the downstream tasks, which is also robust to Gaussian additive noises. We show that the pre-trained encoder can naturally be used as the base classifier in Gaussian smoothed models, where we can analytically compute the certified radius for any data point. Although the proposed method is simple, it yields significant performance improvement in downstream classification tasks. We show that the DMAE ViT-Base model, which just uses 1/10 parameters of the model developed in recent work arXiv:2206.10550, achieves competitive or better certified accuracy in various settings. The DMAE ViT-Large model significantly surpasses all previous results, establishing a new state-of-the-art on ImageNet dataset. We further demonstrate that the pre-trained model has good transferability to the CIFAR-10 dataset, suggesting its wide adaptability. Models and code are available at https://github.com/quanlin-wu/dmae.


title: QDTrack: Quasi-Dense Similarity Learning for Appearance-Only Multiple Object Tracking

abstract: Similarity learning has been recognized as a crucial step for object tracking. However, existing multiple object tracking methods only use sparse ground truth matching as the training objective, while ignoring the majority of the informative regions in images. In this paper, we present Quasi-Dense Similarity Learning, which densely samples hundreds of object regions on a pair of images for contrastive learning. We combine this similarity learning with multiple existing object detectors to build Quasi-Dense Tracking (QDTrack), which does not require displacement regression or motion priors. We find that the resulting distinctive feature space admits a simple nearest neighbor search at inference time for object association. In addition, we show that our similarity learning scheme is not limited to video data, but can learn effective instance similarity even from static input, enabling a competitive tracking performance without training on videos or using tracking supervision. We conduct extensive experiments on a wide variety of popular MOT benchmarks. We find that, despite its simplicity, QDTrack rivals the performance of state-of-the-art tracking methods on all benchmarks and sets a new state-of-the-art on the large-scale BDD100K MOT benchmark, while introducing negligible computational overhead to the detector.


title: A Local Discontinuous Galerkin approximation for the $p$-Navier-Stokes system, Part III: Convergence rates for the pressure

abstract: In the present paper, we prove convergence rates for the pressure of the Local Discontinuous Galerkin (LDG) approximation, proposed in Part I of the paper, of systems of $p$-Navier-Stokes type and $p$-Stokes type with $p\in (2,\infty)$. The results are supported by numerical experiments.


title: Tone prediction and orthographic conversion for Basaa

abstract: In this paper, we present a seq2seq approach for transliterating missionary Basaa orthographies into the official orthography. Our model uses pre-trained Basaa missionary and official orthography corpora using BERT. Since Basaa is a low-resource language, we have decided to use the mT5 model for our project. Before training our model, we pre-processed our corpora by eliminating one-to-one correspondences between spellings and unifying characters variably containing either one to two characters into single-character form. Our best mT5 model achieved a CER equal to 12.6747 and a WER equal to 40.1012.


title: Anomalous coupling studies with intact protons at the LHC

abstract: We describe the reaches on quartic $\gamma \gamma \gamma \gamma$, $\gamma \gamma WW$, $\gamma \gamma ZZ$, $\gamma \gamma \gamma Z$, $\gamma \gamma t \bar{t}$ anomalous couplings at the LHC using intact protons in the final state measured in AFP in ATLAS or PPS in CMS-TOTEM.


title: Measurement of $e^+ e^- \rightarrow \phi \eta^{\prime}$ cross sections at center-of-mass energies between 3.508 and 4.600 GeV

abstract: We present a measurement of the dressed cross sections for $e^+ e^- \rightarrow \phi \eta^{\prime}$ at different center-of-mass energies between 3.508 and 4.600 GeV based on 15.1 fb$^{-1}$ of $e^+ e^-$ annihilation data collected with the BESIII detector operating at the BEPCII collider. In addition, a search for the decay $Y(4230) \to \phi \eta^{\prime}$ is performed. No clear signal is observed and the corresponding upper limit is provided.


title: Multi-Task Meta Learning: learn how to adapt to unseen tasks

abstract: This work proposes Multi-task Meta Learning (MTML), integrating two learning paradigms Multi-Task Learning (MTL) and meta learning, to bring together the best of both worlds. In particular, it focuses simultaneous learning of multiple tasks, an element of MTL and promptly adapting to new tasks, a quality of meta learning. It is important to highlight that we focus on heterogeneous tasks, which are of distinct kind, in contrast to typically considered homogeneous tasks (e.g., if all tasks are classification or if all tasks are regression tasks). The fundamental idea is to train a multi-task model, such that when an unseen task is introduced, it can learn in fewer steps whilst offering a performance at least as good as conventional single task learning on the new task or inclusion within the MTL. By conducting various experiments, we demonstrate this paradigm on two datasets and four tasks: NYU-v2 and the taskonomy dataset for which we perform semantic segmentation, depth estimation, surface normal estimation, and edge detection. MTML achieves state-of-the-art results for three out of four tasks for the NYU-v2 dataset and two out of four for the taskonomy dataset. In the taskonomy dataset, it was discovered that many pseudo-labeled segmentation masks lacked classes that were expected to be present in the ground truth; however, our MTML approach was found to be effective in detecting these missing classes, delivering good qualitative results. While, quantitatively its performance was affected due to the presence of incorrect ground truth labels. The the source code for reproducibility can be found at https://github.com/ricupa/MTML-learn-how-to-adapt-to-unseen-tasks.


title: Exploring Segmentation Approaches for Neural Machine Translation of Code-Switched Egyptian Arabic-English Text

abstract: Data sparsity is one of the main challenges posed by code-switching (CS), which is further exacerbated in the case of morphologically rich languages. For the task of machine translation (MT), morphological segmentation has proven successful in alleviating data sparsity in monolingual contexts; however, it has not been investigated for CS settings. In this paper, we study the effectiveness of different segmentation approaches on MT performance, covering morphology-based and frequency-based segmentation techniques. We experiment on MT from code-switched Arabic-English to English. We provide detailed analysis, examining a variety of conditions, such as data size and sentences with different degrees of CS. Empirical results show that morphology-aware segmenters perform the best in segmentation tasks but under-perform in MT. Nevertheless, we find that the choice of the segmentation setup to use for MT is highly dependent on the data size. For extreme low-resource scenarios, a combination of frequency and morphology-based segmentations is shown to perform the best. For more resourced settings, such a combination does not bring significant improvements over the use of frequency-based segmentation.


title: Density matrix formalism for interacting quantum fields

abstract: We provide a description of interacting quantum fields in terms of density matrices for any occupation numbers in Fock space in a momentum basis. As a simple example, we focus on a real scalar field interacting with another real scalar field, and present a practicable formalism for directly computing the density matrix elements of the combined scalar-scalar system. For deriving the main formula, we use techniques from non-equilibrium quantum field theory like thermo field dynamics and the Schwinger-Keldysh formalism. Our results allow for studies of particle creation/annihilation processes at finite times and other non-equilibrium processes including those found in the theory of open quantum systems.


title: $S_4$-quartics with Prescribed Norms

abstract: Given a number field $k$ and a finitely generated subgroup $\mathcal{A} \subseteq k^*$, we study the distribution of $S_4$-quartic extensions of $k$ such that the elements of $\mathcal{A}$ are norms. We show that the density of such extensions is the product of so-called "local masses" at every place of $k$. We give these local masses explicitly in almost all cases and give an algorithm for computing the remaining cases.


title: Near-infrared and Optical Nebular-phase Spectra of Type Ia Supernovae SN 2013aa and SN 2017cbv in NGC 5643

abstract: We present multi-wavelength time-series spectroscopy of SN 2013aa and SN 2017cbv, two Type Ia supernovae (SNe Ia) on the outskirts of the same host galaxy, NGC 5643. This work utilizes new nebular-phase near-infrared (NIR) spectra obtained by the Carnegie Supernova Project-II, in addition to previously published optical and NIR spectra. By measuring nebular-phase [Fe II] lines in both the optical and NIR, we examine the explosion kinematics and test the efficacy of several emission line fitting techniques commonly used in the literature. The NIR [Fe II] 1.644 $\mu$m line provides the most robust velocity measurements against variations due to the choice of the fit method and line blending. The resulting effects on velocity measurements due to choosing different fit methods, initial fit parameters, continuum and line profile functions, and fit region boundaries were also investigated. The NIR [Fe II] velocities yield the same radial shift direction as velocities measured using the optical [Fe II] 7155 A line, but the sizes of the shifts are consistently and substantially lower, pointing to a potential issue in optical studies. The NIR [Fe II] 1.644 $\mu$m emission profile shows a lack of significant asymmetry in both SNe Ia, and the observed low velocities elevate the importance for correcting for any radial velocity contribution from the host galaxy's rotation. The low [Fe II] velocities measured in the NIR at nebular phases disfavors most progenitor scenarios in close double-degenerate systems for both SN 2013aa and SN 2017cbv. The time evolution of the NIR [Fe II] 1.644 $\mu$m line also indicates moderately high progenitor white dwarf central density and potentially high magnetic fields. These sibling SNe Ia were well observed at both early and late times, providing an excellent opportunity to study the intrinsic diversity of SNe Ia.


title: Linear Optical Modulators for Prospective Communications at the 2 {\mu}m Waveband

abstract: The 2 {\mu}m waveband is an area that could have significant technological consequences, with applications ranging from spectroscopy, LIDAR and free-space communications. The development of the thulium-doped fiber amplifier, hollow-core photonic bandgap fiber and 2 {\mu}m GaSb-based diode lasers has highlighted the ability of the waveband in alleviating the fiber capacity crisis in the incumbent communication infrastructure. The above has initiated vibrant development in the silicon photonic-space at 2 {\mu}m, where the area is capable of enabling highly-integrated photonic circuits, and potentially at low-cost and high-volumes. However, as of now, modulator linearity at 2 {\mu}m has not been addressed. The metric, as characterized by spurious free dynamic range is imperative for numerous applications such as RF photonic links for 5G and digital analog transmission in coherent communications. The development of linear optical modulators will be crucial in bringing these applications to the 2 {\mu}m. In view of that, this work is the first to address modulator linearity at the 2 {\mu}m, where the ring-assisted Mach-Zehnder modulator is developed, indicating spurious free dynamic range as high as 95 dB.Hz^2/3. It is found that that modulator spurious free dynamic range has a strong dependence on modulator bias voltage where it impacts the linearity of the transfer function in which the input RF signal is applied upon. The demonstrated modulator indicates favorable performance within silicon photonic modulators developed at 2 {\mu}m with bandwidth exceeding 17.5 GHz and modulation efficiency ranging from 0.70 to 1.25 V.cm.


title: A Topological Directional Coupler Fed by Microstrip Line with Configurable Coupling Coefficient

abstract: Topological waveguides have been extensively studied for their robust transmission properties immune to defects and their application potentials for microwave and terahertz integrated circuits. In this work, by using grounded planar valley-Hall photonic topological insulators, a high-efficiency topological directional coupler fed directly by microstrip line with configurable coupling coefficient is theoretically proposed and experimentally demonstrated. The topological directional coupler consists of two coupled topological waveguides, which can be directly integrated with microstrip circuits. Different coupling coefficients were achieved by configuring the coupling between the two topological waveguides. Both simulation and measurement demonstrated the proposed designs. In addition, the proposed design is applicable in both microwave and terahertz bands.


title: DICTDIS: Dictionary Constrained Disambiguation for Improved NMT

abstract: Domain-specific neural machine translation (NMT) systems (\eg, in educational applications) are socially significant with the potential to help make information accessible to a diverse set of users in multilingual societies. It is desirable that such NMT systems be lexically constrained and draw from domain-specific dictionaries. Dictionaries could present multiple candidate translations for a source word/phrase due to the polysemous nature of words. The onus is then on the NMT model to choose the contextually most appropriate candidate. Prior work has largely ignored this problem and focused on the single candidate constraint setting wherein the target word or phrase is replaced by a single constraint. In this work we present \dictdis, a lexically constrained NMT system that disambiguates between multiple candidate translations derived from dictionaries. We achieve this by augmenting training data with multiple dictionary candidates to actively encourage disambiguation during training by implicitly aligning multiple candidate constraints. We demonstrate the utility of \dictdis\ via extensive experiments on English-Hindi and English-German sentences in a variety of domains including regulatory, finance, engineering. We also present comparisons on standard benchmark test datasets. In comparison with existing approaches for lexically constrained and unconstrained NMT, we demonstrate superior performance with respect to constraint copy and disambiguation related measures on all domains while also obtaining improved fluency of up to 2-3 BLEU points on some domains.


title: Two approaches to inpainting microstructure with deep convolutional generative adversarial networks

abstract: Imaging is critical to the characterisation of materials. However, even with careful sample preparation and microscope calibration, imaging techniques are often prone to defects and unwanted artefacts. This is particularly problematic for applications where the micrograph is to be used for simulation or feature analysis, as defects are likely to lead to inaccurate results. Microstructural inpainting is a method to alleviate this problem by replacing occluded regions with synthetic microstructure with matching boundaries. In this paper we introduce two methods that use generative adversarial networks to generate contiguous inpainted regions of arbitrary shape and size by learning the microstructural distribution from the unoccluded data. We find that one benefits from high speed and simplicity, whilst the other gives smoother boundaries at the inpainting border. We also outline the development of a graphical user interface that allows users to utilise these machine learning methods in a 'no-code' environment.


title: DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Models

abstract: Text-to-image generation models that generate images based on prompt descriptions have attracted an increasing amount of attention during the past few months. Despite their encouraging performance, these models raise concerns about the misuse of their generated fake images. To tackle this problem, we pioneer a systematic study on the detection and attribution of fake images generated by text-to-image generation models. Concretely, we first build a machine learning classifier to detect the fake images generated by various text-to-image generation models. We then attribute these fake images to their source models, such that model owners can be held responsible for their models' misuse. We further investigate how prompts that generate fake images affect detection and attribution. We conduct extensive experiments on four popular text-to-image generation models, including DALL$\cdot$E 2, Stable Diffusion, GLIDE, and Latent Diffusion, and two benchmark prompt-image datasets. Empirical results show that (1) fake images generated by various models can be distinguished from real ones, as there exists a common artifact shared by fake images from different models; (2) fake images can be effectively attributed to their source models, as different models leave unique fingerprints in their generated images; (3) prompts with the ``person'' topic or a length between 25 and 75 enable models to generate fake images with higher authenticity. All findings contribute to the community's insight into the threats caused by text-to-image generation models. We appeal to the community's consideration of the counterpart solutions, like ours, against the rapidly-evolving fake image generation.


title: GaAs quantum dots under quasi-uniaxial stress: experiment and theory

abstract: The optical properties of excitons confined in initially-unstrained GaAs/AlGaAs quantum dots are studied as a function of a variable quasi-uniaxial stress. To allow the validation of state-of-the-art computational tools for describing the optical properties of nanostructures, we determine the quantum dot morphology and the in-plane components of externally induced strain tensor at the quantum dot positions. Based on these \textsl{experimental} parameters, we calculate the strain-dependent excitonic emission energy, degree of linear polarization, and fine-structure splitting using a combination of eight-band ${\bf k}\cdot{\bf p}$ formalism with multiparticle corrections using the configuration interaction method. The experimental observations are quantitatively well reproduced by our calculations and deviations are discussed.


title: LETTER On putative incommensurate states of a finite Frenkel-Kontorova chain

abstract: We propose a new but simpler explanation of the phases of a Frenkel-Kontorova chain of atoms, and we demonstrate it by examples. Combined with this, we present a criticism of the theory of so-called commensurate and incommensurate states, especially for finite chains. We reject the putative observation of an Aubry-phase transition in a finite chain.


title: Soliton crystals in optical Kerr microresonators in the presence of thermo-optic effects

abstract: The influence of thermo-optic effects on shape profiles of soliton crystals in optical Kerr microresonators is investigated. The study rests on a model that consists of the Lugiato-Lefever equation, coupled to the one-dimensional heat diffusion equation with a source term proportional to the average power of the optical field. Using appropriate variable changes the model equations are transformed into a set of coupled first-order nonlinear ordinary differential equations. These equations are solved numerically with emphasis on the influence of thermo-optic effects on the amplitude and instantaneous frequency of the optical field, as well as on the temperature profile in the microresonator cavity. It is found that thermo-optic effects do not prevent soliton crytals from forming in optical Kerr microresonators, however, a strong thermal detuning will decrease the soliton-crystal amplitude. The model predicts a temperature profile in the microresonator cavity which is insensitive to the specific spatio-temporal profile of the soliton crystal propagating in the microresonator, a feature peculiar to the model.


title: Anonymizing Speech with Generative Adversarial Networks to Preserve Speaker Privacy

abstract: In order to protect the privacy of speech data, speaker anonymization aims for hiding the identity of a speaker by changing the voice in speech recordings. This typically comes with a privacy-utility trade-off between protection of individuals and usability of the data for downstream applications. One of the challenges in this context is to create non-existent voices that sound as natural as possible. In this work, we propose to tackle this issue by generating speaker embeddings using a generative adversarial network with Wasserstein distance as cost function. By incorporating these artificial embeddings into a speech-to-text-to-speech pipeline, we outperform previous approaches in terms of privacy and utility. According to standard objective metrics and human evaluation, our approach generates intelligible and content-preserving yet privacy-protecting versions of the original recordings.


title: 5-Minute Magnetic Particle Spectroscopy (MPS)-based Bioassay: Towards Ultra-fast, Convenient, and Large-scale Disease Diagnosis

abstract: In this work, we report a 5-minute magnetic particle spectroscopy (MPS)-based bioassay strategy. In our approach, surface functionalized magnetic nanoparticles (MNPs) are incubated with target analytes at 37 {\deg}C with agitation for 3 minutes and the MPS reading is then taken at the 5th minute. We have proved the feasibility of 5-minute ultra-fast detection of SARS-CoV-2 spike protein with a detection limit below 5 nM (0.2 pmole). Our proposed 5-minute bioassay strategy may be applied to reduce assay time for other liquid phase, volumetric biosensors such as nuclear magnetic resonance (NMR), quantum dots (QD), fluorescent biosensors, etc.


title: Clifford odd and even objects offer the description of the internal space of fermions and bosons, respectively, opening new insight into the second quantization of fields

abstract: In a long series of works the author has demonstrated that the model named the {\it spin-charge-family} theory offers the explanation for all in the {\it standard model} assumed properties of the fermion and boson fields, as well as for many of their so far observed properties if the space-time is $\ge (13 +1)$ while fermions interact with gravity only. In this paper, I briefly report on the so far achievements of the theory. The main contribution demonstrates the offer of the Clifford odd and even objects for the description of the internal spaces of fermion (Clifford odd) and boson (Clifford even) fields, which is opening up a new understanding of the second quantization postulates for the fermion and boson fields: The "basis vectors" determined by the Clifford odd objects demonstrate all the properties of the internal space of fermions and transfer their anticommutativity to their creation and annihilation operators, while the "basis vectors" determined by the Clifford even objects demonstrate all the properties of the internal space of boson fields and transfer their commutativity to their creation and annihilation operators. The toy model with $d=(5+1)$ illustrates the statements.


title: A Red Giants' Toy Story

abstract: In spite of the spectacular progress accomplished by stellar evolution theory some simple questions remain unanswered. One of these questions is ``Why do stars become Red Giants?''. Here we present a relatively simple analytical answer to this question. We validate our analysis by constructing a quantitative toy-model of a red giant and comparing its predictions to full stellar evolutionar models. We find that the envelope forces the value of $\nabla=d \ln T/d \ln P$ at, and above, the burning shell into a very narrow range of possible values. Together with the fact that the stellar material at the burning shell both provides and transports most of the stellar luminosity, this leads to tight relations between the thermodynamic variables at the burning shell and the mass and radius of the core -- $T_s(M_c,R_s)$, $P_s(M_c,R_s)$ and $\rho_s(M_c,R_s)$. When complemented by typical mass-radius relations of the helium cores, this implies that for all stellar masses the evolution of the core dictates the values of $T_s$, $P_s$ and $\rho_s$. We show that for all stellar masses evolution leads to an increase in the pressure and density contrasts between the shell and the core, forcing a huge expansion of the layers on top of the burning shell. Besides explaining why stars become red giants our analysis also offers a mathematical demonstration of the so-called shell homology relations, and provides simple quantitative answers to some properties of low-mass red giants.


title: Sustainable Online Reinforcement Learning for Auto-bidding

abstract: Recently, auto-bidding technique has become an essential tool to increase the revenue of advertisers. Facing the complex and ever-changing bidding environments in the real-world advertising system (RAS), state-of-the-art auto-bidding policies usually leverage reinforcement learning (RL) algorithms to generate real-time bids on behalf of the advertisers. Due to safety concerns, it was believed that the RL training process can only be carried out in an offline virtual advertising system (VAS) that is built based on the historical data generated in the RAS. In this paper, we argue that there exists significant gaps between the VAS and RAS, making the RL training process suffer from the problem of inconsistency between online and offline (IBOO). Firstly, we formally define the IBOO and systematically analyze its causes and influences. Then, to avoid the IBOO, we propose a sustainable online RL (SORL) framework that trains the auto-bidding policy by directly interacting with the RAS, instead of learning in the VAS. Specifically, based on our proof of the Lipschitz smooth property of the Q function, we design a safe and efficient online exploration (SER) policy for continuously collecting data from the RAS. Meanwhile, we derive the theoretical lower bound on the safety of the SER policy. We also develop a variance-suppressed conservative Q-learning (V-CQL) method to effectively and stably learn the auto-bidding policy with the collected data. Finally, extensive simulated and real-world experiments validate the superiority of our approach over the state-of-the-art auto-bidding algorithm.


title: Photon splitting corrections to soft-photon resummation

abstract: In this paper we present an algorithm to add photon-splitting corrections to the Yennie-Frautschi-Suura-style soft-photon resummation available in the Sherpa Monte-Carlo event generator. Photon-splitting corrections enter at NNLO in QED and, as these effects are not incorporated in the standard QED FSR resummations, their size is larger than the pure hard photon-emission corrections at the same order. We introduce different lepton dressing strategies which incorporate further leptons and hadrons in addition to the customary photons, and discuss their sensitivity to dressing parameters such as the cone size. Finally, we quantify the effects of photon splittings into charged fermions and scalars under different such dressing strategies on $Z\to e^+e^-$ decays and find effects of up to 1% for suitably inclusive dressing strategies independent of the dressing cone size, and up to 9% if only photons are used in the dressing procedure with large dressing cones.


title: Certain tracially nuclear dimensional for certain crossed product ${\rm C^*}$-algebras

abstract: Let $\Omega$ be a class of unital ${\rm C^*}$-algebras which have the second type tracial nuclear dimensional at moat $n$ (or have tracial nuclear dimensional at most $n$). Let $A$ be an infinite dimensional unital simple ${\rm C^*}$-algebra such that $A$ is asymptotical tracially in $\Omega$. Then ${\rm T^2dim_{nuc}}(A)\leq n$ (or ${\rm Tdim_{nuc}}(A)\leq n$). As an application, let $A$ be an infinite dimensional simple separable amenable unital ${\rm C^*}$-algebra with ${\rm T^2dim_{nuc}}(A)\leq n$ (or ${\rm Tdim_{nuc}}(A)\leq n$). Suppose that $\alpha:G\to {\rm Aut}(A)$ is an action of a finite group $G$ on $A$ which has the tracial Rokhlin property. Then ${\rm T^2dim_{nuc}}({{\rm C^*}(G, A,\alpha)})\leq n$ (or ${\rm Tdim_{nuc}}$ $({{\rm C^*}(G, A,\alpha)})\leq n$).


title: Trends in Northern Hemispheric Snow Presence

abstract: This paper develops a mathematical model and statistical methods to quantify trends in presence/absence observations of snow cover (not depths) and applies these in an analysis of Northern Hemispheric observations extracted from satellite flyovers during 1967-2021. A two-state Markov chain model with periodic dynamics is introduced to analyze changes in the data in a grid by grid fashion. Trends, converted to the number of weeks of snow cover lost/gained per century, are estimated for each study grid. Uncertainty margins for these trends are developed from the model and used to assess the significance of the trend estimates. Grids with questionable data quality are identified. Among trustworthy grids, snow presence is seen to be declining in almost twice as many grids as it is advancing. While Arctic and southern latitude snow presence is found to be rapidly receding, other locations, such as Eastern Canada, are experiencing advancing snow cover.


title: A note about charts built by Eriksson-Bique and Soultanis on metric measure spaces

abstract: This note is motivated by recent studies by Eriksson-Bique and Soultanis about the construction of charts in general metric measure spaces. We analyze their construction and provide an alternative and simpler proof of the fact that these charts exist on sets of finite Hausdorff dimension. The observation made here offers also some simplification about the study of the relation between the reference measure and the charts in the setting of $\text{RCD}$ spaces.


abstract: Multi-view graph clustering (MGC) methods are increasingly being studied due to the explosion of multi-view data with graph structural information. The critical point of MGC is to better utilize the view-specific and view-common information in features and graphs of multiple views. However, existing works have an inherent limitation that they are unable to concurrently utilize the consensus graph information across multiple graphs and the view-specific feature information. To address this issue, we propose Variational Graph Generator for Multi-View Graph Clustering (VGMGC). Specifically, a novel variational graph generator is proposed to extract common information among multiple graphs. This generator infers a reliable variational consensus graph based on a priori assumption over multiple graphs. Then a simple yet effective graph encoder in conjunction with the multi-view clustering objective is presented to learn the desired graph embeddings for clustering, which embeds the inferred view-common graph and view-specific graphs together with features. Finally, theoretical results illustrate the rationality of VGMGC by analyzing the uncertainty of the inferred consensus graph with information bottleneck principle. Extensive experiments demonstrate the superior performance of our VGMGC over SOTAs.


title: Over-the-Air Computation Based on Balanced Number Systems for Federated Edge Learning

abstract: In this study, we propose a digital over-the-air computation (OAC) scheme for achieving continuous-valued (analog) aggregation for federated edge learning (FEEL). We show that the average of a set of real-valued parameters can be calculated approximately by using the average of the corresponding numerals, where the numerals are obtained based on a balanced number system. By exploiting this key property, the proposed scheme encodes the local stochastic gradients into a set of numerals. Next, it determines the positions of the activated orthogonal frequency division multiplexing (OFDM) subcarriers by using the values of the numerals. To eliminate the need for precise sample-level time synchronization, channel estimation overhead, and channel inversion, the proposed scheme also uses a non-coherent receiver at the edge server (ES) and does not utilize a pre-equalization at the edge devices (EDs). We theoretically analyze the MSE performance of the proposed scheme and the convergence rate for a non-convex loss function. To improve the test accuracy of FEEL with the proposed scheme, we introduce the concept of adaptive absolute maximum (AAM). Our numerical results show that when the proposed scheme is used with AAM for FEEL, the test accuracy can reach up to 98% for heterogeneous data distribution.


title: Transfer Deep Reinforcement Learning-based Large-scale V2G Continuous Charging Coordination with Renewable Energy Sources

abstract: Due to the increasing popularity of electric vehicles (EVs) and the technological advancement of EV electronics, the vehicle-to-grid (V2G) technique and large-scale scheduling algorithms have been developed to achieve a high level of renewable energy and power grid stability. This paper proposes a deep reinforcement learning (DRL) method for the continuous charging/discharging coordination strategy in aggregating large-scale EVs in V2G mode with renewable energy sources (RES). The DRL coordination strategy can efficiently optimize the electric vehicle aggregator's (EVA's) real-time charging/discharging power with the state of charge (SOC) constraints of the EVA and the individual EV. Compared with uncontrolled charging, the load variance is reduced by 97.37$\%$ and the charging cost by 76.56$\%$. The DRL coordination strategy further demonstrates outstanding transfer learning ability to microgrids with RES and large-scale EVA, as well as the complicated weekly scheduling. The DRL coordination strategy demonstrates flexible, adaptable, and scalable performance for the large-scale V2G under realistic operating conditions.


title: Existence result and free boundary limit of a tumor growth model with necrotic core

abstract: We analyze a system of cross-diffusion equations that models the growth of an avascular-tumor spheroid. The model incorporates two nonlinear diffusion effects, degeneracy type and super diffusion. We prove the global existence of weak solutions and justify the convergence towards the free boundary problem of the Hele-Shaw type when the pressure gets stiff. We also investigate the convergence rate of the solutions in $L^1-$Lebesgue spaces.


title: Augmentation for Learning From Demonstration with Environmental Constraints

abstract: We introduce a Learning from Demonstration (LfD) approach for contact-rich manipulation tasks with articulated mechanisms. The extracted policy from a single human demonstration generalizes to different mechanisms of the same type and is robust against environmental variations. The key to achieving such generalization and robustness from a single human demonstration is to autonomously augment the initial demonstration to gather additional information through purposefully interacting with the environment. Our real-world experiments on complex mechanisms with multi-DOF demonstrate that our approach can reliably accomplish the task in a changing environment. Videos are available at the: https://sites.google.com/view/rbosalfdec/home


title: Learning with Style: Continual Semantic Segmentation Across Tasks and Domains

abstract: Deep learning models dealing with image understanding in real-world settings must be able to adapt to a wide variety of tasks across different domains. Domain adaptation and class incremental learning deal with domain and task variability separately, whereas their unified solution is still an open problem. We tackle both facets of the problem together, taking into account the semantic shift within both input and label spaces. We start by formally introducing continual learning under task and domain shift. Then, we address the proposed setup by using style transfer techniques to extend knowledge across domains when learning incremental tasks and a robust distillation framework to effectively recollect task knowledge under incremental domain shift. The devised framework (LwS, Learning with Style) is able to generalize incrementally acquired task knowledge across all the domains encountered, proving to be robust against catastrophic forgetting. Extensive experimental evaluation on multiple autonomous driving datasets shows how the proposed method outperforms existing approaches, which prove to be ill-equipped to deal with continual semantic segmentation under both task and domain shift.


title: ComSearch: Equation Searching with Combinatorial Strategy for Solving Math Word Problems with Weak Supervision

abstract: Previous studies have introduced a weakly-supervised paradigm for solving math word problems requiring only the answer value annotation. While these methods search for correct value equation candidates as pseudo labels, they search among a narrow sub-space of the enormous equation space. To address this problem, we propose a novel search algorithm with combinatorial strategy \textbf{ComSearch}, which can compress the search space by excluding mathematically equivalent equations. The compression allows the searching algorithm to enumerate all possible equations and obtain high-quality data. We investigate the noise in the pseudo labels that hold wrong mathematical logic, which we refer to as the \textit{false-matching} problem, and propose a ranking model to denoise the pseudo labels. Our approach holds a flexible framework to utilize two existing supervised math word problem solvers to train pseudo labels, and both achieve state-of-the-art performance in the weak supervision task.