title: Perceived and Intended Sarcasm Detection with Graph Attention Networks

abstract: Existing sarcasm detection systems focus on exploiting linguistic markers, context, or user-level priors. However, social studies suggest that the relationship between the author and the audience can be equally relevant for the sarcasm usage and interpretation. In this work, we propose a framework jointly leveraging (1) a user context from their historical tweets together with (2) the social information from a user's conversational neighborhood in an interaction graph, to contextualize the interpretation of the post. We use graph attention networks (GAT) over users and tweets in a conversation thread, combined with dense user history representations. Apart from achieving state-of-the-art results on the recently published dataset of 19k Twitter users with 30K labeled tweets, adding 10M unlabeled tweets as context, our results indicate that the model contributes to interpreting the sarcastic intentions of an author more than to predicting the sarcasm perception by others.


title: Multiplex Behavioral Relation Learning for Recommendation via Memory Augmented Transformer Network

abstract: Capturing users' precise preferences is of great importance in various recommender systems (eg., e-commerce platforms), which is the basis of how to present personalized interesting product lists to individual users. In spite of significant progress has been made to consider relations between users and items, most of the existing recommendation techniques solely focus on singular type of user-item interactions. However, user-item interactive behavior is often exhibited with multi-type (e.g., page view, add-to-favorite and purchase) and inter-dependent in nature. The overlook of multiplex behavior relations can hardly recognize the multi-modal contextual signals across different types of interactions, which limit the feasibility of current recommendation methods. To tackle the above challenge, this work proposes a Memory-Augmented Transformer Networks (MATN), to enable the recommendation with multiplex behavioral relational information, and joint modeling of type-specific behavioral context and type-wise behavior inter-dependencies, in a fully automatic manner. In our MATN framework, we first develop a transformer-based multi-behavior relation encoder, to make the learned interaction representations be reflective of the cross-type behavior relations. Furthermore, a memory attention network is proposed to supercharge MATN capturing the contextual signals of different types of behavior into the category-specific latent embedding space. Finally, a cross-behavior aggregation component is introduced to promote the comprehensive collaboration across type-aware interaction behavior representations, and discriminate their inherent contributions in assisting recommendations. Extensive experiments on two benchmark datasets and a real-world e-commence user behavior data demonstrate significant improvements obtained by MATN over baselines. Codes are available at: https://github.com/akaxlh/MATN.


title: Learning to Centralize Dual-Arm Assembly

abstract: Robotic manipulators are widely used in modern manufacturing processes. However, their deployment in unstructured environments remains an open problem. To deal with the variety, complexity, and uncertainty of real-world manipulation tasks, it is essential to develop a flexible framework with reduced assumptions on the environment characteristics. In recent years, reinforcement learning (RL) has shown great results for single-arm robotic manipulation. However, research focusing on dual-arm manipulation is still rare. From a classical control perspective, solving such tasks often involves complex modeling of interactions between two manipulators and the objects encountered in the tasks, as well as the two robots coupling at a control level. Instead, in this work, we explore the applicability of model-free RL to dual-arm assembly. As we aim to contribute towards an approach that is not limited to dual-arm assembly, but dual-arm manipulation in general, we keep modeling efforts at a minimum. Hence, to avoid modeling the interaction between the two robots and the used assembly tools, we present a modular approach with two decentralized single-arm controllers which are coupled using a single centralized learned policy. We reduce modeling effort to a minimum by using sparse rewards only. Our architecture enables successful assembly and simple transfer from simulation to the real world. We demonstrate the effectiveness of the framework on dual-arm peg-in-hole and analyze sample efficiency and success rates for different action spaces. Moreover, we compare results on different clearances and showcase disturbance recovery and robustness, when dealing with position uncertainties. Finally we zero-shot transfer policies trained in simulation to the real world and evaluate their performance.


title: Trident Pyramid Networks: The importance of processing at the feature pyramid level for better object detection

abstract: Feature pyramids have become ubiquitous in multi-scale computer vision tasks such as object detection. Given their importance, a computer vision network can be divided into three parts: a backbone (generating a feature pyramid), a neck (refining the feature pyramid) and a head (generating the final output). Many existing networks operating on feature pyramids, named necks, are shallow and mostly focus on communication-based processing in the form of top-down and bottom-up operations. We present a new neck architecture called Trident Pyramid Network (TPN), that allows for a deeper design and for a better balance between communication-based processing and self-processing. We show consistent improvements when using our TPN neck on the COCO object detection benchmark, outperforming the popular BiFPN baseline by 0.5 AP, both when using the ResNet-50 and the ResNeXt-101-DCN backbone. Additionally, we empirically show that it is more beneficial to put additional computation into the TPN neck, rather than into the backbone, by outperforming a ResNet-101+FPN baseline with our ResNet-50+TPN network by 1.7 AP, while operating under similar computation budgets. This emphasizes the importance of performing computation at the feature pyramid level in modern-day object detection systems. Code is available at https://github.com/CedricPicron/TPN .


title: KaraSinger: Score-Free Singing Voice Synthesis with VQ-VAE using Mel-spectrograms

abstract: In this paper, we propose a novel neural network model called KaraSinger for a less-studied singing voice synthesis (SVS) task named score-free SVS, in which the prosody and melody are spontaneously decided by machine. KaraSinger comprises a vector-quantized variational autoencoder (VQ-VAE) that compresses the Mel-spectrograms of singing audio to sequences of discrete codes, and a language model (LM) that learns to predict the discrete codes given the corresponding lyrics. For the VQ-VAE part, we employ a Connectionist Temporal Classification (CTC) loss to encourage the discrete codes to carry phoneme-related information. For the LM part, we use location-sensitive attention for learning a robust alignment between the input phoneme sequence and the output discrete code. We keep the architecture of both the VQ-VAE and LM light-weight for fast training and inference speed. We validate the effectiveness of the proposed design choices using a proprietary collection of 550 English pop songs sung by multiple amateur singers. The result of a listening test shows that KaraSinger achieves high scores in intelligibility, musicality, and the overall quality.


title: Ground states for Maxwell's equations in nonlocal nonlinear media

abstract: In this paper we investigate the existence of ground states and dual ground states for Maxwell's Equations in $\mathbb{R}^3$ in nonlocal nonlinear metamaterials. We prove that several nonlocal models admit ground states in contrast to their local analogues.


title: The formation of wide exoKuiper belts from migrating dust traps

abstract: The question of what determines the width of Kuiper belt analogues (exoKuiper belts) is an open one. If solved, this understanding would provide valuable insights into the architecture, dynamics, and formation of exoplanetary systems. Recent observations by ALMA have revealed an apparent paradox in this field, the presence of radially narrow belts in protoplanetary discs that are likely the birthplaces of planetesimals, and exoKuiper belts nearly four times as wide in mature systems. If the parent planetesimals of this type of debris disc indeed form in these narrow protoplanetary rings via streaming instability where dust is trapped, we propose that this width dichotomy could naturally arise if these dust traps form planetesimals whilst migrating radially, e.g. as caused by a migrating planet. Using the dust evolution software DustPy, we find that if the initial protoplanetary disc and trap conditions favour planetesimal formation, dust can still effectively accumulate and form planetesimals as the trap moves. This leads to a positive correlation between the inward radial speed and final planetesimal belt width, forming belts up to $\sim$100 au over 10 Myr of evolution. We show that although planetesimal formation is most efficient in low viscosity ($\alpha = 10^{-4}$) discs with steep dust traps to trigger the streaming instability, the large widths of most observed planetesimal belts constrain $\alpha$ to values $\geq4\times 10^{-4}$ at tens of au, otherwise the traps cannot migrate far enough. Additionally, the large spread in the widths and radii of exoKuiper belts could be due to different trap migration speeds (or protoplanetary disc lifetimes) and different starting locations, respectively. Our work serves as a first step to link exoKuiper belts and rings in protoplanetary discs.


title: Synthesis and study of ScN thin films

abstract: To contemplate an alternative approach for the minimization of diffusion at high temperature depositions, present findings impart viability of room-temperature deposited reactively sputtered ScN thin film samples. The adopted room temperature route endows precise control over the $R_{N_2}$ flow for a methodical structural phase evolution from Sc$\to$ScN and probe the correlated physical aspects of the highly textured ScN samples. In the nitrided regime i.e. at $R_{N_2}$ = 2.5-100% flow, incorporation of unintentional oxygen defects were evidenced from surface sensitive soft x-ray absorption spectroscopy study, though less compared to their metal ($R_{N_2} = 0\%$) and interstitial ($R_{N_2} = 1.6\%$) counterparts, due to higher Gibb's free energy for Sc-O-N formation with no trace of ligand field splitting around the O K-edge spectra. To eradicate the sceptism of appearance of N K-edge (401.6 eV) and Sc L-edge (402.2 eV) absorption spectra adjacent to each other, the nascent Sc K-edge study has been adopted for the first time to validate complementary insight on the metrical parameters of the Sc-N system taken into consideration. Optical bandgaps of the polycrystalline ScN thin film samples were found to vary between 2.25-2.62 eV as obtained from the UV-Vis spectroscopy, whereas, the nano-indentation hardness and modulus of the as-deposited samples lie between 15-34GPa and 152-476GPa, respectively following a linearly increasing trend of resistance to plastic deformations. Besides, contrary to other early 3d transition metal nitrides (TiN, VN, CrN), a comprehensive comparison of noticeably large homogeneity range in Sc-N has been outlined to apprehend the minuscule lattice expansion over the large $R_{N_2}$ realm.


title: An End-to-End Trainable Video Panoptic Segmentation Method usingTransformers

abstract: In this paper, we present an algorithm to tackle a video panoptic segmentation problem, a newly emerging area of research. The video panoptic segmentation is a task that unifies the typical task of panoptic segmentation and multi-object tracking. In other words, it requires generating the instance tracking IDs along with panoptic segmentation results across video sequences. Our proposed video panoptic segmentation algorithm uses the transformer and it can be trained in end-to-end with an input of multiple video frames. We test our method on the STEP dataset and report its performance with recently proposed STQ metric. The method archived 57.81\% on the KITTI-STEP dataset and 31.8\% on the MOTChallenge-STEP dataset.


title: Deterministic control of SDEs with stochastic drift and multiplicative noise: a variational approach

abstract: We consider a linear stochastic differential equation with stochastic drift and multiplicative noise. We study the problem of approximating its solution with the process that solves the equation where the possibly stochastic drift is replaced by a deterministic function. To do this, we use a combination of deterministic Pontryagin's maximum principle approach and direct methods of calculus of variations. We find necessary and sufficient conditions for a function $u \in L^1(0,T)$ to be a minimizer of a certain cost functional. To overcome the problem of the existence of such minimizer, we also consider suitable families of penalized coercive cost functionals. Finally, we consider the important example of the quadratic cost functional, showing that the expected value of the drift component is not always the best choice in the mean squared error approximation.


title: Bayesian parameter estimation in $\chi$EFT using Hamiltonian Monte Carlo

abstract: The number of low-energy constants (LECs) in chiral effective field theory ($\chi$EFT) grows rapidly with increasing chiral order, necessitating the use of Markov chain Monte Carlo techniques for sampling their posterior probability density function. For this we introduce a Hamiltonian Monte Carlo (HMC) algorithm and sample the LEC posterior up to next-to-next-to-leading order (NNLO) in the two-nucleon sector of $\chi$EFT. We find that the sampling efficiency of HMC is three to six times higher compared to an affine-invariant sampling algorithm. We analyze the empirical coverage probability and validate that the NNLO model yields predictions for two-nucleon scattering data with largely reliable credible intervals, provided that one ignores the leading order EFT expansion parameter when inferring the variance of the truncation error. We also find that the NNLO truncation error dominates the error budget.


title: Fractional Sobolev spaces with power weights

abstract: We investigate the form of the closure of the smooth, compactly supported functions $C_{c}^{\infty}(\Omega)$ in the weighted fractional Sobolev space $W^{s,p;\,w,v}(\Omega)$ for bounded $\Omega$. We focus on the weights $w,\,v$ being powers of the distance to the boundary of the domain. Our results depend on the lower and upper Assouad codimension of the boundary of $\Omega$. For such weights we also prove the comparability between the full weighted fractional Gagliardo seminorm and the truncated one.


title: Quarkonium production in pNRQCD: the $P$-wave case

abstract: We review our recent understanding of quarkonium production at $e^+e^-$ and hadronic colliders from the point of view of potential non-relativistic QCD, and apply it to $P$-wave charmonium and bottomonium inclusive production.


title: Critical points in the $CP^{N-1}$ model

abstract: We use scale invariant scattering theory to obtain the exact equations determining the renormalization group fixed points of the two-dimensional $CP^{N-1}$ model, for $N$ real. Also due to special degeneracies at $N=2$ and 3, the space of solutions for $N\geq 2$ reduces to that of the $O(N^2-1)$ model, and accounts for a zero temperature critical point. For $N<2$ the space of solutions becomes larger than that of the $O(N^2-1)$ model, with the appearance of new branches of fixed points relevant for criticality in gases of intersecting loops.


title: Multidirectional Conjugate Gradients for Scalable Bundle Adjustment

abstract: We revisit the problem of large-scale bundle adjustment and propose a technique called Multidirectional Conjugate Gradients that accelerates the solution of the normal equation by up to 61%. The key idea is that we enlarge the search space of classical preconditioned conjugate gradients to include multiple search directions. As a consequence, the resulting algorithm requires fewer iterations, leading to a significant speedup of large-scale reconstruction, in particular for denser problems where traditional approaches notoriously struggle. We provide a number of experimental ablation studies revealing the robustness to variations in the hyper-parameters and the speedup as a function of problem density.


title: Predictions on global properties in O+O collisions at the Large Hadron Collider using a multi-phase transport model

abstract: Oxygen ($^{16}$O) ions are planned to be injected at the Large Hadron Collider (LHC) in its next runs, and a day of physics run is anticipated for O+O collisions at $\sqrt{s_{\rm{NN}}}$ = 7 TeV. As the system size of O+O collisions has the final state multiplicity overlap with those produced in pp, p+Pb and Pb+Pb collisions, the study of global properties in O+O collisions may provide a deeper insight into the heavy-ion-like behavior observed in small collision systems and its similarities/differences with a larger system like Pb+Pb collisions. In the present work, we report the predictions for global properties in O+O collisions at $\sqrt{s_{\rm{NN}}}$ = 7 TeV using a multi-phase transport model (AMPT). We report the mid-rapidity charged-particle multiplicity, transverse mass, Bjorken energy density, pseudo-rapidity distributions, squared speed of sound, transverse momentum ($p_{\rm T}$) spectra, the kinetic freeze-out parameters, and $p_{\rm T}$-differential particle ratio as a function of collision centrality. Further, we have studied the transverse momentum-dependent elliptic flow of charged particles. The results are shown for Woods-Saxon and harmonic oscillator nuclear density profiles. In addition, we have compared the results with an $\alpha$-clustered structure incorporated inside the oxygen nucleus. Average charged-particle multiplicity and the Bjorken energy density show a significant increase in most central collisions for the harmonic oscillator density profile, while other global properties show less dependence on the density profiles considered in this work. The results from the $\alpha$-clustered structure incorporated inside the oxygen nucleus show similar initial energy density and final charged-particle multiplicity as observed for the harmonic oscillator density profile.


title: GMRES algorithms over 35 years

abstract: This paper is about GMRES algorithms for the solution of nonsingular linear systems. We first consider basic algorithms and study their convergence. We then focus on acceleration strategies and parallel algorithms that are useful for solving challenging systems. We also briefly discuss other problems, such as systems with multiple right-hand sides, shifted systems, and singular systems.


title: Investigating the spectra and physical nature of galaxy scale jets

abstract: Previous studies have shown that physically small, low-luminosity radio galaxies, which we refer to as galaxy scale jets (GSJ), could potentially have a significant effect upon the host galaxy's evolution. Using 6 arcsec resolution images taken from the first release of the LOFAR Two Metre Sky Survey (LoTSS DR1), we identified a representative sample of nine potential GSJ for which we obtained high-resolution, 2-4 GHz data using the Karl G. Jansky Very Large Array (VLA). Using these data we aim to verify the GSJ nature of these sources as well as investigating the potential role of feedback. Our VLA images reveal a diversity of structures, confirm the hosts for four of the sources and find that a fifth is the first known example of a galaxy-scale remnant showing that some radio galaxies never grow beyond the GSJ stage. We also derive spectral ages and the first estimates of the lobe expansion speeds of GSJ. We find our GSJ have maximum spectral ages of 60 Myr with most between about 5 and 20 Myr, consistent with being located along an evolutionary path joining compact sources and larger radio galaxies. We find lobe advance speeds a few times the local sound speed, with most GSJ predicted to be driving strong shocks into their environment and having a significant impact upon the host's evolution. Our discovery of a remnant GSJ, which will eventually transfer all of its energy directly into the local environment, represents an important and previously hidden aspect of AGN life cycles.


title: Chaos in coupled Kerr-nonlinear parametric oscillators

abstract: A Kerr-nonlinear parametric oscillator (KPO) can generate a quantum superposition of two oscillating states, known as a Schr\"{o}dinger cat state, via quantum adiabatic evolution, and can be used as a qubit for gate-based quantum computing and quantum annealing. In this work, we investigate complex dynamics, i.e., chaos, in two coupled nondissipative KPOs at a few-photon level. After showing that a classical model for this system is nonintegrable and consequently exhibits chaotic behavior, we provide quantum counterparts for the classical results, which are quantum versions of the Poincar\'{e} surface of section and its lower-dimensional version defined with time integrals of the Wigner and Husimi functions, and also the initial and long-term behavior of out-of-time-ordered correlators. We conclude that some of them can be regarded as quantum signatures of chaos, together with energy-level spacing statistics (conventional signature). Thus, the system of coupled KPOs is expected to offer not only an alternative approach to quantum computing, but also a promising platform for the study on quantum chaos.


title: Pathologies in priors and inference for Bayesian transformers

abstract: In recent years, the transformer has established itself as a workhorse in many applications ranging from natural language processing to reinforcement learning. Similarly, Bayesian deep learning has become the gold-standard for uncertainty estimation in safety-critical applications, where robustness and calibration are crucial. Surprisingly, no successful attempts to improve transformer models in terms of predictive uncertainty using Bayesian inference exist. In this work, we study this curiously underpopulated area of Bayesian transformers. We find that weight-space inference in transformers does not work well, regardless of the approximate posterior. We also find that the prior is at least partially at fault, but that it is very hard to find well-specified weight priors for these models. We hypothesize that these problems stem from the complexity of obtaining a meaningful mapping from weight-space to function-space distributions in the transformer. Therefore, moving closer to function-space, we propose a novel method based on the implicit reparameterization of the Dirichlet distribution to apply variational inference directly to the attention weights. We find that this proposed method performs competitively with our baselines.


title: Photodesorption of acetonitrile CH3CN in UV-irradiated regions of the Interstellar Medium: an experimental evidence

abstract: Pure acetonitrile (CH3CN) and mixed CO:CH3CN and H2O:CH3CN ices have been irradiated at 15K with Vacuum UltraViolet (VUV) photons in the 7-13.6 eV range using synchrotron radiation. VUV photodesorption yields of CH3CN and of photo-products have been derived as a function of the incident photon energy. The coadsorption of CH3CN with CO and H2O molecules, which are expected to be among the main constituents of interstellar ices, is found to have no significant influence on the VUV photodesorption spectra of CH3CN, CHCN, HCN, CN and CH3. Contrary to what has generally been evidenced for most of the condensed molecules, these findings point toward a desorption process for which the CH3CN molecule that absorbs the VUV photon is the one desorbing. It can be ejected in the gas phase as intact CH3CN or in the form of its photo-dissociation fragments. Astrophysical VUV photodesorption yields, applicable to different locations, are derived and can be incorporated into astrochemical modeling. They vary from 0.67(+/-0.33).10^{-5} to 2.0(+/-1.0).10^{-5} molecule/photon for CH3CN depending on the region considered, which is high compared to other organic molecules such as methanol. These results could explain the multiple detections of gas phase CH3CN in different regions of the interstellar medium and are well-correlated to astrophysical observations of the Horsehead nebula and of protoplanetary disks (such as TW Hya and HD 163296).


title: Learning Sparse Graphs with a Core-periphery Structure

abstract: In this paper, we focus on learning sparse graphs with a core-periphery structure. We propose a generative model for data associated with core-periphery structured networks to model the dependence of node attributes on core scores of the nodes of a graph through a latent graph structure. Using the proposed model, we jointly infer a sparse graph and nodal core scores that induce dense (sparse) connections in core (respectively, peripheral) parts of the network. Numerical experiments on a variety of real-world data indicate that the proposed method learns a core-periphery structured graph from node attributes alone, while simultaneously learning core score assignments that agree well with existing works that estimate core scores using graph as input and ignoring commonly available node attributes.


title: Dirichlet problem for weakly harmonic maps with rough data

abstract: Weakly harmonic maps from a domain $\Omega$ (the upper half-space $\Rd$ or a bounded $C^{1,\alpha}$ domain, $\alpha\in (0,1]$) into a smooth closed manifold are studied. Prescribing small Dirichlet data in either of the classes $L^{\infty}(\partial\Omega)$ or $BMO(\partial\Omega)$, we establish solvability of the resulting boundary value problems by means of a nonvariational method. As a by-product, solutions are shown to be locally smooth, $C^{\infty}_{loc}$. Moreover, we show that boundary data can be chosen large in the underlying topologies if $\Omega$ is smooth and bounded by perturbing strictly stable smooth harmonic maps.


title: Hints of dark matter-neutrino interactions in Lyman-$\alpha$ data

abstract: In this work we investigate the possibility that dark matter and (massive) neutrinos can interact via a simple, constant cross section. Building on previous numerical efforts, we constrain this model with CMB, BAO and, in particular, Lyman-$\alpha$ data. We find that the latter hint to a significant departure from $\Lambda$CDM, with a preference for an interaction strength about 3$\sigma$ away from zero. We trace the origin of this preference back to the additional tilt that the interacting scenario can imprint on the Lyman-$\alpha$ flux power spectrum, solving a well-known tension in the determination of this quantity between early-time and Lyman-$\alpha$ probes. Future work including complementary Lyman-$\alpha$ data as well as dedicated numerical simulations will be crucial in order to test these results.


title: Saddlepoint approximations in binary genome-wide association studies

abstract: We investigate saddlepoint approximations applied to the score test statistic in genome-wide association studies with binary phenotypes. The inaccuracy in the normal approximation of the score test statistic increases with increasing sample imbalance and with decreasing minor allele count. Applying saddlepoint approximations to the score test statistic distribution greatly improve the accuracy, even far out in the tail of the distribution. By using exact results for an intercept model and binary covariate model, as well as simulations for models with nuisance parameters, we emphasize the need for continuity corrections in order to achieve valid $p$-values. The performance of the saddlepoint approximations is evaluated by overall and conditional type I error rate on simulated data. We investigate the methods further by using data from UK Biobank with skin and soft tissue infections as phenotype, using both common and rare variants. The analysis confirms that continuity correction is important particularly for rare variants, and that the normal approximation gives a highly inflated type I error rate for case imbalance.


title: Implementation of machine learning techniques to predict impact parameter and transverse spherocity in heavy-ion collisions at the LHC

abstract: Machine learning techniques have been quite popular recently in the high-energy physics community and have led to numerous developments in this field. In heavy-ion collisions, one of the crucial observables, the impact parameter, plays an important role in the final-state particle production. This being extremely small (i.e. of the order of a few fermi), it is almost impossible to measure impact parameter in experiments. In this work, we implement the ML-based regression technique via Gradient Boosting Decision Trees (GBDT) to obtain a prediction of impact parameter in Pb-Pb collisions at $\sqrt{s_{NN}}$ = 5.02 TeV using A Multi-Phase Transport (AMPT) model. After its successful implementation in small collision systems, transverse spherocity, an event shape observable, holds an opportunity to reveal more about the particle production in heavy-ion collisions as well. In the absence of any experimental exploration in this direction at the LHC yet, we suggest an ML-based regression method to estimate centrality-wise transverse spherocity distributions in Pb-Pb collisions at $\sqrt{s_{NN}}$ = 5.02 TeV by training the model with minimum bias collision data. Throughout this work, we have used a few final state observables as the input to the ML-model, which could be easily made available from collision data. Our method seems to work quite well as we see a good agreement between the simulated true values and the predicted values from the ML-model.


title: Photoelectron energy peaks shift against the radiation pressure in strong field ionization

abstract: The photoelectric effect describes the ejection of an electron upon absorption of one or several photons. The kinetic energy of this electron is determined by the photon energy reduced by the binding energy of the electron and, if strong laser fields are involved, by the ponderomotive potential in addition. It has therefore been widely taken for granted that for atoms and molecules the photoelectron energy does not depend on the electron's emission direction but theoretical studies have questioned this since 1990. Here we provide experimental evidence, that the energies of photoelectrons emitted against the light-propagation direction are shifted towards higher values while those electrons that are emitted along the light-propagation direction are shifted to lower values. We attribute the energy shift to a nondipole contribution from the interaction of the moving electrons with the incident photons.


title: Fredholm transformation on Laplacian and rapid stabilization for the heat equation

abstract: We study the rapid stabilization of the heat equation on the 1-dimensional torus using the backstepping method with a Fredholm transformation. We prove that, under some assumption on the control operator, two scalar controls are necessary and sufficient to get controllability and rapid stabilization. This classical framework allows us to present the backstepping method with Fredholm transformations on Laplace operators in a sharp functional setting, which is the main objective of this work. Finally, we prove that the same Fredholm transformation also leads to the local rapid stability of the viscous Burgers equation.


title: Generalised Howe dualityand injectivity of induction: the symplectic case

abstract: We study the symplectic Howe duality using two new and independent combinatorial methods: via determinantal formulae on the one hand, and via (bi)crystals on the other hand. The first approach allows us to establish a generalised version where weight multiplicities are replaced by branching coefficients. In turn, this generalised Howe duality is used to prove the injectivity of induction for Levi branchings as previously conjectured by the last two authors.


title: Chromatic Aberration Recovery on Arbitrary Images

abstract: Digital imaging sensor technology has continued to outpace development in optical technology in modern imaging systems. The resulting quality loss attributable to lateral chromatic aberration is becoming increasingly significant as sensor resolution increases; other classes of aberration are less significant with classical image enhancement (e.g. sharpening), whereas lateral chromatic aberration becomes more significant. The goals of higher-performance and lighter lens systems drive a recent need to find new ways to overcome resulting image quality limitations. This work demonstrates the robust and automatic minimisation of lateral chromatic aberration, recovering the loss of image quality using both artificial and real-world images. A series of test images are used to validate the functioning of the algorithm, and changes across a series of real-world images are used to evaluate the performance of the approach.


title: Tsallis Holographic Dark Energy Reconsidered

abstract: We consider the interacting Tsallis Holographic Dark Energy (THDE), with the Granda-Oliveros (GO) scale as the infrared (IR) cutoff, as dynamical vacuum. We analytically solved for the Hubble parameter, in a spatially flat FLRW universe with dark energy and matter as components, and the solution traces the evolutionary path from the prior decelerated to the late accelerated epoch. Without interaction, the model predicts a $\Lambda$CDM like behavior with an effective cosmological constant. We used Pantheon Supernovae type Ia, observational Hubble data (OHD), cosmic microwave background (CMB), and baryon acoustic oscillation (BAO) data to constrain the free parameters of the model. The estimated values of the cosmological parameters were consistent with observational results. We analyzed the behavior of the model using the statefinder and $\omega^\prime_{e}-\omega_{e}$ plane where $\omega_{e}$ and $\omega^\prime_{e}$ corresponds to the effective equation of state and its evolution, respectively. The model shows a quintessence behavior in general, and the model trajectory ends in a point that corresponds to the de Sitter phase. We performed a dynamical analysis of the model, concluding that the prior decelerated and late accelerated phases are unstable and stable equilibria, respectively. We also investigated the thermodynamical nature of the model and found that the generalized second law remains valid in the dynamical vacuum treatment of the model.


title: Symbolic Register Automata for Complex Event Recognition and Forecasting

abstract: We propose an automaton model which is a combination of symbolic and register automata, i.e., we enrich symbolic automata with memory. We call such automata Symbolic Register Automata (SRA). SRA extend the expressive power of symbolic automata, by allowing Boolean formulas to be applied not only to the last element read from the input string, but to multiple elements, stored in their registers. SRA also extend register automata, by allowing arbitrary Boolean formulas, besides equality predicates. We study the closure properties of SRA under union, intersection, concatenation, Kleene closure, complement and determinization and show that SRA, contrary to symbolic automata, are not in general closed under complement and they are not determinizable. However, they are closed under these operations when a window operator, quintessential in Complex Event Recognition, is used. We show how SRA can be used in Complex Event Recognition in order to detect patterns upon streams of events, using our framework that provides declarative and compositional semantics, and that allows for a systematic treatment of such automata. We also show how the behavior of SRA, as they consume streams of events, can be given a probabilistic description with the help of prediction suffix trees. This allows us to go one step beyond Complex Event Recognition to Complex Event Forecasting, where, besides detecting complex patterns, we can also efficiently forecast their occurrence.


title: Acoustoelastic analysis of soft viscoelastic solids with application to pre-stressed phononic crystals

abstract: The effective dynamic properties of specific periodic structures involving rubber-like materials can be adjusted by pre-strain, thus facilitating the design of custom acoustic filters. While nonlinear viscoelastic behaviour is one of the main features of soft solids, it has been rarely incorporated in the study of such phononic media. Here, we study the dynamic response of nonlinear viscoelastic solids within a 'small-on-large' acoustoelasticity framework, that is we consider the propagation of small amplitude waves superimposed on a large static deformation. Incompressible soft solids whose behaviour is described by the Fung-Simo quasi-linear viscoelasticy theory (QLV) are considered. We derive the incremental equations using stress-like memory variables governed by linear evolution equations. Thus, we show that wave dispersion follows a strain-dependent generalised Maxwell rheology. Illustrations cover the propagation of plane waves under homogeneous tensile strain in a QLV Mooney-Rivlin solid. The acoustoelasticity theory is then applied to phononic crystals involving a lattice of hollow cylinders, by making use of a dedicated perturbation approach. In particular, results highlight the influence of viscoelastic dissipation on the location of the first band gap. We show that dissipation shifts the band gap frequencies, simultaneously increasing the band gap width. These results are relevant to practical applications of soft viscoelastic solids subject to static pre-stress.


title: Channel Estimation and Secret Key Rate Analysis of MIMO Terahertz Quantum Key Distribution

abstract: We study the secret key rate (SKR) of a multiple-input multiple-output (MIMO) continuous variable quantum key distribution (CVQKD) system operating at terahertz (THz) frequencies, accounting for the effects of channel estimation. We propose a practical channel estimation scheme for the THz MIMO CVQKD system which is necessary to realize transmit-receive beamforming between Alice and Bob. We characterize the input-output relation between Alice and Bob during the key generation phase, by incorporating the effects of additional noise terms arising due to the channel estimation error and detector noise. Furthermore, we analyze the SKR of the system and study the effect of channel estimation error and overhead. Our simulation results reveal that the SKR may degrade significantly as compared to the SKR upper bound that assumes perfect channel state information, particularly at large transmission distances.


title: UniNet: Unified Architecture Search with Convolution, Transformer, and MLP

abstract: Recently, transformer and multi-layer perceptron (MLP) architectures have achieved impressive results on various vision tasks. A few works investigated manually combining those operators to design visual network architectures, and can achieve satisfactory performances to some extent. In this paper, we propose to jointly search the optimal combination of convolution, transformer, and MLP for building a series of all-operator network architectures with high performances on visual tasks. We empirically identify that the widely-used strided convolution or pooling based down-sampling modules become the performance bottlenecks when the operators are combined to form a network. To better tackle the global context captured by the transformer and MLP operators, we propose two novel context-aware down-sampling modules, which can better adapt to the global information encoded by transformer and MLP operators. To this end, we jointly search all operators and down-sampling modules in a unified search space. Notably, Our searched network UniNet (Unified Network) outperforms state-of-the-art pure convolution-based architecture, EfficientNet, and pure transformer-based architecture, Swin-Transformer, on multiple public visual benchmarks, ImageNet classification, COCO object detection, and ADE20K semantic segmentation.


title: On the mathematics and metaphysics of the hole argument

abstract: We make some remarks on the mathematics and metaphysics of the hole argument, in response to a recent article in this journal by Weatherall ([2018]). Broadly speaking, we defend the mainstream philosophical literature from the claim that correct usage of the mathematics of general relativity 'blocks' the argument.


title: Simulations for novel problems in recommendation: analyzing misinformation and data characteristics

abstract: In this position paper, we discuss recent applications of simulation approaches for recommender systems tasks. In particular, we describe how they were used to analyze the problem of misinformation spreading and understand which data characteristics affect the performance of recommendation algorithms more significantly. We also present potential lines of future work where simulation methods could advance the work in the recommendation community.


title: Traffic Flow Forecasting with Spatial-Temporal Graph Diffusion Network

abstract: Accurate forecasting of citywide traffic flow has been playing critical role in a variety of spatial-temporal mining applications, such as intelligent traffic control and public risk assessment. While previous work has made significant efforts to learn traffic temporal dynamics and spatial dependencies, two key limitations exist in current models. First, only the neighboring spatial correlations among adjacent regions are considered in most existing methods, and the global inter-region dependency is ignored. Additionally, these methods fail to encode the complex traffic transition regularities exhibited with time-dependent and multi-resolution in nature. To tackle these challenges, we develop a new traffic prediction framework-Spatial-Temporal Graph Diffusion Network (ST-GDN). In particular, ST-GDN is a hierarchically structured graph neural architecture which learns not only the local region-wise geographical dependencies, but also the spatial semantics from a global perspective. Furthermore, a multi-scale attention network is developed to empower ST-GDN with the capability of capturing multi-level temporal dynamics. Experiments on several real-life traffic datasets demonstrate that ST-GDN outperforms different types of state-of-the-art baselines. Source codes of implementations are available at https://github.com/jill001/ST-GDN.


title: Global Context Enhanced Social Recommendation with Hierarchical Graph Neural Networks

abstract: Social recommendation which aims to leverage social connections among users to enhance the recommendation performance. With the revival of deep learning techniques, many efforts have been devoted to developing various neural network-based social recommender systems, such as attention mechanisms and graph-based message passing frameworks. However, two important challenges have not been well addressed yet: (i) Most of existing social recommendation models fail to fully explore the multi-type user-item interactive behavior as well as the underlying cross-relational inter-dependencies. (ii) While the learned social state vector is able to model pair-wise user dependencies, it still has limited representation capacity in capturing the global social context across users. To tackle these limitations, we propose a new Social Recommendation framework with Hierarchical Graph Neural Networks (SR-HGNN). In particular, we first design a relation-aware reconstructed graph neural network to inject the cross-type collaborative semantics into the recommendation framework. In addition, we further augment SR-HGNN with a social relation encoder based on the mutual information learning paradigm between low-level user embeddings and high-level global representation, which endows SR-HGNN with the capability of capturing the global social contextual signals. Empirical results on three public benchmarks demonstrate that SR-HGNN significantly outperforms state-of-the-art recommendation methods. Source codes are available at: https://github.com/xhcdream/SR-HGNN.


title: Towards Math-Aware Automated Classification and Similarity Search of Scientific Publications: Methods of Mathematical Content Representations

abstract: In this paper, we investigate mathematical content representations suitable for the automated classification of and the similarity search in STEM documents using standard machine learning algorithms: the Latent Dirichlet Allocation (LDA) and the Latent Semantic Indexing (LSI). The methods are evaluated on a subset of arXiv.org papers with the Mathematics Subject Classification (MSC) as a reference classification and using the standard precision/recall/F1-measure metrics. The results give insight into how different math representations may influence the performance of the classification and similarity search tasks in STEM repositories. Non-surprisingly, machine learning methods are able to grab distributional semantics from textual tokens. A proper selection of weighted tokens representing math may improve the quality of the results slightly. A structured math representation that imitates successful text-processing techniques with math is shown to yield better results than flat TeX tokens.


title: Pick Your Battles: Interaction Graphs as Population-Level Objectives for Strategic Diversity

abstract: Strategic diversity is often essential in games: in multi-player games, for example, evaluating a player against a diverse set of strategies will yield a more accurate estimate of its performance. Furthermore, in games with non-transitivities diversity allows a player to cover several winning strategies. However, despite the significance of strategic diversity, training agents that exhibit diverse behaviour remains a challenge. In this paper we study how to construct diverse populations of agents by carefully structuring how individuals within a population interact. Our approach is based on interaction graphs, which control the flow of information between agents during training and can encourage agents to specialise on different strategies, leading to improved overall performance. We provide evidence for the importance of diversity in multi-agent training and analyse the effect of applying different interaction graphs on the training trajectories, diversity and performance of populations in a range of games. This is an extended version of the long abstract published at AAMAS.


title: Context-LGM: Leveraging Object-Context Relation for Context-Aware Object Recognition

abstract: Context, as referred to situational factors related to the object of interest, can help infer the object's states or properties in visual recognition. As such contextual features are too diverse (across instances) to be annotated, existing attempts simply exploit image labels as supervision to learn them, resulting in various contextual tricks, such as features pyramid, context attention, etc. However, without carefully modeling the context's properties, especially its relation to the object, their estimated context can suffer from large inaccuracy. To amend this problem, we propose a novel Contextual Latent Generative Model (Context-LGM), which considers the object-context relation and models it in a hierarchical manner. Specifically, we firstly introduce a latent generative model with a pair of correlated latent variables to respectively model the object and context, and embed their correlation via the generative process. Then, to infer contextual features, we reformulate the objective function of Variational Auto-Encoder (VAE), where contextual features are learned as a posterior distribution conditioned on the object. Finally, to implement this contextual posterior, we introduce a Transformer that takes the object's information as a reference and locates correlated contextual factors. The effectiveness of our method is verified by state-of-the-art performance on two context-aware object recognition tasks, i.e. lung cancer prediction and emotion recognition.


title: Polygon Area Decomposition Using a Compactness Metric

abstract: In this paper, we consider the problem of partitioning a polygon into a set of connected disjoint sub-polygons, each of which covers an area of a specific size. The work is motivated by terrain covering applications in robotics, where the goal is to find a set of efficient plans for a team of heterogeneous robots to cover a given area. Within this application, solving a polygon partitioning problem is an essential stepping stone. Unlike previous work, the problem formulation proposed in this paper also considers a compactness metric of the generated sub-polygons, in addition to the area size constraints. Maximizing the compactness of sub-polygons directly influences the optimality of any generated motion plans. Consequently, this increases the efficiency with which robotic tasks can be performed within each sub-region. The proposed problem representation is based on grid cell decomposition and a potential field model that allows for the use of standard optimization techniques. A new algorithm, the AreaDecompose algorithm, is proposed to solve this problem. The algorithm includes a number of existing and new optimization techniques combined with two post-processing methods. The approach has been evaluated on a set of randomly generated polygons which are then divided using different criteria and the results have been compared with a state-of-the-art algorithm. Results show that the proposed algorithm can efficiently divide polygon regions maximizing compactness of the resulting partitions, where the sub-polygon regions are on average up to 73% more compact in comparison to existing techniques.


title: Subspace Change-Point Detection via Low-Rank Matrix Factorisation

abstract: Multivariate time series can often have a large number of dimensions, whether it is due to the vast amount of collected features or due to how the data sources are processed. Frequently, the main structure of the high-dimensional time series can be well represented by a lower dimensional subspace. As vast quantities of data are being collected over long periods of time, it is reasonable to assume that the underlying subspace structure would change over time. In this work, we propose a change-point detection method based on low-rank matrix factorisation that can detect multiple changes in the underlying subspace of a multivariate time series. Experimental results on both synthetic and real data sets demonstrate the effectiveness of our approach and its advantages against various state-of-the-art methods.


title: Effect of Visual Cues on Pointing Tasks in Co-located Augmented Reality Collaboration

abstract: Visual cues are essential in computer-mediated communication. It is especially important when communication happens in a collaboration scenario that requires focusing several users' attention on aspecific object among other similar ones. This paper explores the effect of visual cues on pointing tasks in co-located Augmented Reality (AR) collaboration. A user study (N = 32, 16 pairs) was conducted to compare two types of visual cues: Pointing Line (PL)and Moving Track (MT). Both are head-based visual techniques.Through a series of collaborative pointing tasks on objects with different states (static and dynamic) and density levels (low, mediumand high), the results showed that PL was better on task performance and usability, but MT was rated higher on social presenceand user preference. Based on our results, some design implicationsare provided for pointing tasks in co-located AR collaboration.


title: Local orthogonal maps and rigidity of holomorphic mappings between real hyperquadrics

abstract: We introduced a new coordinate-free approach to study the Cauchy-Riemann (CR) maps between the real hyperquadrics in the complex projective space. The central theme is based on a notion of orthogonality on the projective space induced by the Hermitian structure defining the hyperquadrics. There are various kinds of special linear subspaces associated to this orthogonality which are well respected by the relevant CR maps and this is where the rigidities come from. Our method allows us to generalize a number of well-known rigidity theorems for the CR mappings between real hyperquadrics with much simpler arguments.


title: TRUNet: Transformer-Recurrent-U Network for Multi-channel Reverberant Sound Source Separation

abstract: In recent years, many deep learning techniques for single-channel sound source separation have been proposed using recurrent, convolutional and transformer networks. When multiple microphones are available, spatial diversity between speakers and background noise in addition to spectro-temporal diversity can be exploited by using multi-channel filters for sound source separation. Aiming at end-to-end multi-channel source separation, in this paper we propose a transformer-recurrent-U network (TRUNet), which directly estimates multi-channel filters from multi-channel input spectra. TRUNet consists of a spatial processing network with an attention mechanism across microphone channels aiming at capturing the spatial diversity, and a spectro-temporal processing network aiming at capturing spectral and temporal diversities. In addition to multi-channel filters, we also consider estimating single-channel filters from multi-channel input spectra using TRUNet. We train the network on a large reverberant dataset using a combined compressed mean-squared error loss function, which further improves the sound separation performance. We evaluate the network on a realistic and challenging reverberant dataset, generated from measured room impulse responses of an actual microphone array. The experimental results on realistic reverberant sound source separation show that the proposed TRUNet outperforms state-of-the-art single-channel and multi-channel source separation methods.


title: Understanding and Improving Critical Metrology. Quenching Superradiant Light-Matter Systems Beyond the Critical Point

abstract: We carefully examine critical metrology and present an improved critical quantum metrology protocol which relies on quenching a system exhibiting a superradiant quantum phase transition beyond its critical point. We show that this approach can lead to an exponential increase of the quantum Fisher information in time with respect to existing critical quantum metrology protocols relying on quenching close to the critical point and observing power law behaviour. We demonstrate that the Cram\'er-Rao bound can be saturated in our protocol through the standard homodyne detection scheme. We explicitly show its advantage using the archetypal setting of the Dicke model and explore a quantum gas coupled to a single-mode cavity field as a potential platform. In this case an additional exponential enhancement of the quantum Fisher information can in practice be observed with the number of atoms $N$ in the cavity, even in the absence of $N$-body coupling terms.


title: Minimal-Configuration Anomaly Detection for IIoT Sensors

abstract: The increasing deployment of low-cost IoT sensor platforms in industry boosts the demand for anomaly detection solutions that fulfill two key requirements: minimal configuration effort and easy transferability across equipment. Recent advances in deep learning, especially long-short-term memory (LSTM) and autoencoders, offer promising methods for detecting anomalies in sensor data recordings. We compared autoencoders with various architectures such as deep neural networks (DNN), LSTMs and convolutional neural networks (CNN) using a simple benchmark dataset, which we generated by operating a peristaltic pump under various operating conditions and inducing anomalies manually. Our preliminary results indicate that a single model can detect anomalies under various operating conditions on a four-dimensional data set without any specific feature engineering for each operating condition. We consider this work as being the first step towards a generic anomaly detection method, which is applicable for a wide range of industrial equipment.


title: First Principles Calculation of the Topological Phases of the Photonic Haldane Model

abstract: Photonic topological materials with a broken time reversal symmetry are characterized by nontrivial topological phases, such that they do not support propagation in the bulk region but forcibly support a nontrivial net number of unidirectional edge states when enclosed by an opaque type boundary, e.g., an electric wall. The Haldane model played a central role in the development of topological methods in condensed matter systems, as it unveiled that a broken time reversal is the essential ingredient to have a quantized electronic Hall phase. Recently, it was proved that the magnetic field of the Haldane model can be imitated in photonics with a spatially varying pseudo Tellegen coupling. Here, we use a Greens function method to determine from first principles the band diagram and the topological invariants of the photonic Haldane model, implemented as a Tellegen photonic crystal. Furthermore, the topological phase diagram of the system is found, and it is shown with first principles calculations that the granular structure of the photonic crystal can create nontrivial phase transitions controlled by the amplitude of the pseudo Tellegen parameter.


title: Predictions of TeV emission for a set of hard BL Lac objects

abstract: We focus our analysis on 55 BL Lac objects with a hard Fermi gamma-ray spectrum, and for which a redshift or a lower limit to it has been determined by a previous study of ours. We extrapolate the spectral fits given by the 4FGL catalogue to the VHE band (>0.1 TeV), which can be explored by imaging atmospheric Cherenkov telescopes. Furthermore, we take into account the absorption due to the extragalactic background light, strongly depending on the redshift. Finally, we compare our results with publicly available sensitivity curves for a selection of imaging atmospheric Cherenkov telescope arrays currently operating or under construction. From our extrapolations and simulations we find a large number of promising candidates for observation with the forthcoming Cherenkov Telescope Array observatory.


title: Safe Imitation Learning on Real-Life Highway Data for Human-like Autonomous Driving

abstract: This paper presents a safe imitation learning approach for autonomous vehicle driving, with attention on real-life human driving data and experimental validation. In order to increase occupant's acceptance and gain drivers' trust, the autonomous driving function needs to provide a both safe and comfortable behavior such as risk-free and naturalistic driving. Our goal is to obtain such behavior via imitation learning of a planning policy from human driving data. In particular, we propose to incorporate barrier functions and smooth spline-based motion parametrization in the training loss function. The advantage is twofold: improving safety of the learning algorithm, while reducing the amount of needed training data. Moreover, the behavior is learned from highway driving data, which is collected consistently by a human driver and then processed towards a specific driving scenario. For development validation, a digital twin of the real test vehicle, sensors, and traffic scenarios are reconstructed toward high-fidelity and physics-based modeling technologies. These models are imported to simulation tools and co-simulated with the proposed algorithm for validation and further testing. Finally, we present experimental results and analyses, and compare with the conventional imitation learning technique (behavioral cloning) to justify the proposed development.


title: The HRT conjecture for two classes of special configurations

abstract: The HRT (Heil-Ramanathan-Topiwala) conjecture stipulates that the set of any finitely many time-frequency shifts of a non-zero square Lebesgue integrable function is linearly independent. The present work settles two special cases of this conjecture, namely, the cases where the set of time-frequency shifts has cardinality $N+1$ such that either $N$ of the points lie on some integer lattice and the last point is arbitrary, or $N$ of the points are on a line, while the last point does not belong this line. In both cases, we prove that the HRT conjecture holds appealing mainly to various forms of the ergodic theorem. We note that, in recent years, the latter case has been the subject of many investigations -- notably, the subcase where $N=3$ -- and our work completely resolves it.


title: Core Elements of Social Interaction for Constructive Human-Robot Interaction

abstract: We present a discovery-based, first version, explicit model of social interaction that provides a basis for measuring the quality of interaction of a human user with a social robot. The two core elements of the social interaction model are engagement and co-regulation. Engagement emphasizes the \textit{qualitative nature} of social interaction and the fact that a user needs to be drawn into the interaction with the robot. Co-regulation emphasizes the interaction process and the fact that a user and a robot need to be acting together. We argue that the quality of social interaction with a robot can be measured in terms of how efficiently engagement and co-regulation are established and maintained during the interaction and how satisfied the user is with the interaction.


title: Curating Subject ID Labels using Keypoint Signatures

abstract: Subject ID labels are unique, anonymized codes that can be used to group all images of a subject while maintaining anonymity. ID errors may be inadvertently introduced manually error during enrollment and may lead to systematic error into machine learning evaluation (e.g. due to double-dipping) or potential patient misdiagnosis in clinical contexts. Here we describe a highly efficient system for curating subject ID labels in large generic medical image datasets, based on the 3D image keypoint representation, which recently led to the discovery of previously unknown labeling errors in widely-used public brain MRI datasets


title: Improving Pseudo-label Training For End-to-end Speech Recognition Using Gradient Mask

abstract: In the recent trend of semi-supervised speech recognition, both self-supervised representation learning and pseudo-labeling have shown promising results. In this paper, we propose a novel approach to combine their ideas for end-to-end speech recognition model. Without any extra loss function, we utilize the Gradient Mask to optimize the model when training on pseudo-label. This method forces the speech recognition model to predict from the masked input to learn strong acoustic representation and make training robust to label noise. In our semi-supervised experiments, the method can improve the model performance when training on pseudo-label and our method achieved competitive results comparing with other semi-supervised approaches on the Librispeech 100 hours experiments.


title: FAST-RIR: Fast neural diffuse room impulse response generator

abstract: We present a neural-network-based fast diffuse room impulse response generator (FAST-RIR) for generating room impulse responses (RIRs) for a given acoustic environment. Our FAST-RIR takes rectangular room dimensions, listener and speaker positions, and reverberation time as inputs and generates specular and diffuse reflections for a given acoustic environment. Our FAST-RIR is capable of generating RIRs for a given input reverberation time with an average error of 0.02s. We evaluate our generated RIRs in automatic speech recognition (ASR) applications using Google Speech API, Microsoft Speech API, and Kaldi tools. We show that our proposed FAST-RIR with batch size 1 is 400 times faster than a state-of-the-art diffuse acoustic simulator (DAS) on a CPU and gives similar performance to DAS in ASR experiments. Our FAST-RIR is 12 times faster than an existing GPU-based RIR generator (gpuRIR). We show that our FAST-RIR outperforms gpuRIR by 2.5% in an AMI far-field ASR benchmark.


title: Non-chromatic-adherence of the DP Color Function via Generalized Theta Graphs

abstract: DP-coloring (also called correspondence coloring) is a generalization of list coloring that has been widely studied in recent years after its introduction by Dvo\v{r}\'{a}k and Postle in 2015. The chromatic polynomial of a graph is an extensively studied notion in combinatorics since its introduction by Birkhoff in 1912; denoted $P(G,m)$, it equals the number of proper $m$-colorings of graph $G$. Counting function analogues of the chromatic polynomial have been introduced and studied for list colorings: $P_{\ell}$, the list color function (1990); DP colorings: $P_{DP}$, the DP color function (2019), and $P^*_{DP}$, the dual DP color function (2021). For any graph $G$ and $m \in \mathbb{N}$, $P_{DP}(G, m) \leq P_\ell(G,m) \leq P(G,m) \leq P_{DP}^*(G,m)$. A function $f$ is chromatic-adherent if for every graph $G$, $f(G,a) = P(G,a)$ for some $a \geq \chi(G)$ implies that $f(G,m) = P(G,m)$ for all $m \geq a$. It is not known if the list color function and the DP color function are chromatic-adherent. We show that the DP color function is not chromatic-adherent by studying the DP color function of Generalized Theta graphs. The tools we develop along with the Rearrangement Inequality give a new method for determining the DP color function of all Theta graphs and the dual DP color function of all Generalized Theta graphs.


title: Exceptional Gegenbauer polynomials via isospectral deformation

abstract: We show a method to construct isospectral deformations of classical orthogonal polynomials. The construction is based on confluent Darboux transformations, and it allows to construct Sturm-Liouville problems with polynomial eigenfunctions that have an arbitrary number of continuous parameters. We propose to call these new orthogonal polynomial systems \emph{exceptional polynomials of the second kind}. We illustrate this construction by describing the class of exceptional Gegenbauer polynomials of the second kind.


title: New Insights into Graph Convolutional Networks using Neural Tangent Kernels

abstract: Graph Convolutional Networks (GCNs) have emerged as powerful tools for learning on network structured data. Although empirically successful, GCNs exhibit certain behaviour that has no rigorous explanation -- for instance, the performance of GCNs significantly degrades with increasing network depth, whereas it improves marginally with depth using skip connections. This paper focuses on semi-supervised learning on graphs, and explains the above observations through the lens of Neural Tangent Kernels (NTKs). We derive NTKs corresponding to infinitely wide GCNs (with and without skip connections). Subsequently, we use the derived NTKs to identify that, with suitable normalisation, network depth does not always drastically reduce the performance of GCNs -- a fact that we also validate through extensive simulation. Furthermore, we propose NTK as an efficient `surrogate model' for GCNs that does not suffer from performance fluctuations due to hyper-parameter tuning since it is a hyper-parameter free deterministic kernel. The efficacy of this idea is demonstrated through a comparison of different skip connections for GCNs using the surrogate NTKs.


title: Enhancing business process execution with a context engine

abstract: Changes in workflow relevant data of business processes at run-time can hinder their completion or impact their profitability as they have been instantiated under different circumstances. The purpose of this paper is to propose a context engine to enhance a business process management (BPM) system's context-awareness. The generic architecture provides the flexibility to configure processes during initialization as well as to adapt running instances at decision gates or during execution due to significant context change. The paper discusses context-awareness as the conceptual background. The technological capabilities of business rules and complex event processing (CEP) are outlined in an architecture design. A reference process is proposed and discussed in an exemplary application. The results provide an improvement over the current situation of static variable instantiation of business processes with local information. The proposed architecture extends the well-known combination of business rules and BPM systems with a context engine based on CEP. The resulting architecture for a BPM system using a context engine is generic in nature and, hence, requires to be contextualized for situated implementations. Implementation success is dependent on the availability of context information and process compensation options. Practitioners receive advice on a reference architecture and technology choices for implementing systems, which can provide and monitor context information for business processes as well as intervene and adapt the execution. Currently, there is no multi-purpose non-proprietary context engine based on CEP or any other technology available for BPM, which facilitates the adaptation of processes at run-time due to changes in context variables. This paper will stimulate a debate between research and practice on suitable design and technology.


title: A fast co-simulation approach to vehicle/track interaction with finite element models of S&C

abstract: Simulations of vehicle/track interaction (VTI) in switches and crossings (S\&C) require taking into account the complexity of their geometry. The VTI can be handled via a co-simulation process between a finite element (FE) model of the track and a multibody system (MBS) software. The objective of this paper is to reduce the computing effort in the co-simulation process. In the proposed approach, the VTI problem is solved inside the MBS software to reduce the computational effort in the track model as well as the flow of input/output between both modules. The FE code is used to supply the matrices of stiffness, damping and mass at the beginning of the simulation. An explicit time scheme is used with mass scaling. A good agreement is found between both approaches with a reduction of the computing time by a factor of 10. This new approach allows the optimisation of the design of S\&C in further studies.


title: A New Weakly Supervised Learning Approach for Real-time Iron Ore Feed Load Estimation

abstract: Iron ore feed load control is one of the most critical settings in a mineral grinding process, directly impacting the quality of final products. The setting of the feed load is mainly determined by the characteristics of the ore pellets. However, the characterisation of ore is challenging to acquire in many production environments, leading to poor feed load settings and inefficient production processes. This paper presents our work using deep learning models for direct ore feed load estimation from ore pellet images. To address the challenges caused by the large size of a full ore pellets image and the shortage of accurately annotated data, we treat the whole modelling process as a weakly supervised learning problem. A two-stage model training algorithm and two neural network architectures are proposed. The experiment results show competitive model performance, and the trained models can be used for real-time feed load estimation for grind process optimisation.


title: A Neural Anthropometer Learning from Body Dimensions Computed on Human 3D Meshes

abstract: Human shape estimation has become increasingly important both theoretically and practically, for instance, in 3D mesh estimation, distance garment production and computational forensics, to mention just a few examples. As a further specialization, \emph{Human Body Dimensions Estimation} (HBDE) focuses on estimating human body measurements like shoulder width or chest circumference from images or 3D meshes usually using supervised learning approaches. The main obstacle in this context is the data scarcity problem, as collecting this ground truth requires expensive and difficult procedures. This obstacle can be overcome by obtaining realistic human measurements from 3D human meshes. However, a) there are no well established methods to calculate HBDs from 3D meshes and b) there are no benchmarks to fairly compare results on the HBDE task. Our contribution is twofold. On the one hand, we present a method to calculate right and left arm length, shoulder width, and inseam (crotch height) from 3D meshes with focus on potential medical, virtual try-on and distance tailoring applications. On the other hand, we use four additional body dimensions calculated using recently published methods to assemble a set of eight body dimensions which we use as a supervision signal to our Neural Anthropometer: a convolutional neural network capable of estimating these dimensions. To assess the estimation, we train the Neural Anthropometer with synthetic images of 3D meshes, from which we calculated the HBDs and observed that the network's overall mean estimate error is $20.89$ mm (relative error of 2.84\%). The results we present are fully reproducible and establish a fair baseline for research on the task of HBDE, therefore enabling the community with a valuable method.


title: Test-time Batch Statistics Calibration for Covariate Shift

abstract: Deep neural networks have a clear degradation when applying to the unseen environment due to the covariate shift. Conventional approaches like domain adaptation requires the pre-collected target data for iterative training, which is impractical in real-world applications. In this paper, we propose to adapt the deep models to the novel environment during inference. An previous solution is test time normalization, which substitutes the source statistics in BN layers with the target batch statistics. However, we show that test time normalization may potentially deteriorate the discriminative structures due to the mismatch between target batch statistics and source parameters. To this end, we present a general formulation $\alpha$-BN to calibrate the batch statistics by mixing up the source and target statistics for both alleviating the domain shift and preserving the discriminative structures. Based on $\alpha$-BN, we further present a novel loss function to form a unified test time adaptation framework Core, which performs the pairwise class correlation online optimization. Extensive experiments show that our approaches achieve the state-of-the-art performance on total twelve datasets from three topics, including model robustness to corruptions, domain generalization on image classification and semantic segmentation. Particularly, our $\alpha$-BN improves 28.4\% to 43.9\% on GTA5 $\rightarrow$ Cityscapes without any training, even outperforms the latest source-free domain adaptation method.


title: MToFNet: Object Anti-Spoofing with Mobile Time-of-Flight Data

abstract: In online markets, sellers can maliciously recapture others' images on display screens to utilize as spoof images, which can be challenging to distinguish in human eyes. To prevent such harm, we propose an anti-spoofing method using the paired rgb images and depth maps provided by the mobile camera with a Time-of-Fight sensor. When images are recaptured on display screens, various patterns differing by the screens as known as the moir\'e patterns can be also captured in spoof images. These patterns lead the anti-spoofing model to be overfitted and unable to detect spoof images recaptured on unseen media. To avoid the issue, we build a novel representation model composed of two embedding models, which can be trained without considering the recaptured images. Also, we newly introduce mToF dataset, the largest and most diverse object anti-spoofing dataset, and the first to utilize ToF data. Experimental results confirm that our model achieves robust generalization even across unseen domains.


title: Deep Slap Fingerprint Segmentation for Juveniles and Adults

abstract: Many fingerprint recognition systems capture four fingerprints in one image. In such systems, the fingerprint processing pipeline must first segment each four-fingerprint slap into individual fingerprints. Note that most of the current fingerprint segmentation algorithms have been designed and evaluated using only adult fingerprint datasets. In this work, we have developed a human-annotated in-house dataset of 15790 slaps of which 9084 are adult samples and 6706 are samples drawn from children from ages 4 to 12. Subsequently, the dataset is used to evaluate the matching performance of the NFSEG, a slap fingerprint segmentation system developed by NIST, on slaps from adults and juvenile subjects. Our results reveal the lower performance of NFSEG on slaps from juvenile subjects. Finally, we utilized our novel dataset to develop the Mask-RCNN based Clarkson Fingerprint Segmentation (CFSEG). Our matching results using the Verifinger fingerprint matcher indicate that CFSEG outperforms NFSEG for both adults and juvenile slaps. The CFSEG model is publicly available at \url{https://github.com/keivanB/Clarkson_Finger_Segment}


title: Measurement of In-Circuit Common-Mode Impedance at the AC Input of a Motor Drive System

abstract: The in-circuit common-mode (CM) impedance at the AC input of a motor drive system (MDS) provides valuable inputs for evaluating and estimating the CM electromagnetic interference (EMI) noise generated by the switching of power semiconductor devices in the MDS. This paper introduces a single-probe setup (SPS) with frequency-domain measurement to extract the in-circuit CM impedance of a MDS under its different operating modes. The SPS has the merits of non-contact measurement and simple structure.

categories: eess.SY cs.SY eess.SP physics.class-ph physics.ins-det


title: BI-RADS-Net: An Explainable Multitask Learning Approach for Cancer Diagnosis in Breast Ultrasound Images

abstract: In healthcare, it is essential to explain the decision-making process of machine learning models to establish the trustworthiness of clinicians. This paper introduces BI-RADS-Net, a novel explainable deep learning approach for cancer detection in breast ultrasound images. The proposed approach incorporates tasks for explaining and classifying breast tumors, by learning feature representations relevant to clinical diagnosis. Explanations of the predictions (benign or malignant) are provided in terms of morphological features that are used by clinicians for diagnosis and reporting in medical practice. The employed features include the BI-RADS descriptors of shape, orientation, margin, echo pattern, and posterior features. Additionally, our approach predicts the likelihood of malignancy of the findings, which relates to the BI-RADS assessment category reported by clinicians. Experimental validation on a dataset consisting of 1,192 images indicates improved model accuracy, supported by explanations in clinical terms using the BI-RADS lexicon.


title: Dataset Structural Index: Leveraging a machine's perspective towards visual data

abstract: With advances in vision and perception architectures, we have realized that working with data is equally crucial, if not more, than the algorithms. Till today, we have trained machines based on our knowledge and perspective of the world. The entire concept of Dataset Structural Index(DSI) revolves around understanding a machine`s perspective of the dataset. With DSI, I show two meta values with which we can get more information over a visual dataset and use it to optimize data, create better architectures, and have an ability to guess which model would work best. These two values are the Variety contribution ratio and Similarity matrix. In the paper, I show many applications of DSI, one of which is how the same level of accuracy can be achieved with the same model architectures trained over less amount of data.


title: Generative Pre-Trained Transformer for Cardiac Abnormality Detection

abstract: ECG heartbeat classification plays a vital role in diagnosis of cardiac arrhythmia. The goal of the Physionet/CinC 2021 challenge was to accurately classify clinical diagnosis based on 12, 6, 4, 3 or 2-lead ECG recordings in order to aid doctors in the diagnoses of different heart conditions. Transformers have had great success in the field of natural language processing in the past years. Our team, CinCSEM, proposes to draw the parallel between text and periodic time series signals by viewing the repeated period as words and the whole signal as a sequence of such words. In this way, the attention mechanisms of the transformers can be applied to periodic time series signals. In our implementation, we follow the Transformer Encoder architecture, which combines several encoder layers followed by a dense layer with linear or sigmoid activation for generative pre-training or classification, respectively. The use case presented here is multi-label classification of heartbeat abnormalities of ECG recordings shared by the challenge. Our best entry, not exceeding the challenge's hardware limitations, achieved a score of 0.12, 0.07, 0.10, 0.10 and 0.07 on 12-lead, 6-lead, 4-lead, 3-lead and 2-lead test set respectively. Unfortunately, our team was unable to be ranked because of a missing pre-print.


title: Approximately multiplicative maps between algebras of bounded operators on Banach spaces

abstract: We show that for any separable reflexive Banach space $X$ and a large class of Banach spaces $E$, including those with a subsymmetric shrinking basis but also all spaces $L_p$ for $1\leq p \leq \infty$, every bounded linear map ${\mathcal B}(E)\to {\mathcal B}(X)$ which is approximately multiplicative is necessarily close in the operator norm to some bounded homomorphism ${\mathcal B}(E)\to {\mathcal B}(X)$. That is, the pair $({\mathcal B}(E), {\mathcal B}(X))$ has the AMNM property in the sense of Johnson (\textit{J.~London Math.\ Soc.} 1988). Previously this was only known for $E=X=\ell_p$ with $1<p<\infty$; even for those cases, we improve on the previous methods and obtain better constants in various estimates. A crucial role in our approach is played by a new result, motivated by cohomological techniques, which establishes AMNM properties relative to an amenable subalgebra; this generalizes a theorem of Johnson (\textit{op cit.}).


title: Optimization of Reconfigurable Intelligent Surfaces Through Trace Maximization

abstract: Reconfigurable Intelligent Surfaces (RIS) have received significant attention recently as an innovation for enhanced connectivity, capacity, and energy efficiency in future wireless networks. Recent works indicate that such RIS-augmented communications can significantly enhance performance by intelligently shaping the characteristics of the multipath propagation environment to focus the energy in a desired direction and to circumvent impediments such as blockage, especially for communication at millimeter-wave (mmW), Terahertz (THz) and higher frequencies. In this paper, we investigate optimized (amplitude and phase) RIS design in a point-to-point multipath MIMO link and study the impact on link capacity under the assumption of perfect channel state information at the transmitter (TX), receiver (RX) and RIS. Specifically, we propose RIS design based on the maximization of the trace of the composite TX-RIS-RX link matrix which is a measure of the average power at the RX. We propose two RIS designs: a diagonal RIS matrix, and a general RIS matrix representing a more advanced architecture. The optimum design, in both cases, corresponds to calculating the dominant eigenvector of certain Hermitian matrices induced by the component channel matrices. We illustrate the capacity performance of the optimized RIS designs and compare them to a baseline design (random amplitudes and phases) and a recently proposed low-complexity phase-only design. We present results for sparse and rich multipath, and also consider the impact of line-of-sight paths. Our results show that while all designs offer comparable capacity at high signal-to-noise ratios (SNRs), the proposed optimum designs offer substantial gains at lower SNRs.


title: Active inference, Bayesian optimal design, and expected utility

abstract: Active inference, a corollary of the free energy principle, is a formal way of describing the behavior of certain kinds of random dynamical systems that have the appearance of sentience. In this chapter, we describe how active inference combines Bayesian decision theory and optimal Bayesian design principles under a single imperative to minimize expected free energy. It is this aspect of active inference that allows for the natural emergence of information-seeking behavior. When removing prior outcomes preferences from expected free energy, active inference reduces to optimal Bayesian design, i.e., information gain maximization. Conversely, active inference reduces to Bayesian decision theory in the absence of ambiguity and relative risk, i.e., expected utility maximization. Using these limiting cases, we illustrate how behaviors differ when agents select actions that optimize expected utility, expected information gain, and expected free energy. Our T-maze simulations show optimizing expected free energy produces goal-directed information-seeking behavior while optimizing expected utility induces purely exploitive behavior and maximizing information gain engenders intrinsically motivated behavior.


title: KOHTD: Kazakh Offline Handwritten Text Dataset

abstract: Despite the transition to digital information exchange, many documents, such as invoices, taxes, memos and questionnaires, historical data, and answers to exam questions, still require handwritten inputs. In this regard, there is a need to implement Handwritten Text Recognition (HTR) which is an automatic way to decrypt records using a computer. Handwriting recognition is challenging because of the virtually infinite number of ways a person can write the same message. For this proposal we introduce Kazakh handwritten text recognition research, a comprehensive dataset of Kazakh handwritten texts is necessary. This is particularly true given the lack of a dataset for handwritten Kazakh text. In this paper, we proposed our extensive Kazakh offline Handwritten Text dataset (KOHTD), which has 3000 handwritten exam papers and more than 140335 segmented images and there are approximately 922010 symbols. It can serve researchers in the field of handwriting recognition tasks by using deep and machine learning. We used a variety of popular text recognition methods for word and line recognition in our studies, including CTC-based and attention-based methods. The findings demonstrate KOHTD's diversity. Also, we proposed a Genetic Algorithm (GA) for line and word segmentation based on random enumeration of a parameter. The dataset and GA code are available at https://github.com/abdoelsayed2016/KOHTD.


title: Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networks

abstract: Exploiting past 3D LiDAR scans to predict future point clouds is a promising method for autonomous mobile systems to realize foresighted state estimation, collision avoidance, and planning. In this paper, we address the problem of predicting future 3D LiDAR point clouds given a sequence of past LiDAR scans. Estimating the future scene on the sensor level does not require any preceding steps as in localization or tracking systems and can be trained self-supervised. We propose an end-to-end approach that exploits a 2D range image representation of each 3D LiDAR scan and concatenates a sequence of range images to obtain a 3D tensor. Based on such tensors, we develop an encoder-decoder architecture using 3D convolutions to jointly aggregate spatial and temporal information of the scene and to predict the future 3D point clouds. We evaluate our method on multiple datasets and the experimental results suggest that our method outperforms existing point cloud prediction architectures and generalizes well to new, unseen environments without additional fine-tuning. Our method operates online and is faster than the common LiDAR frame rate of 10 Hz.


title: Physical Context and Timing Aware Sequence Generating GANs

abstract: Generative Adversarial Networks (GANs) have shown remarkable successes in generating realistic images and interpolating changes between images. Existing models, however, do not take into account physical contexts behind images in generating the images, which may cause unrealistic changes. Furthermore, it is difficult to generate the changes at a specific timing and they often do not match with actual changes. This paper proposes a novel GAN, named Physical Context and Timing aware sequence generating GANs (PCTGAN), that generates an image in a sequence at a specific timing between two images with considering physical contexts behind them. Our method consists of three components: an encoder, a generator, and a discriminator. The encoder estimates latent vectors from the beginning and ending images, their timings, and a target timing. The generator generates images and the physical contexts at the beginning, ending, and target timing from the corresponding latent vectors. The discriminator discriminates whether the generated images and contexts are real or not. In the experiments, PCTGAN is applied to a data set of sequential changes of shapes in die forging processes. We show that both timing and physical contexts are effective in generating sequential images.


title: The modularity of elliptic curves over all but finitely many totally real fields of degree 5

abstract: We study the finiteness of low degree points on certain modular curves and their Atkin--Lehner quotients, and, as an application, prove the modularity of elliptic curves over all but finitely many totally real fields of degree $5$. On the way, we prove a criterion for the finiteness of rational points of degree $5$ on a curve of large genus over a number field using the results of Abramovich--Harris and Faltings on subvarieties of Jacobians.


title: A Hybrid Spatial-temporal Deep Learning Architecture for Lane Detection

abstract: Accurate and reliable lane detection is vital for the safe performance of lane-keeping assistance and lane departure warning systems. However, under certain challenging circumstances, it is difficult to get satisfactory performance in accurately detecting the lanes from one single image as mostly done in current literature. Since lane markings are continuous lines, the lanes that are difficult to be accurately detected in the current single image can potentially be better deduced if information from previous frames is incorporated. This study proposes a novel hybrid spatial-temporal (ST) sequence-to-one deep learning architecture. This architecture makes full use of the ST information in multiple continuous image frames to detect the lane markings in the very last frame. Specifically, the hybrid model integrates the following aspects: (a) the single image feature extraction module equipped with the spatial convolutional neural network; (b) the ST feature integration module constructed by ST recurrent neural network; (c) the encoder-decoder structure, which makes this image segmentation problem work in an end-to-end supervised learning format. Extensive experiments reveal that the proposed model architecture can effectively handle challenging driving scenes and outperforms available state-of-the-art methods.


title: Landslide Detection in Real-Time Social Media Image Streams

abstract: Lack of global data inventories obstructs scientific modeling of and response to landslide hazards which are oftentimes deadly and costly. To remedy this limitation, new approaches suggest solutions based on citizen science that requires active participation. However, as a non-traditional data source, social media has been increasingly used in many disaster response and management studies in recent years. Inspired by this trend, we propose to capitalize on social media data to mine landslide-related information automatically with the help of artificial intelligence (AI) techniques. Specifically, we develop a state-of-the-art computer vision model to detect landslides in social media image streams in real time. To that end, we create a large landslide image dataset labeled by experts and conduct extensive model training experiments. The experimental results indicate that the proposed model can be deployed in an online fashion to support global landslide susceptibility maps and emergency response.


title: Flow Plugin Network for conditional generation

abstract: Generative models have gained many researchers' attention in the last years resulting in models such as StyleGAN for human face generation or PointFlow for the 3D point cloud generation. However, by default, we cannot control its sampling process, i.e., we cannot generate a sample with a specific set of attributes. The current approach is model retraining with additional inputs and different architecture, which requires time and computational resources. We propose a novel approach that enables to a generation of objects with a given set of attributes without retraining the base model. For this purpose, we utilize the normalizing flow models - Conditional Masked Autoregressive Flow and Conditional Real NVP, as a Flow Plugin Network (FPN).


title: A Method for Capturing and Reproducing Directional Reverberation in Six Degrees of Freedom

abstract: The reproduction of acoustics is an important aspect of the preservation of cultural heritage. A common approach is to capture an impulse response in a hall and auralize it by convolving an input signal with the measured reverberant response. For immersive applications, it is typical to acquire spatial impulse responses using a spherical microphone array to capture the reverberant sound field. While this allows a listener to freely rotate their head from the captured location during reproduction, delicate considerations must be made to allow a full six degrees of freedom auralization. Furthermore, the computational cost of convolution with a high-order Ambisonics impulse response remains prohibitively expensive for current real-time applications, where most of the resources are dedicated towards rendering graphics. For this reason, simplifications are often made in the reproduction of reverberation, such as using a uniform decay around the listener. However, recent work has highlighted the importance of directional characteristics in the late reverberant sound field and more efficient reproduction methods have been developed. In this article, we propose a framework that extracts directional decay properties from a set of captured spatial impulse responses to characterize a directional feedback delay network. For this purpose, a data set was acquired in the main auditorium of the Finnish National Opera and Ballet in Helsinki from multiple source-listener positions, in order to analyze the anisotropic characteristics of this auditorium and illustrate the proposed reproduction framework.


title: Appearance

abstract: Socially interactive agents (SIAs) are no longer mere visions for future user interfaces, as 20 years of research and technology development has enabled the use of virtual and physical agents in day-to-day interfaces and environments. This chapter of the ACM "The Handbook on Socially Interactive Agents" reviews research on and technologies involving socially interactive agents, including virtually embodied agents and physically embodied robots, focusing particularly on the appearance of socially interactive agents. It covers the history of the development of these technologies; outlines the design space for the appearance of agents, including what appearance comprises, modalities in which agents are presented, and how agents are constructed; and the features that agents use to support social interaction, including facial and bodily features, those that express demographic characteristics, and issues surrounding realism, appeal, and the uncanny valley. The chapter concludes with a brief discussion of open questions surrounding the appearance of socially interactive agents.


title: DeepGOMIMO: Deep Learning-Aided Generalized Optical MIMO with CSI-Free Blind Detection

abstract: Generalized optical multiple-input multiple-output (GOMIMO) techniques have been recently shown to be promising for high-speed optical wireless communication (OWC) systems. In this paper, we propose a novel deep learning-aided GOMIMO (DeepGOMIMO) framework for GOMIMO systems, where channel state information (CSI)-free blind detection can be enabled by employing a specially designed deep neural network (DNN)-based MIMO detector. The CSI-free blind DNN detector mainly consists of two modules: one is the pre-processing module which is designed to address both the path loss and channel crosstalk issues caused by MIMO transmission, and the other is the feed-forward DNN module which is used for joint detection of spatial and constellation information by learning the statistics of both the input signal and the additive noise. Our simulation results clearly verify that, in a typical indoor 4 $\times$ 4 MIMO-OWC system using both generalized optical spatial modulation (GOSM) and generalized optical spatial multiplexing (GOSMP) with unipolar non-zero 4-ary pulse amplitude modulation (4-PAM) modulation, the proposed CSI-free blind DNN detector achieves near the same bit error rate (BER) performance as the optimal joint maximum-likelihood (ML) detector, but with much reduced computational complexity. Moreover, since the CSI-free blind DNN detector does not require instantaneous channel estimation to obtain accurate CSI, it enjoys the unique advantages of improved achievable data rate and reduced communication time delay in comparison to the CSI-based zero-forcing DNN (ZF-DNN) detector.