title: In-context Learning Distillation: Transferring Few-shot Learning Ability of Pre-trained Language Models

abstract: Given the success with in-context learning of large pre-trained language models, we introduce in-context learning distillation to transfer in-context few-shot learning ability from large models to smaller models. We propose to combine in-context learning objectives with language modeling objectives to distill both the ability to read in-context examples and task knowledge to the smaller models. We perform in-context learning distillation under two different few-shot learning paradigms: Meta In-context Tuning (Meta-ICT) and Multitask In-context Tuning (Multitask-ICT). Multitask-ICT performs better on multitask few-shot learning but also requires more computation than Meta-ICT. Our method shows consistent improvements for both Meta-ICT and Multitask-ICT on two benchmarks: LAMA and CrossFit. Our extensive experiments and analysis reveal that in-context learning objectives and language modeling objectives are complementary under the Multitask-ICT paradigm. In-context learning objectives achieve the best performance when combined with language modeling objectives.


title: evoML Yellow Paper: Evolutionary AI and Optimisation Studio

abstract: Machine learning model development and optimisation can be a rather cumbersome and resource-intensive process. Custom models are often more difficult to build and deploy, and they require infrastructure and expertise which are often costly to acquire and maintain. Machine learning product development lifecycle must take into account the need to navigate the difficulties of developing and deploying machine learning models. evoML is an AI-powered tool that provides automated functionalities in machine learning model development, optimisation, and model code optimisation. Core functionalities of evoML include data cleaning, exploratory analysis, feature analysis and generation, model optimisation, model evaluation, model code optimisation, and model deployment. Additionally, a key feature of evoML is that it embeds code and model optimisation into the model development process, and includes multi-objective optimisation capabilities.


title: Additive estimates of the permanent using Gaussian fields

abstract: We present a randomized algorithm for estimating the permanent of an $M \times M$ real matrix $A$ up to an additive error. We do this by viewing the permanent $\mathrm{perm}(A)$ of $A$ as the expectation of a product of centered joint Gaussian random variables with a particular covariance matrix $C$. The algorithm outputs the empirical mean $S_{N}$ of this product after sampling $N$ times. Our algorithm runs in total time $O(M^{3} + M^{2}N + MN)$ with failure probability \begin{equation*} P(|S_{N}-\text{perm}(A)| > t) \leq \frac{3^{M}}{t^{2}N} \prod^{2M}_{i=1} C_{ii}. \end{equation*} In particular, we can estimate $\mathrm{perm}(A)$ to an additive error of $\epsilon\bigg(\sqrt{3^{2M}\prod^{2M}_{i=1} C_{ii}}\bigg)$ in polynomial time. We compare to a previous procedure due to Gurvits. We discuss how to find a particular $C$ using a semidefinite program and a relation to the Max-Cut problem and cut-norms.


title: Asymmetry in the Complexity of the Multi-Commodity Network Pricing Problem

abstract: The network pricing problem (NPP) is a bilevel problem, where the leader optimizes its revenue by deciding on the prices of certain arcs in a graph, while expecting the followers (also known as the commodities) to choose a shortest path based on those prices. In this paper, we investigate the complexity of the NPP with respect to two parameters: the number of tolled arcs, and the number of commodities. We devise a simple algorithm showing that if the number of tolled arcs is fixed, then the problem can be solved in polynomial time with respect to the number of commodities. In contrast, even if there is only one commodity, once the number of tolled arcs is not fixed, the problem becomes NP-hard. We characterize this asymmetry in the complexity with a novel property named strong bilevel feasibility. Finally, we describe an algorithm to generate valid inequalities to the NPP based on this property, accommodated with numerical results to demonstrate its effectiveness in solving the NPP with a high number of commodities.


title: PIM: Video Coding using Perceptual Importance Maps

abstract: Human perception is at the core of lossy video compression, with numerous approaches developed for perceptual quality assessment and improvement over the past two decades. In the determination of perceptual quality, different spatio-temporal regions of the video differ in their relative importance to the human viewer. However, since it is challenging to infer or even collect such fine-grained information, it is often not used during compression beyond low-level heuristics. We present a framework which facilitates research into fine-grained subjective importance in compressed videos, which we then utilize to improve the rate-distortion performance of an existing video codec (x264). The contributions of this work are threefold: (1) we introduce a web-tool which allows scalable collection of fine-grained perceptual importance, by having users interactively paint spatio-temporal maps over encoded videos; (2) we use this tool to collect a dataset with 178 videos with a total of 14443 frames of human annotated spatio-temporal importance maps over the videos; and (3) we use our curated dataset to train a lightweight machine learning model which can predict these spatio-temporal importance regions. We demonstrate via a subjective study that encoding the videos in our dataset while taking into account the importance maps leads to higher perceptual quality at the same bitrate, with the videos encoded with importance maps preferred $1.8 \times$ over the baseline videos. Similarly, we show that for the 18 videos in test set, the importance maps predicted by our model lead to higher perceptual quality videos, $2 \times$ preferred over the baseline at the same bitrate.


title: There's Plenty of Room Right Here: Biological Systems as Evolved, Overloaded, Multi-scale Machines

abstract: The applicability of computational models to the biological world is an active topic of debate. We argue that a useful path forward results from abandoning hard boundaries between categories and adopting an observer-dependent, pragmatic view. Such a view dissolves the contingent dichotomies driven by human cognitive biases (e.g., tendency to oversimplify) and prior technological limitations in favor of a more continuous, gradualist view necessitated by the study of evolution, developmental biology, and intelligent machines. Efforts to re-shape living systems for biomedical or bioengineering purposes require prediction and control of their function at multiple scales. This is challenging for many reasons, one of which is that living systems perform multiple functions in the same place at the same time. We refer to this as "polycomputing" - the ability of the same substrate to simultaneously compute different things. This ability is an important way in which living things are a kind of computer, but not the familiar, linear, deterministic kind; rather, living things are computers in the broad sense of computational materials as reported in the rapidly-growing physical computing literature. We argue that an observer-centered framework for the computations performed by evolved and designed systems will improve the understanding of meso-scale events, as it has already done at quantum and relativistic scales. Here, we review examples of biological and technological polycomputing, and develop the idea that overloading of different functions on the same hardware is an important design principle that helps understand and build both evolved and designed systems. Learning to hack existing polycomputing substrates, as well as evolve and design new ones, will have massive impacts on regenerative medicine, robotics, and computer engineering.


title: High Harmonic Generation without Tunnel-Ionization

abstract: A new High Harmonic Generation (HHG) scheme, which doesn't rely on Tunnel-Ionization as the ionization mechanism but rather on Single-Photon Ionization, is theoretically proposed and numerically demonstrated. The scheme uses two driver fields: an extreme-ultraviolet driver which induces the ionization, and a circularly-polarized, co-rotating, two-color infrared driver carried at a fundamental frequency and its second harmonic which induces the recollision. Using Classical and time-dependent Schr\"odinger equation simulations of a model Argon atom, we show that in this scheme ionization is essentially decoupled from recollision. Releasing the process from being Tunneling-dependent reduces its degree of nonlinearity, which offers new capabilities in attosecond science, such as generation of High Harmonics from highly-charged ions, or from specific deep core electronic levels. It is shown that the emitted high harmonics involve the absorption of photons of one color of the infrared driver, and the emission of photons of the second color. This calls for future examination of the possible correlations between the emitted high harmonics.


title: What sources are the dominant Galactic cosmic-ray accelerators?

abstract: Supernova remnants (SNRs) have long been considered to be the dominant source of Galactic cosmic rays, which implied that they provided most of the energy to power cosmic rays as well as being PeVatrons. The lack of evidence for PeV cosmic rays in SNRs, as well as theoretical considerations, has made this scenario untenable. At the same time the latest LHAASO and other gamma-ray results suggest that PeVatrons lurk inside starforming regions. Here I will discuss why SNRs should still be considered the main sources of Galactic cosmic rays at least up to 10 TeV, but that the cosmic-ray data allow for a second component of cosmic rays with energies up to several PeV. This second component could be a subset of supernovae/SNRs, reacceleration inside starforming regions, or pulsars. As a special case I show that the recent observations of Westerlund 1 by H.E.S.S. suggest a low value of the diffusion coefficient inside this region, which is, together with an Alfv\'en speed > 100 km/s, a prerequisite for making a starforming region collectively a PeVatron due to second order Fermi acceleration.


title: Understanding Stereotypes in Language Models: Towards Robust Measurement and Zero-Shot Debiasing

abstract: Generated texts from large pretrained language models have been shown to exhibit a variety of harmful, human-like biases about various demographics. These findings prompted large efforts aiming to understand and measure such effects, with the goal of providing benchmarks that can guide the development of techniques mitigating these stereotypical associations. However, as recent research has pointed out, the current benchmarks lack a robust experimental setup, consequently hindering the inference of meaningful conclusions from their evaluation metrics. In this paper, we extend these arguments and demonstrate that existing techniques and benchmarks aiming to measure stereotypes tend to be inaccurate and consist of a high degree of experimental noise that severely limits the knowledge we can gain from benchmarking language models based on them. Accordingly, we propose a new framework for robustly measuring and quantifying biases exhibited by generative language models. Finally, we use this framework to investigate GPT-3's occupational gender bias and propose prompting techniques for mitigating these biases without the need for fine-tuning.


title: Null hypersurfaces in 4-manifolds endowed with a product structure

abstract: In a 4-manifold, the composition of a Riemannian Einstein metric with an almost paracomplex structure that is isometric and parallel, defines a neutral metric that is conformally flat and scalar flat. In this paper, we study hypersurfaces that are null with respect to this neutral metric and in particular we study their geometric properties with respect to the Einstein metric. Firstly, we show that all totally geodesic null hypersurfaces are scalar flat and their existence implies that the Einstein metric in the ambient manifold must be Ricci-flat. Then, we find a necessary condition for the existence of null hypersurface with equal non-trivial principal curvatures and finally, we give a necessary condition on the ambient scalar curvature, for the existence of null (non-minimal) hypersurfaces that are of constant mean curvature.


title: A fugacity-based Lattice Boltzmann method for multicomponent multiphase systems

abstract: The free energy model can extend the Lattice Boltzmann method to multiphase systems. However, there is a lack of models capable of simulating multicomponent multiphase fluids with partial miscibility. In addition, existing models cannot be generalized to honor thermodynamic information provided by any multicomponent equation of state of choice. In this paper, we introduce a free energy Lattice Boltzmann model where the forcing term is determined by the fugacity of the species, the thermodynamic property that connects species partial pressure to chemical potential calculations. By doing so, we are able to carry out multicomponent multiphase simulations of partially miscible fluids and generalize the methodology for use with any multicomponent equation of state of interest. We test this fugacity-based Lattice Boltzmann method for the cases of vapor-liquid equilibrium for two and three-component mixtures in various temperature and pressure conditions. We demonstrate that the model is able to reliably reproduce phase densities and compositions as predicted by multicomponent thermodynamics and can reproduce different characteristic pressure-composition and temperature-composition envelopes with a high degree of accuracy. We also demonstrate that the model can offer accurate predictions under dynamic conditions.


title: A Physics-Informed Neural Network to Model Port Channels

abstract: We describe a Physics-Informed Neural Network (PINN) that simulates the flow induced by the astronomical tide in a synthetic port channel, with dimensions based on the Santos - S\~ao Vicente - Bertioga Estuarine System. PINN models aim to combine the knowledge of physical systems and data-driven machine learning models. This is done by training a neural network to minimize the residuals of the governing equations in sample points. In this work, our flow is governed by the Navier-Stokes equations with some approximations. There are two main novelties in this paper. First, we design our model to assume that the flow is periodic in time, which is not feasible in conventional simulation methods. Second, we evaluate the benefit of resampling the function evaluation points during training, which has a near zero computational cost and has been verified to improve the final model, especially for small batch sizes. Finally, we discuss some limitations of the approximations used in the Navier-Stokes equations regarding the modeling of turbulence and how it interacts with PINNs.


title: Privacy-Protecting Behaviours of Risk Detection in People with Dementia using Videos

abstract: People living with dementia often exhibit behavioural and psychological symptoms of dementia that can put their and others' safety at risk. Existing video surveillance systems in long-term care facilities can be used to monitor such behaviours of risk to alert the staff to prevent potential injuries or death in some cases. However, these behaviours of risk events are heterogeneous and infrequent in comparison to normal events. Moreover, analyzing raw videos can also raise privacy concerns. In this paper, we present two novel privacy-protecting video-based anomaly detection approaches to detect behaviours of risks in people with dementia. We either extracted body pose information as skeletons or used semantic segmentation masks to replace multiple humans in the scene with their semantic boundaries. Our work differs from most existing approaches for video anomaly detection that focus on appearance-based features, which can put the privacy of a person at risk and is also susceptible to pixel-based noise, including illumination and viewing direction. We used anonymized videos of normal activities to train customized spatio-temporal convolutional autoencoders and identify behaviours of risk as anomalies. We showed our results on a real-world study conducted in a dementia care unit with patients with dementia, containing approximately 21 hours of normal activities data for training and 9 hours of data containing normal and behaviours of risk events for testing. We compared our approaches with the original RGB videos and obtained a similar area under the receiver operating characteristic curve performance of 0.807 for the skeleton-based approach and 0.823 for the segmentation mask-based approach.


title: Spin dynamics in quantum dots on liquid helium

abstract: Liquid He-4 is free from magnetic defects, making it an ideal substrate for electrons with long-lived spin states. Such states can serve as qubit states. Here we consider the spin states of electrons electrostatically localized in quantum dots on a helium surface. Efficient gate operations in this system require spin-orbit coupling. It can be created by a nonuniform magnetic field from a current-carrying wire, can be turned on and off, and allows one to obtain large electro-dipole moment and comparatively fast coupling of spins in neighboring dots. Of central importance is to understand the spin decay due to the spin-orbit coupling. We establish the leading mechanism of such decay and show that the decay is sufficiently slow to enable high-fidelity single- and two-qubit gate operations


title: Measures of Variance on Windowed Gaussian Processes

abstract: The variance and fractional variance on a fixed time window (variously known as "rms percent" or "modulation index") are commonly used to characterize the variability of astronomical sources. We summarize properties of this statistic for a Gaussian process.


title: Lattice Model For The Quantum Anomalous Hall Effect in Moir\'e Graphene

abstract: Inspired by experiments on magic angle twisted bilayer graphene, we present a lattice mean-field model for the quantum anomalous Hall effect in a moir\'e setting. Our hopping model thus provides a simple route to a moir\'e Chern insulator in commensurately twisted models. We present a study of our model in the ribbon geometry, in which we demonstrate the presence of thick chiral edge states that have a transverse localization that scales with the moir\'e lattice spacing. We also study the electronic structure of a domain wall between opposite Chern insulators. Our model and results are relevant to experiments that will image or manipulate the moir\'e quantum anomalous Hall edge states.


title: Rudin-Keisler capturing and Mutual Stationairy at successors of Singulars

abstract: We introduce a combinatorial notion of measures called Rudin-Keisler capturing and use it to give a new construction of elementary substructures around singular cardinals. The new construction is used to establish mutual stationary results at the first successor of singular cardinals $\langle \aleph_{\omega n + 1}\rangle_{n< \omega}$.


title: Influence of collaborative customer service by service robots and clerks in bakery stores

abstract: In recent years, various service robots have been introduced in stores as recommendation systems. Previous studies attempted to increase the influence of these robots by improving their social acceptance and trust. However, when such service robots recommend a product to customers in real environments, the effect on the customers is influenced not only by the robot itself, but also by the social influence of the surrounding people such as store clerks. Therefore, leveraging the social influence of the clerks may increase the influence of the robots on the customers. Hence, we compared the influence of robots with and without collaborative customer service between the robots and clerks in two bakery stores. The experimental results showed that collaborative customer service increased the purchase rate of the recommended bread and improved the impression regarding the robot and store experience of the customers. Because the results also showed that the workload required for the clerks to collaborate with the robot was not high, this study suggests that all stores with service robots may show high effectiveness in introducing collaborative customer service.


title: Local Differential Privacy Image Generation Using Flow-based Deep Generative Models

abstract: Diagnostic radiologists need artificial intelligence (AI) for medical imaging, but access to medical images required for training in AI has become increasingly restrictive. To release and use medical images, we need an algorithm that can simultaneously protect privacy and preserve pathologies in medical images. To develop such an algorithm, here, we propose DP-GLOW, a hybrid of a local differential privacy (LDP) algorithm and one of the flow-based deep generative models (GLOW). By applying a GLOW model, we disentangle the pixelwise correlation of images, which makes it difficult to protect privacy with straightforward LDP algorithms for images. Specifically, we map images onto the latent vector of the GLOW model, each element of which follows an independent normal distribution, and we apply the Laplace mechanism to the latent vector. Moreover, we applied DP-GLOW to chest X-ray images to generate LDP images while preserving pathologies.


title: On the distribution of Alexander polynomials in certain families of closed braids

abstract: We study the distribution of arithmetic invariants associated to Alexander polynomials for certain infinite families of links. The families of links we consider arise from braids on a fixed number of strings. We explore analogies with number theory and the distribution of class groups in various families of number fields, setting out new directions in arithmetic topology and arithmetic statistics.


title: METEOR Guided Divergence for Video Captioning

abstract: Automatic video captioning aims for a holistic visual scene understanding. It requires a mechanism for capturing temporal context in video frames and the ability to comprehend the actions and associations of objects in a given timeframe. Such a system should additionally learn to abstract video sequences into sensible representations as well as to generate natural written language. While the majority of captioning models focus solely on the visual inputs, little attention has been paid to the audiovisual modality. To tackle this issue, we propose a novel two-fold approach. First, we implement a reward-guided KL Divergence to train a video captioning model which is resilient towards token permutations. Second, we utilise a Bi-Modal Hierarchical Reinforcement Learning (BMHRL) Transformer architecture to capture long-term temporal dependencies of the input data as a foundation for our hierarchical captioning module. Using our BMHRL, we show the suitability of the HRL agent in the generation of content-complete and grammatically sound sentences by achieving $4.91$, $2.23$, and $10.80$ in BLEU3, BLEU4, and METEOR scores, respectively on the ActivityNet Captions dataset. Finally, we make our BMHRL framework and trained models publicly available for users and developers at https://github.com/d-rothen/bmhrl.


title: Nucleosynthesis in Outflows from Black Hole-Neutron Star Merger Disks With Full GR$\nu$RMHD

abstract: Along with binary neutron star mergers, the in-spiral and merger of a black hole and a neutron star is a predicted site of $r$-process nucleosynthesis and associated kilonovae. For the right mass ratio, very large amounts of neutron rich material may become unbound from the post-merger accretion disk. We simulate a suite of four post-merger disks with full-transport general relativistic neutrino radiation magnetohydrodynamics. We find that the outflows from these disks are very close to the threshold conditions for robust $r$-process nucleosynthesis. For these conditions, the detailed properties of the outflow determine whether a full $r$-process can or cannot occur, implying that a wide range of observable phenomena are possible. We show that on average the disk outflow lanthanide fraction is suppressed relative to the solar isotopic pattern. In combination with the dynamical ejecta, these outflows imply a kilonova with both blue and red components.


title: Generation-Augmented Query Expansion For Code Retrieval

abstract: Pre-trained language models have achieved promising success in code retrieval tasks, where a natural language documentation query is given to find the most relevant existing code snippet. However, existing models focus only on optimizing the documentation code pairs by embedding them into latent space, without the association of external knowledge. In this paper, we propose a generation-augmented query expansion framework. Inspired by the human retrieval process - sketching an answer before searching, in this work, we utilize the powerful code generation model to benefit the code retrieval task. Specifically, we demonstrate that rather than merely retrieving the target code snippet according to the documentation query, it would be helpful to augment the documentation query with its generation counterpart - generated code snippets from the code generation model. To the best of our knowledge, this is the first attempt that leverages the code generation model to enhance the code retrieval task. We achieve new state-of-the-art results on the CodeSearchNet benchmark and surpass the baselines significantly.


title: Requirements Engineering for Artificial Intelligence Systems: A Systematic Mapping Study

abstract: [Context] In traditional software systems, Requirements Engineering (RE) activities are well-established and researched. However, building Artificial Intelligence (AI) based software with limited or no insight into the system's inner workings poses significant new challenges to RE. Existing literature has focused on using AI to manage RE activities, with limited research on RE for AI (RE4AI). [Objective] This paper investigates current approaches for specifying requirements for AI systems, identifies available frameworks, methodologies, tools, and techniques used to model requirements, and finds existing challenges and limitations. [Method] We performed a systematic mapping study to find papers on current RE4AI approaches. We identified 43 primary studies and analysed the existing methodologies, models, tools, and techniques used to specify and model requirements in real-world scenarios. [Results] We found several challenges and limitations of existing RE4AI practices. The findings highlighted that current RE applications were not adequately adaptable for building AI systems and emphasised the need to provide new techniques and tools to support RE4AI. [Conclusion] Our results showed that most of the empirical studies on RE4AI focused on autonomous, self-driving vehicles and managing data requirements, and areas such as ethics, trust, and explainability need further research.


title: Fluctuations of eigenvector overlaps and the Berry conjecture for Wigner matrices

abstract: We prove that any finite collection of quadratic forms (overlaps) of general deterministic matrices and eigenvectors of an $N\times N$ Wigner matrix has joint Gaussian fluctuations. This can be viewed as the random matrix analogue of the Berry random wave conjecture.


title: Complex K-theory of moduli spaces of Higgs bundles

abstract: We establish an isomorphism of complex $K$-theory of the moduli space $\check{\mathcal{M}}$ of $``SL_n"$-Higgs bundles of degree $d$ and rank $n$ (in the sense of Hausel--Thaddeus) and twisted complex $K$-theory of the orbifold $\hat{\mathcal{M}}$ of $PGL_n$-Higgs bundles of degree $e$, where $(n,d)=(n,e)=1$. Along the way we prove the vanishing of torsion for $H^*(\check{\mathcal{M}})$ and certain twisted complex $K$-theory groups of $\hat{\mathcal{M}}$. We also extend Arinkin's autoduality of compactified Jacobian to a derived equivalence between $SL_n$ and $PGL_n$-Hitchin systems over the elliptic locus. In the appendix we develop a formalism of $G$-sheaves of spectra, generalising equivariant homotopy theory to a relative setting.


title: Analyzing Semantic Faithfulness of Language Models via Input Intervention on Question Answering

abstract: Transformer-based language models have been shown to be highly effective for several NLP tasks. In this paper, we consider three transformer models, BERT, RoBERTa, and XLNet, in both small and large versions, and investigate how faithful their representations are with respect to the semantic content of texts. We formalize a notion of semantic faithfulness, in which the semantic content of a text should causally figure in a model's inferences in question answering. We then test this notion by observing a model's behavior on answering questions about a story after performing two novel semantic interventions: deletion intervention and negation intervention. While transformer models achieve high performance on standard question answering tasks, we show that they fail to be semantically faithful once we perform these interventions for a significant number of cases (~50% for deletion intervention, and ~20% drop in accuracy for negation intervention). We then propose an intervention-based training regime that can mitigate the undesirable effects for deletion intervention by a significant margin (from ~ 50% to ~6%). We analyze the inner-workings of the models to better understand the effectiveness of intervention-based training for deletion intervention. But we show that this training does not attenuate other aspects of semantic unfaithfulness such as the models' inability to deal with negation intervention or to capture the predicate-argument structure of texts. We also test InstructGPT, via prompting, for its ability to handle the two interventions and to capture predicate-argument structure. While InstructGPT models do achieve very high performance on predicate-argument structure task, they fail to respond adequately to our deletion and negation interventions.


title: Embedding Positive Process Models into Lognormal Bayesian State Space Frameworks using Moment Matching

abstract: In ecology it is common for processes to be bounded based on physical constraints of the system. One common example is the positivity constraint, which applies to phenomena such as duration times, population sizes, and total stock of a system's commodity. In this paper, we propose a novel method for embedding these dynamical systems into a lognormal state space model using an approach based on moment matching. Our method enforces the positivity constraint, allows for embedding of arbitrary mean evolution and variance structure, and has a closed-form Markov transition density which allows for more flexibility in fitting techniques. We discuss two existing lognormal state space models, and examine how they differ from the method presented here. We use 180 synthetic datasets to compare the forecasting performance under model misspecification and assess estimability of precision parameters between our method and existing methods. We find that our models well under misspecification, and that fixing the observation variance both helps to improve estimation of the process variance and improves forecast performance. To test our method on a difficult problem, we compare the predictive performance of two lognormal state space models in predicting Leaf Area Index over a 151 day horizon by embedding a process-based ecosystem model. We find that our moment matching model performs better than its competitor, and is better suited for long predictive horizons. Overall, our study helps to inform practitioners about the importance of embedding sensible dynamics when using models complex systems to predict out of sample.


title: The complete quantification of parametric uncertainties in (d,p) transfer reactions

abstract: Previous work quantified the uncertainty associated with the optical potentials between the nucleons and the target. In this study, we extend that work by also including the parameters of the mean field associated with the overlap function of the final bound state, thus obtaining the full parametric uncertainty on transfer observables. We use Bayesian Markov Chain Monte Carlo simulations to obtain parameter posterior distributions. We use elastic-scattering cross sections to constrain the optical potential parameters and use the asymptotic normalization coefficient of the final state to constrain the bound state interaction. We then propagate these posteriors to the transfer angular distributions and obtain confidence intervals for this observable. We study (d,p) reactions on 14C, 16O, and 48Ca at energies in the range E=10-24 MeV. Our results show a strong reduction in uncertainty by using the asymptotic normalization coefficient as a constraint, particularly for those reactions most sensitive to ambiguities in the mean-field. For those reactions, the importance of constraining the bound state interaction is equal to that of constrain the optical potentials. The case of 14C is an outlier because it populates a halo state, and the observable is less sensitive to the nuclear interior. We conclude that when minimal constraints are used on the parameters of the nucleon-target interaction, the 68% confidence interval uncertainties on the differential cross sections are very large (~ 140-185%). However, if elastic-scattering data and the asymptotic normalization coefficient are used in the analysis, with an error of 10% (5%), this uncertainty reduces to ~30% (~15%).


title: PaletteNeRF: Palette-based Appearance Editing of Neural Radiance Fields

abstract: Recent advances in neural radiance fields have enabled the high-fidelity 3D reconstruction of complex scenes for novel view synthesis. However, it remains underexplored how the appearance of such representations can be efficiently edited while maintaining photorealism. In this work, we present PaletteNeRF, a novel method for photorealistic appearance editing of neural radiance fields (NeRF) based on 3D color decomposition. Our method decomposes the appearance of each 3D point into a linear combination of palette-based bases (i.e., 3D segmentations defined by a group of NeRF-type functions) that are shared across the scene. While our palette-based bases are view-independent, we also predict a view-dependent function to capture the color residual (e.g., specular shading). During training, we jointly optimize the basis functions and the color palettes, and we also introduce novel regularizers to encourage the spatial coherence of the decomposition. Our method allows users to efficiently edit the appearance of the 3D scene by modifying the color palettes. We also extend our framework with compressed semantic features for semantic-aware appearance editing. We demonstrate that our technique is superior to baseline methods both quantitatively and qualitatively for appearance editing of complex real-world scenes.


title: Stuffle regularized multiple Eisenstein series revisited

abstract: Multiple Eisenstein series are holomorphic functions in the complex upper-half plane, which can be seen as a crossbreed between multiple zeta values and classical Eisenstein series. They were originally defined by Gangl-Kaneko-Zagier in 2006, and since then, many variants and regularizations of them have been studied. They give a natural bridge between the world of modular forms and multiple zeta values. In this note, we give a new algebraic interpretation of stuffle regularized multiple Eisenstein series based on the Hopf algebra structure of the harmonic algebra introduced by Hoffman.


title: A Non-Asymptotic Analysis of Oversmoothing in Graph Neural Networks

abstract: Oversmoothing is a central challenge of building more powerful Graph Neural Networks (GNNs). While previous works have only demonstrated that oversmoothing is inevitable when the number of graph convolutions tends to infinity, in this paper, we precisely characterize the mechanism behind the phenomenon via a non-asymptotic analysis. Specifically, we distinguish between two different effects when applying graph convolutions -- an undesirable mixing effect that homogenizes node representations in different classes, and a desirable denoising effect that homogenizes node representations in the same class. By quantifying these two effects on random graphs sampled from the Contextual Stochastic Block Model (CSBM), we show that oversmoothing happens once the mixing effect starts to dominate the denoising effect, and the number of layers required for this transition is $O(\log N/\log (\log N))$ for sufficiently dense graphs with $N$ nodes. We also extend our analysis to study the effects of Personalized PageRank (PPR), or equivalently, the effects of initial residual connections on oversmoothing. Our results suggest that while PPR mitigates oversmoothing at deeper layers, PPR-based architectures still achieve their best performance at a shallow depth and are outperformed by the graph convolution approach on certain graphs. Finally, we support our theoretical results with numerical experiments, which further suggest that the oversmoothing phenomenon observed in practice can be magnified by the difficulty of optimizing deep GNN models.


title: New determination of the branching ratio of the structure dependent radiative $K^{+} \to e^{+} \nu_{e} \gamma$ decay

abstract: The branching ratio of the structure dependent (SD) radiative $K^{+} \to e^{+} \nu_{e} \gamma$ decay relative to that of the $K^+\rightarrow e^+ \nu_{e} (\gamma)$ decay including the internal bremsstrahlung (IB) process ($K_{e2(\gamma)}$) has been measured in the J-PARC E36 experiment using plastic scintillator/lead sandwich detectors. In the analysis, the effect of IB was also taken into account in the SD radiative decay as $K_{e2\gamma(\gamma)}^{\rm SD}$. By combining the new data with the previously reported result of the E36 experiment using a CsI(Tl) calorimeter after revision for the IB correction for $K_{e2\gamma(\gamma)}^{\rm SD}$, a new value $Br(K_{e2\gamma(\gamma)}^{\rm SD})/Br(K_{e2(\gamma)})=1.20\pm0.07$ has been determined, which is consistent with a recent lattice QCD calculation, but larger than the expectation of Chiral Perturbation Theory (ChPT) at order $O(p^4)$ and the previous KLOE value. Also, using the method to relate form factor and branching ratio described in the KLOE paper, the present result is consistent with the form factor prediction based on a gauged nonlocal chiral quark model, but larger than ChPT at order $O(p^6)$.


title: Large area optimization of meta-lens via data-free machine learning

abstract: Sub-wavelength diffractive optics meta-optics present a multi-scale optical system, where the behavior of constituent sub-wavelength scatterers, or meta-atoms, need to be modelled by full-wave electromagnetic simulations, whereas the whole meta-optical system can be modelled using ray/ wave optics. Current simulation techniques for large-scale meta-optics rely on the local phase approximation (LPA), where the coupling between dissimilar meta-atoms are completely neglected. Here we introduce a physics-informed neural network, which can efficiently model the meta-optics while still incorporating all of the coupling between meta-atoms. Unlike existing deep learning techniques which generally predict the mean transmission and reflection coefficients of meta-atoms, we predict the full electro-magnetic field distribution. We demonstrate the efficacy of our technique by designing 1mm aperture cylindrical meta-lenses exhibiting higher efficiency than the ones designed under LPA. We experimentally validated the maximum intensity improvement (up to $53\%$) of the inverse-designed meta-lens. Our reported method can design large aperture $(\sim 10^4-10^5\lambda)$ meta-optics in a reasonable time (approximately 15 minutes on a graphics processing unit) without relying on any approximation.


title: A Dirichlet Process Mixture Model for Directional-Linear Data

abstract: Directional data require specialized probability models because of the non-Euclidean and periodic nature of their domain. When a directional variable is observed jointly with linear variables, modeling their dependence adds an additional layer of complexity. This paper introduces a novel Bayesian nonparametric approach for directional-linear data based on the Dirichlet process. We first extend the projected normal distribution to model the joint distribution of linear variables and a directional variable with arbitrary dimension as a projection of a higher-dimensional augmented multivariate normal distribution (MVN). We call the new distribution the semi-projected normal distribution (SPN); it possesses properties similar to the MVN. The SPN is then used as the mixture distribution in a Dirichlet process model to obtain a more flexible class of models for directional-linear data. We propose a normal conditional inverse-Wishart distribution as part of the prior distribution to address an identifiability issue inherited from the projected normal and preserve conjugacy with the SPN distribution. A Gibbs sampling algorithm is provided for posterior inference. Experiments on synthetic data and the Berkeley image database show superior performance of the Dirichlet process SPN mixture model (DPSPN) in clustering compared to other directional-linear models. We also build a hierarchical Dirichlet process model with the SPN to develop a likelihood ratio approach to bloodstain pattern analysis using the DPSPN model for density estimation to estimate the likelihood of a given pattern from a set of training data.


title: Control of Continuous Quantum Systems with Many Degrees of Freedom based on Convergent Reinforcement Learning

abstract: With the development of experimental quantum technology, quantum control has attracted increasing attention due to the realization of controllable artificial quantum systems. However, because quantum-mechanical systems are often too difficult to analytically deal with, heuristic strategies and numerical algorithms which search for proper control protocols are adopted, and, deep learning, especially deep reinforcement learning (RL), is a promising generic candidate solution for the control problems. Although there have been a few successful applications of deep RL to quantum control problems, most of the existing RL algorithms suffer from instabilities and unsatisfactory reproducibility, and require a large amount of fine-tuning and a large computational budget, both of which limit their applicability. To resolve the issue of instabilities, in this dissertation, we investigate the non-convergence issue of Q-learning. Then, we investigate the weakness of existing convergent approaches that have been proposed, and we develop a new convergent Q-learning algorithm, which we call the convergent deep Q network (C-DQN) algorithm, as an alternative to the conventional deep Q network (DQN) algorithm. We prove the convergence of C-DQN and apply it to the Atari 2600 benchmark. We show that when DQN fail, C-DQN still learns successfully. Then, we apply the algorithm to the measurement-feedback cooling problems of a quantum quartic oscillator and a trapped quantum rigid body. We establish the physical models and analyse their properties, and we show that although both C-DQN and DQN can learn to cool the systems, C-DQN tends to behave more stably, and when DQN suffers from instabilities, C-DQN can achieve a better performance. As the performance of DQN can have a large variance and lack consistency, C-DQN can be a better choice for researches on complicated control problems.


title: Mutually orthogonal frequency rectangles

abstract: A frequency rectangle of type FR$(m,n;q)$ is an $m \times n$ matrix such that each symbol from a set of size $q$ appears $n/q$ times in each row and $m/q$ times in each column. Two frequency rectangles of the same type are said to be orthogonal if, upon superimposition, each possible ordered pair of symbols appear the same number of times. A set of $k$ frequency rectangles in which every pair is orthogonal is called a set of mutually orthogonal frequency rectangles, denoted by $k$--MOFR$(m,n;q)$. We show that a $k$--MOFR$(2,2n;2)$ and an orthogonal array OA$(2n,k,2,2)$ are equivalent. We also show that an OA$(mn,k,2,2)$ implies the existence of a $k$--MOFR$(2m,2n;2)$. We construct $(4a-2)$--MOFR$(4,2a;2)$ assuming the existence of a Hadamard matrix of order $4a$. A $k$--MOFR$(m,n;q)$ is said to be $t$--orthogonal, if each subset of size $t$, when superimposed, contains each of the $q^t$ possible ordered $t$-tuples of entries exactly $mn/q^t$ times. A set of vectors over a finite field $\mathbb{F}_q$ is said to be $t$-independent if each subset of size $t$ is linearly independent. We describe a method to obtain a set of $t$--orthogonal $k$--MOFR$(q^M, q^N, q)$ corresponding to a set of $t$--independent vectors in $(\mathbb{F}_q)^{M+N}$. We also discuss upper and lower bounds on the set of $t$--independent vectors and give a table of values for binary vectors of length $N \leq 16$. A frequency rectangle of type FR$(n,n;q)$ is called a frequency square and a set of $k$ mutually orthogonal frequency squares is denoted by $k$--MOFS$(n;q)$ or $k$--MOFS$(n)$ when there is no ambiguity about the symbol set. For $p$ an odd prime, we show that there exists a set of $(p-1)$ binary MOFS$(2p)$, hence improving the lower bounds in (Britz et al. 2020) for the previously known values for $p \geq 19 $.


title: Extractive Text Summarization Using Generalized Additive Models with Interactions for Sentence Selection

abstract: Automatic Text Summarization (ATS) is becoming relevant with the growth of textual data; however, with the popularization of public large-scale datasets, some recent machine learning approaches have focused on dense models and architectures that, despite producing notable results, usually turn out in models difficult to interpret. Given the challenge behind interpretable learning-based text summarization and the importance it may have for evolving the current state of the ATS field, this work studies the application of two modern Generalized Additive Models with interactions, namely Explainable Boosting Machine and GAMI-Net, to the extractive summarization problem based on linguistic features and binary classification.


title: Zero-shot Triplet Extraction by Template Infilling

abstract: The task of triplet extraction aims to extract pairs of entities and their corresponding relations from unstructured text. Most existing methods train an extraction model on training data involving specific target relations, and are incapable of extracting new relations that were not observed at training time. Generalizing the model to unseen relations typically requires fine-tuning on synthetic training data which is often noisy and unreliable. We show that by reducing triplet extraction to a template infilling task over a pre-trained language model (LM), we can equip the extraction model with zero-shot learning capabilities and eliminate the need for additional training data. We propose a novel framework, ZETT (ZEro-shot Triplet extraction by Template infilling), that aligns the task objective to the pre-training objective of generative transformers to generalize to unseen relations. Experiments on FewRel and Wiki-ZSL datasets demonstrate that ZETT shows consistent and stable performance, outperforming previous state-of-the-art methods, even when using automatically generated templates. https://github.com/megagonlabs/zett/


title: Stability of iterated dyadic filter banks

abstract: This paper examines the frame properties of finitely and infinitely iterated dyadic filter banks. It is shown that the stability of an infinitely iterated dyadic filter bank guarantees that of any associated finitely iterated dyadic filter bank with uniform bounds. Conditions under which the stability of finitely iterated dyadic filter banks with uniform bounds implies that of the infinitely iterated dyadic filter bank are also given. The main result describes a sufficient condition under which the infinitely iterated dyadic filter bank associated with a specific class of finitely supported filters is stable.


title: Quantum vs Classical Birth and Death Processes; Exactly Solvable Examples

abstract: A coinless quantisation procedure of continuous and discrete time Birth and Death (BD) processes is presented. The quantum Hamiltonian H is derived by similarity transforming the matrix L describing the BD equation in terms of the square root of the stationary (reversible) distribution. The quantum and classical systems share the entire eigenvalues and the eigenvectors are related one to one. When the birth rate B(x) and the death rate D(x) are chosen to be the coefficients of the difference equation governing the orthogonal polynomials of Askey scheme, the quantum system is exactly solvable. The eigenvectors are the orthogonal polynomials themselves and the eigenvalues are given analytically. Many examples are periodic since their eigenvalues are all integers, or all integers for integer parameters. The situation is very similar to the exactly solvable one dimensional quantum mechanical systems. These exactly solvable Markov chains contain many adjustable free parameters which could be helpful for various simulation purposes.


title: Task Ambiguity in Humans and Language Models

abstract: Language models have recently achieved strong performance across a wide range of NLP benchmarks. However, unlike benchmarks, real world tasks are often poorly specified, and agents must deduce the user's intended behavior from a combination of context, instructions, and examples. We investigate how both humans and models behave in the face of such task ambiguity by proposing AmbiBench, a new benchmark of six ambiguously-specified classification tasks. We evaluate humans and models on AmbiBench by seeing how well they identify the intended task using 1) instructions with varying degrees of ambiguity, and 2) different numbers of labeled examples. We find that the combination of model scaling (to 175B parameters) and training with human feedback data enables models to approach or exceed the accuracy of human participants across tasks, but that either one alone is not sufficient. In addition, we show how to dramatically improve the accuracy of language models trained without large-scale human feedback training by finetuning on a small number of ambiguous in-context examples, providing a promising direction for teaching models to generalize well in the face of ambiguity.


title: Neighboring state-based RL Exploration

abstract: Reinforcement Learning is a powerful tool to model decision-making processes. However, it relies on an exploration-exploitation trade-off that remains an open challenge for many tasks. In this work, we study neighboring state-based, model-free exploration led by the intuition that, for an early-stage agent, considering actions derived from a bounded region of nearby states may lead to better actions when exploring. We propose two algorithms that choose exploratory actions based on a survey of nearby states, and find that one of our methods, ${\rho}$-explore, consistently outperforms the Double DQN baseline in an discrete environment by 49\% in terms of Eval Reward Return.


title: Quantum vs classical Markov chains; Exactly solvable examples

abstract: A coinless quantisation procedure of general reversible Markov chains on graphs is presented. A quantum Hamiltonian H is obtained by a similarity transformation of the fundamental transition probability matrix K in terms of the square root of the reversible distribution. The evolution of the classical and quantum Markov chains are described by the solutions of the eigenvalue problem of the quantum Hamiltonian H. About twenty plus exactly solvable Markov chains based on the hypergeometric orthogonal polynomials of Askey scheme, derived by Odake-Sasaki, would provide a good window for scrutinising the quantum/classical contrast of Markov chains. Among them five explicit examples, related to the Krawtchouk, Hahn, q-Hahn, Charlier and Meixner, are demonstrated to illustrate the actual calculations.


title: Integrating Heterogeneous Domain Information into Relation Extraction: A Case Study on Drug-Drug Interaction Extraction

abstract: The development of deep neural networks has improved representation learning in various domains, including textual, graph structural, and relational triple representations. This development opened the door to new relation extraction beyond the traditional text-oriented relation extraction. However, research on the effectiveness of considering multiple heterogeneous domain information simultaneously is still under exploration, and if a model can take an advantage of integrating heterogeneous information, it is expected to exhibit a significant contribution to many problems in the world. This thesis works on Drug-Drug Interactions (DDIs) from the literature as a case study and realizes relation extraction utilizing heterogeneous domain information. First, a deep neural relation extraction model is prepared and its attention mechanism is analyzed. Next, a method to combine the drug molecular structure information and drug description information to the input sentence information is proposed, and the effectiveness of utilizing drug molecular structures and drug descriptions for the relation extraction task is shown. Then, in order to further exploit the heterogeneous information, drug-related items, such as protein entries, medical terms and pathways are collected from multiple existing databases and a new data set in the form of a knowledge graph (KG) is constructed. A link prediction task on the constructed data set is conducted to obtain embedding representations of drugs that contain the heterogeneous domain information. Finally, a method that integrates the input sentence information and the heterogeneous KG information is proposed. The proposed model is trained and evaluated on a widely used data set, and as a result, it is shown that utilizing heterogeneous domain information significantly improves the performance of relation extraction from the literature.


title: Anderson localization of a one-dimensional lattice model with mosaic quasi-periodic off-diagonal disorders

abstract: In this work, we investigate Anderson localization of a one-dimensional lattice with a mosaic off-diagonal quasi-periodic hopping. It is found that the localization properties of zero-energy states depend sensitively on the parity of mosaic modulation period $\kappa$. If the mosaic period is an odd integer, there is no Anderson localization transition for an arbitrarily large quasiperiodic hopping. The zero-energy state is a critical state. While for an even number period and a generic quasiperiodic hopping, the zero-energy state would be a localized edge state at left (or right)-hand end of system. The above even-odd effects of mosaic period have been also transmitted into the other eigenstates near zero-energy. More specifically, when mosaic period is odd, there always exists an energy window in which the eigenstates are critical for arbitrarily strong quasiperiodic hopping. While for even period, there exists Anderson localization transition as the hopping strength increases. In addition, the Lyapunov exponent $\gamma(E)$ and the mobility edges $E_c$ are exactly obtained. With the Lyapunov exponent, we further find that there exist critical regions in the parameter $\tau-E$ (for $\kappa=1$) and $\lambda-E$ (for $\kappa>1$) plane. Furthermore, when $E$ approaches mobility edges $E_c$, it is found that the critical index of localization length is $\nu=1$. At the end, we show that the systems with different $E$ can be characterized by Lyapunov exponent $\gamma(E)$ and Avila acceleration $\omega(E)$.


title: Waveform discrimination by fitting derivative of synchronized ideal normalized curves, dSINC fit

abstract: dSINC proposes an alternative algorithm for waveform discrimination of measurement data from multi-layer scintillator sandwich designs. dSINC attempts to solve problems related to noise and peaks-piling sensitivity in the feature extraction step of traditional KNN waveform discrimination, by fitting the derivative of the entire gain section of the waveform against ideal waveforms learned from training data and thereby completely sidestepping the problems of feature extraction.


title: Hidden Poison: Machine Unlearning Enables Camouflaged Poisoning Attacks

abstract: We introduce camouflaged data poisoning attacks, a new attack vector that arises in the context of machine unlearning and other settings when model retraining may be induced. An adversary first adds a few carefully crafted points to the training dataset such that the impact on the model's predictions is minimal. The adversary subsequently triggers a request to remove a subset of the introduced points at which point the attack is unleashed and the model's predictions are negatively affected. In particular, we consider clean-label targeted attacks (in which the goal is to cause the model to misclassify a specific test point) on datasets including CIFAR-10, Imagenette, and Imagewoof. This attack is realized by constructing camouflage datapoints that mask the effect of a poisoned dataset.


title: Interpretability and causal discovery of the machine learning models to predict the production of CBM wells after hydraulic fracturing

abstract: Machine learning approaches are widely studied in the production prediction of CBM wells after hydraulic fracturing, but merely used in practice due to the low generalization ability and the lack of interpretability. A novel methodology is proposed in this article to discover the latent causality from observed data, which is aimed at finding an indirect way to interpret the machine learning results. Based on the theory of causal discovery, a causal graph is derived with explicit input, output, treatment and confounding variables. Then, SHAP is employed to analyze the influence of the factors on the production capability, which indirectly interprets the machine learning models. The proposed method can capture the underlying nonlinear relationship between the factors and the output, which remedies the limitation of the traditional machine learning routines based on the correlation analysis of factors. The experiment on the data of CBM shows that the detected relationship between the production and the geological/engineering factors by the presented method, is coincident with the actual physical mechanism. Meanwhile, compared with traditional methods, the interpretable machine learning models have better performance in forecasting production capability, averaging 20% improvement in accuracy.


title: AEStream: Accelerated event-based processing with coroutines

abstract: Neuromorphic sensors imitate the sparse and event-based communication seen in biological sensory organs and brains. Today's sensors can emit many millions of asynchronous events per second, which is challenging to process on conventional computers. To avoid bottleneck effects, there is a need to apply and improve concurrent and parallel processing of events. We present AEStream: a library to efficiently stream asynchronous events from inputs to outputs on conventional computers. AEStream leverages cooperative multitasking primitives known as coroutines to concurrently process individual events, which dramatically simplifies the integration with event-based peripherals, such as event-based cameras and (neuromorphic) asynchronous hardware. We explore the effects of coroutines in concurrent settings by benchmarking them against conventional threading mechanisms, and find that AEStream provides at least twice the throughput. We then apply AEStream in a real-time edge detection task on a GPU and demonstrate 1.3 times faster processing with 5 times fewer memory operations.


title: MoralDial: A Framework to Train and Evaluate Moral Dialogue Systems via Moral Discussions

abstract: Morality in dialogue systems has raised great attention in research recently. A moral dialogue system aligned with users' values could enhance conversation engagement and user connections. In this paper, we propose a framework, MoralDial to train and evaluate moral dialogue systems. In our framework, we first explore the communication mechanisms of morality and resolve expressed morality into three parts, which indicate the roadmap for building a moral dialogue system. Based on that, we design a simple yet effective method: constructing moral discussions between simulated specific users and the dialogue system. The constructed discussions consist of expressing, explaining, revising, and inferring moral views in dialogue exchanges, which makes conversational models learn morality well in a natural manner. Furthermore, we propose a novel evaluation method under the framework. We evaluate the multiple aspects of morality by judging the relation between dialogue responses and human values in discussions, where the multifaceted nature of morality is particularly considered. Automatic and manual experiments demonstrate that our framework is promising to train and evaluate moral dialogue systems.


title: Every Bit Counts: A New Version of Non-binary VT Codes with More Efficient Encoder

abstract: In this work, we present a new version of non-binary VT codes that are capable of correcting a single deletion or single insertion. Moreover, we provide the first known linear time algorithms that encode user messages into these codes of length n over the $q$-ary alphabet for $q\ge 2$ with at most $\ceil{\log_q n} + 1$ redundant symbols, while the optimal redundancy required is at least $\log_q n + \log_q (q - 1)$ symbols. Our designed encoder reduces the redundancy of the best-known encoder of Tenengolts (1984) by at least $2+\log_q(3)$ redundant symbols, or equivalently $2\log_2 q+3$ redundant bits.


title: Contrastive Error Attribution for Finetuned Language Models

abstract: Recent work has identified noisy and misannotated data as a core cause of hallucinations and unfaithful outputs in Natural Language Generation (NLG) tasks. Consequently, identifying and removing these examples is a key open challenge in creating reliable NLG systems. In this work, we introduce a framework to identify and remove low-quality training instances that lead to undesirable outputs, such as faithfulness errors in text summarization. We show that existing approaches for error tracing, such as gradient-based influence measures, do not perform reliably for detecting faithfulness errors in NLG datasets. We overcome the drawbacks of existing error tracing methods through a new, contrast-based estimate that compares undesired generations to human-corrected outputs. Our proposed method can achieve a mean average precision of 0.93 at detecting known data errors across synthetic tasks with known ground truth, substantially outperforming existing approaches. Using this approach and re-training models on cleaned data leads to a 70% reduction in entity hallucinations on the NYT dataset and a 55% reduction in semantic errors on the E2E dataset.


title: Comparison and Evaluation of Methods for a Predict+Optimize Problem in Renewable Energy

abstract: Algorithms that involve both forecasting and optimization are at the core of solutions to many difficult real-world problems, such as in supply chains (inventory optimization), traffic, and in the transition towards carbon-free energy generation in battery/load/production scheduling in sustainable energy systems. Typically, in these scenarios we want to solve an optimization problem that depends on unknown future values, which therefore need to be forecast. As both forecasting and optimization are difficult problems in their own right, relatively few research has been done in this area. This paper presents the findings of the ``IEEE-CIS Technical Challenge on Predict+Optimize for Renewable Energy Scheduling," held in 2021. We present a comparison and evaluation of the seven highest-ranked solutions in the competition, to provide researchers with a benchmark problem and to establish the state of the art for this benchmark, with the aim to foster and facilitate research in this area. The competition used data from the Monash Microgrid, as well as weather data and energy market data. It then focused on two main challenges: forecasting renewable energy production and demand, and obtaining an optimal schedule for the activities (lectures) and on-site batteries that lead to the lowest cost of energy. The most accurate forecasts were obtained by gradient-boosted tree and random forest models, and optimization was mostly performed using mixed integer linear and quadratic programming. The winning method predicted different scenarios and optimized over all scenarios jointly using a sample average approximation method.


title: Investigation of Network Architecture for Multimodal Head-and-Neck Tumor Segmentation

abstract: Inspired by the recent success of Transformers for Natural Language Processing and vision Transformer for Computer Vision, many researchers in the medical imaging community have flocked to Transformer-based networks for various main stream medical tasks such as classification, segmentation, and estimation. In this study, we analyze, two recently published Transformer-based network architectures for the task of multimodal head-and-tumor segmentation and compare their performance to the de facto standard 3D segmentation network - the nnU-Net. Our results showed that modeling long-range dependencies may be helpful in cases where large structures are present and/or large field of view is needed. However, for small structures such as head-and-neck tumor, the convolution-based U-Net architecture seemed to perform well, especially when training dataset is small and computational resource is limited.


title: Measuring deviations from the Kerr geometry with black hole ringdown

abstract: Black holes in General Relativity are famously characterized by two "hairs" only, the mass and the spin of the Kerr spacetime. Theories extending General Relativity, however, allow in principle for additional black hole charges, which will generally modify the multipole structure of the Kerr solution. Here, we show that gravitational wave observations of the post-merger ringdown signal from black hole binaries may permit measuring these additional "hairs". We do so by considering spacetime geometries differing from the Kerr one at the level of the quadrupole moment, and computing the differences of their quasinormal mode frequencies from the Kerr ones in the eikonal limit. We then perform a Bayesian analysis with current and future gravitational wave data and compute posterior constraints for the quadrupole deviation away from Kerr. We find that the inclusion of higher modes, which are potentially observable by future detectors, will allow for constraining deviations from the Kerr quadrupole at percent level.


title: Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval

abstract: Contrastive learning has been successfully used for retrieval of semantically aligned sentences, but it often requires large batch sizes or careful engineering to work well. In this paper, we instead propose a generative model for learning multilingual text embeddings which can be used to retrieve or score sentence pairs. Our model operates on parallel data in $N$ languages and, through an approximation we introduce, efficiently encourages source separation in this multilingual setting, separating semantic information that is shared between translations from stylistic or language-specific variation. We show careful large-scale comparisons between contrastive and generation-based approaches for learning multilingual text embeddings, a comparison that has not been done to the best of our knowledge despite the popularity of these approaches. We evaluate this method on a suite of tasks including semantic similarity, bitext mining, and cross-lingual question retrieval -- the last of which we introduce in this paper. Overall, our Variational Multilingual Source-Separation Transformer (VMSST) model outperforms both a strong contrastive and generative baseline on these tasks.


title: On Minima of Difference of Epstein Zeta Functions and Exact Solutions to Lennard-Jones Lattice Energy

abstract: Let $\zeta(s,z)=\sum_{(m,n)\in\mathbb{Z}^2\backslash\{0\}}\frac{(\Im(z))^s}{|mz+n|^{2s}}$ be the Eisenstein series/Epstein Zeta function. Motivated by widely used Lennard-Jones potential \begin{equation}\aligned\nonumber \mathcal{V}(|\cdot|^2):=4\varepsilon\Big( (\frac{\sigma}{|\cdot|})^{12}-(\frac{\sigma}{|\cdot|})^{6} \Big), \endaligned\end{equation} in physics, in this paper, we consider the following lattice minimization problem \begin{equation}\aligned\nonumber \min_{z\in\mathbb{H}}\Big(\zeta(6,z)-b\zeta(3,z)\Big), \;\;b=\frac{1}{\sigma^6} \endaligned\end{equation} and completely classify the minimizers for all $b\in \R$. Our results resolve an open problem in Blanc-Lewin \cite{Bla2015}, and a conjecture by B\'etermin \cite{Bet2018}. Furthermore, our method of proofs works for general minimization problem \begin{equation}\aligned\nonumber \min_{z\in\mathbb{H}}\Big(\zeta(s_1,z)-b\zeta(s_2,z)\Big), \;\;s_1>s_2>1 \endaligned\end{equation} which corresponds to general Lennard-Jones potential \begin{equation}\aligned\nonumber \mathcal{V}(|\cdot|^2):=4\varepsilon\Big( (\frac{\sigma}{|\cdot|})^{2s_1}-(\frac{\sigma}{|\cdot|})^{2s_2} \Big),\;\;s_1>s_2>1. \endaligned\end{equation}


title: Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction

abstract: When a human communicates with a machine using natural language on the web and online, how can it understand the human's intention and semantic context of their talk? This is an important AI task as it enables the machine to construct a sensible answer or perform a useful action for the human. Meaning is represented at the sentence level, identification of which is known as intent detection, and at the word level, a labelling task called slot filling. This dual-level joint task requires innovative thinking about natural language and deep learning network design, and as a result, many approaches and models have been proposed and applied. This tutorial will discuss how the joint task is set up and introduce Spoken Language Understanding/Natural Language Understanding (SLU/NLU) with Deep Learning techniques. We will cover the datasets, experiments and metrics used in the field. We will describe how the machine uses the latest NLP and Deep Learning techniques to address the joint task, including recurrent and attention-based Transformer networks and pre-trained models (e.g. BERT). We will then look in detail at a network that allows the two levels of the task, intent classification and slot filling, to interact to boost performance explicitly. We will do a code demonstration of a Python notebook for this model and attendees will have an opportunity to watch coding demo tasks on this joint NLU to further their understanding.


title: UnICLAM:Contrastive Representation Learning with Adversarial Masking for Unified and Interpretable Medical Vision Question Answering

abstract: Medical Visual Question Answering (Medical-VQA) aims to to answer clinical questions regarding radiology images, assisting doctors with decision-making options. Nevertheless, current Medical-VQA models learn cross-modal representations through residing vision and texture encoders in dual separate spaces, which lead to indirect semantic alignment. In this paper, we propose UnICLAM, a Unified and Interpretable Medical-VQA model through Contrastive Representation Learning with Adversarial Masking. Specifically, to learn an aligned image-text representation, we first establish a unified dual-stream pre-training structure with the gradually soft-parameter sharing strategy. Technically, the proposed strategy learns a constraint for the vision and texture encoders to be close in a same space, which is gradually loosened as the higher number of layers. Moreover, for grasping the unified semantic representation, we extend the adversarial masking data augmentation to the contrastive representation learning of vision and text in a unified manner. Concretely, while the encoder training minimizes the distance between original and masking samples, the adversarial masking module keeps adversarial learning to conversely maximize the distance. Furthermore, we also intuitively take a further exploration to the unified adversarial masking augmentation model, which improves the potential ante-hoc interpretability with remarkable performance and efficiency. Experimental results on VQA-RAD and SLAKE public benchmarks demonstrate that UnICLAM outperforms existing 11 state-of-the-art Medical-VQA models. More importantly, we make an additional discussion about the performance of UnICLAM in diagnosing heart failure, verifying that UnICLAM exhibits superior few-shot adaption performance in practical disease diagnosis.


title: Real-time Path Planning of Driver-less Mining Trains with Time-dependent Physical Constraints

abstract: While the increased automation levels of production and operation equipment have led to improved productivity of mining activity in open pit mines, the capacity of mine transport system become a bottleneck. The optimization of mine transport system is of great practical significance to reduce the production and operation cost and improve the production and organizational efficiency of mines. In this paper we first formulate a multi-objective optimisation problem for mine railway scheduling by introducing a set of mathematical constraints. As the problem is NP-hard, we then devise a Mixed Integer Programming based solution to solve this problem, and develop an online framework accordingly. We finally conduct test cases to evaluate the performance of the proposed solution. Experimental results demonstrate that the proposed solution is efficient and able to generate train schedule in a real-time manner.


title: Development of robust X-bar charts with unequal sample sizes

abstract: The traditional variable control charts, such as the X-bar chart, are widely used to monitor variation in a process. They have been shown to perform well for monitoring processes under the general assumptions that the observations are normally distributed without data contamination and that the sample sizes from the process are all equal. However, these two assumptions may not be met and satisfied in many practical applications and thus make them potentially limited for widespread application especially in production processes. In this paper, we alleviate this limitation by providing a novel method for constructing the robust X-bar control charts, which can simultaneously deal with both data contamination and unequal sample sizes. The proposed method for the process parameters is optimal in a sense of the best linear unbiased estimation. Numerical results from extensive Monte Carlo simulations and a real data analysis reveal that traditional control charts seriously underperform for monitoring process in the presence of data contamination and are extremely sensitive to even a single contaminated value, while the proposed robust control charts outperform in a manner that is comparable with the traditional ones, whereas they are far superior when the data are contaminated by outliers.


title: Prospects of a Strong first-order Electroweak Phase Transition in the $Z_3$-NMSSM

abstract: We have studied the viability and possible patterns of a strong first-order electroweak phase transition (SFOEWPT) within the $Z_3$-symmetric Next-to-Minimal Supersymmetric Standard Model (NMSSM), in view of the latest experimental results from the dark matter (DM) sector, Higgs sector and the searches of the lighter chargino and neutralinos at the Large Hadron Collider (LHC). We show that the region of parameter space with relatively small $\mu_\mathrm{eff}$ that favors an SFOEWPT has started to get excluded from the searches at the LHC and various DM experiments. However, there still remain phenomenologically much involved and compatible regions for an SFOEWPT that are yet not sensitive to the latest LHC and DM searches. We further estimate the production of stochastic gravitational waves (GW) from an SFOEWPT within and without the bag model and the prospects of detecting such signals at various future/proposed GW experiments.


title: Scalable Hybrid Learning Techniques for Scientific Data Compression

abstract: Data compression is becoming critical for storing scientific data because many scientific applications need to store large amounts of data and post process this data for scientific discovery. Unlike image and video compression algorithms that limit errors to primary data, scientists require compression techniques that accurately preserve derived quantities of interest (QoIs). This paper presents a physics-informed compression technique implemented as an end-to-end, scalable, GPU-based pipeline for data compression that addresses this requirement. Our hybrid compression technique combines machine learning techniques and standard compression methods. Specifically, we combine an autoencoder, an error-bounded lossy compressor to provide guarantees on raw data error, and a constraint satisfaction post-processing step to preserve the QoIs within a minimal error (generally less than floating point error). The effectiveness of the data compression pipeline is demonstrated by compressing nuclear fusion simulation data generated by a large-scale fusion code, XGC, which produces hundreds of terabytes of data in a single day. Our approach works within the ADIOS framework and results in compression by a factor of more than 150 while requiring only a few percent of the computational resources necessary for generating the data, making the overall approach highly effective for practical scenarios.


title: A brief introduction to quantum algorithms

abstract: Quantum algorithms are demonstrated to outperform classical algorithms for certain problems and thus are promising candidates for efficient information processing. Herein we aim to provide a brief and popular introduction to quantum algorithms for both the academic community and the general public with interest. We start from elucidating quantum parallelism, the basic framework of quantum algorithms and the difficulty of quantum algorithm design. Then we mainly focus on a historical overview of progress in quantum algorithm research over the past three to four decades. Finally, we clarify two common questions about the study of quantum algorithms, hoping to stimulate readers for further exploration.


title: NADBenchmarks -- a compilation of Benchmark Datasets for Machine Learning Tasks related to Natural Disasters

abstract: Climate change has increased the intensity, frequency, and duration of extreme weather events and natural disasters across the world. While the increased data on natural disasters improves the scope of machine learning (ML) in this field, progress is relatively slow. One bottleneck is the lack of benchmark datasets that would allow ML researchers to quantify their progress against a standard metric. The objective of this short paper is to explore the state of benchmark datasets for ML tasks related to natural disasters, categorizing them according to the disaster management cycle. We compile a list of existing benchmark datasets introduced in the past five years. We propose a web platform - NADBenchmarks - where researchers can search for benchmark datasets for natural disasters, and we develop a preliminary version of such a platform using our compiled list. This paper is intended to aid researchers in finding benchmark datasets to train their ML models on, and provide general directions for topics where they can contribute new benchmark datasets.


title: The molecular environment of the solar-type protostar IRAS 16293-2422

abstract: Studying the physical and chemical processes leading to the formation of low-mass stars is crucial for understanding the origin of our Sun and the Solar System. In particular, analyzing the emission and absorption lines from molecules is a fundamental tool to obtain information on the kinematics and chemistry at the very early stages of star formation. In this work we aim to examine the spatial structures and molecular abundances of material surrounding the very well-known low-mass binary protostar IRAS 16293-2422 and the prestellar core 16293E, which are embedded in the Lynds 1689N dark cloud. We have used the LAsMA heterodyne array installed on the Atacama Pathfinder EXperiment (APEX) 12 meter submillimeter telescope to image a region of about 0.12x0.12pc$^2$ around IRAS 16293-2422 and 16293E and to study their molecular environment covering 45.6GHz in a frequency range from 277GHz to 375GHz. We have identified 144 transitions from 36 molecular species, including isotopologues. The maps reveal the envelope to have a complex morphology around the cloud cores and the emission peaks known as E1, E2, W1, W2, and HE2, including the outflow structure arising from IRAS 16293-2422. Using several transitions of para-H$_2$CO, we have derived new lower limits for the kinetic temperatures toward IRAS 16293-2422 and the surrounding emission peaks. Based on these temperatures, H$_2$ volume densities and column densities for all detected species were derived around the cloud cores and all emission peaks. Our new observations further confirm the scenario of an outflow arising from IRAS 16293-2422 interacting with the prestellar core 16293E. We observe a large-scale velocity gradient across the molecular cloud. Furthermore, we see clear chemical differences at the examined positions. The data suggests that emission peak W2 may be related to a colder dust source.


title: Driving Style Recognition at First Impression for Online Trajectory Prediction

abstract: This paper proposes a new driving style recognition approach that allows autonomous vehicles (AVs) to perform trajectory predictions for surrounding vehicles with minimal data. Toward that end, we use a hybrid of offline and online methods in the proposed approach. We first learn typical driving styles with PCA and K-means algorithms in the offline part. After that, local Maximum-Likelihood techniques are used to perform online driving style recognition. We benchmarked our method on a real driving dataset against other methods in terms of the RMSE value of the predicted trajectory and the observed trajectory over a 5s duration. The proposed approach can reduce trajectory prediction error by up to 37.7\% compared to using the parameters from other literature and up to 24.4\% compared to not performing driving style recognition.


title: Flag Gadgets based on Classical Codes

abstract: Fault-tolerant syndrome extraction is a key ingredient in implementing fault-tolerant quantum computations. While conventional methods use a number of extra qubits linear in the weight of the syndrome, several improvements have been introduced using flag gadgets. In this work, we develop a framework to design flag gadgets using classical codes. Using this framework we show how to perform fault-tolerant syndrome extraction for any stabilizer code with arbitrary distance using exponentially fewer qubits than conventional methods when qubit measurement and reset are relatively slow compared to a round of error correction. We further take advantage of the saving provided by our construction to fault-tolerantly measure multiple stabilizers using a single gadget, and show that it maintains the same exponential advantage when it is used to fault-tolerantly extract the syndrome of quantum LDPC codes. Using the developed framework we perform computer-assisted search to find several small examples where our constructions reduce the number of qubits required. These small examples may be relevant to near-term experiments on small-scale quantum computers.


title: Decay of the Mediator Particle at Threshold

abstract: A light mediator particle is often predicted in the dark sector scenario, which weakly interacts with the standard model (SM) particles. The weakness of the interaction is usually described by a small coupling; however, the small coupling does not always guarantee the weakness of the interaction. When the mass of the mediator particle lies in a threshold region, the so-called threshold singularity may emerge, and then the perturbative calculation fails. This singularity causes several effects, e.g., the mixing between the mediator particle and bound states, the Sommerfeld effect on the final state of the mediator particle decay, etc. Taking the minimal model of the vector mediator particle decaying mainly into the SM particles as an example, we develop a method to describe the singularity quantitatively. We also calculate some physical quantities using this method, such as the lifetime of the mediator particle, and find that those could be significantly altered compared with the result of the perturbative calculation.


title: ToL: A Tensor of List-Based Unified Computation Model

abstract: Previous computation models either have equivalent abilities in representing all computations but fail to provide primitive operators for programming complex algorithms or lack generalized expression ability to represent newly-added computations. This article presents a unified computation model with generalized expression ability and a concise set of primitive operators for programming high-level algorithms. We propose a unified data abstraction -- Tensor of List, and offer a unified computation model based on Tensor of List, which we call the ToL model (in short, ToL). ToL introduces five atomic computations that can represent any elementary computation by finite composition, ensured with strict formal proof. Based on ToL, we design a pure-functional language -- ToLang. ToLang provides a concise set of primitive operators that can be used to program complex big data and AI algorithms. Our evaluations show ToL has generalized expression ability and a built-in performance indicator, born with a strictly defined computation metric -- elementary operation count (EOPs), consistent with FLOPs within a small error range.


title: Simulation Software of the JUNO Experiment

abstract: The Jiangmen Underground Neutrino Observatory (JUNO) is a multi-purpose experiment, under construction in southeast China, that is designed to determine the neutrino mass ordering and precisely measure neutrino oscillation parameters. Monte Carlo simulation plays an important role for JUNO detector design, detector commissioning, offline data processing, and physics processing. The JUNO experiment has the world's largest liquid scintillator detector instrumented with many thousands of PMTs. The broad energy range of interest, long lifetime, and the large scale present data processing challenges across all areas. This paper describes the JUNO simulation software, highlighting the challenges of JUNO simulation and solutions to meet these challenges, including such issues as support for time-correlated analysis, event mixing, event correlation and handling the simulation of many millions of optical photons.


title: Realization of a quantum neural network using repeat-until-success circuits in a superconducting quantum processor

abstract: Artificial neural networks are becoming an integral part of digital solutions to complex problems. However, employing neural networks on quantum processors faces challenges related to the implementation of non-linear functions using quantum circuits. In this paper, we use repeat-until-success circuits enabled by real-time control-flow feedback to realize quantum neurons with non-linear activation functions. These neurons constitute elementary building blocks that can be arranged in a variety of layouts to carry out deep learning tasks quantum coherently. As an example, we construct a minimal feedforward quantum neural network capable of learning all 2-to-1-bit Boolean functions by optimization of network activation parameters within the supervised-learning paradigm. This model is shown to perform non-linear classification and effectively learns from multiple copies of a single training state consisting of the maximal superposition of all inputs.


title: Experimental and theoretical study of dynamic polarizabilities in the $5S_{1/2}$-$5D_{5/2}$ clock transition in rubidium-87 and determination of E1 matrix elements

abstract: The interaction between light and an atom causes perturbations in the atom's energy levels, known as the light-shift. These light-shifts are a key source of inaccuracy in atomic clocks, and can also deteriorate their precision. We present a study of light-shifts and associated dynamic polarizabilities for a two-photon atomic clock based on the $5S_{1/2}$-$5D_{5/2}$ transition in rubidium-87 over the range 770 nm to 800 nm. We determine experimental and theoretical values for a magic wavelength in this range and the electric dipole (E1) matrix element for the $5P_{3/2}$-$5D_{5/2}$ transition. We find a magic wavelength of 776.179(5) nm (experimental) and 776.21 nm (theoretical) in the vicinity of the $5P_{3/2}$-$5D_{5/2}$ resonance, and the corresponding reduced E1 matrix element 1.80(6) $ea_0$ (experimental) and 1.96(15) $ea_0$ (theoretical). These values resolve a previous discrepancy between theory and experiment.


title: An Audio-Visual Speech Separation Model Inspired by Cortico-Thalamo-Cortical Circuits

abstract: Audio-visual approaches involving visual inputs have laid the foundation for recent progress in speech separation. However, the optimization of the concurrent usage of auditory and visual inputs is still an active research area. Inspired by the cortico-thalamo-cortical circuit, in which the sensory processing mechanisms of different modalities modulate one another via the non-lemniscal sensory thalamus, we propose a novel cortico-thalamo-cortical neural network (CTCNet) for audio-visual speech separation (AVSS). First, the CTCNet learns hierarchical auditory and visual representations in a bottom-up manner in separate auditory and visual subnetworks, mimicking the functions of the auditory and visual cortical areas. Then, inspired by the large number of connections between cortical regions and the thalamus, the model fuses the auditory and visual information in a thalamic subnetwork through top-down connections. Finally, the model transmits this fused information back to the auditory and visual subnetworks, and the above process is repeated several times. The results of experiments on three speech separation benchmark datasets show that CTCNet remarkably outperforms existing AVSS methods with considerably fewer parameters. These results suggest that mimicking the anatomical connectome of the mammalian brain has great potential for advancing the development of deep neural networks. Project repo is https://github.com/JusperLee/CTCNet.


title: Shard theory for $g$-fans

abstract: For a finite dimensional algebra $A$, the notion of $g$-fan $\Sigma(A)$ is defined from two-term silting complexes of $A$ in the real Grothendieck group $K_0(\mathsf{proj} A)_{\mathbb{R}}$. In this paper, we discuss the theory of shards to $\Sigma(A)$, which was originally defined for a hyperplane arrangement. We establish a correspondence between the set of join-irreducible elements of the poset of torsion classes of $\mathrm{mod} A$ and the set of shards of $\Sigma(A)$ for $g$-finite algebra $A$. Moreover, we show that the semistable region of a brick of $\mathrm{mod} A$ is exactly given by a shard. We also give a poset isomorphism of shard intersections and wide subcategories of $\mathrm{mod} A$.


title: SLGTformer: An Attention-Based Approach to Sign Language Recognition

abstract: Sign language is the preferred method of communication of deaf or mute people, but similar to any language, it is difficult to learn and represents a significant barrier for those who are hard of hearing or unable to speak. A person's entire frontal appearance dictates and conveys specific meaning. However, this frontal appearance can be quantified as a temporal sequence of human body pose, leading to Sign Language Recognition through the learning of spatiotemporal dynamics of skeleton keypoints. We propose a novel, attention-based approach to Sign Language Recognition exclusively built upon decoupled graph and temporal self-attention: the Sign Language Graph Time Transformer (SLGTformer). SLGTformer first deconstructs spatiotemporal pose sequences separately into spatial graphs and temporal windows. SLGTformer then leverages novel Learnable Graph Relative Positional Encodings (LGRPE) to guide spatial self-attention with the graph neighborhood context of the human skeleton. By modeling the temporal dimension as intra- and inter-window dynamics, we introduce Temporal Twin Self-Attention (TTSA) as the combination of locally-grouped temporal attention (LTA) and global sub-sampled temporal attention (GSTA). We demonstrate the effectiveness of SLGTformer on the World-Level American Sign Language (WLASL) dataset, achieving state-of-the-art performance with an ensemble-free approach on the keypoint modality. The code is available at https://github.com/neilsong/slt


title: Performance Analysis of LOS THz Systems under Misalignment and Deterministic Fading

abstract: Line-of-sight (LOS) wireless communication at terahertz (THz) frequency bands is envisioned to play a major role in defining next-generation wireless technologies. This work analyzes the performance of a potential LOS THz system experiencing propagation loss and misaligned antenna beams. The THz channel particularities are discussed in terms of deterministic path loss, molecular absorption effect and stochastic fading due to antenna pointing errors. Assuming phase shift keying (PSK) modulation schemes, simplified analytical expressions are approximated for computing symbol error rate (SER) of the proposed THz system. Monte Carlo simulations are applied to verify theoretical model accuracy over various transmission distances and misalignment scenarios. The derived SER formulas match simulation results for Signal-to-noise ratio (SNR) above 35 dB at transmission distance up to 100 m and antenna displacement jitter variance of 0.05 $m^2$. In general, the theoretical model mismatch does not exceed 2 dB for lower SNR levels.


title: The Internet of Senses: Building on Semantic Communications and Edge Intelligence

abstract: The Internet of Senses (IoS) holds the promise of flawless telepresence-style communication for all human `receptors' and therefore blurs the difference of virtual and real environments. We commence by highlighting the compelling use cases empowered by the IoS and also the key network requirements. We then elaborate on how the emerging semantic communications and Artificial Intelligence (AI)/Machine Learning (ML) paradigms along with 6G technologies may satisfy the requirements of IoS use cases. On one hand, semantic communications can be applied for extracting meaningful and significant information and hence efficiently exploit the resources and for harnessing a priori information at the receiver to satisfy IoS requirements. On the other hand, AI/ML facilitates frugal network resource management by making use of the enormous amount of data generated in IoS edge nodes and devices, as well as by optimizing the IoS performance via intelligent agents. However, the intelligent agents deployed at the edge are not completely aware of each others' decisions and the environments of each other, hence they operate in a partially rather than fully observable environment. Therefore, we present a case study of Partially Observable Markov Decision Processes (POMDP) for improving the User Equipment (UE) throughput and energy consumption, as they are imperative for IoS use cases, using Reinforcement Learning for astutely activating and deactivating the component carriers in carrier aggregation. Finally, we outline the challenges and open issues of IoS implementations and employing semantic communications, edge intelligence as well as learning under partial observability in the IoS context.


title: Coherent control of a high-orbital hole in a semiconductor quantum dot

abstract: Coherently driven semiconductor quantum dots are one of the most promising platforms for non-classical light sources and quantum logic gates which form the foundation of photonic quantum technologies. However, to date, coherent manipulation of single charge carriers in quantum dots is limited mainly to their lowest orbital states. Ultrafast coherent control of high-orbital states is obstructed by the demand for tunable terahertz pulses. To break this constraint, we demonstrate an all-optical method to control high-orbital states of a hole via stimulated Auger process. The coherent nature of the Auger process is proved by Rabi oscillation and Ramsey interference. Harnessing this coherence further enables the investigation of single-hole relaxation mechanism. A hole relaxation time of 161 ps is observed and attributed to the phonon bottleneck effect. Our work opens new possibilities for understanding the fundamental properties of high-orbital states in quantum emitters and developing new types of orbital-based quantum photonic devices.