title: MM-BD: Post-Training Detection of Backdoor Attacks with Arbitrary Backdoor Pattern Types Using a Maximum Margin Statistic

abstract: Backdoor attacks are an important type of adversarial threat against deep neural network classifiers, wherein test samples from one or more source classes will be (mis)classified to the attacker's target class when a backdoor pattern is embedded. In this paper, we focus on the post-training backdoor defense scenario commonly considered in the literature, where the defender aims to detect whether a trained classifier was backdoor-attacked without any access to the training set. Many post-training detectors are designed to detect attacks that use either one or a few specific backdoor embedding functions (e.g., patch-replacement or additive attacks). These detectors may fail when the backdoor embedding function used by the attacker (unknown to the defender) is different from the backdoor embedding function assumed by the defender. In contrast, we propose a post-training defense that detects backdoor attacks with arbitrary types of backdoor embeddings, without making any assumptions about the backdoor embedding type. Our detector leverages the influence of the backdoor attack, independent of the backdoor embedding mechanism, on the landscape of the classifier's outputs prior to the softmax layer. For each class, a maximum margin statistic is estimated. Detection inference is then performed by applying an unsupervised anomaly detector to these statistics. Thus, our detector does not need any legitimate clean samples, and can efficiently detect backdoor attacks with arbitrary numbers of source classes. These advantages over several state-of-the-art methods are demonstrated on four datasets, for three different types of backdoor patterns, and for a variety of attack configurations. Finally, we propose a novel, general approach for backdoor mitigation once a detection is made. The mitigation approach was the runner-up at the first IEEE Trojan Removal Competition. The code is online available.


title: Calibration of Transition-edge Sensor (TES) Bolometer Arrays with Application to CLASS

abstract: The current and future cosmic microwave background (CMB) experiments fielding kilo-pixel arrays of transition-edge sensor (TES) bolometers require accurate and robust gain calibration methods. We simplify and refactor the standard TES model to directly relate the detector responsivity calibration and optical time constant to the measured TES current $I$ and the applied bias current $I_{\mathrm{b}}$. The calibration method developed for the Cosmology Large Angular Scale Surveyor (CLASS) TES bolometer arrays relies on current versus voltage ($I$-$V$) measurements acquired daily prior to CMB observations. By binning Q-band (40GHz) $I$-$V$ measurements by optical loading, we find that the gain calibration median standard error within a bin is 0.3%. We test the accuracy of this "$I$-$V$ bin" detector calibration method by using the Moon as a photometric standard. The ratio of measured Moon amplitudes between detector pairs sharing the same feedhorn indicates a TES calibration error of 0.5%. We also find that for the CLASS Q-band TES array, calibrating the response of individual detectors based solely on the applied TES bias current accurately corrects TES gain variations across time but introduces a bias in the TES calibration from data counts to power units. Since the TES current bias value is set and recorded before every observation, this calibration method can always be applied to raw TES data and is not subject to $I$-$V$ data quality or processing errors.


title: Explicit Transition Density Functions of Skew Brownian Motions with Two-Valued Drift

abstract: In this article, we derive the explicit transition density functions of skew Brownian motion (SBM in abbreviation) with two-valued drift for all $t>0$. As an important step of this result, it is also shown in this paper that SBM with two-valued drift is a strong Markov process by finding its symmetrizing measure and canonical scale function, from which one can tell what values of the drift make such a process transient or recurrent.


title: On the Accuracy of Three-dimensional Kinematic Distances

abstract: Over the past decade, the BeSSeL Survey and the VERA project have measured trigonometric parallaxes to approximately 250 massive, young stars using VLBI techniques. These sources trace spiral arms over nearly half of the Milky Way. What is now needed are accurate distances to such stars which are well past the Galactic center. Here we analyze the potential for addressing this need by combining line-of-sight velocities and proper motions to yield 3D kinematic distance estimates. For sources within about 10 kpc of the Sun, significant systematic uncertainties can occur, and trigonometric parallaxes are generally superior. However, for sources well past the Galactic center, 3D kinematic distances are robust and more accurate than can usually be achieved by trigonometic parallaxes.


title: Developing a Production System for Purpose of Call Detection in Business Phone Conversations

abstract: For agents at a contact centre receiving calls, the most important piece of information is the reason for a given call. An agent cannot provide support on a call if they do not know why a customer is calling. In this paper we describe our implementation of a commercial system to detect Purpose of Call statements in English business call transcripts in real time. We present a detailed analysis of types of Purpose of Call statements and language patterns related to them, discuss an approach to collect rich training data by bootstrapping from a set of rules to a neural model, and describe a hybrid model which consists of a transformer-based classifier and a set of rules by leveraging insights from the analysis of call transcripts. The model achieved 88.6 F1 on average in various types of business calls when tested on real life data and has low inference time. We reflect on the challenges and design decisions when developing and deploying the system.


title: Perspectives on Incorporating Expert Feedback into Model Updates

abstract: Machine learning (ML) practitioners are increasingly tasked with developing models that are aligned with non-technical experts' values and goals. However, there has been insufficient consideration on how practitioners should translate domain expertise into ML updates. In this paper, we consider how to capture interactions between practitioners and experts systematically. We devise a taxonomy to match expert feedback types with practitioner updates. A practitioner may receive feedback from an expert at the observation- or domain-level, and convert this feedback into updates to the dataset, loss function, or parameter space. We review existing work from ML and human-computer interaction to describe this feedback-update taxonomy, and highlight the insufficient consideration given to incorporating feedback from non-technical experts. We end with a set of open questions that naturally arise from our proposed taxonomy and subsequent survey.


title: Structural Dropout for Model Width Compression

abstract: Existing ML models are known to be highly over-parametrized, and use significantly more resources than required for a given task. Prior work has explored compressing models offline, such as by distilling knowledge from larger models into much smaller ones. This is effective for compression, but does not give an empirical method for measuring how much the model can be compressed, and requires additional training for each compressed model. We propose a method that requires only a single training session for the original model and a set of compressed models. The proposed approach is a "structural" dropout that prunes all elements in the hidden state above a randomly chosen index, forcing the model to learn an importance ordering over its features. After learning this ordering, at inference time unimportant features can be pruned while retaining most accuracy, reducing parameter size significantly. In this work, we focus on Structural Dropout for fully-connected layers, but the concept can be applied to any kind of layer with unordered features, such as convolutional or attention layers. Structural Dropout requires no additional pruning/retraining, but requires additional validation for each possible hidden sizes. At inference time, a non-expert can select a memory versus accuracy trade-off that best suits their needs, across a wide range of highly compressed versus more accurate models.


title: Multimodal Conversational AI: A Survey of Datasets and Approaches

abstract: As humans, we experience the world with all our senses or modalities (sound, sight, touch, smell, and taste). We use these modalities, particularly sight and touch, to convey and interpret specific meanings. Multimodal expressions are central to conversations; a rich set of modalities amplify and often compensate for each other. A multimodal conversational AI system answers questions, fulfills tasks, and emulates human conversations by understanding and expressing itself via multiple modalities. This paper motivates, defines, and mathematically formulates the multimodal conversational research objective. We provide a taxonomy of research required to solve the objective: multimodal representation, fusion, alignment, translation, and co-learning. We survey state-of-the-art datasets and approaches for each research area and highlight their limiting assumptions. Finally, we identify multimodal co-learning as a promising direction for multimodal conversational AI research.


title: Neural-Fly Enables Rapid Learning for Agile Flight in Strong Winds

abstract: Executing safe and precise flight maneuvers in dynamic high-speed winds is important for the ongoing commoditization of uninhabited aerial vehicles (UAVs). However, because the relationship between various wind conditions and its effect on aircraft maneuverability is not well understood, it is challenging to design effective robot controllers using traditional control design methods. We present Neural-Fly, a learning-based approach that allows rapid online adaptation by incorporating pretrained representations through deep learning. Neural-Fly builds on two key observations that aerodynamics in different wind conditions share a common representation and that the wind-specific part lies in a low-dimensional space. To that end, Neural-Fly uses a proposed learning algorithm, domain adversarially invariant meta-learning (DAIML), to learn the shared representation, only using 12 minutes of flight data. With the learned representation as a basis, Neural-Fly then uses a composite adaptation law to update a set of linear coefficients for mixing the basis elements. When evaluated under challenging wind conditions generated with the Caltech Real Weather Wind Tunnel, with wind speeds up to 43.6 kilometers/hour (12.1 meters/second), Neural-Fly achieves precise flight control with substantially smaller tracking error than state-of-the-art nonlinear and adaptive controllers. In addition to strong empirical performance, the exponential stability of Neural-Fly results in robustness guarantees. Last, our control design extrapolates to unseen wind conditions, is shown to be effective for outdoor flights with only onboard sensors, and can transfer across drones with minimal performance degradation.


title: Dressing due to correlations strongly reduces the effect of electron-phonon coupling

abstract: We investigate the difference between the coupling of a bare carrier to phonons versus the coupling of a correlations-dressed quasiparticle to phonons, and show that latter may be weak even if the former is strong. Specifically, we analyze the effect of the hole-phonon coupling on the dispersion of the quasiparticle that forms when a single hole is doped into a cuprate layer. To model this, we start from the three-band Emery model supplemented by the Peierls modulation of the $p$-$d$ and $p$-$p$ hoppings due to the motion of O ions. We then project onto the strongly correlated $U_{dd}\rightarrow \infty$ limit where charge fluctuations are frozen on the Cu site. The resulting effective Hamiltonian describes the motion of a doped hole on the O sublattice, and its interactions with Cu spins and O phonons. We show that even though the hole-phonon coupling is moderate to strong, it leads to only a very minor increase of the quasiparticle's effective mass as compared to its mass in the absence of coupling to phonons, consistent with a weak coupling to phonons of the correlations-dressed quasiparticle. We explain the reasons for this suppression, revealing why it is expected to happen in any systems with strong correlations.


title: A Property Induction Framework for Neural Language Models

abstract: To what extent can experience from language contribute to our conceptual knowledge? Computational explorations of this question have shed light on the ability of powerful neural language models (LMs) -- informed solely through text input -- to encode and elicit information about concepts and properties. To extend this line of research, we present a framework that uses neural-network language models (LMs) to perform property induction -- a task in which humans generalize novel property knowledge (has sesamoid bones) from one or more concepts (robins) to others (sparrows, canaries). Patterns of property induction observed in humans have shed considerable light on the nature and organization of human conceptual knowledge. Inspired by this insight, we use our framework to explore the property inductions of LMs, and find that they show an inductive preference to generalize novel properties on the basis of category membership, suggesting the presence of a taxonomic bias in their representations.


title: Blockaid: Data Access Policy Enforcement for Web Applications

abstract: Modern web applications serve large amounts of sensitive user data, access to which is typically governed by data-access policies. Enforcing such policies is crucial to preventing improper data access, and prior work has proposed many enforcement mechanisms. However, these prior methods either alter application semantics or require adopting a new programming model; the former can result in unexpected application behavior, while the latter cannot be used with existing web frameworks. Blockaid is an access-policy enforcement system that preserves application semantics and is compatible with existing web frameworks. It intercepts database queries from the application, attempts to verify that each query is policy-compliant, and blocks queries that are not. It verifies policy compliance using SMT solvers and generalizes and caches previous compliance decisions for better performance. We show that Blockaid supports existing web applications while requiring minimal code changes and adding only modest overheads.


title: Expanding the Quantum Photonic Toolbox in AlGaAsOI

abstract: Aluminum gallium arsenide-on-insulator (AlGaAsOI) exhibits large $\chi^\left(2\right)$ and $\chi^\left(3\right)$ optical nonlinearities, a wide tunable bandgap, low waveguide propagation loss, and a large thermo-optic coefficient, making it an exciting platform for integrated quantum photonics. With ultrabright sources of quantum light established in AlGaAsOI, the next step is to develop the critical building blocks for chip-scale quantum photonic circuits. Here we expand the quantum photonic toolbox for AlGaAsOI by demonstrating edge couplers, 3-dB splitters, tunable interferometers, and waveguide crossings with performance comparable to or exceeding silicon and silicon-nitride quantum photonic platforms. As a demonstration, we demultiplex photonic qubits through an unbalanced interferometer, paving the route toward ultra-efficient and high-rate chip-scale demonstrations of photonic quantum computation and information applications.


title: A rigorous multi-population multi-lane hybrid traffic model and its mean-field limit for dissipation of waves via autonomous vehicles

abstract: In this paper, a multi-lane multi-population microscopic model, which presents stop and go waves, is proposed to simulate traffic on a ring-road. Vehicles are divided between human-driven and autonomous vehicles (AV). Control strategies are designed with the ultimate goal of using a small number of AVs (less than 5\% penetration rate) to represent Lagrangian control actuators that can smooth the multilane traffic flow and dissipate the stop-and-go waves. This in turn may reduce fuel consumption and emissions. The lane-changing mechanism is based on three components that we treat as parameters in the model: safety, incentive and cool-down time. The choice of these parameters in the lane-change mechanism is critical to modeling traffic accurately, because different parameter values can lead to drastically different traffic behaviors. In particular, the number of lane-changes and the speed variance are highly affected by the choice of parameters. Despite this modeling issue, when using sufficiently simple and robust controllers for AVs, the stabilization of uniform flow steady-state is effective for any realistic value of the parameters, and ultimately bypasses the observed modeling issue. Our approach is based on accurate and rigorous mathematical models, which allows a limit procedure that is termed, in gas dynamic terminology, mean-field. In simple words, from increasing the human-driven population to infinity, a system of coupled ordinary and partial differential equations are obtained. Moreover, control problems also pass to the limit, allowing the design to be tackled at different scales.


title: The Origin and Evolution of Saturn: A Post-Cassini Perspective

abstract: The Saturn System has been studied in detail by the Cassini-Huygens Mission. A major thrust of those investigations has been to understand how Saturn formed and evolved and to place Saturn in the context of other gas giants and planetary systems in general. Two models have been proposed for the formation of the giant planets,the core accretion model and the disk instability model. The heavy element enrichment, core size, and internal structure of Saturn, compared to Jupiter strongly favor the core accretion model as for Jupiter. Two features of the core accretion model that are distinct from the disk instability model are the growth of a core with a mass several times that of the Earth, followed by runaway collapse of gas onto the core once a mass threshold is reached. The heavy element core grows slowly over millions of years through accretion of cm-m sized pebbles, even larger bodies, and moon sized embryos in the gaseous disk. The abundance pattern of heavy elements is thus a key constraint on formation models. C, N, S, and P at Saturn are presently known to varying degree of uncertainty. The He to H ratio in the atmosphere is crucial for understanding heat balance, interior processes, and planetary evolution, but present values at Saturn range from low to high, allowing for a wide range of possibilities. While the very low values are favored to explain excess luminosity, high values might indicate presence of layered convection in the interior, resulting in slow cooling. Additional insight into Saturn's formation comes from the unique data on the rings from Cassini's Grand Finale orbits. While the solar system is the only analog for the extra solar systems, detection of the alkali metals and water in giant exoplanets is useful for understanding the formation and evolution of Saturn, where such data are presently lacking.


title: Formal limitations of sample-wise information-theoretic generalization bounds

abstract: Some of the tightest information-theoretic generalization bounds depend on the average information between the learned hypothesis and a single training example. However, these sample-wise bounds were derived only for expected generalization gap. We show that even for expected squared generalization gap no such sample-wise information-theoretic bounds exist. The same is true for PAC-Bayes and single-draw bounds. Remarkably, PAC-Bayes, single-draw and expected squared generalization gap bounds that depend on information in pairs of examples exist.


title: Modeling Combinatorial Disjunctive Constraints via Junction Trees

abstract: We introduce techniques to build small ideal mixed-integer programming (MIP) formulations of combinatorial disjunctive constraints (CDCs) via the independent branching scheme. We present a novel pairwise IB-representable class of CDCs, CDCs admitting junction trees, and provide a combinatorial procedure to build MIP formulations for those constraints. Generalized special ordered sets ($\text{SOS} k$) can be modeled by CDCs admitting junction trees and we also obtain MIP formulations of $\text{SOS} k$. Furthermore, we provide a novel ideal extended formulation of any combinatorial disjunctive constraints with fewer auxiliary binary variables with an application in planar obstacle avoidance.


title: A Schmidt decomposition approach to quantum thermodynamics

abstract: The development of a self-consistent thermodynamic theory of quantum systems is of fundamental importance for modern physics. Still, despite its essential role in quantum science and technology, there is no unifying formalism for characterizing the thermodynamics within general autonomous quantum systems, and many fundamental open questions remain unanswered. Along these lines, most current efforts and approaches restrict the analysis to particular scenarios of approximative descriptions and semi-classical regimes. Here we propose a novel approach to describe the thermodynamics of arbitrary bipartite autonomous quantum systems based on the well-known Schmidt decomposition. This formalism provides a simple, exact and symmetrical framework for expressing the energetics between interacting systems, including scenarios beyond the standard description regimes, such as strong coupling. We show that this procedure allows a straightforward identification of local effective operators suitable for characterizing the physical local internal energies. We also demonstrate that these quantities naturally satisfy the usual thermodynamic notion of energy additivity.


title: Representation learning with function call graph transformations for malware open set recognition

abstract: Open set recognition (OSR) problem has been a challenge in many machine learning (ML) applications, such as security. As new/unknown malware families occur regularly, it is difficult to exhaust samples that cover all the classes for the training process in ML systems. An advanced malware classification system should classify the known classes correctly while sensitive to the unknown class. In this paper, we introduce a self-supervised pre-training approach for the OSR problem in malware classification. We propose two transformations for the function call graph (FCG) based malware representations to facilitate the pretext task. Also, we present a statistical thresholding approach to find the optimal threshold for the unknown class. Moreover, the experiment results indicate that our proposed pre-training process can improve different performances of different downstream loss functions for the OSR problem.


title: Grounding Explainability Within the Context of Global South in XAI

abstract: In this position paper, we propose building a broader and deeper understanding around Explainability in AI by 'grounding' it in social contexts, the socio-technical systems operate in. We situate our understanding of grounded explainability in the 'Global South' in general and India in particular and express the need for more research within the global south context when it comes to explainability and AI.


title: Beyond General Purpose Machine Translation: The Need for Context-specific Empirical Research to Design for Appropriate User Trust

abstract: Machine Translation (MT) has the potential to help people overcome language barriers and is widely used in high-stakes scenarios, such as in hospitals. However, in order to use MT reliably and safely, users need to understand when to trust MT outputs and how to assess the quality of often imperfect translation results. In this paper, we discuss research directions to support users to calibrate trust in MT systems. We share findings from an empirical study in which we conducted semi-structured interviews with 20 clinicians to understand how they communicate with patients across language barriers, and if and how they use MT systems. Based on our findings, we advocate for empirical research on how MT systems are used in practice as an important first step to addressing the challenges in building appropriate trust between users and MT tools.


title: Ferrite: A Judgmental Embedding of Session Types in Rust

abstract: \emph{Session types} have proved viable in expressing and verifying the protocols of message-passing systems. While message passing is a dominant concurrency paradigm in practice, real world software is written without session types. A limitation of existing session type libraries in mainstream languages is their restriction to linear session types, precluding application scenarios that demand sharing and thus aliasing of channel references. This paper introduces Ferrite, a shallow embedding of session types in Rust that supports both \emph{linear} and \emph{shared} sessions. The formal foundation of Ferrite constitutes the shared session type calculus $\sills$, which Ferrite encodes via a novel \emph{judgmental embedding} technique. The fulcrum of the embedding is the notion of a typing judgment that allows reasoning about shared and linear resources to type a session. Typing rules are then encoded as functions over judgments, with a valid typing derivation manifesting as a well-typed Rust program. This Rust program generated by Ferrite serves as a \emph{certificate}, ensuring that the application will proceed according to the protocol defined by the session type. The paper details the features and implementation of Ferrite and includes a case study on implementing Servo's canvas component in Ferrite.


title: Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits

abstract: Recent years have seen the development of many open-source ML fairness toolkits aimed at helping ML practitioners assess and address unfairness in their systems. However, there has been little research investigating how ML practitioners actually use these toolkits in practice. In this paper, we conducted the first in-depth empirical exploration of how industry practitioners (try to) work with existing fairness toolkits. In particular, we conducted think-aloud interviews to understand how participants learn about and use fairness toolkits, and explored the generality of our findings through an anonymous online survey. We identified several opportunities for fairness toolkits to better address practitioner needs and scaffold them in using toolkits effectively and responsibly. Based on these findings, we highlight implications for the design of future open-source fairness toolkits that can support practitioners in better contextualizing, communicating, and collaborating around ML fairness efforts.


title: Uniform bounds for ruin probability in Multidimensional Risk Model

abstract: In this paper we consider some generalizations of the classical d-dimensional Brownian risk model. This contribution derives some non-asymptotic bounds for simultaneous ruin probabilities of interest. In addition, we obtain non-asymptotic bounds also for the case of general trend functions and convolutions of our original risk model.


title: A Tale of Two Flows: Cooperative Learning of Langevin Flow and Normalizing Flow Toward Energy-Based Model

abstract: This paper studies the cooperative learning of two generative flow models, in which the two models are iteratively updated based on the jointly synthesized examples. The first flow model is a normalizing flow that transforms an initial simple density to a target density by applying a sequence of invertible transformations. The second flow model is a Langevin flow that runs finite steps of gradient-based MCMC toward an energy-based model. We start from proposing a generative framework that trains an energy-based model with a normalizing flow as an amortized sampler to initialize the MCMC chains of the energy-based model. In each learning iteration, we generate synthesized examples by using a normalizing flow initialization followed by a short-run Langevin flow revision toward the current energy-based model. Then we treat the synthesized examples as fair samples from the energy-based model and update the model parameters with the maximum likelihood learning gradient, while the normalizing flow directly learns from the synthesized examples by maximizing the tractable likelihood. Under the short-run non-mixing MCMC scenario, the estimation of the energy-based model is shown to follow the perturbation of maximum likelihood, and the short-run Langevin flow and the normalizing flow form a two-flow generator that we call CoopFlow. We provide an understating of the CoopFlow algorithm by information geometry and show that it is a valid generator as it converges to a moment matching estimator. We demonstrate that the trained CoopFlow is capable of synthesizing realistic images, reconstructing images, and interpolating between images.


title: A Relaxation Approach to Feature Selection for Linear Mixed Effects Models

abstract: Linear Mixed-Effects (LME) models are a fundamental tool for modeling correlated data, including cohort studies, longitudinal data analysis, and meta-analysis. Design and analysis of variable selection methods for LMEs is more difficult than for linear regression because LME models are nonlinear. In this work we propose a relaxation strategy and optimization methods that enable a wide range of variable selection methods for LMEs using both convex and nonconvex regularizers, including $\ell_1$, Adaptive-$\ell_1$, CAD, and $\ell_0$. The computational framework only requires the proximal operator for each regularizer to be available, and the implementation is available in an open source python package pysr3, consistent with the sklearn standard. The numerical results on simulated data sets indicate that the proposed strategy improves on the state of the art for both accuracy and compute time. The variable selection techniques are also validated on a real example using a data set on bullying victimization.


title: Toward a Geometrical Understanding of Self-supervised Contrastive Learning

abstract: Self-supervised learning (SSL) is currently one of the premier techniques to create data representations that are actionable for transfer learning in the absence of human annotations. Despite their success, the underlying geometry of these representations remains elusive, which obfuscates the quest for more robust, trustworthy, and interpretable models. In particular, mainstream SSL techniques rely on a specific deep neural network architecture with two cascaded neural networks: the encoder and the projector. When used for transfer learning, the projector is discarded since empirical results show that its representation generalizes more poorly than the encoder's. In this paper, we investigate this curious phenomenon and analyze how the strength of the data augmentation policies affects the data embedding. We discover a non-trivial relation between the encoder, the projector, and the data augmentation strength: with increasingly larger augmentation policies, the projector, rather than the encoder, is more strongly driven to become invariant to the augmentations. It does so by eliminating crucial information about the data by learning to project it into a low-dimensional space, a noisy estimate of the data manifold tangent plane in the encoder representation. This analysis is substantiated through a geometrical perspective with theoretical and empirical results.


title: Wrist-Squeezing Force Feedback Improves Accuracy and Speed in Robotic Surgery Training

abstract: Current robotic minimally invasive surgery (RMIS) platforms provide surgeons with no haptic feedback of the robot's physical interactions. This limitation forces surgeons to rely heavily on visual feedback and can make it challenging for surgical trainees to manipulate tissue gently. Prior research has demonstrated that haptic feedback can increase task accuracy in RMIS training. However, it remains unclear whether these improvements represent a fundamental improvement in skill, or if they simply stem from re-prioritizing accuracy over task completion time. In this study, we provide haptic feedback of the force applied by the surgical instruments using custom wrist-squeezing devices. We hypothesize that individuals receiving haptic feedback will increase accuracy (produce less force) while increasing their task completion time, compared to a control group receiving no haptic feedback. To test this hypothesis, N=21 novice participants were asked to repeatedly complete a ring rollercoaster surgical training task as quickly as possible. Results show that participants receiving haptic feedback apply significantly less force (0.67 N) than the control group, and they complete the task no faster or slower than the control group after twelve repetitions. Furthermore, participants in the feedback group decreased their task completion times significantly faster (7.68%) than participants in the control group (5.26%). This form of haptic feedback, therefore, has the potential to help trainees improve their technical accuracy without compromising speed.


title: Circular multi-party quantum private comparison with n-level single-particle states

abstract: In this paper, a novel multi-party quantum private comparison (MQPC) protocol for equality comparison with n-level single-particle states is constructed, where the encoded particles are transmitted in a circular way. Here, n parties employ the qudit shifting operation to encode their private secrets and can compare the equality of their private secrets within one time execution of protocol. The proposed MQPC protocol can overcome both the outside attack and the participant attack. Specially, each party's secret can be kept unknown to other parties and the third party (TP).


title: ImageSig: A signature transform for ultra-lightweight image recognition

abstract: This paper introduces a new lightweight method for image recognition. ImageSig is based on computing signatures and does not require a convolutional structure or an attention-based encoder. It is striking to the authors that it achieves: a) an accuracy for 64 X 64 RGB images that exceeds many of the state-of-the-art methods and simultaneously b) requires orders of magnitude less FLOPS, power and memory footprint. The pretrained model can be as small as 44.2 KB in size. ImageSig shows unprecedented performance on hardware such as Raspberry Pi and Jetson-nano. ImageSig treats images as streams with multiple channels. These streams are parameterized by spatial directions. We contribute to the functionality of signature and rough path theory to stream-like data and vision tasks on static images beyond temporal streams. With very few parameters and small size models, the key advantage is that one could have many of these "detectors" assembled on the same chip; moreover, the feature acquisition can be performed once and shared between different models of different tasks - further accelerating the process. This contributes to energy efficiency and the advancements of embedded AI at the edge.


title: Information leakage resistant quantum dialogue with single photons in both polarization and spatial-mode degrees of freedom

abstract: In this paper, a novel quantum dialogue (QD) protocol is proposed based on single photons in both polarization and spatial-mode degrees of freedom. In the proposed QD protocol, the initial states of single photons in both polarization and spatial-mode degrees of freedom used for encoding are privately shared between two communicants through the direct transmissions of their auxiliary counterparts from one communicant to another. As a result, the information leakage problem is avoided. Moreover, the detailed security analysis also shows that the proposed QD protocol can resist Eve's several famous active attacks, such as the Trojan horse attack, the intercept-resend attack, the measure-resend attack and the entangle-measure attack. The proposed QD protocol only needs single photons in both polarization and spatial-mode degrees of freedom as quantum resource and adopts single-photon measurements. As a result, it is feasible in practice as the preparation and the measurement of a single photon in both polarization and spatial-mode degrees of freedom can be accomplished with current experimental techniques.


title: Task splitting for DNN-based acoustic echo and noise removal

abstract: Neural networks have led to tremendous performance gains for single-task speech enhancement, such as noise suppression and acoustic echo cancellation (AEC). In this work, we evaluate whether it is more useful to use a single joint or separate modules to tackle these problems. We describe different possible implementations and give insights into their performance and efficiency. We show that using a separate echo cancellation module and a module for noise and residual echo removal results in less near-end speech distortion and better performance during double-talk at same complexity.


title: Multi-party quantum private comparison based on entanglement swapping of Bell entangled states within d-level quantum system

abstract: In this paper, a multi-party quantum private comparison (MQPC) scheme is suggested based on entanglement swapping of Bell entangled states within d-level quantum system, which can accomplish the equality comparison of secret binary sequences from n users via one execution of scheme. Detailed security analysis shows that both the outside attack and the participant attack are ineffective. The suggested scheme needn't establish a private key among n users beforehand through the quantum key distribution (QKD) method to encrypt the secret binary sequences. Compared with previous MQPC scheme based on d-level Cat states and d-level Bell entangled states, the suggested scheme has distinct advantages on quantum resource, quantum measurement of third party (TP) and qubit efficiency.


title: ACT now: Aggregate Comparison of Traces for Incident Localization

abstract: Incidents in production systems are common and downtime is expensive. Applying an appropriate mitigating action quickly, such as changing a specific firewall rule, reverting a change, or diverting traffic to a different availability zone, saves money. Incident localization is time-consuming since a single failure can have many effects, extending far from the site of failure. Knowing how different system events relate to each other is necessary to quickly identify \emph{where} to mitigate. Our approach, Aggregate Comparison of Traces (ACT), localizes incidents by comparing sets of traces (which capture events and their relationships for individual requests) sampled from the most recent steady-state operation and during an incident. In our quantitative experiments, we show that ACT is able to effectively localize more than 99% of incidents.


title: A Saliency-Guided Street View Image Inpainting Framework for Efficient Last-Meters Wayfinding

abstract: Global Positioning Systems (GPS) have played a crucial role in various navigation applications. Nevertheless, localizing the perfect destination within the last few meters remains an important but unresolved problem. Limited by the GPS positioning accuracy, navigation systems always show users a vicinity of a destination, but not its exact location. Street view images (SVI) in maps as an immersive media technology have served as an aid to provide the physical environment for human last-meters wayfinding. However, due to the large diversity of geographic context and acquisition conditions, the captured SVI always contains various distracting objects (e.g., pedestrians and vehicles), which will distract human visual attention from efficiently finding the destination in the last few meters. To address this problem, we highlight the importance of reducing visual distraction in image-based wayfinding by proposing a saliency-guided image inpainting framework. It aims at redirecting human visual attention from distracting objects to destination-related objects for more efficient and accurate wayfinding in the last meters. Specifically, a context-aware distracting object detection method driven by deep salient object detection has been designed to extract distracting objects from three semantic levels in SVI. Then we employ a large-mask inpainting method with fast Fourier convolutions to remove the detected distracting objects. Experimental results with both qualitative and quantitative analysis show that our saliency-guided inpainting method can not only achieve great perceptual quality in street view images but also redirect the human's visual attention to focus more on static location-related objects than distracting ones. The human-based evaluation also justified the effectiveness of our method in improving the efficiency of locating the target destination.


title: DendroMap: Visual Exploration of Large-Scale Image Datasets for Machine Learning with Treemaps

abstract: In this paper, we present DendroMap, a novel approach to interactively exploring large-scale image datasets for machine learning (ML). ML practitioners often explore image datasets by generating a grid of images or projecting high-dimensional representations of images into 2-D using dimensionality reduction techniques (e.g., t-SNE). However, neither approach effectively scales to large datasets because images are ineffectively organized and interactions are insufficiently supported. To address these challenges, we develop DendroMap by adapting Treemaps, a well-known visualization technique. DendroMap effectively organizes images by extracting hierarchical cluster structures from high-dimensional representations of images. It enables users to make sense of the overall distributions of datasets and interactively zoom into specific areas of interests at multiple levels of abstraction. Our case studies with widely-used image datasets for deep learning demonstrate that users can discover insights about datasets and trained models by examining the diversity of images, identifying underperforming subgroups, and analyzing classification errors. We conducted a user study that evaluates the effectiveness of DendroMap in grouping and searching tasks by comparing it with a gridified version of t-SNE and found that participants preferred DendroMap. DendroMap is available at https://div-lab.github.io/dendromap/.


title: Efficient Learning of Interpretable Classification Rules

abstract: Machine learning has become omnipresent with applications in various safety-critical domains such as medical, law, and transportation. In these domains, high-stake decisions provided by machine learning necessitate researchers to design interpretable models, where the prediction is understandable to a human. In interpretable machine learning, rule-based classifiers are particularly effective in representing the decision boundary through a set of rules comprising input features. The interpretability of rule-based classifiers is in general related to the size of the rules, where smaller rules are considered more interpretable. To learn such a classifier, the brute-force direct approach is to consider an optimization problem that tries to learn the smallest classification rule that has close to maximum accuracy. This optimization problem is computationally intractable due to its combinatorial nature and thus, the problem is not scalable in large datasets. To this end, in this paper we study the triangular relationship among the accuracy, interpretability, and scalability of learning rule-based classifiers. The contribution of this paper is an interpretable learning framework IMLI, that is based on maximum satisfiability (MaxSAT) for synthesizing classification rules expressible in proposition logic. Despite the progress of MaxSAT solving in the last decade, the straightforward MaxSAT-based solution cannot scale. Therefore, we incorporate an efficient incremental learning technique inside the MaxSAT formulation by integrating mini-batch learning and iterative rule-learning. In our experiments, IMLI achieves the best balance among prediction accuracy, interpretability, and scalability. As an application, we deploy IMLI in learning popular interpretable classifiers such as decision lists and decision sets.


title: Experimental Evidence for Using a TTM Stages of Change Model in Boosting Progress Toward 2FA Adoption

abstract: Behavior change ideas from health psychology can also help boost end user compliance with security recommendations, such as adopting two-factor authentication (2FA). Our research adapts the Transtheoretical Model Stages of Change from health and wellness research to a cybersecurity context. We first create and validate an assessment to identify workers on Amazon Mechanical Turk who have not enabled 2FA for their accounts as being in Stage 1 (no intention to adopt 2FA) or Stages 2-3 (some intention to adopt 2FA). We randomly assigned participants to receive an informational intervention with varied content (highlighting process, norms, or both) or not. After three days, we again surveyed workers for Stage of Amazon 2FA adoption. We found that those in the intervention group showed more progress toward action/maintenance (Stages 4-5) than those in the control group, and those who received content highlighting the process of enabling 2FA were significantly more likely to progress toward 2FA adoption. Our work contributes support for applying a Stages of Change Model in usable security.


title: Generating Literal and Implied Subquestions to Fact-check Complex Claims

abstract: Verifying complex political claims is a challenging task, especially when politicians use various tactics to subtly misrepresent the facts. Automatic fact-checking systems fall short here, and their predictions like "half-true" are not very useful in isolation, since we have no idea which parts of the claim are true and which are not. In this work, we focus on decomposing a complex claim into a comprehensive set of yes-no subquestions whose answers influence the veracity of the claim. We present ClaimDecomp, a dataset of decompositions for over 1000 claims. Given a claim and its verification paragraph written by fact-checkers, our trained annotators write subquestions covering both explicit propositions of the original claim and its implicit facets, such as asking about additional political context that changes our view of the claim's veracity. We study whether state-of-the-art models can generate such subquestions, showing that these models generate reasonable questions to ask, but predicting the comprehensive set of subquestions from the original claim without evidence remains challenging. We further show that these subquestions can help identify relevant evidence to fact-check the full claim and derive the veracity through their answers, suggesting that they can be useful pieces of a fact-checking pipeline.


title: Relevance between Information scrambling and quantum Darwinism

abstract: Quantum system interacting with environment can induce redundant encoding of the information of system into a multipartite environment, which is the essence of quantum Darwinism. At the same time, environment may scramble the initially localized information about the system. We mainly investigate the relevance between information scrambling in environment and the emergence of quantum Darwinism. First, we generally identify that when the system shows a Darwinistic behavior system information that is initially localized in the environment is not scrambled, while when Darwinism disappears scrambling occurs.We then verify our result through a collision model where the system, consisting of one or two qubits, interacts with an ensemble of environmental ancillas.Moreover, dependent on the nature of system-environment interactions, our results also shows that the single qubit and two-qubit systems behave differently for the emergence of QD and the scrambling, but the above relevance between them remains valid.


title: BiAIT*: Symmetrical Bidirectional Optimal Path Planning with Adaptive Heuristic

abstract: Adaptively Informed Trees (AIT*) is an algorithm that uses the problem-specific heuristic to avoid unnecessary searches, which significantly improves its performance, especially when collision checking is expensive. However, the heuristic estimation in AIT* consumes lots of computational resources, and its asymmetric bidirectional searching strategy cannot fully exploit the potential of the bidirectional method. In this article, we propose an extension of AIT* called BiAIT*. Unlike AIT*, BiAIT* uses symmetrical bidirectional search for both the heuristic and space searching. The proposed method allows BiAIT* to find the initial solution faster than AIT*, and update the heuristic with less computation when a collision occurs. We evaluated the performance of BiAIT* through simulations and experiments, and the results show that BiAIT* can find the solution faster than state-of-the-art methods. We also analyze the reasons for the different performances between BiAIT* and AIT*. Furthermore, we discuss two simple but effective modifications to fully exploit the potential of the adaptively heuristic method.


title: Blockchain Goes Green? Part II: Characterizing the Performance and Cost of Blockchains on the Cloud and at the Edge

abstract: While state-of-the-art permissioned blockchains can achieve thousands of transactions per second on commodity hardware with x86/64 architecture, their performance when running on different architectures is not clear. The goal of this work is to characterize the performance and cost of permissioned blockchains on different hardware systems, which is important as diverse application domains are adopting t. To this end, we conduct extensive cost and performance evaluation of two permissioned blockchains, namely Hyperledger Fabric and ConsenSys Quorum, on five different types of hardware covering both x86/64 and ARM architecture, as well as, both cloud and edge computing. The hardware nodes include servers with Intel Xeon CPU, servers with ARM-based Amazon Graviton CPU, and edge devices with ARM-based CPU. Our results reveal a diverse profile of the two blockchains across different settings, demonstrating the impact of hardware choices on the overall performance and cost. We find that Graviton servers outperform Xeon servers in many settings, due to their powerful CPU and high memory bandwidth. Edge devices with ARM architecture, on the other hand, exhibit low performance. When comparing the cloud with the edge, we show that the cost of the latter is much smaller in the long run if manpower cost is not considered.


title: Enhanced spectral broadening via self-phase modulation with femtosecond optical pulses in silicon nanowires integrated with 2D graphene oxide films

abstract: We experimentally demonstrate enhanced spectral broadening of femtosecond optical pulses af-ter propagation through silicon-on-insulator (SOI) nanowire waveguides integrated with two-dimensional (2D) graphene oxide (GO) films. Owing to the strong mode overlap between the SOI nanowires and the GO films with a high Kerr nonlinearity, the self-phase modulation (SPM) process in the hybrid waveguides is significantly enhanced, resulting in greatly improved spectral broadening of the femtosecond optical pulses. A solution-based, transfer-free coating method is used to integrate GO films onto the SOI nanowires with precise control of the film thickness. Detailed SPM measurements using femtosecond optical pulses are carried out, achieving a broadening factor of up to ~4.3 for a device with 0.4-mm-long, 2 layers of GO. By fit-ting the experimental results with theory, we obtain an improvement in the waveguide nonlin-ear parameter by a factor of ~3.5 and the effective nonlinear figure of merit (FOM) by a factor of ~3.8, relative to the uncoated waveguide. Finally, we discuss the influence of GO film length on the spectral broadening and compare the nonlinear optical performance of different integrated waveguides coated with GO films. These results confirm the improved nonlinear optical per-formance for silicon devices integrated with 2D GO films.


title: New Insights into Backbending in the Symmetry-adapted Framework

abstract: We provide new insights into backbending phenomenon within the symmetry-adapted framework which naturally describes the intrinsic deformation of atomic nuclei. For $^{20}\text{Ne}$, the canonical example of backbending in light nuclei, the ab initio symmetry-adapted no-core shell model shows that while the energy spectrum replicates the backbending from experimental energies under the rigid rotor assumption, there is no change in the intrinsic deformation or intrinsic spin of the yrast band around the backbend. For the traditional example of $^{48}\text{Cr}$, computed in the valence shell with empirical interactions, we confirm a high-spin nucleus that is effectively spherical, in agreement with previous models. However, we find that this spherical distribution results, on average, from an almost equal mixing of deformed prolate shapes with deformed oblate and triaxial shapes. Microscopic calculations confirm the importance of spin alignment and configuration mixing, but surprisingly unveil no anomalous increase in moment of inertia. This finding opens the path toward further understanding the rotational behavior and moment of inertia of medium-mass nuclei.


title: Dense residual Transformer for image denoising

abstract: Image denoising is an important low-level computer vision task, which aims to reconstruct a noise-free and high-quality image from a noisy image. With the development of deep learning, convolutional neural network (CNN) has been gradually applied and achieved great success in image denoising, image compression, image enhancement, etc. Recently, Transformer has been a hot technique, which is widely used to tackle computer vision tasks. However, few Transformer-based methods have been proposed for low-level vision tasks. In this paper, we proposed an image denoising network structure based on Transformer, which is named DenSformer. DenSformer consists of three modules, including a preprocessing module, a local-global feature extraction module, and a reconstruction module. Specifically, the local-global feature extraction module consists of several Sformer groups, each of which has several ETransformer layers and a convolution layer, together with a residual connection. These Sformer groups are densely skip-connected to fuse the feature of different layers, and they jointly capture the local and global information from the given noisy images. We conduct our model on comprehensive experiments. Experimental results prove that our DenSformer achieves improvement compared to some state-of-the-art methods, both for the synthetic noise data and real noise data, in the objective and subjective evaluations.


title: Avoiding leakage and errors caused by unwanted transitions in Lambda systems

abstract: Three-level Lambda systems appear in various quantum information processing platforms. In several control schemes, the excited level serves as an auxiliary state for implementing gate operations between the lower qubit states. However, extra excited levels give rise to unwanted transitions that cause leakage and other errors, degrading the gate fidelity. We focus on a coherent-population-trapping scheme for gates and design protocols that reduce the effects of the unwanted off-resonant couplings and improve the gate performance up to several orders of magnitude. For a particular setup of unwanted couplings, we find an exact solution, which leads to error-free gate operations via only a static detuning modification. In the general case, we improve gate operations by adding corrective modulations to the pulses, thereby generalizing the DRAG protocol to Lambda systems. Our techniques enable fast and high-fidelity gates and apply to a wide range of optically driven platforms, such as quantum dots, color centers, and trapped ions.


title: Unified Distributed Environment

abstract: We propose Unified Distributed Environment (UDE), an environment virtualization toolkit for reinforcement learning research. UDE is designed to integrate environments built on any simulation platform such as Gazebo, Unity, Unreal, and OpenAI Gym. Through environment virtualization, UDE enables offloading the environment for execution on a remote machine while still maintaining a unified interface. The UDE interface is designed to support multi-agent by default. With environment virtualization and its interface design, the agent policies can be trained in multiple machines for a multi-agent environment. Furthermore, UDE supports integration with existing major RL toolkits for researchers to leverage the benefits. This paper discusses the components of UDE and its design decisions.


title: BronchusNet: Region and Structure Prior Embedded Representation Learning for Bronchus Segmentation and Classification

abstract: CT-based bronchial tree analysis plays an important role in the computer-aided diagnosis for respiratory diseases, as it could provide structured information for clinicians. The basis of airway analysis is bronchial tree reconstruction, which consists of bronchus segmentation and classification. However, there remains a challenge for accurate bronchial analysis due to the individual variations and the severe class imbalance. In this paper, we propose a region and structure prior embedded framework named BronchusNet to achieve accurate segmentation and classification of bronchial regions in CT images. For bronchus segmentation, we propose an adaptive hard region-aware UNet that incorporates multi-level prior guidance of hard pixel-wise samples in the general Unet segmentation network to achieve better hierarchical feature learning. For the classification of bronchial branches, we propose a hybrid point-voxel graph learning module to fully exploit bronchial structure priors and to support simultaneous feature interactions across different branches. To facilitate the study of bronchial analysis, we contribute~\textbf{BRSC}: an open-access benchmark of \textbf{BR}onchus imaging analysis with high-quality pixel-wise \textbf{S}egmentation masks and the \textbf{C}lass of bronchial segments. Experimental results on BRSC show that our proposed method not only achieves the state-of-the-art performance for binary segmentation of bronchial region but also exceeds the best existing method on bronchial branches classification by 6.9\%.


title: Bayesian Physics-Informed Extreme Learning Machine for Forward and Inverse PDE Problems with Noisy Data

abstract: Physics-informed extreme learning machine (PIELM) has recently received significant attention as a rapid version of physics-informed neural network (PINN) for solving partial differential equations (PDEs). The key characteristic is to fix the input layer weights with random values and use Moore-Penrose generalized inverse for the output layer weights. The framework is effective, but it easily suffers from overfitting noisy data and lacks uncertainty quantification for the solution under noise scenarios.To this end, we develop the Bayesian physics-informed extreme learning machine (BPIELM) to solve both forward and inverse linear PDE problems with noisy data in a unified framework. In our framework, a prior probability distribution is introduced in the output layer for extreme learning machine with physic laws and the Bayesian method is used to estimate the posterior of parameters. Besides, for inverse PDE problems, problem parameters considered as new output layer weights are unified in a framework with forward PDE problems. Finally, we demonstrate BPIELM considering both forward problems, including Poisson, advection, and diffusion equations, as well as inverse problems, where unknown problem parameters are estimated. The results show that, compared with PIELM, BPIELM quantifies uncertainty arising from noisy data and provides more accurate predictions. In addition, BPIELM is considerably cheaper than PINN in terms of the computational cost.


title: Design optimisation of piezoelectric energy harvesters for bridge infrastructure

abstract: Vibrational energy harvested from the bridge excitation due to the traffic flow or the wind load can be supplied to sensors in a Structural Health Monitoring (SHM) system and help prolong its service life, reduce chemical battery waste and enable its use in remote locations. A common approach to designing a Piezoelectric Energy Harvester (PEH) consists in tuning its fundamental frequency to some target value (e.g., the fundamental frequency of a bridge). However, such approach does not answer the question if the chosen target frequency is optimal, and does not take into account the possibility to have multiple design configurations with the same fundamental frequency. In this work, we approach the problem of a PEH design optimisation in a rigorous way, using a PEH model based on the Kirchhoff-Love plate theory and Isogeometric Analysis (IGA), coupled with the Modal Order Reduction (MOR) approach and Runge-Kutta time integration method. The model is further equipped with the Particle Swarm Optimisation (PSO) algorithm that allows finding geometry which maximises energy output from a given base acceleration signal. A comprehensive study is conducted to infer the impact of a PEH geometry on its energy harvesting performance in a real-world setting by considering field health monitoring data of a large-scale cable-stayed bridge in NSW, Australia. A shape optimisation framework is developed based on acceleration events, i.e., where the level of response exceeds a certain threshold. Designs obtained in the event-based optimisation are then clustered to propose several best candidates for continuous energy generation. This work represents the first study on PEH design optimisation for real operational conditions.


title: Good geodesics satisfying the timelike curvature-dimension condition

abstract: Let $(M,\mathsf{d},\mathfrak{m},\ll,\leq,\tau)$ be a causally closed, $\mathscr{K}$-globally hyperbolic, regular measured Lorentzian geodesic space satisfying the weak timelike curvature-dimension condition $\smash{\mathrm{wTCD}_p^e(K,N)}$ in the sense of Cavalletti and Mondino. We prove the existence of geodesics of probability measures on $M$ which satisfy the entropic semiconvexity inequality defining $\smash{\mathrm{wTCD}_p^e(K,N)}$ and whose densities with respect to $\mathfrak{m}$ are additionally uniformly $L^\infty$ in time. This holds apart from any nonbranching assumption. We also discuss similar results under the timelike measure-contraction property.


title: NR-RRT: Neural Risk-Aware Near-Optimal Path Planning in Uncertain Nonconvex Environments

abstract: Balancing the trade-off between safety and efficiency is of significant importance for path planning under uncertainty. Many risk-aware path planners have been developed to explicitly limit the probability of collision to an acceptable bound in uncertain environments. However, convex obstacles or Gaussian uncertainties are usually assumed to make the problem tractable in the existing method. These assumptions limit the generalization and application of path planners in real-world implementations. In this article, we propose to apply deep learning methods to the sampling-based planner, developing a novel risk bounded near-optimal path planning algorithm named neural risk-aware RRT (NR-RRT). Specifically, a deterministic risk contours map is maintained by perceiving the probabilistic nonconvex obstacles, and a neural network sampler is proposed to predict the next most-promising safe state. Furthermore, the recursive divide-and-conquer planning and bidirectional search strategies are used to accelerate the convergence to a near-optimal solution with guaranteed bounded risk. Worst-case theoretical guarantees can also be proven owing to a standby safety guaranteed planner utilizing a uniform sampling distribution. Simulation experiments demonstrate that the proposed algorithm outperforms the state-of-the-art remarkably for finding risk bounded low-cost paths in seen and unseen environments with uncertainty and nonconvex constraints.


title: Rydberg Exciton-Polaritons in a Magnetic Field

abstract: We theoretically investigate exciton-polaritons in a two-dimensional (2D) semiconductor heterostructure, where a static magnetic field is applied perpendicular to the plane. To explore the interplay between magnetic field and a strong light-matter coupling, we employ a fully microscopic theory that explicitly incorporates electrons, holes and photons in a semiconductor microcavity. Furthermore, we exploit a mapping between the 2D harmonic oscillator and the 2D hydrogen atom that allows us to efficiently solve the problem numerically for the entire Rydberg series as well as for the ground-state exciton. In contrast to previous approaches, we can readily obtain the real-space exciton wave functions and we show how they shrink in size with increasing magnetic field, which mirrors their increasing interaction energy and oscillator strength. We compare our theory with recent experiments on exciton-polaritons in GaAs heterostructures in an external magnetic field and we find excellent agreement with the measured polariton energies. Crucially, we are able to capture the observed light-induced changes to the exciton in the regime of very strong light-matter coupling where a perturbative coupled oscillator description breaks down. Our work can guide future experimental efforts to engineer and control Rydberg excitons and exciton-polaritons in a range of 2D materials.


title: Topological indices of general relativity and Yang-Mills theory in four-dimensional space-time

abstract: This report investigates general relativity and the Yang-Mills theory in four-dimensional space-time using a common mathematical framework, the Chern--Weil theory for principal bundles. The whole theory is described owing to the fibre bundle with the $GL(4)$ symmetry by twisting several principal bundles with the gauge symmetry. In addition to the principal connection, we introduce the Hodge-dual connection into the Lagrangian to make gauge fields have dynamics independent from the Bianchi identity. We show that the duplex superstructure appears in the bundle when a $\mathbb{Z}_2$-grading operator exists in the total space of the bundle in general. The Dirac operator appears in the secondary superspace using the one-dimensional Clifford algebra, and it provides topological indices from the Atiyah--Singer index theorem. Though the topological index is usually discussed in the elliptic-type manifold, this report treats it in the hyperbolic type space-time manifold using a novel method, namely the $\theta$-metric space. The $\theta$-metric treats the Euclidean and Minkowski spaces simultaneously and defines the topological index in the Minkowski space-time.


title: On an injectivity theorem for log-canonical pairs with analytic adjoint ideal sheaves

abstract: As an application of the residue functions corresponding to the lc-measures developed by the authors, the proof of the injectivity theorem on compact K\"ahler manifolds for plt pairs by Matsumura is improved in this article to allow multiplier ideal sheaves of plurisubharmonic functions with neat analytic singularities in the coefficients of the relevant cohomology groups. With the use of a refined version of analytic adjoint ideal sheaves, a plan towards a solution to the generalised version of Fujino's conjecture (i.e. an injectivity theorem on compact K\"ahler manifolds for lc pairs with multiplier ideal sheaves) is laid down and, in addition to the result for plt pairs, a proof for lc pairs in dimension 2, which is also an improvement of Matsumura's result, is given.


title: Robust Design of Federated Learning for Edge-Intelligent Networks

abstract: Mass data traffics, low-latency wireless services and advanced artificial intelligence (AI) technologies have driven the emergence of a new paradigm for wireless networks, namely edge-intelligent networks, which are more efficient and flexible than traditional cloud-intelligent networks. Considering users' privacy, model sharing-based federated learning (FL) that migrates model parameters but not private data from edge devices to a central cloud is particularly attractive for edge-intelligent networks. Due to multiple rounds of iterative updating of high-dimensional model parameters between base station (BS) and edge devices, the communication reliability is a critical issue of FL for edge-intelligent networks. We reveal the impacts of the errors generated during model broadcast and model aggregation via wireless channels caused by channel fading, interference and noise on the accuracy of FL, especially when there exists channel uncertainty. To alleviate the impacts, we propose a robust FL algorithm for edge-intelligent networks with channel uncertainty, which is formulated as a worst-case optimization problem with joint device selection and transceiver design. Finally, simulation results validate the robustness and effectiveness of the proposed algorithm.


title: The multi-robber damage number of a graph

abstract: In many variants of the game of Cops and Robbers on graphs, multiple cops play against a single robber. In 2019, Cox and Sanaei introduced a variant of the game that gives the robber a more active role than simply evading the cop. In their version, the robber tries to damage as many vertices as possible and the cop attempts to minimize this damage. While the damage variant was originally studied with one cop and one robber, it was later extended to play with multiple cops by Carlson et. al in 2021. We take a different approach by studying the damage variant with multiple robbers against one cop. Specifically, we introduce the $s$-robber damage number of a graph and obtain a variety of bounds on this parameter. Applying these bounds, we determine the $s$-robber damage number for a variety of graph families and characterize graphs with extreme $2$-robber damage number.


title: Evaluation of Femtosecond Time-bin Qubits Using Frequency Up-conversion Technique

abstract: Time-bin qubits, in which quantum information is encoded in a single photon at different times $\Delta$t, are suitable for long-distance transmission via optical fibers. However, detection of time-bin qubits has been limited to the nanosecond range owing to the limited temporal resolution of single-photon detectors. In this study, we developed an up-conversion single-photon detector (UCSPD), using commercial nonlinear crystals of different lengths. By changing the crystal length and pump power, we quantitatively evaluated the efficiency and temporal resolution of the UCSPD and determined the optimal conditions for measuring femtosecond time-bin qubits. This detector achieved a temporal resolution of 415 fs and up-conversion efficiency of 10.1 %. Consequently, we successfully evaluated single-photon level pseudo femtosecond time-bin qubits with a pulse interval of only 800 fs.


title: The secular growth of bars revealed by flat (peak + shoulders) density profiles

abstract: The major-axis density profiles of bars are known to be either exponential or 'flat'. We develop an automated non-parametric algorithm to detect flat profiles and apply it to a suite of simulations (with and without gas). We demonstrate that flat profiles are a manifestation of a bar's secular growth, producing a 'shoulder' region (an overdensity above an exponential) in its outskirts. Shoulders are not present when bars form, but develop as the bar grows. If the bar does not grow, shoulders do not form. Shoulders are often accompanied by box/peanut bulges, but develop separately from them and are independent tracers of a bar's growth. They can be observed at a wide range of viewing orientations with only their slope varying significantly with inclination. We present evidence that shoulders are produced by looped x1 orbits. Since the growth rate of the bar moderately correlates with the growth rate of the shoulder strength, these orbits are probably recently trapped. Shoulders therefore are evidence of bar growth. The properties of the shoulders do not, however, establish the age of a bar, because secondary buckling or strong spirals may destroy shoulders, and also because shoulders do not form if the bar does not grow much. In particular, our results show that an exponential profile is not necessarily an indication of a young bar.


title: Tidal dynamo in solar-like close binary stars

abstract: Thermal convection is commonly believed to be the energy source of stellar or planetary dynamo. In this short paper we provide another possibility, namely large-scale tidal flow. In close binary stars, say, solar-like stars with orbital period at 2 or 3 days, large-scale tidal flow is comparable to or even stronger than convective flow, and it can induce magnetic dynamo action. Based on dynamo equation and tidal theory we estimate the magnetic energy induced by large-scale tidal flow, which is proportional to the cube of orbital frequency. Our estimation can be tested by the future spectropolarimetric observations and numerical simulations for close binary stars.


title: Assessing the Most Vulnerable Subgroup to Type II Diabetes Associated with Statin Usage: Evidence from Electronic Health Record Data

abstract: There have been increased concerns that the use of statins, one of the most commonly prescribed drugs for treating coronary artery disease, is potentially associated with the increased risk of new-onset type II diabetes (T2D). Nevertheless, to date, there is no robust evidence supporting as to whether and what kind of populations are indeed vulnerable for developing T2D after taking statins. In this case study, leveraging the biobank and electronic health record data in the Partner Health System, we introduce a new data analysis pipeline and a novel statistical methodology that address existing limitations by (i) designing a rigorous causal framework that systematically examines the causal effects of statin usage on T2D risk in observational data, (ii) uncovering which patient subgroup is most vulnerable for developing T2D after taking statins, and (iii) assessing the replicability and statistical significance of the most vulnerable subgroup via a bootstrap calibration procedure. Our proposed approach delivers asymptotically sharp confidence intervals and debiased estimate for the treatment effect of the most vulnerable subgroup in the presence of high-dimensional covariates. With our proposed approach, we find that females with high T2D genetic risk are at the highest risk of developing T2D due to statin usage.


title: Auto-Select Reading Passages in English Assessment Tests?

abstract: We show a method to auto-select reading passages in English assessment tests and share some key insights that can be helpful in related fields. In specifics, we prove that finding a similar passage (to a passage that already appeared in the test) can give a suitable passage for test development. In the process, we create a simple database-tagger-filter algorithm and perform a human evaluation. However, 1. the textual features, that we analyzed, lack coverage, and 2. we fail to find meaningful correlations between each feature and suitability score. Lastly, we describe the future developments to improve automated reading passage selection.


title: Testing black hole equatorial reflection symmetry using Sgr A* shadow images

abstract: The recently released images of the supermassive black holes in the M87 galaxy and the galaxy of our own make probing black hole spacetimes and testing general relativity (GR) possible. The violation of equatorial reflection symmetry of black hole spacetimes is clearly a smoking gun of physics beyond GR. In this paper, we place constraints on the violation of black hole reflection symmetry using the bounds on the ring size of the Sgr A* black hole images, which are consistent with the critical curve radius predicted in GR within $\sim10\%$. Adopting a theory-agnostic framework, we consider a Kerr-like metric in which the violation of reflection symmetry is parametrized by a single parameter, without altering the multipoles of the black hole. The critical curves are always vertically symmetric due to the existence of hidden symmetry associated with the Killing tensor, even though the spacetime is reflection asymmetric. We find that the size of critical curves is sensitive to the amount of reflection symmetry being violated, and place the first constraints on the parameter space of the model using the Sgr A* images.


title: Improved Consistency Training for Semi-Supervised Sequence-to-Sequence ASR via Speech Chain Reconstruction and Self-Transcribing

abstract: Consistency regularization has recently been applied to semi-supervised sequence-to-sequence (S2S) automatic speech recognition (ASR). This principle encourages an ASR model to output similar predictions for the same input speech with different perturbations. The existing paradigm of semi-supervised S2S ASR utilizes SpecAugment as data augmentation and requires a static teacher model to produce pseudo transcripts for untranscribed speech. However, this paradigm fails to take full advantage of consistency regularization. First, the masking operations of SpecAugment may damage the linguistic contents of the speech, thus influencing the quality of pseudo labels. Second, S2S ASR requires both input speech and prefix tokens to make the next prediction. The static prefix tokens made by the offline teacher model cannot match dynamic pseudo labels during consistency training. In this work, we propose an improved consistency training paradigm of semi-supervised S2S ASR. We utilize speech chain reconstruction as the weak augmentation to generate high-quality pseudo labels. Moreover, we demonstrate that dynamic pseudo transcripts produced by the student ASR model benefit the consistency training. Experiments on LJSpeech and LibriSpeech corpora show that compared to supervised baselines, our improved paradigm achieves a 12.2% CER improvement in the single-speaker setting and 38.6% in the multi-speaker setting.


title: Holographic entanglement entropy of the double Wick rotated BTZ black hole

abstract: In this paper, we analyze the holographic covariant entanglement entropy in the double Wick rotated version of a rotating BTZ black hole (3 dimensional Kerr-AdS solution), where the periodicity of Euclidean time and spatial direction are changed. The dual field theory has negative energy in the Lorentzian signature. The holographic entanglement entropy agrees with its CFT counterpart, which is obtained by a conformal transformation of the correlation functions of twisted operators.


title: Atom Interferometry with Floquet Atom Optics

abstract: Floquet engineering offers a compelling approach for designing the time evolution of periodically driven systems. We implement a periodic atom-light coupling to realize Floquet atom optics on the strontium ${}^1\!S_0\,\text{-}\, {}^3\!P_1$ transition. These atom optics reach pulse efficiencies above $99.4\%$ over a wide range of frequency offsets between light and atomic resonance, even under strong driving where this detuning is on the order of the Rabi frequency. Moreover, we use Floquet atom optics to compensate for differential Doppler shifts in large momentum transfer atom interferometers and achieve state-of-the-art momentum separation in excess of $400~\hbar k$. This technique can be applied to any two-level system at arbitrary coupling strength, with broad application in coherent quantum control.


title: Electrically switchable giant Berry curvature dipole in silicene, germanene and stanene

abstract: The anomalous Hall effect in time-reversal symmetry broken systems is underpinned by the concept of Berry curvature in band theory. However, recent experiments reveal that the nonlinear Hall effect can be observed in non-magnetic systems without applying an external magnetic field. The emergence of nonlinear Hall effect under time-reversal symmetric conditions can be explained in terms of non-vanishing Berry curvature dipole arising from inversion symmetry breaking. In this work, we availed realistic tight-binding models, first-principles calculations, and symmetry analyses to explore the combined effect of transverse electric field and strain, which leads to a giant Berry curvature dipole in the elemental buckled honeycomb lattices -- silicene, germanene, and stanene. The external electric field breaks the inversion symmetry of these systems, while strain helps to attain an asymmetrical distribution of Berry curvature of a single valley. Furthermore, the topology of the electronic wavefunction switches from the band inverted quantum spin Hall state to normal insulating one at the gapless point. This band gap closing at the critical electric field strength is accompanied by an enhanced Berry curvature and concomitantly a giant Berry curvature dipole at the Fermi level. Our results predict the occurrence of an electrically switchable nonlinear electrical and thermal Hall effect in a new class of elemental systems that can be experimentally verified.


title: On LGRB progenitors: an approach from thermally-produced neutrinos

abstract: Gamma-ray bursts (GRB) are the most intense electromagnetic (EM) sources in the Universe. Long GRB (LGRB) correspond to those events with a typical prompt emission of more than a few seconds. It is generally assumed that they are originated after an implosion of a very massive star within a central compact object engine that can be either a black hole (BH) or a rapidly-spinning highly-magnetized neutron star (NS). Nevertheless, one of the most challenging aspects of defining a unique model is that the progenitor remains initially hidden for direct EM observation. In this work, we investigate the evolution of thermally-produced neutrino properties in both GRB progenitors to provide an alternative solution. We consider the characteristics of both progenitors and the fireball scenario to calculate the oscillation probabilities within a three-flavor admixture regime. Then we obtain the expected neutrino ratio and we also estimate the number of events from these sources that could be detected in the future Hyper-Kamiokande (Hyper-K) detector, considering a sample of previously observed GRB with remarkably signs of being magnetar-produced. Our findings indicate that examining the predicted neutrino rates result in an additional mechanism to determine the type of progenitor associated with these events. This is especially useful when, for instance, we cannot directly observe an electromagnetic counterpart, such as so-called "failed" GRB with hidden jets, or when light curve analysis is inconclusive.


title: No-regret learning for repeated non-cooperative games with lossy bandits

abstract: This paper considers no-regret learning for repeated continuous-kernel games with lossy bandit feedback. Since it is difficult to give the explicit model of the utility functions in dynamic environments, the players' action can only be learned with bandit feedback. Moreover, because of unreliable communication channels or privacy protection, the bandit feedback may be lost or dropped at random. Therefore, we study the asynchronous online learning strategy of the players to adaptively adjust the next actions for minimizing the long-term regret loss. The paper provides a novel no-regret learning algorithm, called Online Gradient Descent with lossy bandits (OGD-lb). We first give the regret analysis for concave games with differentiable and Lipschitz utilities. Then we show that the action profile converges to a Nash equilibrium with probability 1 when the game is also strictly monotone. We further provide the mean square convergence rate $\mathcal{O}\left(k^{-2\min\{\beta, 1/6\}}\right)$ when the game is $\beta-$ strongly monotone. In addition, we extend the algorithm to the case when the loss probability of the bandit feedback is unknown, and prove its almost sure convergence to Nash equilibrium for strictly monotone games. Finally, we take the resource management in fog computing as an application example, and carry out numerical experiments to empirically demonstrate the algorithm performance.


title: Mask CycleGAN: Unpaired Multi-modal Domain Translation with Interpretable Latent Variable

abstract: We propose Mask CycleGAN, a novel architecture for unpaired image domain translation built based on CycleGAN, with an aim to address two issues: 1) unimodality in image translation and 2) lack of interpretability of latent variables. Our innovation in the technical approach is comprised of three key components: masking scheme, generator and objective. Experimental results demonstrate that this architecture is capable of bringing variations to generated images in a controllable manner and is reasonably robust to different masks.


title: Learning to Reorient Objects with Stable Placements Afforded by Extrinsic Supports

abstract: Reorienting objects by using supports is a practical yet challenging manipulation task. Owing to the intricate geometry of objects and the constrained feasible motions of the robot, multiple manipulation steps are required for object reorientation. In this work, we propose a pipeline for predicting various object placements from point clouds. This pipeline comprises three stages: a pose generation stage, followed by a pose refinement stage, and culminating in a placement classification stage. We also propose an algorithm to construct manipulation graphs based on point clouds. Feasible manipulation sequences are determined for the robot to transfer object placements. Both simulated and real-world experiments demonstrate that our approach is effective. The simulation results underscore our pipeline's capacity to generalize to novel objects in random start poses. Our predicted placements exhibit a 20% enhancement in accuracy compared to the state-of-the-art baseline. Furthermore, the robot finds feasible sequential steps in the manipulation graphs constructed by our algorithm to accomplish object reorientation manipulation.


title: Design of a Reconfigurable Intelligent Surface-Assisted FM-DCSK-SWIPT Scheme with Non-linear Energy Harvesting Model

abstract: In this paper, we propose a reconfigurable intelligent surface (RIS)-assisted frequency-modulated (FM) differential chaos shift keying (DCSK) scheme with simultaneous wireless information and power transfer (SWIPT), called RIS-FM-DCSK-SWIPT scheme, for low-power, low-cost, and high-reliability wireless communication networks. In particular, the proposed scheme is developed under a non-linear energy-harvesting (EH) model which can accurately characterize the practical situation. The proposed RIS-FM-DCSK-SWIPT scheme has an appealing feature that it does not require channel state information, thus avoiding the complex channel estimation. We further derive the closed-form theoretical expressions for the energy shortage probability and bit error rate (BER) of the proposed scheme over the multipath Rayleigh fading channel. In addition, we investigate the influence of key parameters on the performance of the proposed transmission scheme in two different scenarios, i.e., RIS-assisted access point (RIS-AP) and dual-hop communication (RIS-DH). Finally, we carry out various Monte-Carlo experiments to verify the accuracy of the theoretical derivation, illustrate the performance advantage of the proposed scheme, and give some design insights for future study.


title: Intermittency and collisions of fast sedimenting droplets in turbulence

abstract: We study theoretically and numerically spatial distribution and collision rate of droplets that sediment in homogeneous isotropic Navier-Stokes turbulence. It is assumed that typical turbulent accelerations of fluid particles are much smaller than gravity. This was shown to imply that the particles interact weakly with individual vortices and, as a result, form a smooth flow in most of the space. In weakly intermittent turbulence with moderate Reynolds number, rare regions where the flow breaks down can be neglected in the calculation of space averaged rate of droplet collisions. However, increase of Re increases probability of rare, large quiescent vortices whose long coherent interaction with the particles destroys the flow. Thus at higher Re the space averaged collision rate forms in rare regions where the assumption of smooth flow breaks down. We describe the transition between the regimes and provide collision kernel in the case of moderate Re describable by the flow. The distribution of pairwise distances is shown to obey a separable dependence on the magnitude and the polar angle of the separation vector. Magnitude dependence obeys a power-law with a negative exponent, manifesting multifractality of the droplet's attractor. We provide the so far missing numerical confirmation of a relation between this exponent and the Lyapunov exponents and demonstrate that it holds beyond the theoretical range. The angular dependence of the RDF exhibits a maximum at small angles quantifying particle's formation of spatial columns. We derive the droplet's collision kernel using that in the considered limit the gradients of droplet's flow are Gaussian. We demonstrate that as Re increases the column's aspect ratio decreases, eventually becoming one when the isotropy is restored. We propose how the theory could be constructed at higher Re of clouds by using the example of the RDF.


title: Efficient Hierarchical State Vector Simulation of Quantum Circuits via Acyclic Graph Partitioning

abstract: Early but promising results in quantum computing have been enabled by the concurrent development of quantum algorithms, devices, and materials. Classical simulation of quantum programs has enabled the design and analysis of algorithms and implementation strategies targeting current and anticipated quantum device architectures. In this paper, we present a graph-based approach to achieve efficient quantum circuit simulation. Our approach involves partitioning the graph representation of a given quantum circuit into acyclic sub-graphs/circuits that exhibit better data locality. Simulation of each sub-circuit is organized hierarchically, with the iterative construction and simulation of smaller state vectors, improving overall performance. Also, this partitioning reduces the number of passes through data, improving the total computation time. We present three partitioning strategies and observe that acyclic graph partitioning typically results in the best time-to-solution. In contrast, other strategies reduce the partitioning time at the expense of potentially increased simulation times. Experimental evaluation demonstrates the effectiveness of our approach.


title: On the Joint Optimization of Energy Harvesting and Sensing of Piezoelectric Energy Harvesters: Case Study of a Cable-Stayed Bridge

abstract: Piezoelectric Energy Harvesters (PEHs) are typically employed to provide additional source of energy for a sensing system. However, studies show that a PEH can be also used as a sensor to acquire information about the source of vibration by analysing the produced voltage signal. This opens a possibility to create Simultaneous Energy Harvesting and Sensing (SEHS) system, where a single piece of hardware, a PEH, acts as both, a harvester and as a sensor. This raises a question if it is possible to design a bi-functional PEH device with optimal harvesting and sensing performance. In this work, we propose a bi-objective PEH design optimisation framework and show that there is a trade-off between energy harvesting efficiency and sensing accuracy within a PEH design space. The proposed framework is based on an extensive vibration (strain and acceleration) dataset collected from a real-world operational cable-stayed bridge in New South Wales, Australia. The bridge acceleration data is used as an input for a PEH numerical model to simulate a voltage signal and estimate the amount of produced energy. The numerical PEH model is based on the Kirchhoff-Love plate and isogeometric analysis. For sensing, convolutional neural network AlexNet is trained to identify traffic speed labels from voltage CWT (Continuous Wavelet Transform) images. In order to improve computational efficiency of the approach, a kriging metamodel is built and genetic algorithm is used as an optimisation method. The results are presented in the form of Pareto fronts in three design spaces.


title: RiCS: A 2D Self-Occlusion Map for Harmonizing Volumetric Objects

abstract: There have been remarkable successes in computer vision with deep learning. While such breakthroughs show robust performance, there have still been many challenges in learning in-depth knowledge, like occlusion or predicting physical interactions. Although some recent works show the potential of 3D data in serving such context, it is unclear how we efficiently provide 3D input to the 2D models due to the misalignment in dimensionality between 2D and 3D. To leverage the successes of 2D models in predicting self-occlusions, we design Ray-marching in Camera Space (RiCS), a new method to represent the self-occlusions of foreground objects in 3D into a 2D self-occlusion map. We test the effectiveness of our representation on the human image harmonization task by predicting shading that is coherent with a given background image. Our experiments demonstrate that our representation map not only allows us to enhance the image quality but also to model temporally coherent complex shadow effects compared with the simulation-to-real and harmonization methods, both quantitatively and qualitatively. We further show that we can significantly improve the performance of human parts segmentation networks trained on existing synthetic datasets by enhancing the harmonization quality with our method.


title: Temperature Sensing with RF-Dressed States of Nitrogen-Vacancy Centers in Diamond

abstract: Nitrogen vacancy (NV) centers in diamond are promising systems for realizing sensitive temperature sensors. Pulsed optically detected magnetic resonance (Pulsed-ODMR) is one of the ways to measure the temperature using NV centers. However, Pulsed-ODMR requires careful calibration and strict time synchronization to control the microwave pulse, which complicates its applicability. Nonetheless, the continuous-wave optically detected magnetic resonance (CW- ODMR) in NV centers is another more advantageous way to measure temperature with NV centers, owing to its simple implementation by applying a green laser and microwave in a continuous manner. This, however, has the drawback of a lower sensitivity compared to pulsed-ODMR. Therefore, to benefit from its accessible adaptation, it is highly important to improve the sensitivity of temperature sensing with CW-ODMR. Here, we propose a novel method to measure temperature using CW-ODMR with a quantum state dressed by radio-frequency (RF) fields under transverse magnetic fields. RF fields are expected to suppress inhomogeneous broadening owing to strain variations. Experimental results confirmed that the linewidth becomes narrower in our scheme compared to the conventional one. Moreover, we estimated the sensitivity to be approximately 65.5 $\mathrm{m}\mathrm{K}/\sqrt{\mathrm{Hz}}$, which constitutes approximately seven times improvement with respect to the sensitivity of the conventional scheme.


title: Hay from the haystack: explicit examples of exponential quantum circuit complexity

abstract: The vast majority of quantum states and unitaries have circuit complexity exponential in the number of qubits. In a similar vein, most of them also have exponential minimum description length, which makes it difficult to pinpoint examples of exponential complexity. In this work, we construct examples of constant description length but exponential circuit complexity. We provide infinite families such that each element requires an exponential number of two-qubit gates to be generated exactly from a product and where the same is true for the approximate generation of the vast majority of elements in the family. The results are based on sets of large transcendence degree and discussed for tensor networks, diagonal unitaries, and maximally coherent states.


title: Efficient Off-Policy Reinforcement Learning via Brain-Inspired Computing

abstract: Reinforcement Learning (RL) has opened up new opportunities to enhance existing smart systems that generally include a complex decision-making process. However, modern RL algorithms, e.g., Deep Q-Networks (DQN), are based on deep neural networks, resulting in high computational costs. In this paper, we propose QHD, an off-policy value-based Hyperdimensional Reinforcement Learning, that mimics brain properties toward robust and real-time learning. QHD relies on a lightweight brain-inspired model to learn an optimal policy in an unknown environment. On both desktop and power-limited embedded platforms, QHD achieves significantly better overall efficiency than DQN while providing higher or comparable rewards. QHD is also suitable for highly-efficient reinforcement learning with great potential for online and real-time learning. Our solution supports a small experience replay batch size that provides 12.3 times speedup compared to DQN while ensuring minimal quality loss. Our evaluation shows QHD capability for real-time learning, providing 34.6 times speedup and significantly better quality of learning than DQN.